2024-03-29T03:57:42.327 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-29T03:57:42.327 DEBUG:teuthology.run:Teuthology command: teuthology --name mchangir-2024-03-29_02:01:30-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi --verbose --description fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/uninlining} --owner scheduled_mchangir@teuthology --archive /home/teuthworker/archive/mchangir-2024-03-29_02:01:30-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629079 -- /home/teuthworker/archive/mchangir-2024-03-29_02:01:30-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629079/orig.config.yaml 2024-03-29T03:57:42.376 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T03:57:42.468 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-03-29_02:01:30-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629079 branch: wip-mchangir-testing1-main-20240328-072412 description: fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/uninlining} email: mchangir@redhat.com first_in_suite: false job_id: '7629079' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: mchangir-2024-03-29_02:01:30-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-mchangir-testing1-main-20240328-072412 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability log-whitelist: - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 69e2cd73c52284dfd5096c66b60c6e6b26a3c447 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 69e2cd73c52284dfd5096c66b60c6e6b26a3c447 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-testing1-main-20240328-072412 sha1: 69e2cd73c52284dfd5096c66b60c6e6b26a3c447 owner: scheduled_mchangir@teuthology priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 8207 sha1: 69e2cd73c52284dfd5096c66b60c6e6b26a3c447 sleep_before_teardown: 0 suite: fs:functional suite_branch: wip-mchangir-testing1-main-20240328-072412 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_69e2cd73c52284dfd5096c66b60c6e6b26a3c447/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 69e2cd73c52284dfd5096c66b60c6e6b26a3c447 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi073.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI4Ax4u1lAgFsWLs5ESi5tpuehTRg0FRB0+vfAHwr/KO29aNjk4W0DsWrZMAGFfrq5Snk2BJ03OryLC7ByC/ctQ= smithi142.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCpFhUf5tCEKq5adp87Qd5MYoDuMKAXwJCchRCoZgAO2mw2wDoCcH5s0QIau8OOLXBgc+O0rKIPTXdfT3blRVk0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_uninlining teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-29_02:01:30 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-29T03:57:42.469 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_69e2cd73c52284dfd5096c66b60c6e6b26a3c447/qa; will attempt to use it 2024-03-29T03:57:42.469 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_69e2cd73c52284dfd5096c66b60c6e6b26a3c447/qa/tasks 2024-03-29T03:57:42.469 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-29T03:57:42.471 INFO:teuthology.task.internal:Checking packages... 2024-03-29T03:57:42.496 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '69e2cd73c52284dfd5096c66b60c6e6b26a3c447' 2024-03-29T03:57:42.496 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-29T03:57:42.496 INFO:teuthology.packaging:ref: None 2024-03-29T03:57:42.497 INFO:teuthology.packaging:tag: None 2024-03-29T03:57:42.497 INFO:teuthology.packaging:branch: wip-mchangir-testing1-main-20240328-072412 2024-03-29T03:57:42.497 INFO:teuthology.packaging:sha1: 69e2cd73c52284dfd5096c66b60c6e6b26a3c447 2024-03-29T03:57:42.497 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-mchangir-testing1-main-20240328-072412 2024-03-29T03:57:42.720 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2520.g69e2cd73 2024-03-29T03:57:42.721 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-29T03:57:42.728 INFO:teuthology.task.internal:no buildpackages task found 2024-03-29T03:57:42.729 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-29T03:57:42.736 INFO:teuthology.task.internal:Saving configuration 2024-03-29T03:57:42.754 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-29T03:57:42.761 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-29T03:57:42.785 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-03-29_02:01:30-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629079', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-29 03:52:49.533430', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI4Ax4u1lAgFsWLs5ESi5tpuehTRg0FRB0+vfAHwr/KO29aNjk4W0DsWrZMAGFfrq5Snk2BJ03OryLC7ByC/ctQ='} 2024-03-29T03:57:42.806 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-03-29_02:01:30-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629079', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-29 03:52:49.532101', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCpFhUf5tCEKq5adp87Qd5MYoDuMKAXwJCchRCoZgAO2mw2wDoCcH5s0QIau8OOLXBgc+O0rKIPTXdfT3blRVk0='} 2024-03-29T03:57:42.807 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-29T03:57:42.813 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-03-29T03:57:42.813 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-03-29T03:57:42.813 INFO:teuthology.run_tasks:Running task console_log... 2024-03-29T03:57:42.888 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1fe9dedf70>, signals=[15]) 2024-03-29T03:57:42.889 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-29T03:57:42.895 INFO:teuthology.task.internal:Opening connections... 2024-03-29T03:57:42.895 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi073.front.sepia.ceph.com 2024-03-29T03:57:42.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T03:57:43.030 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi142.front.sepia.ceph.com 2024-03-29T03:57:43.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T03:57:43.121 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-29T03:57:43.128 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2024-03-29T03:57:43.145 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2024-03-29T03:57:43.146 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2024-03-29T03:57:43.203 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream" 2024-03-29T03:57:43.203 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="9" 2024-03-29T03:57:43.203 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2024-03-29T03:57:43.203 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2024-03-29T03:57:43.203 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="9" 2024-03-29T03:57:43.203 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el9" 2024-03-29T03:57:43.203 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-29T03:57:43.203 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2024-03-29T03:57:43.203 INFO:teuthology.orchestra.run.smithi073.stdout:LOGO="fedora-logo-icon" 2024-03-29T03:57:43.203 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-29T03:57:43.203 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/" 2024-03-29T03:57:43.204 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-29T03:57:43.204 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-29T03:57:43.204 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-29T03:57:43.204 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2024-03-29T03:57:43.224 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2024-03-29T03:57:43.241 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2024-03-29T03:57:43.241 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2024-03-29T03:57:43.297 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2024-03-29T03:57:43.298 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="9" 2024-03-29T03:57:43.298 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2024-03-29T03:57:43.298 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2024-03-29T03:57:43.298 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="9" 2024-03-29T03:57:43.298 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el9" 2024-03-29T03:57:43.298 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-29T03:57:43.298 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2024-03-29T03:57:43.298 INFO:teuthology.orchestra.run.smithi142.stdout:LOGO="fedora-logo-icon" 2024-03-29T03:57:43.298 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-29T03:57:43.298 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2024-03-29T03:57:43.298 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-29T03:57:43.299 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-29T03:57:43.299 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-29T03:57:43.299 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2024-03-29T03:57:43.323 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-29T03:57:43.334 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-29T03:57:43.339 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-29T03:57:43.339 DEBUG:teuthology.orchestra.run.smithi073:> test '!' -e /home/ubuntu/cephtest 2024-03-29T03:57:43.342 DEBUG:teuthology.orchestra.run.smithi142:> test '!' -e /home/ubuntu/cephtest 2024-03-29T03:57:43.357 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-29T03:57:43.363 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-29T03:57:43.364 DEBUG:teuthology.orchestra.run.smithi073:> test -z $(ls -A /var/lib/ceph) 2024-03-29T03:57:43.398 DEBUG:teuthology.orchestra.run.smithi142:> test -z $(ls -A /var/lib/ceph) 2024-03-29T03:57:43.512 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-29T03:57:43.571 INFO:teuthology.run_tasks:Running task kernel... 2024-03-29T03:57:43.585 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2024-03-29T03:57:43.586 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-03-29T03:57:43.586 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-03-29T03:57:43.586 DEBUG:teuthology.orchestra.run.smithi073:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-29T03:57:43.586 DEBUG:teuthology.orchestra.run.smithi142:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-29T03:57:43.603 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-29T03:57:43.603 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-03-29T03:57:43.604 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-29T03:57:43.604 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2024-03-29T03:57:43.663 INFO:teuthology.orchestra.run.smithi073.stdout:5.14.0-361.el9.x86_64 2024-03-29T03:57:43.663 INFO:teuthology.task.kernel:Running kernel on smithi073: 5.14.0-361.el9.x86_64 2024-03-29T03:57:43.663 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum install -y kernel 2024-03-29T03:57:43.665 INFO:teuthology.orchestra.run.smithi142.stdout:5.14.0-361.el9.x86_64 2024-03-29T03:57:43.665 INFO:teuthology.task.kernel:Running kernel on smithi142: 5.14.0-361.el9.x86_64 2024-03-29T03:57:43.665 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum install -y kernel 2024-03-29T03:57:45.741 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS-9 - AppStream 16 MB/s | 6.7 MB 00:00 2024-03-29T03:57:45.782 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-9 - AppStream 16 MB/s | 6.7 MB 00:00 2024-03-29T03:57:47.124 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS-9 - BaseOS 7.8 MB/s | 2.0 MB 00:00 2024-03-29T03:57:47.173 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-9 - BaseOS 8.2 MB/s | 2.0 MB 00:00 2024-03-29T03:57:48.382 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - BaseOS 9.1 MB/s | 8.0 MB 00:00 2024-03-29T03:57:50.339 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - BaseOS 2.9 MB/s | 8.0 MB 00:02 2024-03-29T03:57:51.524 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - AppStream 9.1 MB/s | 19 MB 00:02 2024-03-29T03:57:52.915 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - AppStream 13 MB/s | 19 MB 00:01 2024-03-29T03:57:55.625 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.1 MB 00:00 2024-03-29T03:57:57.167 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 16 kB 00:00 2024-03-29T03:57:57.226 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - CRB 7.5 MB/s | 6.1 MB 00:00 2024-03-29T03:57:57.944 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 32 MB/s | 21 MB 00:00 2024-03-29T03:57:59.676 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - Extras packages 12 kB/s | 16 kB 00:01 2024-03-29T03:58:02.883 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 6.7 MB/s | 21 MB 00:03 2024-03-29T03:58:02.968 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 11 kB/s | 1.7 kB 00:00 2024-03-29T03:58:05.242 INFO:teuthology.orchestra.run.smithi073.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-29T03:58:05.242 INFO:teuthology.orchestra.run.smithi073.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-29T03:58:05.334 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-03-29T03:58:05.339 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-03-29T03:58:05.339 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-03-29T03:58:05.340 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-03-29T03:58:05.340 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-03-29T03:58:05.340 INFO:teuthology.orchestra.run.smithi073.stdout: kernel x86_64 5.14.0-434.el9 CentOS-BaseOS 192 k 2024-03-29T03:58:05.340 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-03-29T03:58:05.340 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-core x86_64 5.14.0-434.el9 CentOS-BaseOS 15 M 2024-03-29T03:58:05.340 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules x86_64 5.14.0-434.el9 CentOS-BaseOS 34 M 2024-03-29T03:58:05.340 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules-core x86_64 5.14.0-434.el9 CentOS-BaseOS 28 M 2024-03-29T03:58:05.340 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T03:58:05.340 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-03-29T03:58:05.340 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-03-29T03:58:05.340 INFO:teuthology.orchestra.run.smithi073.stdout:Install 4 Packages 2024-03-29T03:58:05.340 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T03:58:05.341 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 76 M 2024-03-29T03:58:05.341 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 123 M 2024-03-29T03:58:05.341 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-03-29T03:58:05.611 INFO:teuthology.orchestra.run.smithi073.stdout:(1/4): kernel-5.14.0-434.el9.x86_64.rpm 710 kB/s | 192 kB 00:00 2024-03-29T03:58:06.362 INFO:teuthology.orchestra.run.smithi073.stdout:(2/4): kernel-core-5.14.0-434.el9.x86_64.rpm 15 MB/s | 15 MB 00:01 2024-03-29T03:58:07.262 INFO:teuthology.orchestra.run.smithi073.stdout:(3/4): kernel-modules-5.14.0-434.el9.x86_64.rpm 17 MB/s | 34 MB 00:01 2024-03-29T03:58:07.895 INFO:teuthology.orchestra.run.smithi073.stdout:(4/4): kernel-modules-core-5.14.0-434.el9.x86_6 12 MB/s | 28 MB 00:02 2024-03-29T03:58:07.898 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-03-29T03:58:07.902 INFO:teuthology.orchestra.run.smithi073.stdout:Total 30 MB/s | 76 MB 00:02 2024-03-29T03:58:07.902 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-03-29T03:58:07.925 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-03-29T03:58:08.270 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-03-29T03:58:08.270 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-03-29T03:58:09.117 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-03-29T03:58:09.117 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-03-29T03:58:10.206 INFO:teuthology.orchestra.run.smithi142.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-29T03:58:10.207 INFO:teuthology.orchestra.run.smithi142.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-29T03:58:10.298 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-03-29T03:58:10.310 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-03-29T03:58:10.310 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-03-29T03:58:10.311 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-03-29T03:58:10.311 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-03-29T03:58:10.311 INFO:teuthology.orchestra.run.smithi142.stdout: kernel x86_64 5.14.0-434.el9 CentOS-BaseOS 192 k 2024-03-29T03:58:10.311 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-03-29T03:58:10.311 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-core x86_64 5.14.0-434.el9 CentOS-BaseOS 15 M 2024-03-29T03:58:10.311 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules x86_64 5.14.0-434.el9 CentOS-BaseOS 34 M 2024-03-29T03:58:10.311 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules-core x86_64 5.14.0-434.el9 CentOS-BaseOS 28 M 2024-03-29T03:58:10.311 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T03:58:10.311 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-03-29T03:58:10.311 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-03-29T03:58:10.311 INFO:teuthology.orchestra.run.smithi142.stdout:Install 4 Packages 2024-03-29T03:58:10.311 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T03:58:10.312 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 76 M 2024-03-29T03:58:10.312 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 123 M 2024-03-29T03:58:10.312 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-03-29T03:58:10.467 INFO:teuthology.orchestra.run.smithi142.stdout:(1/4): kernel-5.14.0-434.el9.x86_64.rpm 1.2 MB/s | 192 kB 00:00 2024-03-29T03:58:10.984 INFO:teuthology.orchestra.run.smithi142.stdout:(2/4): kernel-core-5.14.0-434.el9.x86_64.rpm 22 MB/s | 15 MB 00:00 2024-03-29T03:58:11.401 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-03-29T03:58:11.601 INFO:teuthology.orchestra.run.smithi142.stdout:(3/4): kernel-modules-5.14.0-434.el9.x86_64.rpm 26 MB/s | 34 MB 00:01 2024-03-29T03:58:11.876 INFO:teuthology.orchestra.run.smithi142.stdout:(4/4): kernel-modules-core-5.14.0-434.el9.x86_6 20 MB/s | 28 MB 00:01 2024-03-29T03:58:11.879 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-03-29T03:58:11.880 INFO:teuthology.orchestra.run.smithi142.stdout:Total 49 MB/s | 76 MB 00:01 2024-03-29T03:58:11.880 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-03-29T03:58:11.986 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-modules-core-5.14.0-434.el9.x86_64 1/4 2024-03-29T03:58:12.070 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-core-5.14.0-434.el9.x86_64 2/4 2024-03-29T03:58:12.254 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-03-29T03:58:12.254 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-03-29T03:58:13.101 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-03-29T03:58:13.102 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-03-29T03:58:14.843 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-core-5.14.0-434.el9.x86_64 2/4 2024-03-29T03:58:14.972 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-modules-5.14.0-434.el9.x86_64 3/4 2024-03-29T03:58:15.429 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-03-29T03:58:16.021 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-modules-core-5.14.0-434.el9.x86_64 1/4 2024-03-29T03:58:16.109 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-core-5.14.0-434.el9.x86_64 2/4 2024-03-29T03:58:18.869 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-core-5.14.0-434.el9.x86_64 2/4 2024-03-29T03:58:19.000 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-modules-5.14.0-434.el9.x86_64 3/4 2024-03-29T03:58:19.658 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-modules-5.14.0-434.el9.x86_64 3/4 2024-03-29T03:58:19.696 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-5.14.0-434.el9.x86_64 4/4 2024-03-29T03:58:23.727 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-modules-5.14.0-434.el9.x86_64 3/4 2024-03-29T03:58:23.832 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : kernel-5.14.0-434.el9.x86_64 4/4 2024-03-29T03:58:24.415 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-modules-core-5.14.0-434.el9.x86_64 4/4 2024-03-29T03:58:28.563 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-modules-core-5.14.0-434.el9.x86_64 4/4 2024-03-29T03:58:53.600 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-core-5.14.0-434.el9.x86_64 4/4 2024-03-29T03:58:53.600 INFO:teuthology.orchestra.run.smithi073.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-29T03:58:53.600 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T03:58:53.643 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-modules-5.14.0-434.el9.x86_64 4/4 2024-03-29T03:58:54.021 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-5.14.0-434.el9.x86_64 4/4 2024-03-29T03:58:54.021 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-5.14.0-434.el9.x86_64 1/4 2024-03-29T03:58:54.021 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-core-5.14.0-434.el9.x86_64 2/4 2024-03-29T03:58:54.021 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-modules-5.14.0-434.el9.x86_64 3/4 2024-03-29T03:58:54.441 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-modules-core-5.14.0-434.el9.x86_64 4/4 2024-03-29T03:58:54.441 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T03:58:54.441 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-03-29T03:58:54.441 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-5.14.0-434.el9.x86_64 2024-03-29T03:58:54.442 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-core-5.14.0-434.el9.x86_64 2024-03-29T03:58:54.442 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules-5.14.0-434.el9.x86_64 2024-03-29T03:58:54.442 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules-core-5.14.0-434.el9.x86_64 2024-03-29T03:58:54.442 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T03:58:54.442 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-03-29T03:58:54.837 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q kernel | sort -rV | head -n 1 2024-03-29T03:58:54.953 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-5.14.0-434.el9.x86_64 2024-03-29T03:58:54.953 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-434.el9.x86_64 2024-03-29T03:58:54.954 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-434.el9.x86_64 2024-03-29T03:58:54.954 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-29T03:58:54.954 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-29T03:58:54.954 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-03-29T03:58:54.954 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi073.front.sepia.ceph.com, path=None, version=distro) 2024-03-29T03:58:54.957 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q kernel | sort -rV | head -n 1 2024-03-29T03:58:55.037 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-5.14.0-434.el9.x86_64 2024-03-29T03:58:55.038 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-434.el9.x86_64 2024-03-29T03:58:55.038 DEBUG:teuthology.orchestra.run.smithi073:> sudo rpm -qi grub2-tools 2024-03-29T03:58:55.081 INFO:teuthology.orchestra.run.smithi073.stdout:Name : grub2-tools 2024-03-29T03:58:55.081 INFO:teuthology.orchestra.run.smithi073.stdout:Epoch : 1 2024-03-29T03:58:55.081 INFO:teuthology.orchestra.run.smithi073.stdout:Version : 2.06 2024-03-29T03:58:55.081 INFO:teuthology.orchestra.run.smithi073.stdout:Release : 68.el9 2024-03-29T03:58:55.081 INFO:teuthology.orchestra.run.smithi073.stdout:Architecture: x86_64 2024-03-29T03:58:55.081 INFO:teuthology.orchestra.run.smithi073.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-29T03:58:55.081 INFO:teuthology.orchestra.run.smithi073.stdout:Group : Unspecified 2024-03-29T03:58:55.081 INFO:teuthology.orchestra.run.smithi073.stdout:Size : 8264254 2024-03-29T03:58:55.081 INFO:teuthology.orchestra.run.smithi073.stdout:License : GPLv3+ 2024-03-29T03:58:55.082 INFO:teuthology.orchestra.run.smithi073.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-29T03:58:55.082 INFO:teuthology.orchestra.run.smithi073.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-29T03:58:55.082 INFO:teuthology.orchestra.run.smithi073.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-29T03:58:55.082 INFO:teuthology.orchestra.run.smithi073.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-29T03:58:55.082 INFO:teuthology.orchestra.run.smithi073.stdout:Packager : builder@centos.org 2024-03-29T03:58:55.082 INFO:teuthology.orchestra.run.smithi073.stdout:Vendor : CentOS 2024-03-29T03:58:55.082 INFO:teuthology.orchestra.run.smithi073.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-29T03:58:55.082 INFO:teuthology.orchestra.run.smithi073.stdout:Summary : Support tools for GRUB. 2024-03-29T03:58:55.082 INFO:teuthology.orchestra.run.smithi073.stdout:Description : 2024-03-29T03:58:55.083 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T03:58:55.083 INFO:teuthology.orchestra.run.smithi073.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-29T03:58:55.083 INFO:teuthology.orchestra.run.smithi073.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-29T03:58:55.083 INFO:teuthology.orchestra.run.smithi073.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-29T03:58:55.083 INFO:teuthology.orchestra.run.smithi073.stdout:hardware devices. 2024-03-29T03:58:55.083 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T03:58:55.083 INFO:teuthology.orchestra.run.smithi073.stdout:This subpackage provides tools for support of all platforms. 2024-03-29T03:58:55.084 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-29T03:58:55.084 INFO:teuthology.task.kernel:Updating grub on smithi073 to boot 5.14.0-434.el9.x86_64 2024-03-29T03:58:55.084 DEBUG:teuthology.orchestra.run.smithi073:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-29T03:58:55.719 INFO:teuthology.orchestra.run.smithi073.stderr:Generating grub configuration file ... 2024-03-29T03:58:57.158 INFO:teuthology.orchestra.run.smithi073.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-29T03:58:57.179 INFO:teuthology.orchestra.run.smithi073.stderr:done 2024-03-29T03:58:57.182 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-03-29T03:58:57.198 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.hCRSUYRv5f 2024-03-29T03:58:57.198 DEBUG:teuthology.orchestra.run.smithi073:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.hCRSUYRv5f 2024-03-29T03:58:57.267 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.hCRSUYRv5f 2024-03-29T03:58:57.408 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.hCRSUYRv5f is 6KB 2024-03-29T03:58:57.456 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.hCRSUYRv5f 2024-03-29T03:58:57.470 DEBUG:teuthology.orchestra.run.smithi073:> sudo /bin/ls /boot/loader/entries || true 2024-03-29T03:58:57.536 INFO:teuthology.orchestra.run.smithi073.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-29T03:58:57.536 INFO:teuthology.orchestra.run.smithi073.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-29T03:58:57.536 INFO:teuthology.orchestra.run.smithi073.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-29T03:58:57.536 INFO:teuthology.orchestra.run.smithi073.stdout:15949e3c88704300882482eddfd7baae-5.14.0-434.el9.x86_64.conf 2024-03-29T03:58:57.537 DEBUG:teuthology.orchestra.run.smithi073:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-434.el9.x86_64 2024-03-29T03:58:57.680 DEBUG:teuthology.orchestra.run.smithi073:> sudo shutdown -r now 2024-03-29T03:58:57.777 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-core-5.14.0-434.el9.x86_64 4/4 2024-03-29T03:58:57.778 INFO:teuthology.orchestra.run.smithi142.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-29T03:58:57.778 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T03:58:57.821 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-modules-5.14.0-434.el9.x86_64 4/4 2024-03-29T03:58:58.234 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-5.14.0-434.el9.x86_64 4/4 2024-03-29T03:58:58.234 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-5.14.0-434.el9.x86_64 1/4 2024-03-29T03:58:58.234 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-core-5.14.0-434.el9.x86_64 2/4 2024-03-29T03:58:58.234 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-modules-5.14.0-434.el9.x86_64 3/4 2024-03-29T03:58:58.614 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-modules-core-5.14.0-434.el9.x86_64 4/4 2024-03-29T03:58:58.615 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T03:58:58.615 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-03-29T03:58:58.615 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-5.14.0-434.el9.x86_64 2024-03-29T03:58:58.615 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-core-5.14.0-434.el9.x86_64 2024-03-29T03:58:58.615 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules-5.14.0-434.el9.x86_64 2024-03-29T03:58:58.615 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-modules-core-5.14.0-434.el9.x86_64 2024-03-29T03:58:58.615 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T03:58:58.615 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-03-29T03:58:58.961 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q kernel | sort -rV | head -n 1 2024-03-29T03:58:59.106 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-5.14.0-434.el9.x86_64 2024-03-29T03:58:59.106 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-434.el9.x86_64 2024-03-29T03:58:59.106 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-434.el9.x86_64 2024-03-29T03:58:59.106 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-29T03:58:59.106 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-29T03:58:59.106 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-03-29T03:58:59.106 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi142.front.sepia.ceph.com, path=None, version=distro) 2024-03-29T03:58:59.107 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q kernel | sort -rV | head -n 1 2024-03-29T03:58:59.186 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-5.14.0-434.el9.x86_64 2024-03-29T03:58:59.187 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-434.el9.x86_64 2024-03-29T03:58:59.187 DEBUG:teuthology.orchestra.run.smithi142:> sudo rpm -qi grub2-tools 2024-03-29T03:58:59.221 INFO:teuthology.orchestra.run.smithi142.stdout:Name : grub2-tools 2024-03-29T03:58:59.221 INFO:teuthology.orchestra.run.smithi142.stdout:Epoch : 1 2024-03-29T03:58:59.221 INFO:teuthology.orchestra.run.smithi142.stdout:Version : 2.06 2024-03-29T03:58:59.221 INFO:teuthology.orchestra.run.smithi142.stdout:Release : 68.el9 2024-03-29T03:58:59.221 INFO:teuthology.orchestra.run.smithi142.stdout:Architecture: x86_64 2024-03-29T03:58:59.221 INFO:teuthology.orchestra.run.smithi142.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-29T03:58:59.221 INFO:teuthology.orchestra.run.smithi142.stdout:Group : Unspecified 2024-03-29T03:58:59.221 INFO:teuthology.orchestra.run.smithi142.stdout:Size : 8264254 2024-03-29T03:58:59.221 INFO:teuthology.orchestra.run.smithi142.stdout:License : GPLv3+ 2024-03-29T03:58:59.221 INFO:teuthology.orchestra.run.smithi142.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-29T03:58:59.222 INFO:teuthology.orchestra.run.smithi142.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-29T03:58:59.222 INFO:teuthology.orchestra.run.smithi142.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-29T03:58:59.222 INFO:teuthology.orchestra.run.smithi142.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-29T03:58:59.222 INFO:teuthology.orchestra.run.smithi142.stdout:Packager : builder@centos.org 2024-03-29T03:58:59.222 INFO:teuthology.orchestra.run.smithi142.stdout:Vendor : CentOS 2024-03-29T03:58:59.222 INFO:teuthology.orchestra.run.smithi142.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-29T03:58:59.222 INFO:teuthology.orchestra.run.smithi142.stdout:Summary : Support tools for GRUB. 2024-03-29T03:58:59.222 INFO:teuthology.orchestra.run.smithi142.stdout:Description : 2024-03-29T03:58:59.222 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T03:58:59.222 INFO:teuthology.orchestra.run.smithi142.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-29T03:58:59.222 INFO:teuthology.orchestra.run.smithi142.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-29T03:58:59.222 INFO:teuthology.orchestra.run.smithi142.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-29T03:58:59.222 INFO:teuthology.orchestra.run.smithi142.stdout:hardware devices. 2024-03-29T03:58:59.223 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T03:58:59.223 INFO:teuthology.orchestra.run.smithi142.stdout:This subpackage provides tools for support of all platforms. 2024-03-29T03:58:59.223 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-29T03:58:59.223 INFO:teuthology.task.kernel:Updating grub on smithi142 to boot 5.14.0-434.el9.x86_64 2024-03-29T03:58:59.224 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-29T03:58:59.816 INFO:teuthology.orchestra.run.smithi142.stderr:Generating grub configuration file ... 2024-03-29T03:59:01.181 INFO:teuthology.orchestra.run.smithi142.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-29T03:59:01.216 INFO:teuthology.orchestra.run.smithi142.stderr:done 2024-03-29T03:59:01.219 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2024-03-29T03:59:01.234 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.2vAyO29NJz 2024-03-29T03:59:01.234 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.2vAyO29NJz 2024-03-29T03:59:01.302 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.2vAyO29NJz 2024-03-29T03:59:01.439 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.2vAyO29NJz is 6KB 2024-03-29T03:59:01.488 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.2vAyO29NJz 2024-03-29T03:59:01.502 DEBUG:teuthology.orchestra.run.smithi142:> sudo /bin/ls /boot/loader/entries || true 2024-03-29T03:59:01.578 INFO:teuthology.orchestra.run.smithi142.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-29T03:59:01.578 INFO:teuthology.orchestra.run.smithi142.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-29T03:59:01.578 INFO:teuthology.orchestra.run.smithi142.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-29T03:59:01.578 INFO:teuthology.orchestra.run.smithi142.stdout:15949e3c88704300882482eddfd7baae-5.14.0-434.el9.x86_64.conf 2024-03-29T03:59:01.578 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-434.el9.x86_64 2024-03-29T03:59:01.737 DEBUG:teuthology.orchestra.run.smithi142:> sudo shutdown -r now 2024-03-29T03:59:27.708 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-03-29T03:59:27.709 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-03-29T03:59:27.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T03:59:31.742 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-03-29T03:59:31.742 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-03-29T03:59:31.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T04:00:27.768 DEBUG:teuthology.orchestra.remote:timed out 2024-03-29T04:00:31.746 DEBUG:teuthology.orchestra.remote:timed out 2024-03-29T04:00:36.770 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-03-29T04:00:36.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T04:00:37.178 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-03-29T04:00:37.642 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-03-29T04:00:37.642 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-434.el9.x86_64"... 2024-03-29T04:00:37.643 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-03-29T04:00:37.657 INFO:teuthology.orchestra.run.smithi073.stdout:5.14.0-434.el9.x86_64 2024-03-29T04:00:37.657 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-434.el9.x86_64 vs 5.14.0-434.el9.x86_64 2024-03-29T04:00:37.657 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-29T04:00:37.657 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-29T04:00:38.658 DEBUG:teuthology.parallel:result is None 2024-03-29T04:00:40.747 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-03-29T04:00:40.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T04:00:41.197 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-03-29T04:00:41.573 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-03-29T04:00:41.574 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-434.el9.x86_64"... 2024-03-29T04:00:41.574 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2024-03-29T04:00:41.589 INFO:teuthology.orchestra.run.smithi142.stdout:5.14.0-434.el9.x86_64 2024-03-29T04:00:41.589 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-434.el9.x86_64 vs 5.14.0-434.el9.x86_64 2024-03-29T04:00:41.589 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-29T04:00:41.589 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-29T04:00:42.590 DEBUG:teuthology.parallel:result is None 2024-03-29T04:00:42.590 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-29T04:00:42.597 INFO:teuthology.task.internal:Creating test directory... 2024-03-29T04:00:42.597 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-29T04:00:42.600 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-29T04:00:42.615 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-29T04:00:42.621 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-29T04:00:42.669 INFO:teuthology.task.internal:Creating archive directory... 2024-03-29T04:00:42.670 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-29T04:00:42.672 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-29T04:00:42.700 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-29T04:00:42.707 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-29T04:00:42.707 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-29T04:00:42.736 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-29T04:00:42.807 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-29T04:00:42.817 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-29T04:00:42.845 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-29T04:00:42.865 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-29T04:00:42.866 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-29T04:00:42.873 INFO:teuthology.task.internal:Configuring sudo... 2024-03-29T04:00:42.874 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-29T04:00:42.876 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-29T04:00:42.904 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-29T04:00:42.916 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-29T04:00:42.916 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-29T04:00:42.944 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-29T04:00:42.958 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-29T04:00:43.037 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-29T04:00:43.094 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-29T04:00:43.176 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-29T04:00:43.216 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-29T04:00:43.216 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-29T04:00:43.283 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-29T04:00:43.323 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-29T04:00:43.371 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-29T04:00:43.452 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-29T04:00:43.497 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-03-29T04:00:43.497 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-29T04:00:43.569 DEBUG:teuthology.orchestra.run.smithi073:> sudo service rsyslog restart 2024-03-29T04:00:43.571 DEBUG:teuthology.orchestra.run.smithi142:> sudo service rsyslog restart 2024-03-29T04:00:43.615 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-29T04:00:43.664 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-29T04:00:44.224 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-29T04:00:44.232 INFO:teuthology.task.internal:Starting timer... 2024-03-29T04:00:44.232 INFO:teuthology.run_tasks:Running task pcp... 2024-03-29T04:00:44.243 INFO:teuthology.run_tasks:Running task selinux... 2024-03-29T04:00:44.252 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-03-29T04:00:44.252 DEBUG:teuthology.orchestra.run.smithi073:> sudo service auditd rotate 2024-03-29T04:00:44.325 INFO:teuthology.orchestra.run.smithi073.stdout:Rotating logs: 2024-03-29T04:00:44.327 DEBUG:teuthology.orchestra.run.smithi142:> sudo service auditd rotate 2024-03-29T04:00:44.410 INFO:teuthology.orchestra.run.smithi142.stdout:Rotating logs: 2024-03-29T04:00:44.412 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-29T04:00:44.412 DEBUG:teuthology.orchestra.run.smithi073:> /usr/sbin/getenforce 2024-03-29T04:00:44.440 INFO:teuthology.orchestra.run.smithi073.stdout:Permissive 2024-03-29T04:00:44.440 DEBUG:teuthology.orchestra.run.smithi142:> /usr/sbin/getenforce 2024-03-29T04:00:44.460 INFO:teuthology.orchestra.run.smithi142.stdout:Permissive 2024-03-29T04:00:44.460 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi073.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi142.front.sepia.ceph.com': 'permissive'} 2024-03-29T04:00:44.460 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-29T04:00:44.507 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-29T04:00:44.508 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-29T04:00:44.536 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-29T04:00:44.538 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-29T04:00:44.538 DEBUG:teuthology.orchestra.run.smithi073:> sudo /usr/sbin/setenforce permissive 2024-03-29T04:00:44.592 DEBUG:teuthology.orchestra.run.smithi142:> sudo /usr/sbin/setenforce permissive 2024-03-29T04:00:44.747 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-29T04:00:44.757 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-29T04:00:44.774 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-29T04:00:44.776 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi073.front.sepia.ceph.com,smithi142.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-29T04:04:58.017 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi073.front.sepia.ceph.com'), Remote(name='ubuntu@smithi142.front.sepia.ceph.com')] 2024-03-29T04:04:58.018 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-03-29T04:04:58.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T04:04:58.114 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-03-29T04:04:58.188 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-03-29T04:04:58.189 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-03-29T04:04:58.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T04:04:58.278 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-03-29T04:04:58.353 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-03-29T04:04:58.354 INFO:teuthology.run_tasks:Running task clock... 2024-03-29T04:04:58.369 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-29T04:04:58.369 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-29T04:04:58.370 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-29T04:04:58.372 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-29T04:04:58.372 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-29T04:04:58.401 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-29T04:04:58.417 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-29T04:04:58.424 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-29T04:04:58.441 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-29T04:04:58.447 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: ntpd: command not found 2024-03-29T04:04:58.460 INFO:teuthology.orchestra.run.smithi073.stdout:506 Cannot talk to daemon 2024-03-29T04:04:58.470 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: ntpd: command not found 2024-03-29T04:04:58.477 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-29T04:04:58.483 INFO:teuthology.orchestra.run.smithi142.stdout:506 Cannot talk to daemon 2024-03-29T04:04:58.493 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-29T04:04:58.500 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-29T04:04:58.516 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-29T04:04:58.549 INFO:teuthology.orchestra.run.smithi073.stderr:bash: line 1: ntpq: command not found 2024-03-29T04:04:58.553 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-29T04:04:58.553 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2024-03-29T04:04:58.553 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-29T04:04:58.553 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-29T04:04:58.553 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-29T04:04:58.553 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-29T04:04:58.567 INFO:teuthology.orchestra.run.smithi142.stderr:bash: line 1: ntpq: command not found 2024-03-29T04:04:58.571 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-29T04:04:58.571 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2024-03-29T04:04:58.571 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-29T04:04:58.571 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-29T04:04:58.571 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-29T04:04:58.571 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-29T04:04:58.571 INFO:teuthology.run_tasks:Running task install... 2024-03-29T04:04:58.580 DEBUG:teuthology.task.install:project ceph 2024-03-29T04:04:58.580 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '69e2cd73c52284dfd5096c66b60c6e6b26a3c447'}} 2024-03-29T04:04:58.580 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '69e2cd73c52284dfd5096c66b60c6e6b26a3c447'} 2024-03-29T04:04:58.580 INFO:teuthology.task.install:Using flavor: default 2024-03-29T04:04:58.586 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-29T04:04:58.586 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-03-29T04:04:58.587 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '69e2cd73c52284dfd5096c66b60c6e6b26a3c447', 'tag': None, 'wait_for_package': False} 2024-03-29T04:04:58.587 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=69e2cd73c52284dfd5096c66b60c6e6b26a3c447 2024-03-29T04:04:58.589 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '69e2cd73c52284dfd5096c66b60c6e6b26a3c447', 'tag': None, 'wait_for_package': False} 2024-03-29T04:04:58.590 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=69e2cd73c52284dfd5096c66b60c6e6b26a3c447 2024-03-29T04:04:58.733 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/69e2cd73c52284dfd5096c66b60c6e6b26a3c447/centos/9/flavors/default/ 2024-03-29T04:04:58.733 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2520.g69e2cd73 2024-03-29T04:04:58.811 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/69e2cd73c52284dfd5096c66b60c6e6b26a3c447/centos/9/flavors/default/ 2024-03-29T04:04:58.811 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2520.g69e2cd73 2024-03-29T04:04:58.938 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/69e2cd73c52284dfd5096c66b60c6e6b26a3c447/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/69e2cd73c52284dfd5096c66b60c6e6b26a3c447/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/69e2cd73c52284dfd5096c66b60c6e6b26a3c447/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-29T04:04:58.939 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-03-29T04:04:58.939 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-29T04:04:58.968 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-29T04:04:58.969 DEBUG:teuthology.orchestra.run.smithi142:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/69e2cd73c52284dfd5096c66b60c6e6b26a3c447/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-29T04:04:59.021 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/69e2cd73c52284dfd5096c66b60c6e6b26a3c447/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/69e2cd73c52284dfd5096c66b60c6e6b26a3c447/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-mchangir-testing1-main-20240328-072412/69e2cd73c52284dfd5096c66b60c6e6b26a3c447/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-29T04:04:59.021 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-29T04:04:59.021 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-29T04:04:59.037 DEBUG:teuthology.orchestra.run.smithi142:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-29T04:04:59.049 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-29T04:04:59.049 DEBUG:teuthology.orchestra.run.smithi073:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/69e2cd73c52284dfd5096c66b60c6e6b26a3c447/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-29T04:04:59.117 DEBUG:teuthology.orchestra.run.smithi073:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-29T04:04:59.119 DEBUG:teuthology.orchestra.run.smithi142:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-29T04:04:59.185 INFO:teuthology.orchestra.run.smithi142.stdout:check_obsoletes = 1 2024-03-29T04:04:59.187 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum clean all 2024-03-29T04:04:59.197 DEBUG:teuthology.orchestra.run.smithi073:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-29T04:04:59.264 INFO:teuthology.orchestra.run.smithi073.stdout:check_obsoletes = 1 2024-03-29T04:04:59.265 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum clean all 2024-03-29T04:04:59.438 INFO:teuthology.orchestra.run.smithi142.stdout:74 files removed 2024-03-29T04:04:59.465 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-29T04:04:59.508 INFO:teuthology.orchestra.run.smithi073.stdout:74 files removed 2024-03-29T04:04:59.535 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-29T04:05:00.687 INFO:teuthology.orchestra.run.smithi073.stdout:ceph packages for x86_64 98 kB/s | 83 kB 00:00 2024-03-29T04:05:00.826 INFO:teuthology.orchestra.run.smithi142.stdout:ceph packages for x86_64 78 kB/s | 83 kB 00:01 2024-03-29T04:05:01.659 INFO:teuthology.orchestra.run.smithi142.stdout:ceph noarch packages 15 kB/s | 12 kB 00:00 2024-03-29T04:05:01.679 INFO:teuthology.orchestra.run.smithi073.stdout:ceph noarch packages 12 kB/s | 12 kB 00:00 2024-03-29T04:05:02.551 INFO:teuthology.orchestra.run.smithi142.stdout:ceph source packages 2.2 kB/s | 1.9 kB 00:00 2024-03-29T04:05:02.563 INFO:teuthology.orchestra.run.smithi073.stdout:ceph source packages 2.2 kB/s | 1.9 kB 00:00 2024-03-29T04:05:03.053 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-9 - AppStream 15 MB/s | 6.7 MB 00:00 2024-03-29T04:05:03.770 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS-9 - AppStream 5.7 MB/s | 6.7 MB 00:01 2024-03-29T04:05:04.795 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-9 - BaseOS 3.3 MB/s | 2.0 MB 00:00 2024-03-29T04:05:05.933 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS-9 - BaseOS 1.9 MB/s | 2.0 MB 00:01 2024-03-29T04:05:06.594 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - BaseOS 5.5 MB/s | 8.0 MB 00:01 2024-03-29T04:05:07.265 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - BaseOS 8.1 MB/s | 8.0 MB 00:00 2024-03-29T04:05:29.284 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - AppStream 895 kB/s | 19 MB 00:21 2024-03-29T04:05:30.155 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - AppStream 887 kB/s | 19 MB 00:21 2024-03-29T04:05:35.843 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - CRB 2.0 MB/s | 6.1 MB 00:03 2024-03-29T04:05:35.864 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - CRB 2.8 MB/s | 6.1 MB 00:02 2024-03-29T04:05:37.498 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - Extras packages 54 kB/s | 16 kB 00:00 2024-03-29T04:05:38.101 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 16 kB 00:01 2024-03-29T04:05:38.516 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 23 MB/s | 21 MB 00:00 2024-03-29T04:05:40.214 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 10 MB/s | 21 MB 00:01 2024-03-29T04:05:43.466 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-03-29T04:05:45.077 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-03-29T04:05:46.028 INFO:teuthology.orchestra.run.smithi073.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-29T04:05:46.029 INFO:teuthology.orchestra.run.smithi073.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-29T04:05:46.044 INFO:teuthology.orchestra.run.smithi073.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-29T04:05:46.044 INFO:teuthology.orchestra.run.smithi073.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-29T04:05:46.046 INFO:teuthology.orchestra.run.smithi073.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-29T04:05:46.047 INFO:teuthology.orchestra.run.smithi073.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-29T04:05:46.049 INFO:teuthology.orchestra.run.smithi073.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-29T04:05:46.051 INFO:teuthology.orchestra.run.smithi073.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-29T04:05:46.053 INFO:teuthology.orchestra.run.smithi073.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-29T04:05:46.133 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-03-29T04:05:46.147 INFO:teuthology.orchestra.run.smithi073.stdout:============================================================================================ 2024-03-29T04:05:46.148 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-03-29T04:05:46.148 INFO:teuthology.orchestra.run.smithi073.stdout:============================================================================================ 2024-03-29T04:05:46.148 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-03-29T04:05:46.148 INFO:teuthology.orchestra.run.smithi073.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-29T04:05:46.148 INFO:teuthology.orchestra.run.smithi073.stdout: ceph x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 6.6 k 2024-03-29T04:05:46.148 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 5.4 M 2024-03-29T04:05:46.148 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 890 k 2024-03-29T04:05:46.148 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 145 k 2024-03-29T04:05:46.148 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 1.5 M 2024-03-29T04:05:46.148 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2520.g69e2cd73.el9 ceph-noarch 141 k 2024-03-29T04:05:46.148 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2520.g69e2cd73.el9 ceph-noarch 3.5 M 2024-03-29T04:05:46.149 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2520.g69e2cd73.el9 ceph-noarch 7.4 M 2024-03-29T04:05:46.149 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook noarch 2:19.0.0-2520.g69e2cd73.el9 ceph-noarch 49 k 2024-03-29T04:05:46.149 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 9.8 M 2024-03-29T04:05:46.149 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 48 M 2024-03-29T04:05:46.149 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume noarch 2:19.0.0-2520.g69e2cd73.el9 ceph-noarch 264 k 2024-03-29T04:05:46.149 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm noarch 2:19.0.0-2520.g69e2cd73.el9 ceph-noarch 762 k 2024-03-29T04:05:46.149 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-mirror x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 221 k 2024-03-29T04:05:46.149 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-shell x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 27 k 2024-03-29T04:05:46.149 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-top noarch 2:19.0.0-2520.g69e2cd73.el9 ceph-noarch 18 k 2024-03-29T04:05:46.149 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-29T04:05:46.149 INFO:teuthology.orchestra.run.smithi073.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-29T04:05:46.149 INFO:teuthology.orchestra.run.smithi073.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-29T04:05:46.150 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 32 k 2024-03-29T04:05:46.150 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2 x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 746 k 2024-03-29T04:05:46.150 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 127 k 2024-03-29T04:05:46.150 INFO:teuthology.orchestra.run.smithi073.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-29T04:05:46.150 INFO:teuthology.orchestra.run.smithi073.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-29T04:05:46.150 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-29T04:05:46.150 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql x86_64 13.14-1.el9 CentOS-AppStream 1.5 M 2024-03-29T04:05:46.150 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-contrib x86_64 13.14-1.el9 CentOS-AppStream 817 k 2024-03-29T04:05:46.150 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-server x86_64 13.14-1.el9 CentOS-AppStream 5.7 M 2024-03-29T04:05:46.150 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 162 k 2024-03-29T04:05:46.150 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 321 k 2024-03-29T04:05:46.150 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 298 k 2024-03-29T04:05:46.150 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 99 k 2024-03-29T04:05:46.151 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 85 k 2024-03-29T04:05:46.151 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 3.1 M 2024-03-29T04:05:46.151 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 170 k 2024-03-29T04:05:46.151 INFO:teuthology.orchestra.run.smithi073.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-29T04:05:46.151 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrading: 2024-03-29T04:05:46.151 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager x86_64 1:1.47.2-1.el9 CentOS-BaseOS 2.3 M 2024-03-29T04:05:46.151 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 CentOS-BaseOS 1.8 M 2024-03-29T04:05:46.151 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 CentOS-BaseOS 41 k 2024-03-29T04:05:46.151 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 CentOS-BaseOS 247 k 2024-03-29T04:05:46.151 INFO:teuthology.orchestra.run.smithi073.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-29T04:05:46.151 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-29T04:05:46.151 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-29T04:05:46.151 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-29T04:05:46.152 INFO:teuthology.orchestra.run.smithi073.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-29T04:05:46.152 INFO:teuthology.orchestra.run.smithi073.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-29T04:05:46.152 INFO:teuthology.orchestra.run.smithi073.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-29T04:05:46.152 INFO:teuthology.orchestra.run.smithi073.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-29T04:05:46.152 INFO:teuthology.orchestra.run.smithi073.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-29T04:05:46.152 INFO:teuthology.orchestra.run.smithi073.stdout: librados2 x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 3.4 M 2024-03-29T04:05:46.152 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1 x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 3.1 M 2024-03-29T04:05:46.152 INFO:teuthology.orchestra.run.smithi073.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-29T04:05:46.152 INFO:teuthology.orchestra.run.smithi073.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-29T04:05:46.152 INFO:teuthology.orchestra.run.smithi073.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-29T04:05:46.152 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-29T04:05:46.152 INFO:teuthology.orchestra.run.smithi073.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-29T04:05:46.152 INFO:teuthology.orchestra.run.smithi073.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-29T04:05:46.153 INFO:teuthology.orchestra.run.smithi073.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-29T04:05:46.153 INFO:teuthology.orchestra.run.smithi073.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-29T04:05:46.153 INFO:teuthology.orchestra.run.smithi073.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-29T04:05:46.153 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-03-29T04:05:46.153 INFO:teuthology.orchestra.run.smithi073.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-29T04:05:46.153 INFO:teuthology.orchestra.run.smithi073.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-29T04:05:46.153 INFO:teuthology.orchestra.run.smithi073.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-29T04:05:46.153 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 21 M 2024-03-29T04:05:46.153 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2520.g69e2cd73.el9 ceph-noarch 34 k 2024-03-29T04:05:46.153 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 2.4 M 2024-03-29T04:05:46.153 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2520.g69e2cd73.el9 ceph-noarch 249 k 2024-03-29T04:05:46.153 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 4.7 M 2024-03-29T04:05:46.153 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 17 M 2024-03-29T04:05:46.153 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2520.g69e2cd73.el9 ceph-noarch 16 k 2024-03-29T04:05:46.154 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 25 k 2024-03-29T04:05:46.154 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-29T04:05:46.154 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-29T04:05:46.154 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-29T04:05:46.154 INFO:teuthology.orchestra.run.smithi073.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-29T04:05:46.154 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-29T04:05:46.154 INFO:teuthology.orchestra.run.smithi073.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-29T04:05:46.154 INFO:teuthology.orchestra.run.smithi073.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-29T04:05:46.154 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-29T04:05:46.154 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-29T04:05:46.154 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 163 k 2024-03-29T04:05:46.154 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-29T04:05:46.154 INFO:teuthology.orchestra.run.smithi073.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-29T04:05:46.155 INFO:teuthology.orchestra.run.smithi073.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-29T04:05:46.155 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-29T04:05:46.155 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-29T04:05:46.155 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1 x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 500 k 2024-03-29T04:05:46.155 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-29T04:05:46.155 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2 x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 5.1 M 2024-03-29T04:05:46.155 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-29T04:05:46.155 INFO:teuthology.orchestra.run.smithi073.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-29T04:05:46.155 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-29T04:05:46.155 INFO:teuthology.orchestra.run.smithi073.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-29T04:05:46.155 INFO:teuthology.orchestra.run.smithi073.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-29T04:05:46.155 INFO:teuthology.orchestra.run.smithi073.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-29T04:05:46.155 INFO:teuthology.orchestra.run.smithi073.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-29T04:05:46.155 INFO:teuthology.orchestra.run.smithi073.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-29T04:05:46.155 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-29T04:05:46.156 INFO:teuthology.orchestra.run.smithi073.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-29T04:05:46.156 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-private-libs x86_64 13.14-1.el9 CentOS-AppStream 132 k 2024-03-29T04:05:46.156 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-29T04:05:46.156 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-29T04:05:46.156 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-29T04:05:46.156 INFO:teuthology.orchestra.run.smithi073.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-29T04:05:46.156 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-29T04:05:46.156 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-29T04:05:46.156 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-29T04:05:46.156 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 45 k 2024-03-29T04:05:46.156 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 134 k 2024-03-29T04:05:46.156 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-29T04:05:46.156 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-29T04:05:46.156 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-29T04:05:46.157 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-29T04:05:46.157 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-29T04:05:46.157 INFO:teuthology.orchestra.run.smithi073.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-29T04:05:46.157 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-29T04:05:46.157 INFO:teuthology.orchestra.run.smithi073.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-29T04:05:46.157 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-29T04:05:46.157 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-29T04:05:46.157 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-29T04:05:46.157 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-29T04:05:46.157 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-29T04:05:46.157 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-29T04:05:46.157 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-29T04:05:46.157 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-29T04:05:46.158 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-29T04:05:46.158 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-29T04:05:46.158 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-29T04:05:46.158 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-29T04:05:46.158 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-29T04:05:46.158 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-29T04:05:46.158 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-29T04:05:46.158 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-29T04:05:46.158 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-29T04:05:46.158 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-29T04:05:46.158 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-29T04:05:46.158 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-29T04:05:46.158 INFO:teuthology.orchestra.run.smithi073.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-29T04:05:46.158 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-29T04:05:46.159 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-29T04:05:46.159 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-29T04:05:46.159 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-29T04:05:46.159 INFO:teuthology.orchestra.run.smithi073.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-29T04:05:46.159 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-29T04:05:46.159 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-29T04:05:46.159 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-29T04:05:46.159 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-29T04:05:46.159 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-29T04:05:46.159 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-29T04:05:46.159 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-29T04:05:46.159 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-29T04:05:46.159 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-29T04:05:46.159 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-29T04:05:46.159 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-29T04:05:46.160 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-29T04:05:46.160 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-29T04:05:46.160 INFO:teuthology.orchestra.run.smithi073.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-29T04:05:46.160 INFO:teuthology.orchestra.run.smithi073.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-29T04:05:46.160 INFO:teuthology.orchestra.run.smithi073.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-29T04:05:46.160 INFO:teuthology.orchestra.run.smithi073.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-29T04:05:46.160 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-29T04:05:46.160 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-29T04:05:46.160 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-29T04:05:46.160 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-29T04:05:46.160 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-03-29T04:05:46.160 INFO:teuthology.orchestra.run.smithi073.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-03-29T04:05:46.160 INFO:teuthology.orchestra.run.smithi073.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-29T04:05:46.161 INFO:teuthology.orchestra.run.smithi073.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-29T04:05:46.161 INFO:teuthology.orchestra.run.smithi073.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-29T04:05:46.161 INFO:teuthology.orchestra.run.smithi073.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-29T04:05:46.161 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-29T04:05:46.161 INFO:teuthology.orchestra.run.smithi073.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-29T04:05:46.161 INFO:teuthology.orchestra.run.smithi073.stdout:Installing weak dependencies: 2024-03-29T04:05:46.161 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-03-29T04:05:46.161 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:05:46.161 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-03-29T04:05:46.161 INFO:teuthology.orchestra.run.smithi073.stdout:============================================================================================ 2024-03-29T04:05:46.162 INFO:teuthology.orchestra.run.smithi073.stdout:Install 150 Packages 2024-03-29T04:05:46.163 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrade 24 Packages 2024-03-29T04:05:46.163 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:05:46.163 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 226 M 2024-03-29T04:05:46.163 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-03-29T04:05:47.017 INFO:teuthology.orchestra.run.smithi073.stdout:(1/174): ceph-19.0.0-2520.g69e2cd73.el9.x86_64. 29 kB/s | 6.6 kB 00:00 2024-03-29T04:05:47.409 INFO:teuthology.orchestra.run.smithi073.stdout:(2/174): ceph-fuse-19.0.0-2520.g69e2cd73.el9.x8 2.2 MB/s | 890 kB 00:00 2024-03-29T04:05:47.484 INFO:teuthology.orchestra.run.smithi073.stdout:(3/174): ceph-immutable-object-cache-19.0.0-252 1.9 MB/s | 145 kB 00:00 2024-03-29T04:05:47.662 INFO:teuthology.orchestra.run.smithi142.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-29T04:05:47.663 INFO:teuthology.orchestra.run.smithi142.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-29T04:05:47.678 INFO:teuthology.orchestra.run.smithi142.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-29T04:05:47.679 INFO:teuthology.orchestra.run.smithi142.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-29T04:05:47.680 INFO:teuthology.orchestra.run.smithi142.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-29T04:05:47.681 INFO:teuthology.orchestra.run.smithi142.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-29T04:05:47.683 INFO:teuthology.orchestra.run.smithi142.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-29T04:05:47.686 INFO:teuthology.orchestra.run.smithi142.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-29T04:05:47.687 INFO:teuthology.orchestra.run.smithi142.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-29T04:05:47.693 INFO:teuthology.orchestra.run.smithi073.stdout:(4/174): ceph-base-19.0.0-2520.g69e2cd73.el9.x8 6.0 MB/s | 5.4 MB 00:00 2024-03-29T04:05:47.771 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-03-29T04:05:47.796 INFO:teuthology.orchestra.run.smithi142.stdout:============================================================================================ 2024-03-29T04:05:47.796 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-03-29T04:05:47.796 INFO:teuthology.orchestra.run.smithi142.stdout:============================================================================================ 2024-03-29T04:05:47.796 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-03-29T04:05:47.797 INFO:teuthology.orchestra.run.smithi142.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-29T04:05:47.797 INFO:teuthology.orchestra.run.smithi142.stdout: ceph x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 6.6 k 2024-03-29T04:05:47.797 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 5.4 M 2024-03-29T04:05:47.797 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 890 k 2024-03-29T04:05:47.797 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 145 k 2024-03-29T04:05:47.797 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 1.5 M 2024-03-29T04:05:47.797 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2520.g69e2cd73.el9 ceph-noarch 141 k 2024-03-29T04:05:47.797 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2520.g69e2cd73.el9 ceph-noarch 3.5 M 2024-03-29T04:05:47.797 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2520.g69e2cd73.el9 ceph-noarch 7.4 M 2024-03-29T04:05:47.797 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook noarch 2:19.0.0-2520.g69e2cd73.el9 ceph-noarch 49 k 2024-03-29T04:05:47.797 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 9.8 M 2024-03-29T04:05:47.797 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 48 M 2024-03-29T04:05:47.797 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume noarch 2:19.0.0-2520.g69e2cd73.el9 ceph-noarch 264 k 2024-03-29T04:05:47.797 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm noarch 2:19.0.0-2520.g69e2cd73.el9 ceph-noarch 762 k 2024-03-29T04:05:47.798 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-mirror x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 221 k 2024-03-29T04:05:47.798 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-shell x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 27 k 2024-03-29T04:05:47.798 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-top noarch 2:19.0.0-2520.g69e2cd73.el9 ceph-noarch 18 k 2024-03-29T04:05:47.798 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-29T04:05:47.798 INFO:teuthology.orchestra.run.smithi142.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-29T04:05:47.798 INFO:teuthology.orchestra.run.smithi142.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-29T04:05:47.798 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 32 k 2024-03-29T04:05:47.798 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2 x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 746 k 2024-03-29T04:05:47.798 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 127 k 2024-03-29T04:05:47.798 INFO:teuthology.orchestra.run.smithi142.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-29T04:05:47.798 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-29T04:05:47.798 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-29T04:05:47.798 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql x86_64 13.14-1.el9 CentOS-AppStream 1.5 M 2024-03-29T04:05:47.799 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-contrib x86_64 13.14-1.el9 CentOS-AppStream 817 k 2024-03-29T04:05:47.799 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-server x86_64 13.14-1.el9 CentOS-AppStream 5.7 M 2024-03-29T04:05:47.799 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 162 k 2024-03-29T04:05:47.799 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 321 k 2024-03-29T04:05:47.799 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 298 k 2024-03-29T04:05:47.799 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 99 k 2024-03-29T04:05:47.799 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 85 k 2024-03-29T04:05:47.799 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 3.1 M 2024-03-29T04:05:47.799 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 170 k 2024-03-29T04:05:47.799 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-29T04:05:47.799 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrading: 2024-03-29T04:05:47.799 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager x86_64 1:1.47.2-1.el9 CentOS-BaseOS 2.3 M 2024-03-29T04:05:47.799 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 CentOS-BaseOS 1.8 M 2024-03-29T04:05:47.800 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 CentOS-BaseOS 41 k 2024-03-29T04:05:47.800 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 CentOS-BaseOS 247 k 2024-03-29T04:05:47.800 INFO:teuthology.orchestra.run.smithi142.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-29T04:05:47.800 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-29T04:05:47.800 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-29T04:05:47.800 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-29T04:05:47.800 INFO:teuthology.orchestra.run.smithi142.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-29T04:05:47.800 INFO:teuthology.orchestra.run.smithi142.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-29T04:05:47.800 INFO:teuthology.orchestra.run.smithi142.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-29T04:05:47.800 INFO:teuthology.orchestra.run.smithi142.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-29T04:05:47.800 INFO:teuthology.orchestra.run.smithi142.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-29T04:05:47.800 INFO:teuthology.orchestra.run.smithi142.stdout: librados2 x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 3.4 M 2024-03-29T04:05:47.800 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1 x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 3.1 M 2024-03-29T04:05:47.801 INFO:teuthology.orchestra.run.smithi142.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-29T04:05:47.801 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-29T04:05:47.801 INFO:teuthology.orchestra.run.smithi142.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-29T04:05:47.801 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-29T04:05:47.801 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-29T04:05:47.801 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-29T04:05:47.801 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-29T04:05:47.801 INFO:teuthology.orchestra.run.smithi142.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-29T04:05:47.801 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-29T04:05:47.801 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-03-29T04:05:47.801 INFO:teuthology.orchestra.run.smithi142.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-29T04:05:47.801 INFO:teuthology.orchestra.run.smithi142.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-29T04:05:47.801 INFO:teuthology.orchestra.run.smithi142.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-29T04:05:47.801 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 21 M 2024-03-29T04:05:47.802 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2520.g69e2cd73.el9 ceph-noarch 34 k 2024-03-29T04:05:47.802 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 2.4 M 2024-03-29T04:05:47.802 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2520.g69e2cd73.el9 ceph-noarch 249 k 2024-03-29T04:05:47.802 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 4.7 M 2024-03-29T04:05:47.802 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 17 M 2024-03-29T04:05:47.802 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2520.g69e2cd73.el9 ceph-noarch 16 k 2024-03-29T04:05:47.802 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 25 k 2024-03-29T04:05:47.802 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-29T04:05:47.802 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-29T04:05:47.802 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-29T04:05:47.802 INFO:teuthology.orchestra.run.smithi142.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-29T04:05:47.802 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-29T04:05:47.802 INFO:teuthology.orchestra.run.smithi142.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-29T04:05:47.802 INFO:teuthology.orchestra.run.smithi142.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-29T04:05:47.803 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-29T04:05:47.803 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-29T04:05:47.803 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 163 k 2024-03-29T04:05:47.803 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-29T04:05:47.803 INFO:teuthology.orchestra.run.smithi142.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-29T04:05:47.803 INFO:teuthology.orchestra.run.smithi142.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-29T04:05:47.803 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-29T04:05:47.803 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-29T04:05:47.803 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1 x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 500 k 2024-03-29T04:05:47.803 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-29T04:05:47.803 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2 x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 5.1 M 2024-03-29T04:05:47.803 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-29T04:05:47.803 INFO:teuthology.orchestra.run.smithi142.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-29T04:05:47.804 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-29T04:05:47.804 INFO:teuthology.orchestra.run.smithi142.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-29T04:05:47.804 INFO:teuthology.orchestra.run.smithi142.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-29T04:05:47.804 INFO:teuthology.orchestra.run.smithi142.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-29T04:05:47.804 INFO:teuthology.orchestra.run.smithi142.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-29T04:05:47.804 INFO:teuthology.orchestra.run.smithi142.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-29T04:05:47.804 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-29T04:05:47.804 INFO:teuthology.orchestra.run.smithi142.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-29T04:05:47.804 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-private-libs x86_64 13.14-1.el9 CentOS-AppStream 132 k 2024-03-29T04:05:47.804 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-29T04:05:47.804 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-29T04:05:47.804 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-29T04:05:47.804 INFO:teuthology.orchestra.run.smithi142.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-29T04:05:47.804 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-29T04:05:47.804 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-29T04:05:47.805 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-29T04:05:47.805 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 45 k 2024-03-29T04:05:47.805 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common x86_64 2:19.0.0-2520.g69e2cd73.el9 ceph 134 k 2024-03-29T04:05:47.805 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-29T04:05:47.805 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-29T04:05:47.805 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-29T04:05:47.805 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-29T04:05:47.805 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-29T04:05:47.805 INFO:teuthology.orchestra.run.smithi142.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-29T04:05:47.805 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-29T04:05:47.805 INFO:teuthology.orchestra.run.smithi142.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-29T04:05:47.805 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-29T04:05:47.805 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-29T04:05:47.805 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-29T04:05:47.806 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-29T04:05:47.806 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-29T04:05:47.806 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-29T04:05:47.806 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-29T04:05:47.806 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-29T04:05:47.806 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-29T04:05:47.806 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-29T04:05:47.806 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-29T04:05:47.806 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-29T04:05:47.806 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-29T04:05:47.806 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-29T04:05:47.806 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-29T04:05:47.806 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-29T04:05:47.806 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-29T04:05:47.807 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-29T04:05:47.807 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-29T04:05:47.807 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-29T04:05:47.807 INFO:teuthology.orchestra.run.smithi142.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-29T04:05:47.807 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-29T04:05:47.807 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-29T04:05:47.807 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-29T04:05:47.807 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-29T04:05:47.807 INFO:teuthology.orchestra.run.smithi142.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-29T04:05:47.807 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-29T04:05:47.807 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-29T04:05:47.807 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-29T04:05:47.807 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-29T04:05:47.807 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-29T04:05:47.808 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-29T04:05:47.808 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-29T04:05:47.808 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-29T04:05:47.808 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-29T04:05:47.808 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-29T04:05:47.808 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-29T04:05:47.808 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-29T04:05:47.808 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-29T04:05:47.808 INFO:teuthology.orchestra.run.smithi142.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-29T04:05:47.808 INFO:teuthology.orchestra.run.smithi142.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-29T04:05:47.808 INFO:teuthology.orchestra.run.smithi142.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-29T04:05:47.808 INFO:teuthology.orchestra.run.smithi142.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-29T04:05:47.808 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-29T04:05:47.808 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-29T04:05:47.808 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-29T04:05:47.809 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-29T04:05:47.809 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-03-29T04:05:47.809 INFO:teuthology.orchestra.run.smithi142.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-03-29T04:05:47.809 INFO:teuthology.orchestra.run.smithi142.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-29T04:05:47.809 INFO:teuthology.orchestra.run.smithi142.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-29T04:05:47.809 INFO:teuthology.orchestra.run.smithi142.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-29T04:05:47.809 INFO:teuthology.orchestra.run.smithi142.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-29T04:05:47.809 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-29T04:05:47.809 INFO:teuthology.orchestra.run.smithi142.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-29T04:05:47.809 INFO:teuthology.orchestra.run.smithi142.stdout:Installing weak dependencies: 2024-03-29T04:05:47.809 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-03-29T04:05:47.809 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:05:47.809 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-03-29T04:05:47.809 INFO:teuthology.orchestra.run.smithi142.stdout:============================================================================================ 2024-03-29T04:05:47.810 INFO:teuthology.orchestra.run.smithi142.stdout:Install 150 Packages 2024-03-29T04:05:47.810 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrade 24 Packages 2024-03-29T04:05:47.810 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:05:47.810 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 226 M 2024-03-29T04:05:47.810 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-03-29T04:05:47.910 INFO:teuthology.orchestra.run.smithi073.stdout:(5/174): ceph-mgr-19.0.0-2520.g69e2cd73.el9.x86 6.9 MB/s | 1.5 MB 00:00 2024-03-29T04:05:48.051 INFO:teuthology.orchestra.run.smithi073.stdout:(6/174): ceph-mds-19.0.0-2520.g69e2cd73.el9.x86 4.2 MB/s | 2.4 MB 00:00 2024-03-29T04:05:48.402 INFO:teuthology.orchestra.run.smithi073.stdout:(7/174): ceph-mon-19.0.0-2520.g69e2cd73.el9.x86 9.6 MB/s | 4.7 MB 00:00 2024-03-29T04:05:48.870 INFO:teuthology.orchestra.run.smithi142.stdout:(1/174): ceph-19.0.0-2520.g69e2cd73.el9.x86_64. 22 kB/s | 6.6 kB 00:00 2024-03-29T04:05:48.994 INFO:teuthology.orchestra.run.smithi073.stdout:(8/174): ceph-common-19.0.0-2520.g69e2cd73.el9. 9.4 MB/s | 21 MB 00:02 2024-03-29T04:05:49.061 INFO:teuthology.orchestra.run.smithi073.stdout:(9/174): ceph-selinux-19.0.0-2520.g69e2cd73.el9 379 kB/s | 25 kB 00:00 2024-03-29T04:05:49.277 INFO:teuthology.orchestra.run.smithi073.stdout:(10/174): ceph-radosgw-19.0.0-2520.g69e2cd73.el 11 MB/s | 9.8 MB 00:00 2024-03-29T04:05:49.329 INFO:teuthology.orchestra.run.smithi142.stdout:(2/174): ceph-fuse-19.0.0-2520.g69e2cd73.el9.x8 1.9 MB/s | 890 kB 00:00 2024-03-29T04:05:49.353 INFO:teuthology.orchestra.run.smithi073.stdout:(11/174): cephfs-mirror-19.0.0-2520.g69e2cd73.e 2.9 MB/s | 221 kB 00:00 2024-03-29T04:05:49.412 INFO:teuthology.orchestra.run.smithi142.stdout:(3/174): ceph-immutable-object-cache-19.0.0-252 1.7 MB/s | 145 kB 00:00 2024-03-29T04:05:49.429 INFO:teuthology.orchestra.run.smithi073.stdout:(12/174): cephfs-shell-19.0.0-2520.g69e2cd73.el 361 kB/s | 27 kB 00:00 2024-03-29T04:05:49.495 INFO:teuthology.orchestra.run.smithi073.stdout:(13/174): libcephfs-devel-19.0.0-2520.g69e2cd73 477 kB/s | 32 kB 00:00 2024-03-29T04:05:49.629 INFO:teuthology.orchestra.run.smithi073.stdout:(14/174): libcephfs2-19.0.0-2520.g69e2cd73.el9. 5.5 MB/s | 746 kB 00:00 2024-03-29T04:05:49.729 INFO:teuthology.orchestra.run.smithi073.stdout:(15/174): libcephsqlite-19.0.0-2520.g69e2cd73.e 1.6 MB/s | 163 kB 00:00 2024-03-29T04:05:49.821 INFO:teuthology.orchestra.run.smithi073.stdout:(16/174): librados-devel-19.0.0-2520.g69e2cd73. 1.4 MB/s | 127 kB 00:00 2024-03-29T04:05:49.938 INFO:teuthology.orchestra.run.smithi073.stdout:(17/174): libradosstriper1-19.0.0-2520.g69e2cd7 4.2 MB/s | 500 kB 00:00 2024-03-29T04:05:50.130 INFO:teuthology.orchestra.run.smithi073.stdout:(18/174): ceph-osd-19.0.0-2520.g69e2cd73.el9.x8 8.1 MB/s | 17 MB 00:02 2024-03-29T04:05:50.230 INFO:teuthology.orchestra.run.smithi073.stdout:(19/174): python3-ceph-argparse-19.0.0-2520.g69 453 kB/s | 45 kB 00:00 2024-03-29T04:05:50.339 INFO:teuthology.orchestra.run.smithi073.stdout:(20/174): python3-ceph-common-19.0.0-2520.g69e2 1.2 MB/s | 134 kB 00:00 2024-03-29T04:05:50.379 INFO:teuthology.orchestra.run.smithi142.stdout:(4/174): ceph-mds-19.0.0-2520.g69e2cd73.el9.x86 2.5 MB/s | 2.4 MB 00:00 2024-03-29T04:05:50.414 INFO:teuthology.orchestra.run.smithi073.stdout:(21/174): librgw2-19.0.0-2520.g69e2cd73.el9.x86 11 MB/s | 5.1 MB 00:00 2024-03-29T04:05:50.439 INFO:teuthology.orchestra.run.smithi073.stdout:(22/174): python3-cephfs-19.0.0-2520.g69e2cd73. 1.6 MB/s | 162 kB 00:00 2024-03-29T04:05:50.490 INFO:teuthology.orchestra.run.smithi073.stdout:(23/174): python3-rados-19.0.0-2520.g69e2cd73.e 4.2 MB/s | 321 kB 00:00 2024-03-29T04:05:50.523 INFO:teuthology.orchestra.run.smithi073.stdout:(24/174): python3-rbd-19.0.0-2520.g69e2cd73.el9 3.5 MB/s | 298 kB 00:00 2024-03-29T04:05:50.573 INFO:teuthology.orchestra.run.smithi073.stdout:(25/174): python3-rgw-19.0.0-2520.g69e2cd73.el9 1.2 MB/s | 99 kB 00:00 2024-03-29T04:05:50.599 INFO:teuthology.orchestra.run.smithi073.stdout:(26/174): rbd-fuse-19.0.0-2520.g69e2cd73.el9.x8 1.1 MB/s | 85 kB 00:00 2024-03-29T04:05:50.629 INFO:teuthology.orchestra.run.smithi142.stdout:(5/174): ceph-mgr-19.0.0-2520.g69e2cd73.el9.x86 6.0 MB/s | 1.5 MB 00:00 2024-03-29T04:05:50.674 INFO:teuthology.orchestra.run.smithi073.stdout:(27/174): rbd-nbd-19.0.0-2520.g69e2cd73.el9.x86 2.2 MB/s | 170 kB 00:00 2024-03-29T04:05:50.746 INFO:teuthology.orchestra.run.smithi142.stdout:(6/174): ceph-base-19.0.0-2520.g69e2cd73.el9.x8 2.5 MB/s | 5.4 MB 00:02 2024-03-29T04:05:50.749 INFO:teuthology.orchestra.run.smithi073.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2520.g 452 kB/s | 34 kB 00:00 2024-03-29T04:05:50.841 INFO:teuthology.orchestra.run.smithi073.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2520.g69e2cd7 1.5 MB/s | 141 kB 00:00 2024-03-29T04:05:50.908 INFO:teuthology.orchestra.run.smithi073.stdout:(30/174): rbd-mirror-19.0.0-2520.g69e2cd73.el9. 9.2 MB/s | 3.1 MB 00:00 2024-03-29T04:05:51.258 INFO:teuthology.orchestra.run.smithi073.stdout:(31/174): ceph-mgr-dashboard-19.0.0-2520.g69e2c 8.5 MB/s | 3.5 MB 00:00 2024-03-29T04:05:51.359 INFO:teuthology.orchestra.run.smithi073.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2520.g69 2.4 MB/s | 249 kB 00:00 2024-03-29T04:05:51.451 INFO:teuthology.orchestra.run.smithi073.stdout:(33/174): ceph-mgr-rook-19.0.0-2520.g69e2cd73.e 539 kB/s | 49 kB 00:00 2024-03-29T04:05:51.526 INFO:teuthology.orchestra.run.smithi073.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2520.g6 219 kB/s | 16 kB 00:00 2024-03-29T04:05:51.548 INFO:teuthology.orchestra.run.smithi142.stdout:(7/174): ceph-mon-19.0.0-2520.g69e2cd73.el9.x86 5.1 MB/s | 4.7 MB 00:00 2024-03-29T04:05:51.602 INFO:teuthology.orchestra.run.smithi073.stdout:(35/174): ceph-volume-19.0.0-2520.g69e2cd73.el9 3.4 MB/s | 264 kB 00:00 2024-03-29T04:05:51.718 INFO:teuthology.orchestra.run.smithi073.stdout:(36/174): cephadm-19.0.0-2520.g69e2cd73.el9.noa 6.4 MB/s | 762 kB 00:00 2024-03-29T04:05:51.802 INFO:teuthology.orchestra.run.smithi073.stdout:(37/174): cephfs-top-19.0.0-2520.g69e2cd73.el9. 218 kB/s | 18 kB 00:00 2024-03-29T04:05:51.943 INFO:teuthology.orchestra.run.smithi073.stdout:(38/174): automake-1.16.2-8.el9.noarch.rpm 4.6 MB/s | 662 kB 00:00 2024-03-29T04:05:52.036 INFO:teuthology.orchestra.run.smithi073.stdout:(39/174): ceph-mgr-diskprediction-local-19.0.0- 6.6 MB/s | 7.4 MB 00:01 2024-03-29T04:05:52.069 INFO:teuthology.orchestra.run.smithi073.stdout:(40/174): bison-3.7.4-5.el9.x86_64.rpm 7.2 MB/s | 920 kB 00:00 2024-03-29T04:05:52.095 INFO:teuthology.orchestra.run.smithi073.stdout:(41/174): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 106 kB 00:00 2024-03-29T04:05:52.128 INFO:teuthology.orchestra.run.smithi073.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 5.1 MB/s | 307 kB 00:00 2024-03-29T04:05:52.153 INFO:teuthology.orchestra.run.smithi073.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 541 kB/s | 32 kB 00:00 2024-03-29T04:05:52.229 INFO:teuthology.orchestra.run.smithi073.stdout:(44/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 30 MB/s | 3.0 MB 00:00 2024-03-29T04:05:52.254 INFO:teuthology.orchestra.run.smithi073.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 174 kB/s | 17 kB 00:00 2024-03-29T04:05:52.287 INFO:teuthology.orchestra.run.smithi073.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 172 kB/s | 10 kB 00:00 2024-03-29T04:05:52.315 INFO:teuthology.orchestra.run.smithi073.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.6 MB/s | 159 kB 00:00 2024-03-29T04:05:52.341 INFO:teuthology.orchestra.run.smithi073.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 840 kB/s | 44 kB 00:00 2024-03-29T04:05:52.374 INFO:teuthology.orchestra.run.smithi073.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2024-03-29T04:05:52.408 INFO:teuthology.orchestra.run.smithi073.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 8.4 MB/s | 578 kB 00:00 2024-03-29T04:05:52.433 INFO:teuthology.orchestra.run.smithi073.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 802 kB/s | 46 kB 00:00 2024-03-29T04:05:52.466 INFO:teuthology.orchestra.run.smithi073.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.7 MB/s | 282 kB 00:00 2024-03-29T04:05:52.492 INFO:teuthology.orchestra.run.smithi073.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2024-03-29T04:05:52.517 INFO:teuthology.orchestra.run.smithi073.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.2 MB/s | 217 kB 00:00 2024-03-29T04:05:52.542 INFO:teuthology.orchestra.run.smithi073.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 681 kB/s | 34 kB 00:00 2024-03-29T04:05:52.671 INFO:teuthology.orchestra.run.smithi142.stdout:(8/174): ceph-radosgw-19.0.0-2520.g69e2cd73.el9 8.7 MB/s | 9.8 MB 00:01 2024-03-29T04:05:52.713 INFO:teuthology.orchestra.run.smithi142.stdout:(9/174): ceph-selinux-19.0.0-2520.g69e2cd73.el9 606 kB/s | 25 kB 00:00 2024-03-29T04:05:52.726 INFO:teuthology.orchestra.run.smithi073.stdout:(56/174): openblas-openmp-0.3.21-2.el9.x86_64.r 23 MB/s | 4.7 MB 00:00 2024-03-29T04:05:52.760 INFO:teuthology.orchestra.run.smithi073.stdout:(57/174): postgresql-13.14-1.el9.x86_64.rpm 7.0 MB/s | 1.5 MB 00:00 2024-03-29T04:05:52.793 INFO:teuthology.orchestra.run.smithi073.stdout:(58/174): postgresql-contrib-13.14-1.el9.x86_64 12 MB/s | 817 kB 00:00 2024-03-29T04:05:52.818 INFO:teuthology.orchestra.run.smithi073.stdout:(59/174): postgresql-private-libs-13.14-1.el9.x 2.3 MB/s | 132 kB 00:00 2024-03-29T04:05:52.955 INFO:teuthology.orchestra.run.smithi142.stdout:(10/174): ceph-common-19.0.0-2520.g69e2cd73.el9 4.7 MB/s | 21 MB 00:04 2024-03-29T04:05:52.994 INFO:teuthology.orchestra.run.smithi073.stdout:(60/174): postgresql-server-13.14-1.el9.x86_64. 29 MB/s | 5.7 MB 00:00 2024-03-29T04:05:53.022 INFO:teuthology.orchestra.run.smithi142.stdout:(11/174): cephfs-mirror-19.0.0-2520.g69e2cd73.e 3.3 MB/s | 221 kB 00:00 2024-03-29T04:05:53.027 INFO:teuthology.orchestra.run.smithi073.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 4.8 MB/s | 1.0 MB 00:00 2024-03-29T04:05:53.053 INFO:teuthology.orchestra.run.smithi073.stdout:(62/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 78 kB 00:00 2024-03-29T04:05:53.089 INFO:teuthology.orchestra.run.smithi142.stdout:(12/174): cephfs-shell-19.0.0-2520.g69e2cd73.el 406 kB/s | 27 kB 00:00 2024-03-29T04:05:53.156 INFO:teuthology.orchestra.run.smithi142.stdout:(13/174): libcephfs-devel-19.0.0-2520.g69e2cd73 477 kB/s | 32 kB 00:00 2024-03-29T04:05:53.186 INFO:teuthology.orchestra.run.smithi073.stdout:(63/174): python3-babel-2.9.1-2.el9.noarch.rpm 36 MB/s | 5.8 MB 00:00 2024-03-29T04:05:53.211 INFO:teuthology.orchestra.run.smithi073.stdout:(64/174): python3-jsonpatch-1.21-16.el9.noarch. 156 kB/s | 24 kB 00:00 2024-03-29T04:05:53.237 INFO:teuthology.orchestra.run.smithi073.stdout:(65/174): python3-jsonpointer-2.0-4.el9.noarch. 360 kB/s | 18 kB 00:00 2024-03-29T04:05:53.262 INFO:teuthology.orchestra.run.smithi073.stdout:(66/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2024-03-29T04:05:53.287 INFO:teuthology.orchestra.run.smithi073.stdout:(67/174): python3-markupsafe-1.1.1-12.el9.x86_6 632 kB/s | 32 kB 00:00 2024-03-29T04:05:53.322 INFO:teuthology.orchestra.run.smithi142.stdout:(14/174): libcephfs2-19.0.0-2520.g69e2cd73.el9. 4.4 MB/s | 746 kB 00:00 2024-03-29T04:05:53.398 INFO:teuthology.orchestra.run.smithi142.stdout:(15/174): libcephsqlite-19.0.0-2520.g69e2cd73.e 2.1 MB/s | 163 kB 00:00 2024-03-29T04:05:53.404 INFO:teuthology.orchestra.run.smithi073.stdout:(68/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 34 MB/s | 4.8 MB 00:00 2024-03-29T04:05:53.421 INFO:teuthology.orchestra.run.smithi073.stdout:(69/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 217 kB 00:00 2024-03-29T04:05:53.438 INFO:teuthology.orchestra.run.smithi073.stdout:(70/174): python3-oauthlib-3.1.1-5.el9.noarch.r 5.1 MB/s | 174 kB 00:00 2024-03-29T04:05:53.464 INFO:teuthology.orchestra.run.smithi073.stdout:(71/174): python3-packaging-20.9-5.el9.noarch.r 1.6 MB/s | 69 kB 00:00 2024-03-29T04:05:53.473 INFO:teuthology.orchestra.run.smithi142.stdout:(16/174): librados-devel-19.0.0-2520.g69e2cd73. 1.7 MB/s | 127 kB 00:00 2024-03-29T04:05:53.514 INFO:teuthology.orchestra.run.smithi073.stdout:(72/174): python3-prettytable-0.7.2-27.el9.noar 549 kB/s | 41 kB 00:00 2024-03-29T04:05:53.539 INFO:teuthology.orchestra.run.smithi073.stdout:(73/174): python3-protobuf-3.14.0-13.el9.noarch 3.1 MB/s | 238 kB 00:00 2024-03-29T04:05:53.565 INFO:teuthology.orchestra.run.smithi073.stdout:(74/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2024-03-29T04:05:53.590 INFO:teuthology.orchestra.run.smithi073.stdout:(75/174): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2024-03-29T04:05:53.598 INFO:teuthology.orchestra.run.smithi142.stdout:(17/174): libradosstriper1-19.0.0-2520.g69e2cd7 3.9 MB/s | 500 kB 00:00 2024-03-29T04:05:53.607 INFO:teuthology.orchestra.run.smithi073.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 1.1 MB/s | 47 kB 00:00 2024-03-29T04:05:53.624 INFO:teuthology.orchestra.run.smithi073.stdout:(77/174): python3-requests-oauthlib-1.3.0-12.el 1.2 MB/s | 43 kB 00:00 2024-03-29T04:05:53.766 INFO:teuthology.orchestra.run.smithi073.stdout:(78/174): python3-toml-0.10.2-6.el9.noarch.rpm 274 kB/s | 39 kB 00:00 2024-03-29T04:05:53.933 INFO:teuthology.orchestra.run.smithi073.stdout:(79/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 48 MB/s | 16 MB 00:00 2024-03-29T04:05:53.950 INFO:teuthology.orchestra.run.smithi073.stdout:(80/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 226 kB/s | 41 kB 00:00 2024-03-29T04:05:53.975 INFO:teuthology.orchestra.run.smithi073.stdout:(81/174): qatlib-24.02.0-1.el9.x86_64.rpm 5.2 MB/s | 220 kB 00:00 2024-03-29T04:05:53.992 INFO:teuthology.orchestra.run.smithi073.stdout:(82/174): qatlib-service-24.02.0-1.el9.x86_64.r 837 kB/s | 35 kB 00:00 2024-03-29T04:05:54.018 INFO:teuthology.orchestra.run.smithi073.stdout:(83/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 46 kB 00:00 2024-03-29T04:05:54.043 INFO:teuthology.orchestra.run.smithi073.stdout:(84/174): socat-1.7.4.1-5.el9.x86_64.rpm 5.8 MB/s | 300 kB 00:00 2024-03-29T04:05:54.060 INFO:teuthology.orchestra.run.smithi073.stdout:(85/174): uuid-1.6.2-55.el9.x86_64.rpm 1.3 MB/s | 56 kB 00:00 2024-03-29T04:05:54.077 INFO:teuthology.orchestra.run.smithi073.stdout:(86/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2024-03-29T04:05:54.094 INFO:teuthology.orchestra.run.smithi073.stdout:(87/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-03-29T04:05:54.119 INFO:teuthology.orchestra.run.smithi073.stdout:(88/174): fuse-2.9.9-15.el9.x86_64.rpm 1.8 MB/s | 79 kB 00:00 2024-03-29T04:05:54.144 INFO:teuthology.orchestra.run.smithi073.stdout:(89/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-03-29T04:05:54.178 INFO:teuthology.orchestra.run.smithi073.stdout:(90/174): python3-cryptography-36.0.1-4.el9.x86 20 MB/s | 1.1 MB 00:00 2024-03-29T04:05:54.203 INFO:teuthology.orchestra.run.smithi073.stdout:(91/174): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2024-03-29T04:05:54.229 INFO:teuthology.orchestra.run.smithi073.stdout:(92/174): python3-pycparser-2.20-6.el9.noarch.r 2.4 MB/s | 124 kB 00:00 2024-03-29T04:05:54.254 INFO:teuthology.orchestra.run.smithi073.stdout:(93/174): python3-urllib3-1.26.5-5.el9.noarch.r 3.6 MB/s | 187 kB 00:00 2024-03-29T04:05:54.457 INFO:teuthology.orchestra.run.smithi142.stdout:(18/174): librgw2-19.0.0-2520.g69e2cd73.el9.x86 6.0 MB/s | 5.1 MB 00:00 2024-03-29T04:05:54.616 INFO:teuthology.orchestra.run.smithi142.stdout:(19/174): ceph-osd-19.0.0-2520.g69e2cd73.el9.x8 4.4 MB/s | 17 MB 00:03 2024-03-29T04:05:54.632 INFO:teuthology.orchestra.run.smithi142.stdout:(20/174): python3-ceph-argparse-19.0.0-2520.g69 258 kB/s | 45 kB 00:00 2024-03-29T04:05:54.691 INFO:teuthology.orchestra.run.smithi142.stdout:(21/174): python3-ceph-common-19.0.0-2520.g69e2 1.8 MB/s | 134 kB 00:00 2024-03-29T04:05:54.716 INFO:teuthology.orchestra.run.smithi142.stdout:(22/174): python3-cephfs-19.0.0-2520.g69e2cd73. 1.9 MB/s | 162 kB 00:00 2024-03-29T04:05:54.763 INFO:teuthology.orchestra.run.smithi073.stdout:(94/174): jq-1.6-16.el9.x86_64.rpm 351 kB/s | 187 kB 00:00 2024-03-29T04:05:54.783 INFO:teuthology.orchestra.run.smithi142.stdout:(23/174): python3-rados-19.0.0-2520.g69e2cd73.e 3.4 MB/s | 321 kB 00:00 2024-03-29T04:05:54.817 INFO:teuthology.orchestra.run.smithi142.stdout:(24/174): python3-rbd-19.0.0-2520.g69e2cd73.el9 2.9 MB/s | 298 kB 00:00 2024-03-29T04:05:54.842 INFO:teuthology.orchestra.run.smithi142.stdout:(25/174): python3-rgw-19.0.0-2520.g69e2cd73.el9 1.7 MB/s | 99 kB 00:00 2024-03-29T04:05:54.884 INFO:teuthology.orchestra.run.smithi142.stdout:(26/174): rbd-fuse-19.0.0-2520.g69e2cd73.el9.x8 1.2 MB/s | 85 kB 00:00 2024-03-29T04:05:54.946 INFO:teuthology.orchestra.run.smithi073.stdout:(95/174): libquadmath-11.4.1-3.el9.x86_64.rpm 1.0 MB/s | 195 kB 00:00 2024-03-29T04:05:54.959 INFO:teuthology.orchestra.run.smithi142.stdout:(27/174): rbd-nbd-19.0.0-2520.g69e2cd73.el9.x86 2.2 MB/s | 170 kB 00:00 2024-03-29T04:05:54.997 INFO:teuthology.orchestra.run.smithi073.stdout:(96/174): libgfortran-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 803 kB 00:00 2024-03-29T04:05:55.034 INFO:teuthology.orchestra.run.smithi142.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2520.g 453 kB/s | 34 kB 00:00 2024-03-29T04:05:55.055 INFO:teuthology.orchestra.run.smithi073.stdout:(97/174): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-03-29T04:05:55.110 INFO:teuthology.orchestra.run.smithi142.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2520.g69e2cd7 1.8 MB/s | 141 kB 00:00 2024-03-29T04:05:55.180 INFO:teuthology.orchestra.run.smithi073.stdout:(98/174): elfutils-libelf-devel-0.190-2.el9.x86 117 kB/s | 21 kB 00:00 2024-03-29T04:05:55.214 INFO:teuthology.orchestra.run.smithi073.stdout:(99/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 160 kB/s | 25 kB 00:00 2024-03-29T04:05:55.331 INFO:teuthology.orchestra.run.smithi073.stdout:(100/174): python3-devel-3.9.17-2.el9.x86_64.rp 2.1 MB/s | 245 kB 00:00 2024-03-29T04:05:55.390 INFO:teuthology.orchestra.run.smithi073.stdout:(101/174): python3-jinja2-2.11.3-5.el9.noarch.r 4.1 MB/s | 248 kB 00:00 2024-03-29T04:05:55.452 INFO:teuthology.orchestra.run.smithi142.stdout:(30/174): rbd-mirror-19.0.0-2520.g69e2cd73.el9. 5.1 MB/s | 3.1 MB 00:00 2024-03-29T04:05:55.473 INFO:teuthology.orchestra.run.smithi073.stdout:(102/174): openssl-devel-3.0.7-27.el9.x86_64.rp 14 MB/s | 4.1 MB 00:00 2024-03-29T04:05:55.516 INFO:teuthology.orchestra.run.smithi073.stdout:(103/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 747 kB/s | 94 kB 00:00 2024-03-29T04:05:55.582 INFO:teuthology.orchestra.run.smithi073.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-03-29T04:05:55.718 INFO:teuthology.orchestra.run.smithi142.stdout:(31/174): ceph-mgr-dashboard-19.0.0-2520.g69e2c 5.8 MB/s | 3.5 MB 00:00 2024-03-29T04:05:55.741 INFO:teuthology.orchestra.run.smithi073.stdout:(105/174): protobuf-compiler-3.14.0-13.el9.x86_ 3.7 MB/s | 863 kB 00:00 2024-03-29T04:05:55.785 INFO:teuthology.orchestra.run.smithi142.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2520.g69 3.7 MB/s | 249 kB 00:00 2024-03-29T04:05:55.861 INFO:teuthology.orchestra.run.smithi142.stdout:(33/174): ceph-mgr-rook-19.0.0-2520.g69e2cd73.e 659 kB/s | 49 kB 00:00 2024-03-29T04:05:55.945 INFO:teuthology.orchestra.run.smithi142.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2520.g6 197 kB/s | 16 kB 00:00 2024-03-29T04:05:55.983 INFO:teuthology.orchestra.run.smithi073.stdout:(106/174): gperftools-libs-2.9.1-2.el9.x86_64.r 1.2 MB/s | 309 kB 00:00 2024-03-29T04:05:56.033 INFO:teuthology.orchestra.run.smithi073.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 390 kB/s | 19 kB 00:00 2024-03-29T04:05:56.045 INFO:teuthology.orchestra.run.smithi142.stdout:(35/174): ceph-volume-19.0.0-2520.g69e2cd73.el9 2.6 MB/s | 264 kB 00:00 2024-03-29T04:05:56.092 INFO:teuthology.orchestra.run.smithi073.stdout:(108/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.1 MB/s | 548 kB 00:00 2024-03-29T04:05:56.159 INFO:teuthology.orchestra.run.smithi073.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 389 kB/s | 26 kB 00:00 2024-03-29T04:05:56.203 INFO:teuthology.orchestra.run.smithi142.stdout:(36/174): cephadm-19.0.0-2520.g69e2cd73.el9.noa 4.7 MB/s | 762 kB 00:00 2024-03-29T04:05:56.259 INFO:teuthology.orchestra.run.smithi073.stdout:(110/174): libarrow-9.0.0-10.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-03-29T04:05:56.278 INFO:teuthology.orchestra.run.smithi142.stdout:(37/174): cephfs-top-19.0.0-2520.g69e2cd73.el9. 244 kB/s | 18 kB 00:00 2024-03-29T04:05:56.284 INFO:teuthology.orchestra.run.smithi073.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 387 kB/s | 49 kB 00:00 2024-03-29T04:05:56.310 INFO:teuthology.orchestra.run.smithi073.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-03-29T04:05:56.385 INFO:teuthology.orchestra.run.smithi073.stdout:(113/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 11 MB/s | 838 kB 00:00 2024-03-29T04:05:56.412 INFO:teuthology.orchestra.run.smithi142.stdout:(38/174): automake-1.16.2-8.el9.noarch.rpm 4.9 MB/s | 662 kB 00:00 2024-03-29T04:05:56.419 INFO:teuthology.orchestra.run.smithi073.stdout:(114/174): luarocks-3.9.2-1.el9.noarch.rpm 1.1 MB/s | 151 kB 00:00 2024-03-29T04:05:56.452 INFO:teuthology.orchestra.run.smithi073.stdout:(115/174): python3-asyncssh-2.13.2-5.el9.noarch 8.0 MB/s | 548 kB 00:00 2024-03-29T04:05:56.471 INFO:teuthology.orchestra.run.smithi142.stdout:(39/174): bison-3.7.4-5.el9.x86_64.rpm 15 MB/s | 920 kB 00:00 2024-03-29T04:05:56.486 INFO:teuthology.orchestra.run.smithi073.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 647 kB/s | 43 kB 00:00 2024-03-29T04:05:56.511 INFO:teuthology.orchestra.run.smithi073.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 548 kB/s | 32 kB 00:00 2024-03-29T04:05:56.545 INFO:teuthology.orchestra.run.smithi073.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 255 kB/s | 15 kB 00:00 2024-03-29T04:05:56.579 INFO:teuthology.orchestra.run.smithi073.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-03-29T04:05:56.637 INFO:teuthology.orchestra.run.smithi073.stdout:(120/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-03-29T04:05:56.638 INFO:teuthology.orchestra.run.smithi142.stdout:(40/174): boost-program-options-1.75.0-8.el9.x8 635 kB/s | 106 kB 00:00 2024-03-29T04:05:56.696 INFO:teuthology.orchestra.run.smithi073.stdout:(121/174): python3-colorama-0.4.4-12.el9.noarch 606 kB/s | 35 kB 00:00 2024-03-29T04:05:56.721 INFO:teuthology.orchestra.run.smithi142.stdout:(41/174): ceph-mgr-diskprediction-local-19.0.0- 5.8 MB/s | 7.4 MB 00:01 2024-03-29T04:05:56.738 INFO:teuthology.orchestra.run.smithi073.stdout:(122/174): python3-cherrypy-18.6.1-2.el9.noarch 1.8 MB/s | 358 kB 00:00 2024-03-29T04:05:56.747 INFO:teuthology.orchestra.run.smithi142.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 307 kB 00:00 2024-03-29T04:05:56.763 INFO:teuthology.orchestra.run.smithi073.stdout:(123/174): python3-google-auth-2.28.2-1.el9.noa 3.0 MB/s | 203 kB 00:00 2024-03-29T04:05:56.772 INFO:teuthology.orchestra.run.smithi142.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 639 kB/s | 32 kB 00:00 2024-03-29T04:05:56.813 INFO:teuthology.orchestra.run.smithi073.stdout:(124/174): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-03-29T04:05:56.864 INFO:teuthology.orchestra.run.smithi073.stdout:(125/174): python3-jaraco-8.2.1-3.el9.noarch.rp 214 kB/s | 11 kB 00:00 2024-03-29T04:05:56.914 INFO:teuthology.orchestra.run.smithi073.stdout:(126/174): python3-jaraco-classes-3.2.1-5.el9.n 354 kB/s | 18 kB 00:00 2024-03-29T04:05:56.964 INFO:teuthology.orchestra.run.smithi073.stdout:(127/174): python3-jaraco-collections-3.0.0-8.e 464 kB/s | 23 kB 00:00 2024-03-29T04:05:57.014 INFO:teuthology.orchestra.run.smithi073.stdout:(128/174): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-03-29T04:05:57.065 INFO:teuthology.orchestra.run.smithi073.stdout:(129/174): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-03-29T04:05:57.132 INFO:teuthology.orchestra.run.smithi073.stdout:(130/174): python3-kubernetes-26.1.0-2.el9.noar 15 MB/s | 1.0 MB 00:00 2024-03-29T04:05:57.182 INFO:teuthology.orchestra.run.smithi073.stdout:(131/174): python3-logutils-0.3.5-21.el9.noarch 924 kB/s | 46 kB 00:00 2024-03-29T04:05:57.189 INFO:teuthology.orchestra.run.smithi142.stdout:(44/174): ceph-test-19.0.0-2520.g69e2cd73.el9.x 11 MB/s | 48 MB 00:04 2024-03-29T04:05:57.214 INFO:teuthology.orchestra.run.smithi142.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 39 kB/s | 17 kB 00:00 2024-03-29T04:05:57.241 INFO:teuthology.orchestra.run.smithi073.stdout:(132/174): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-03-29T04:05:57.264 INFO:teuthology.orchestra.run.smithi142.stdout:(46/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.8 MB/s | 3.0 MB 00:00 2024-03-29T04:05:57.281 INFO:teuthology.orchestra.run.smithi142.stdout:(47/174): libaio-devel-0.3.111-13.el9.x86_64.rp 113 kB/s | 10 kB 00:00 2024-03-29T04:05:57.291 INFO:teuthology.orchestra.run.smithi073.stdout:(133/174): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-03-29T04:05:57.298 INFO:teuthology.orchestra.run.smithi142.stdout:(48/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 159 kB 00:00 2024-03-29T04:05:57.315 INFO:teuthology.orchestra.run.smithi142.stdout:(49/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-03-29T04:05:57.340 INFO:teuthology.orchestra.run.smithi142.stdout:(50/174): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2024-03-29T04:05:57.365 INFO:teuthology.orchestra.run.smithi142.stdout:(51/174): libtool-2.4.6-45.el9.x86_64.rpm 8.6 MB/s | 578 kB 00:00 2024-03-29T04:05:57.366 INFO:teuthology.orchestra.run.smithi073.stdout:(134/174): python3-grpcio-1.46.7-10.el9.x86_64. 3.2 MB/s | 2.0 MB 00:00 2024-03-29T04:05:57.382 INFO:teuthology.orchestra.run.smithi142.stdout:(52/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 46 kB 00:00 2024-03-29T04:05:57.392 INFO:teuthology.orchestra.run.smithi073.stdout:(135/174): python3-pecan-1.4.2-3.el9.noarch.rpm 2.7 MB/s | 272 kB 00:00 2024-03-29T04:05:57.407 INFO:teuthology.orchestra.run.smithi142.stdout:(53/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.2 MB/s | 282 kB 00:00 2024-03-29T04:05:57.425 INFO:teuthology.orchestra.run.smithi073.stdout:(136/174): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-03-29T04:05:57.432 INFO:teuthology.orchestra.run.smithi142.stdout:(54/174): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 187 kB 00:00 2024-03-29T04:05:57.449 INFO:teuthology.orchestra.run.smithi142.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 832 kB/s | 34 kB 00:00 2024-03-29T04:05:57.451 INFO:teuthology.orchestra.run.smithi073.stdout:(137/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-03-29T04:05:57.483 INFO:teuthology.orchestra.run.smithi142.stdout:(56/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.8 MB/s | 217 kB 00:00 2024-03-29T04:05:57.484 INFO:teuthology.orchestra.run.smithi073.stdout:(138/174): python3-pyperclip-1.8.2-2.el9.noarch 480 kB/s | 28 kB 00:00 2024-03-29T04:05:57.509 INFO:teuthology.orchestra.run.smithi073.stdout:(139/174): python3-repoze-lru-0.7-16.el9.noarch 524 kB/s | 31 kB 00:00 2024-03-29T04:05:57.560 INFO:teuthology.orchestra.run.smithi073.stdout:(140/174): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-03-29T04:05:57.586 INFO:teuthology.orchestra.run.smithi073.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-03-29T04:05:57.591 INFO:teuthology.orchestra.run.smithi142.stdout:(57/174): openblas-openmp-0.3.21-2.el9.x86_64.r 30 MB/s | 4.7 MB 00:00 2024-03-29T04:05:57.611 INFO:teuthology.orchestra.run.smithi073.stdout:(142/174): python3-tempora-5.0.0-2.el9.noarch.r 709 kB/s | 36 kB 00:00 2024-03-29T04:05:57.634 INFO:teuthology.orchestra.run.smithi142.stdout:(58/174): postgresql-13.14-1.el9.x86_64.rpm 8.4 MB/s | 1.5 MB 00:00 2024-03-29T04:05:57.653 INFO:teuthology.orchestra.run.smithi073.stdout:(143/174): python3-typing-extensions-4.4.0-2.el 762 kB/s | 51 kB 00:00 2024-03-29T04:05:57.659 INFO:teuthology.orchestra.run.smithi142.stdout:(59/174): postgresql-contrib-13.14-1.el9.x86_64 4.6 MB/s | 817 kB 00:00 2024-03-29T04:05:57.678 INFO:teuthology.orchestra.run.smithi073.stdout:(144/174): python3-webob-1.8.7-6.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-03-29T04:05:57.709 INFO:teuthology.orchestra.run.smithi142.stdout:(60/174): postgresql-private-libs-13.14-1.el9.x 1.1 MB/s | 132 kB 00:00 2024-03-29T04:05:57.728 INFO:teuthology.orchestra.run.smithi073.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-03-29T04:05:57.751 INFO:teuthology.orchestra.run.smithi142.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 11 MB/s | 1.0 MB 00:00 2024-03-29T04:05:57.754 INFO:teuthology.orchestra.run.smithi073.stdout:(146/174): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-03-29T04:05:57.834 INFO:teuthology.orchestra.run.smithi142.stdout:(62/174): postgresql-server-13.14-1.el9.x86_64. 33 MB/s | 5.7 MB 00:00 2024-03-29T04:05:57.845 INFO:teuthology.orchestra.run.smithi073.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 170 kB/s | 20 kB 00:00 2024-03-29T04:05:57.860 INFO:teuthology.orchestra.run.smithi142.stdout:(63/174): python3-attrs-20.3.0-7.el9.noarch.rpm 518 kB/s | 78 kB 00:00 2024-03-29T04:05:57.871 INFO:teuthology.orchestra.run.smithi073.stdout:(148/174): re2-20211101-3.el9.x86_64.rpm 1.6 MB/s | 192 kB 00:00 2024-03-29T04:05:57.960 INFO:teuthology.orchestra.run.smithi142.stdout:(64/174): python3-babel-2.9.1-2.el9.noarch.rpm 28 MB/s | 5.8 MB 00:00 2024-03-29T04:05:57.977 INFO:teuthology.orchestra.run.smithi142.stdout:(65/174): python3-jsonpatch-1.21-16.el9.noarch. 213 kB/s | 24 kB 00:00 2024-03-29T04:05:57.993 INFO:teuthology.orchestra.run.smithi142.stdout:(66/174): python3-jsonpointer-2.0-4.el9.noarch. 138 kB/s | 18 kB 00:00 2024-03-29T04:05:58.019 INFO:teuthology.orchestra.run.smithi142.stdout:(67/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.4 MB/s | 144 kB 00:00 2024-03-29T04:05:58.044 INFO:teuthology.orchestra.run.smithi142.stdout:(68/174): python3-markupsafe-1.1.1-12.el9.x86_6 630 kB/s | 32 kB 00:00 2024-03-29T04:05:58.120 INFO:teuthology.orchestra.run.smithi142.stdout:(69/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 38 MB/s | 4.8 MB 00:00 2024-03-29T04:05:58.121 INFO:teuthology.orchestra.run.smithi073.stdout:(149/174): thrift-0.15.0-2.el9.x86_64.rpm 5.7 MB/s | 1.6 MB 00:00 2024-03-29T04:05:58.150 INFO:teuthology.orchestra.run.smithi142.stdout:(70/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.7 MB/s | 217 kB 00:00 2024-03-29T04:05:58.178 INFO:teuthology.orchestra.run.smithi142.stdout:(71/174): python3-oauthlib-3.1.1-5.el9.noarch.r 1.3 MB/s | 174 kB 00:00 2024-03-29T04:05:58.203 INFO:teuthology.orchestra.run.smithi142.stdout:(72/174): python3-packaging-20.9-5.el9.noarch.r 827 kB/s | 69 kB 00:00 2024-03-29T04:05:58.229 INFO:teuthology.orchestra.run.smithi142.stdout:(73/174): python3-prettytable-0.7.2-27.el9.noar 826 kB/s | 41 kB 00:00 2024-03-29T04:05:58.254 INFO:teuthology.orchestra.run.smithi142.stdout:(74/174): python3-protobuf-3.14.0-13.el9.noarch 3.1 MB/s | 238 kB 00:00 2024-03-29T04:05:58.279 INFO:teuthology.orchestra.run.smithi142.stdout:(75/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2024-03-29T04:05:58.305 INFO:teuthology.orchestra.run.smithi142.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 945 kB/s | 47 kB 00:00 2024-03-29T04:05:58.330 INFO:teuthology.orchestra.run.smithi142.stdout:(77/174): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 211 kB 00:00 2024-03-29T04:05:58.355 INFO:teuthology.orchestra.run.smithi142.stdout:(78/174): python3-requests-oauthlib-1.3.0-12.el 568 kB/s | 43 kB 00:00 2024-03-29T04:05:58.388 INFO:teuthology.orchestra.run.smithi073.stdout:(150/174): librados2-19.0.0-2520.g69e2cd73.el9. 6.6 MB/s | 3.4 MB 00:00 2024-03-29T04:05:58.480 INFO:teuthology.orchestra.run.smithi142.stdout:(79/174): python3-toml-0.10.2-6.el9.noarch.rpm 314 kB/s | 39 kB 00:00 2024-03-29T04:05:58.505 INFO:teuthology.orchestra.run.smithi142.stdout:(80/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 277 kB/s | 41 kB 00:00 2024-03-29T04:05:58.564 INFO:teuthology.orchestra.run.smithi073.stdout:(151/174): librbd1-19.0.0-2520.g69e2cd73.el9.x8 7.1 MB/s | 3.1 MB 00:00 2024-03-29T04:05:58.606 INFO:teuthology.orchestra.run.smithi073.stdout:(152/174): NetworkManager-1.47.2-1.el9.x86_64.r 11 MB/s | 2.3 MB 00:00 2024-03-29T04:05:58.656 INFO:teuthology.orchestra.run.smithi073.stdout:(153/174): NetworkManager-libnm-1.47.2-1.el9.x8 20 MB/s | 1.8 MB 00:00 2024-03-29T04:05:58.673 INFO:teuthology.orchestra.run.smithi073.stdout:(154/174): NetworkManager-team-1.47.2-1.el9.x86 631 kB/s | 41 kB 00:00 2024-03-29T04:05:58.689 INFO:teuthology.orchestra.run.smithi142.stdout:(81/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 41 MB/s | 16 MB 00:00 2024-03-29T04:05:58.698 INFO:teuthology.orchestra.run.smithi073.stdout:(155/174): NetworkManager-tui-1.47.2-1.el9.x86_ 5.8 MB/s | 247 kB 00:00 2024-03-29T04:05:58.714 INFO:teuthology.orchestra.run.smithi142.stdout:(82/174): qatlib-service-24.02.0-1.el9.x86_64.r 169 kB/s | 35 kB 00:00 2024-03-29T04:05:58.732 INFO:teuthology.orchestra.run.smithi073.stdout:(156/174): xfsdump-3.1.12-4.el9.x86_64.rpm 5.4 MB/s | 321 kB 00:00 2024-03-29T04:05:58.739 INFO:teuthology.orchestra.run.smithi142.stdout:(83/174): qatlib-24.02.0-1.el9.x86_64.rpm 949 kB/s | 220 kB 00:00 2024-03-29T04:05:58.756 INFO:teuthology.orchestra.run.smithi142.stdout:(84/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 693 kB/s | 46 kB 00:00 2024-03-29T04:05:58.781 INFO:teuthology.orchestra.run.smithi142.stdout:(85/174): socat-1.7.4.1-5.el9.x86_64.rpm 4.4 MB/s | 300 kB 00:00 2024-03-29T04:05:58.806 INFO:teuthology.orchestra.run.smithi142.stdout:(86/174): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-03-29T04:05:58.824 INFO:teuthology.orchestra.run.smithi142.stdout:(87/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 940 kB/s | 63 kB 00:00 2024-03-29T04:05:58.849 INFO:teuthology.orchestra.run.smithi142.stdout:(88/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 660 kB/s | 44 kB 00:00 2024-03-29T04:05:58.865 INFO:teuthology.orchestra.run.smithi142.stdout:(89/174): fuse-2.9.9-15.el9.x86_64.rpm 1.9 MB/s | 79 kB 00:00 2024-03-29T04:05:58.891 INFO:teuthology.orchestra.run.smithi142.stdout:(90/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.5 MB/s | 241 kB 00:00 2024-03-29T04:05:58.924 INFO:teuthology.orchestra.run.smithi142.stdout:(91/174): python3-cryptography-36.0.1-4.el9.x86 15 MB/s | 1.1 MB 00:00 2024-03-29T04:05:58.941 INFO:teuthology.orchestra.run.smithi142.stdout:(92/174): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 103 kB 00:00 2024-03-29T04:05:58.965 INFO:teuthology.orchestra.run.smithi073.stdout:(157/174): acl-2.3.1-4.el9.x86_64.rpm 267 kB/s | 71 kB 00:00 2024-03-29T04:05:58.966 INFO:teuthology.orchestra.run.smithi142.stdout:(93/174): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 124 kB 00:00 2024-03-29T04:05:58.991 INFO:teuthology.orchestra.run.smithi073.stdout:(158/174): elfutils-debuginfod-client-0.190-2.e 141 kB/s | 36 kB 00:00 2024-03-29T04:05:58.991 INFO:teuthology.orchestra.run.smithi142.stdout:(94/174): python3-urllib3-1.26.5-5.el9.noarch.r 2.7 MB/s | 187 kB 00:00 2024-03-29T04:05:59.125 INFO:teuthology.orchestra.run.smithi142.stdout:(95/174): jq-1.6-16.el9.x86_64.rpm 1.2 MB/s | 187 kB 00:00 2024-03-29T04:05:59.159 INFO:teuthology.orchestra.run.smithi142.stdout:(96/174): libquadmath-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2024-03-29T04:05:59.184 INFO:teuthology.orchestra.run.smithi142.stdout:(97/174): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-03-29T04:05:59.218 INFO:teuthology.orchestra.run.smithi142.stdout:(98/174): libgfortran-11.4.1-3.el9.x86_64.rpm 3.1 MB/s | 803 kB 00:00 2024-03-29T04:05:59.224 INFO:teuthology.orchestra.run.smithi073.stdout:(159/174): elfutils-libelf-0.190-2.el9.x86_64.r 745 kB/s | 192 kB 00:00 2024-03-29T04:05:59.276 INFO:teuthology.orchestra.run.smithi142.stdout:(99/174): elfutils-libelf-devel-0.190-2.el9.x86 183 kB/s | 21 kB 00:00 2024-03-29T04:05:59.301 INFO:teuthology.orchestra.run.smithi142.stdout:(100/174): libuuid-devel-2.37.4-18.el9.x86_64.r 217 kB/s | 25 kB 00:00 2024-03-29T04:05:59.376 INFO:teuthology.orchestra.run.smithi142.stdout:(101/174): python3-devel-3.9.17-2.el9.x86_64.rp 2.4 MB/s | 245 kB 00:00 2024-03-29T04:05:59.402 INFO:teuthology.orchestra.run.smithi142.stdout:(102/174): python3-jinja2-2.11.3-5.el9.noarch.r 2.4 MB/s | 248 kB 00:00 2024-03-29T04:05:59.430 INFO:teuthology.orchestra.run.smithi142.stdout:(103/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.8 MB/s | 94 kB 00:00 2024-03-29T04:05:59.505 INFO:teuthology.orchestra.run.smithi142.stdout:(104/174): openssl-devel-3.0.7-27.el9.x86_64.rp 14 MB/s | 4.1 MB 00:00 2024-03-29T04:05:59.555 INFO:teuthology.orchestra.run.smithi142.stdout:(105/174): lua-devel-5.4.4-4.el9.x86_64.rpm 146 kB/s | 22 kB 00:00 2024-03-29T04:05:59.683 INFO:teuthology.orchestra.run.smithi073.stdout:(160/174): ceph-test-19.0.0-2520.g69e2cd73.el9. 4.5 MB/s | 48 MB 00:10 2024-03-29T04:05:59.688 INFO:teuthology.orchestra.run.smithi142.stdout:(106/174): abseil-cpp-20211102.0-3.el9.x86_64.r 2.9 MB/s | 548 kB 00:00 2024-03-29T04:05:59.708 INFO:teuthology.orchestra.run.smithi073.stdout:(161/174): libacl-2.3.1-4.el9.x86_64.rpm 48 kB/s | 23 kB 00:00 2024-03-29T04:05:59.730 INFO:teuthology.orchestra.run.smithi142.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 474 kB/s | 19 kB 00:00 2024-03-29T04:05:59.734 INFO:teuthology.orchestra.run.smithi073.stdout:(162/174): elfutils-libs-0.190-2.el9.x86_64.rpm 344 kB/s | 256 kB 00:00 2024-03-29T04:05:59.756 INFO:teuthology.orchestra.run.smithi142.stdout:(108/174): gperftools-libs-2.9.1-2.el9.x86_64.r 1.5 MB/s | 309 kB 00:00 2024-03-29T04:05:59.789 INFO:teuthology.orchestra.run.smithi142.stdout:(109/174): protobuf-compiler-3.14.0-13.el9.x86_ 2.3 MB/s | 863 kB 00:00 2024-03-29T04:05:59.814 INFO:teuthology.orchestra.run.smithi142.stdout:(110/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 445 kB/s | 26 kB 00:00 2024-03-29T04:05:59.842 INFO:teuthology.orchestra.run.smithi073.stdout:(163/174): libmount-2.37.4-18.el9.x86_64.rpm 1.2 MB/s | 136 kB 00:00 2024-03-29T04:05:59.865 INFO:teuthology.orchestra.run.smithi142.stdout:(111/174): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-03-29T04:05:59.892 INFO:teuthology.orchestra.run.smithi073.stdout:(164/174): libfdisk-2.37.4-18.el9.x86_64.rpm 843 kB/s | 155 kB 00:00 2024-03-29T04:05:59.898 INFO:teuthology.orchestra.run.smithi142.stdout:(112/174): liboath-2.6.7-2.el9.x86_64.rpm 447 kB/s | 49 kB 00:00 2024-03-29T04:05:59.923 INFO:teuthology.orchestra.run.smithi142.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-03-29T04:05:59.943 INFO:teuthology.orchestra.run.smithi073.stdout:(165/174): libsmartcols-2.37.4-18.el9.x86_64.rp 638 kB/s | 64 kB 00:00 2024-03-29T04:05:59.991 INFO:teuthology.orchestra.run.smithi142.stdout:(114/174): libarrow-9.0.0-10.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-03-29T04:05:59.993 INFO:teuthology.orchestra.run.smithi073.stdout:(166/174): libuuid-2.37.4-18.el9.x86_64.rpm 285 kB/s | 29 kB 00:00 2024-03-29T04:06:00.016 INFO:teuthology.orchestra.run.smithi142.stdout:(115/174): python3-asyncssh-2.13.2-5.el9.noarch 5.8 MB/s | 548 kB 00:00 2024-03-29T04:06:00.041 INFO:teuthology.orchestra.run.smithi142.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 867 kB/s | 43 kB 00:00 2024-03-29T04:06:00.066 INFO:teuthology.orchestra.run.smithi142.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 642 kB/s | 32 kB 00:00 2024-03-29T04:06:00.092 INFO:teuthology.orchestra.run.smithi142.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 299 kB/s | 15 kB 00:00 2024-03-29T04:06:00.110 INFO:teuthology.orchestra.run.smithi073.stdout:(167/174): libblkid-2.37.4-18.el9.x86_64.rpm 254 kB/s | 108 kB 00:00 2024-03-29T04:06:00.117 INFO:teuthology.orchestra.run.smithi142.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2024-03-29T04:06:00.150 INFO:teuthology.orchestra.run.smithi142.stdout:(120/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.3 MB/s | 838 kB 00:00 2024-03-29T04:06:00.176 INFO:teuthology.orchestra.run.smithi142.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-03-29T04:06:00.201 INFO:teuthology.orchestra.run.smithi142.stdout:(122/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.5 MB/s | 303 kB 00:00 2024-03-29T04:06:00.218 INFO:teuthology.orchestra.run.smithi142.stdout:(123/174): python3-colorama-0.4.4-12.el9.noarch 527 kB/s | 35 kB 00:00 2024-03-29T04:06:00.243 INFO:teuthology.orchestra.run.smithi142.stdout:(124/174): python3-google-auth-2.28.2-1.el9.noa 2.9 MB/s | 203 kB 00:00 2024-03-29T04:06:00.268 INFO:teuthology.orchestra.run.smithi142.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-03-29T04:06:00.285 INFO:teuthology.orchestra.run.smithi142.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 256 kB/s | 11 kB 00:00 2024-03-29T04:06:00.294 INFO:teuthology.orchestra.run.smithi073.stdout:(168/174): openssl-3.0.7-27.el9.x86_64.rpm 3.4 MB/s | 1.2 MB 00:00 2024-03-29T04:06:00.310 INFO:teuthology.orchestra.run.smithi142.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 423 kB/s | 18 kB 00:00 2024-03-29T04:06:00.336 INFO:teuthology.orchestra.run.smithi142.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-03-29T04:06:00.361 INFO:teuthology.orchestra.run.smithi142.stdout:(129/174): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-03-29T04:06:00.386 INFO:teuthology.orchestra.run.smithi142.stdout:(130/174): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-03-29T04:06:00.411 INFO:teuthology.orchestra.run.smithi073.stdout:(169/174): util-linux-core-2.37.4-18.el9.x86_64 3.9 MB/s | 465 kB 00:00 2024-03-29T04:06:00.437 INFO:teuthology.orchestra.run.smithi142.stdout:(131/174): python3-grpcio-1.46.7-10.el9.x86_64. 8.7 MB/s | 2.0 MB 00:00 2024-03-29T04:06:00.454 INFO:teuthology.orchestra.run.smithi073.stdout:(170/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 4.7 MB/s | 2.2 MB 00:00 2024-03-29T04:06:00.462 INFO:teuthology.orchestra.run.smithi142.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 615 kB/s | 46 kB 00:00 2024-03-29T04:06:00.487 INFO:teuthology.orchestra.run.smithi142.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-03-29T04:06:00.511 INFO:teuthology.orchestra.run.smithi073.stdout:(171/174): util-linux-user-2.37.4-18.el9.x86_64 311 kB/s | 31 kB 00:00 2024-03-29T04:06:00.512 INFO:teuthology.orchestra.run.smithi142.stdout:(134/174): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-03-29T04:06:00.546 INFO:teuthology.orchestra.run.smithi142.stdout:(135/174): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-03-29T04:06:00.578 INFO:teuthology.orchestra.run.smithi073.stdout:(172/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 8.6 MB/s | 1.1 MB 00:00 2024-03-29T04:06:00.580 INFO:teuthology.orchestra.run.smithi142.stdout:(136/174): python3-kubernetes-26.1.0-2.el9.noar 4.7 MB/s | 1.0 MB 00:00 2024-03-29T04:06:00.605 INFO:teuthology.orchestra.run.smithi142.stdout:(137/174): python3-portend-3.1.0-2.el9.noarch.r 178 kB/s | 16 kB 00:00 2024-03-29T04:06:00.630 INFO:teuthology.orchestra.run.smithi142.stdout:(138/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.1 MB/s | 90 kB 00:00 2024-03-29T04:06:00.657 INFO:teuthology.orchestra.run.smithi142.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-03-29T04:06:00.681 INFO:teuthology.orchestra.run.smithi142.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 409 kB/s | 31 kB 00:00 2024-03-29T04:06:00.706 INFO:teuthology.orchestra.run.smithi142.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-03-29T04:06:00.728 INFO:teuthology.orchestra.run.smithi073.stdout:(173/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 343 kB/s | 74 kB 00:00 2024-03-29T04:06:00.731 INFO:teuthology.orchestra.run.smithi142.stdout:(142/174): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-03-29T04:06:00.790 INFO:teuthology.orchestra.run.smithi142.stdout:(143/174): python3-rsa-4.9-2.el9.noarch.rpm 544 kB/s | 59 kB 00:00 2024-03-29T04:06:00.815 INFO:teuthology.orchestra.run.smithi142.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 469 kB/s | 51 kB 00:00 2024-03-29T04:06:00.840 INFO:teuthology.orchestra.run.smithi142.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-03-29T04:06:00.866 INFO:teuthology.orchestra.run.smithi142.stdout:(146/174): python3-webob-1.8.7-6.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-03-29T04:06:00.891 INFO:teuthology.orchestra.run.smithi142.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-03-29T04:06:00.916 INFO:teuthology.orchestra.run.smithi142.stdout:(148/174): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-03-29T04:06:00.941 INFO:teuthology.orchestra.run.smithi142.stdout:(149/174): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-03-29T04:06:00.953 INFO:teuthology.orchestra.run.smithi073.stdout:(174/174): util-linux-2.37.4-18.el9.x86_64.rpm 2.7 MB/s | 2.3 MB 00:00 2024-03-29T04:06:00.959 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-03-29T04:06:00.960 INFO:teuthology.orchestra.run.smithi073.stdout:Total 15 MB/s | 226 MB 00:14 2024-03-29T04:06:01.041 INFO:teuthology.orchestra.run.smithi142.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-03-29T04:06:01.208 INFO:teuthology.orchestra.run.smithi142.stdout:(151/174): NetworkManager-1.47.2-1.el9.x86_64.r 14 MB/s | 2.3 MB 00:00 2024-03-29T04:06:01.275 INFO:teuthology.orchestra.run.smithi142.stdout:(152/174): NetworkManager-libnm-1.47.2-1.el9.x8 27 MB/s | 1.8 MB 00:00 2024-03-29T04:06:01.309 INFO:teuthology.orchestra.run.smithi142.stdout:(153/174): NetworkManager-team-1.47.2-1.el9.x86 1.2 MB/s | 41 kB 00:00 2024-03-29T04:06:01.325 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-03-29T04:06:01.351 INFO:teuthology.orchestra.run.smithi142.stdout:(154/174): NetworkManager-tui-1.47.2-1.el9.x86_ 5.8 MB/s | 247 kB 00:00 2024-03-29T04:06:01.393 INFO:teuthology.orchestra.run.smithi142.stdout:(155/174): xfsdump-3.1.12-4.el9.x86_64.rpm 7.6 MB/s | 321 kB 00:00 2024-03-29T04:06:01.477 INFO:teuthology.orchestra.run.smithi142.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 855 kB/s | 71 kB 00:00 2024-03-29T04:06:01.527 INFO:teuthology.orchestra.run.smithi142.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 732 kB/s | 36 kB 00:00 2024-03-29T04:06:01.585 INFO:teuthology.orchestra.run.smithi142.stdout:(158/174): librbd1-19.0.0-2520.g69e2cd73.el9.x8 4.9 MB/s | 3.1 MB 00:00 2024-03-29T04:06:01.598 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-03-29T04:06:01.599 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-03-29T04:06:01.610 INFO:teuthology.orchestra.run.smithi142.stdout:(159/174): elfutils-libelf-0.190-2.el9.x86_64.r 2.2 MB/s | 192 kB 00:00 2024-03-29T04:06:01.661 INFO:teuthology.orchestra.run.smithi142.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 461 kB/s | 23 kB 00:00 2024-03-29T04:06:01.711 INFO:teuthology.orchestra.run.smithi142.stdout:(161/174): libblkid-2.37.4-18.el9.x86_64.rpm 2.1 MB/s | 108 kB 00:00 2024-03-29T04:06:01.762 INFO:teuthology.orchestra.run.smithi142.stdout:(162/174): librados2-19.0.0-2520.g69e2cd73.el9. 4.0 MB/s | 3.4 MB 00:00 2024-03-29T04:06:01.787 INFO:teuthology.orchestra.run.smithi142.stdout:(163/174): elfutils-libs-0.190-2.el9.x86_64.rpm 1.2 MB/s | 256 kB 00:00 2024-03-29T04:06:01.812 INFO:teuthology.orchestra.run.smithi142.stdout:(164/174): libfdisk-2.37.4-18.el9.x86_64.rpm 1.5 MB/s | 155 kB 00:00 2024-03-29T04:06:01.837 INFO:teuthology.orchestra.run.smithi142.stdout:(165/174): libmount-2.37.4-18.el9.x86_64.rpm 1.8 MB/s | 136 kB 00:00 2024-03-29T04:06:01.879 INFO:teuthology.orchestra.run.smithi142.stdout:(166/174): libuuid-2.37.4-18.el9.x86_64.rpm 690 kB/s | 29 kB 00:00 2024-03-29T04:06:01.930 INFO:teuthology.orchestra.run.smithi142.stdout:(167/174): openssl-3.0.7-27.el9.x86_64.rpm 13 MB/s | 1.2 MB 00:00 2024-03-29T04:06:01.963 INFO:teuthology.orchestra.run.smithi142.stdout:(168/174): libsmartcols-2.37.4-18.el9.x86_64.rp 363 kB/s | 64 kB 00:00 2024-03-29T04:06:02.013 INFO:teuthology.orchestra.run.smithi142.stdout:(169/174): util-linux-2.37.4-18.el9.x86_64.rpm 27 MB/s | 2.3 MB 00:00 2024-03-29T04:06:02.055 INFO:teuthology.orchestra.run.smithi142.stdout:(170/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 12 MB/s | 2.2 MB 00:00 2024-03-29T04:06:02.081 INFO:teuthology.orchestra.run.smithi142.stdout:(171/174): util-linux-user-2.37.4-18.el9.x86_64 466 kB/s | 31 kB 00:00 2024-03-29T04:06:02.122 INFO:teuthology.orchestra.run.smithi142.stdout:(172/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 16 MB/s | 1.1 MB 00:00 2024-03-29T04:06:02.147 INFO:teuthology.orchestra.run.smithi142.stdout:(173/174): util-linux-core-2.37.4-18.el9.x86_64 2.5 MB/s | 465 kB 00:00 2024-03-29T04:06:02.173 INFO:teuthology.orchestra.run.smithi142.stdout:(174/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 809 kB/s | 74 kB 00:00 2024-03-29T04:06:02.176 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-03-29T04:06:02.176 INFO:teuthology.orchestra.run.smithi142.stdout:Total 16 MB/s | 226 MB 00:14 2024-03-29T04:06:02.529 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-03-29T04:06:02.800 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-03-29T04:06:02.801 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-03-29T04:06:03.588 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-03-29T04:06:03.588 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-03-29T04:06:04.822 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-03-29T04:06:04.822 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-03-29T04:06:10.470 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-03-29T04:06:10.642 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-29T04:06:10.676 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-29T04:06:10.714 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-29T04:06:10.724 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-29T04:06:10.772 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-29T04:06:10.827 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-29T04:06:10.860 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-29T04:06:10.885 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-29T04:06:10.934 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-29T04:06:11.267 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-29T04:06:11.323 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librados2-2:19.0.0-2520.g69e2cd73.el9.x86_64 10/198 2024-03-29T04:06:11.446 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:19.0.0-2520.g69e2cd73.el9.x86_64 10/198 2024-03-29T04:06:11.474 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs2-2:19.0.0-2520.g69e2cd73.el9.x86_64 11/198 2024-03-29T04:06:11.548 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephfs2-2:19.0.0-2520.g69e2cd73.el9.x86_64 11/198 2024-03-29T04:06:11.578 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rados-2:19.0.0-2520.g69e2cd73.el9.x86_64 12/198 2024-03-29T04:06:11.618 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-03-29T04:06:11.817 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-29T04:06:11.868 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-03-29T04:06:11.896 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephsqlite-2:19.0.0-2520.g69e2cd73.el9.x86_64 16/198 2024-03-29T04:06:11.994 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-03-29T04:06:11.999 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2520.g69e2cd73.el9.x86_64 16/198 2024-03-29T04:06:12.022 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libradosstriper1-2:19.0.0-2520.g69e2cd73.el9.x86 17/198 2024-03-29T04:06:12.085 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-29T04:06:12.095 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2520.g69e2cd73.el9.x86 17/198 2024-03-29T04:06:12.129 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-29T04:06:12.143 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-29T04:06:12.165 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-29T04:06:12.166 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-29T04:06:12.176 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-29T04:06:12.181 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-29T04:06:12.225 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-29T04:06:12.286 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-29T04:06:12.320 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-29T04:06:12.354 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-29T04:06:12.357 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-29T04:06:12.399 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-29T04:06:12.409 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-29T04:06:12.436 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-29T04:06:12.631 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-29T04:06:12.740 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-29T04:06:12.742 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-29T04:06:12.791 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librados2-2:19.0.0-2520.g69e2cd73.el9.x86_64 10/198 2024-03-29T04:06:12.803 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-29T04:06:12.890 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-29T04:06:12.895 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:19.0.0-2520.g69e2cd73.el9.x86_64 10/198 2024-03-29T04:06:12.934 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs2-2:19.0.0-2520.g69e2cd73.el9.x86_64 11/198 2024-03-29T04:06:12.946 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-29T04:06:13.025 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephfs2-2:19.0.0-2520.g69e2cd73.el9.x86_64 11/198 2024-03-29T04:06:13.072 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rados-2:19.0.0-2520.g69e2cd73.el9.x86_64 12/198 2024-03-29T04:06:13.121 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-03-29T04:06:13.168 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-29T04:06:13.276 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-29T04:06:13.306 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-29T04:06:13.352 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-03-29T04:06:13.372 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-29T04:06:13.380 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephsqlite-2:19.0.0-2520.g69e2cd73.el9.x86_64 16/198 2024-03-29T04:06:13.410 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-29T04:06:13.436 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-29T04:06:13.480 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-29T04:06:13.483 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2520.g69e2cd73.el9.x86_64 16/198 2024-03-29T04:06:13.506 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libradosstriper1-2:19.0.0-2520.g69e2cd73.el9.x86 17/198 2024-03-29T04:06:13.553 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-29T04:06:13.574 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2520.g69e2cd73.el9.x86 17/198 2024-03-29T04:06:13.608 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-29T04:06:13.618 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-29T04:06:13.641 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-29T04:06:13.647 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-29T04:06:13.657 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-29T04:06:13.712 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-29T04:06:13.746 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-29T04:06:13.789 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-29T04:06:13.822 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-29T04:06:13.850 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-29T04:06:13.850 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-29T04:06:13.886 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-29T04:06:13.919 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-29T04:06:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-29T04:06:13.955 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-common-2:19.0.0-2520.g69e2cd73.el9. 39/198 2024-03-29T04:06:14.015 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-argparse-2:19.0.0-2520.g69e2cd73.el 40/198 2024-03-29T04:06:14.043 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cephfs-2:19.0.0-2520.g69e2cd73.el9.x86_6 41/198 2024-03-29T04:06:14.086 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-29T04:06:14.114 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-29T04:06:14.166 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-29T04:06:14.223 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-29T04:06:14.240 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-29T04:06:14.275 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-29T04:06:14.374 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-29T04:06:14.382 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-29T04:06:14.435 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-29T04:06:14.435 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-29T04:06:14.642 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-29T04:06:14.747 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-29T04:06:14.837 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-29T04:06:14.881 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-29T04:06:14.908 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-29T04:06:14.952 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-29T04:06:14.953 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-29T04:06:15.027 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-29T04:06:15.040 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-29T04:06:15.080 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-29T04:06:15.118 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-29T04:06:15.118 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-29T04:06:15.176 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-29T04:06:15.185 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-29T04:06:15.185 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-29T04:06:15.226 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-29T04:06:15.229 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-03-29T04:06:15.269 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-29T04:06:15.291 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-29T04:06:15.302 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-29T04:06:15.328 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librados-devel-2:19.0.0-2520.g69e2cd73.el9.x86_6 53/198 2024-03-29T04:06:15.329 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-29T04:06:15.359 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-29T04:06:15.402 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-29T04:06:15.434 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-common-2:19.0.0-2520.g69e2cd73.el9. 39/198 2024-03-29T04:06:15.477 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-argparse-2:19.0.0-2520.g69e2cd73.el 40/198 2024-03-29T04:06:15.507 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cephfs-2:19.0.0-2520.g69e2cd73.el9.x86_6 41/198 2024-03-29T04:06:15.580 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-29T04:06:15.620 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-29T04:06:15.620 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-29T04:06:15.696 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-29T04:06:15.834 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-29T04:06:15.892 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-29T04:06:15.982 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-29T04:06:16.062 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-29T04:06:16.106 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-29T04:06:16.252 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-29T04:06:16.308 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-29T04:06:16.363 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-29T04:06:16.436 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-29T04:06:16.439 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-29T04:06:16.467 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-29T04:06:16.504 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-29T04:06:16.521 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-29T04:06:16.551 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-29T04:06:16.587 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-29T04:06:16.605 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-29T04:06:16.630 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-29T04:06:16.663 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-29T04:06:16.672 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-29T04:06:16.673 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-29T04:06:16.712 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-03-29T04:06:16.761 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-29T04:06:16.799 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librados-devel-2:19.0.0-2520.g69e2cd73.el9.x86_6 53/198 2024-03-29T04:06:16.807 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-29T04:06:16.829 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-29T04:06:16.861 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-29T04:06:16.891 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-29T04:06:16.933 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-29T04:06:17.026 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-29T04:06:17.068 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-03-29T04:06:17.103 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-29T04:06:17.108 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-29T04:06:17.134 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-29T04:06:17.159 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-29T04:06:17.248 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-29T04:06:17.377 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-29T04:06:17.484 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-29T04:06:17.492 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-29T04:06:17.534 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-29T04:06:17.581 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-29T04:06:17.583 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-29T04:06:17.626 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-29T04:06:17.638 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-29T04:06:17.766 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-29T04:06:17.820 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-29T04:06:17.827 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-29T04:06:17.871 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-29T04:06:17.883 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-29T04:06:17.958 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-29T04:06:17.995 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-29T04:06:18.018 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-29T04:06:18.053 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-03-29T04:06:18.085 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-29T04:06:18.089 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-29T04:06:18.115 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-29T04:06:18.138 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-29T04:06:18.143 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-29T04:06:18.177 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-29T04:06:18.197 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-29T04:06:18.217 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-29T04:06:18.240 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-29T04:06:18.253 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-29T04:06:18.283 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-29T04:06:18.411 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-29T04:06:18.422 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-29T04:06:18.463 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-29T04:06:18.493 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-29T04:06:18.535 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-29T04:06:18.618 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-29T04:06:18.634 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-29T04:06:18.676 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-03-29T04:06:18.716 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-29T04:06:18.742 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-29T04:06:18.764 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-29T04:06:18.766 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-29T04:06:18.797 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-29T04:06:18.839 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-29T04:06:18.847 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-29T04:06:18.873 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-29T04:06:18.963 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-29T04:06:18.972 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-29T04:06:19.052 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-29T04:06:19.080 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-29T04:06:19.104 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-29T04:06:19.133 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-29T04:06:19.135 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-29T04:06:19.183 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-29T04:06:19.190 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-29T04:06:19.264 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-29T04:06:19.280 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-29T04:06:19.328 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-29T04:06:19.454 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-29T04:06:19.495 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-29T04:06:19.640 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-29T04:06:19.686 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-03-29T04:06:19.726 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-29T04:06:19.756 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-29T04:06:19.784 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-29T04:06:19.827 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-29T04:06:19.866 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-29T04:06:19.898 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-29T04:06:19.927 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-29T04:06:20.007 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-29T04:06:20.038 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-29T04:06:20.060 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-29T04:06:20.071 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-29T04:06:20.109 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-29T04:06:20.113 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-29T04:06:20.143 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-29T04:06:20.147 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-29T04:06:20.191 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-29T04:06:20.242 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-29T04:06:20.278 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-29T04:06:20.310 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-29T04:06:20.365 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-29T04:06:20.422 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-29T04:06:20.453 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-29T04:06:20.488 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-29T04:06:20.500 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-29T04:06:20.527 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-29T04:06:20.600 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-29T04:06:20.606 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-29T04:06:20.655 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-29T04:06:21.249 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-29T04:06:21.366 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-29T04:06:21.434 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-29T04:06:21.476 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-29T04:06:21.510 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-29T04:06:21.560 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-29T04:06:21.652 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-29T04:06:21.686 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-29T04:06:21.865 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-29T04:06:21.900 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-29T04:06:21.979 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-29T04:06:22.600 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-29T04:06:22.662 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-29T04:06:22.685 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-29T04:06:22.716 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-29T04:06:22.748 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-29T04:06:22.775 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-29T04:06:22.776 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-29T04:06:23.092 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-29T04:06:23.122 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librbd1-2:19.0.0-2520.g69e2cd73.el9.x86_64 124/198 2024-03-29T04:06:23.195 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:19.0.0-2520.g69e2cd73.el9.x86_64 124/198 2024-03-29T04:06:23.227 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rbd-2:19.0.0-2520.g69e2cd73.el9.x86_64 125/198 2024-03-29T04:06:23.263 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-29T04:06:23.728 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-29T04:06:23.750 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librgw2-2:19.0.0-2520.g69e2cd73.el9.x86_64 128/198 2024-03-29T04:06:23.812 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librgw2-2:19.0.0-2520.g69e2cd73.el9.x86_64 128/198 2024-03-29T04:06:23.835 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rgw-2:19.0.0-2520.g69e2cd73.el9.x86_64 129/198 2024-03-29T04:06:24.070 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-29T04:06:24.159 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-29T04:06:24.189 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-29T04:06:24.221 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-29T04:06:24.248 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-29T04:06:24.567 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-29T04:06:24.703 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librbd1-2:19.0.0-2520.g69e2cd73.el9.x86_64 124/198 2024-03-29T04:06:24.794 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:19.0.0-2520.g69e2cd73.el9.x86_64 124/198 2024-03-29T04:06:24.824 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rbd-2:19.0.0-2520.g69e2cd73.el9.x86_64 125/198 2024-03-29T04:06:24.868 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-29T04:06:25.327 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-29T04:06:25.356 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librgw2-2:19.0.0-2520.g69e2cd73.el9.x86_64 128/198 2024-03-29T04:06:25.435 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librgw2-2:19.0.0-2520.g69e2cd73.el9.x86_64 128/198 2024-03-29T04:06:25.457 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rgw-2:19.0.0-2520.g69e2cd73.el9.x86_64 129/198 2024-03-29T04:06:26.078 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:19.0.0-2520.g69e2cd73.el9.x86_64 130/198 2024-03-29T04:06:26.116 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-common-2:19.0.0-2520.g69e2cd73.el9.x86_64 130/198 2024-03-29T04:06:26.665 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:19.0.0-2520.g69e2cd73.el9.x86_64 130/198 2024-03-29T04:06:26.711 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-base-2:19.0.0-2520.g69e2cd73.el9.x86_64 131/198 2024-03-29T04:06:26.795 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-base-2:19.0.0-2520.g69e2cd73.el9.x86_64 131/198 2024-03-29T04:06:26.795 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-29T04:06:26.796 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-29T04:06:26.796 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:06:26.837 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-selinux-2:19.0.0-2520.g69e2cd73.el9.x86_64 132/198 2024-03-29T04:06:27.727 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:19.0.0-2520.g69e2cd73.el9.x86_64 130/198 2024-03-29T04:06:27.763 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-common-2:19.0.0-2520.g69e2cd73.el9.x86_64 130/198 2024-03-29T04:06:28.328 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:19.0.0-2520.g69e2cd73.el9.x86_64 130/198 2024-03-29T04:06:28.367 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-base-2:19.0.0-2520.g69e2cd73.el9.x86_64 131/198 2024-03-29T04:06:28.472 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-base-2:19.0.0-2520.g69e2cd73.el9.x86_64 131/198 2024-03-29T04:06:28.473 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-29T04:06:28.473 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-29T04:06:28.473 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:06:28.509 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-selinux-2:19.0.0-2520.g69e2cd73.el9.x86_64 132/198 2024-03-29T04:06:38.952 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2520.g69e2cd73.el9.x86_64 132/198 2024-03-29T04:06:38.952 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /sys 2024-03-29T04:06:38.952 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /proc 2024-03-29T04:06:38.952 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /mnt 2024-03-29T04:06:38.952 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /var/tmp 2024-03-29T04:06:38.952 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /home 2024-03-29T04:06:38.952 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /root 2024-03-29T04:06:38.952 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /tmp 2024-03-29T04:06:38.952 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:06:39.117 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-volume-2:19.0.0-2520.g69e2cd73.el9.noarch 133/198 2024-03-29T04:06:39.131 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-volume-2:19.0.0-2520.g69e2cd73.el9.noarch 133/198 2024-03-29T04:06:39.132 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-29T04:06:39.132 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-29T04:06:39.132 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:06:40.462 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2520.g69e2cd73.el9.x86_64 132/198 2024-03-29T04:06:40.462 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /sys 2024-03-29T04:06:40.462 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /proc 2024-03-29T04:06:40.462 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /mnt 2024-03-29T04:06:40.462 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /var/tmp 2024-03-29T04:06:40.462 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /home 2024-03-29T04:06:40.462 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /root 2024-03-29T04:06:40.463 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /tmp 2024-03-29T04:06:40.463 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:06:40.559 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-osd-2:19.0.0-2520.g69e2cd73.el9.x86_64 134/198 2024-03-29T04:06:40.584 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-osd-2:19.0.0-2520.g69e2cd73.el9.x86_64 134/198 2024-03-29T04:06:40.585 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-29T04:06:40.585 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-29T04:06:40.585 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-29T04:06:40.585 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-29T04:06:40.585 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:06:40.629 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-volume-2:19.0.0-2520.g69e2cd73.el9.noarch 133/198 2024-03-29T04:06:40.644 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-volume-2:19.0.0-2520.g69e2cd73.el9.noarch 133/198 2024-03-29T04:06:40.644 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-29T04:06:40.644 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-29T04:06:40.644 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:06:40.802 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mds-2:19.0.0-2520.g69e2cd73.el9.x86_64 135/198 2024-03-29T04:06:40.824 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mds-2:19.0.0-2520.g69e2cd73.el9.x86_64 135/198 2024-03-29T04:06:40.824 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-29T04:06:40.824 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-29T04:06:40.824 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-29T04:06:40.824 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-29T04:06:40.824 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:06:41.260 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mon-2:19.0.0-2520.g69e2cd73.el9.x86_64 136/198 2024-03-29T04:06:41.283 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mon-2:19.0.0-2520.g69e2cd73.el9.x86_64 136/198 2024-03-29T04:06:41.283 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-29T04:06:41.283 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-29T04:06:41.283 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-29T04:06:41.283 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-29T04:06:41.283 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:06:41.379 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-29T04:06:41.722 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: cephadm-2:19.0.0-2520.g69e2cd73.el9.noarch 138/198 2024-03-29T04:06:41.753 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephadm-2:19.0.0-2520.g69e2cd73.el9.noarch 138/198 2024-03-29T04:06:41.784 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2520.g69e2cd73.e 139/198 2024-03-29T04:06:41.845 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2520.g69e2cd73. 140/198 2024-03-29T04:06:41.867 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2520.g69e2cd73.el9.noa 141/198 2024-03-29T04:06:42.124 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-osd-2:19.0.0-2520.g69e2cd73.el9.x86_64 134/198 2024-03-29T04:06:42.150 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-osd-2:19.0.0-2520.g69e2cd73.el9.x86_64 134/198 2024-03-29T04:06:42.150 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-29T04:06:42.150 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-29T04:06:42.150 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-29T04:06:42.150 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-29T04:06:42.150 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:06:42.374 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mds-2:19.0.0-2520.g69e2cd73.el9.x86_64 135/198 2024-03-29T04:06:42.397 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mds-2:19.0.0-2520.g69e2cd73.el9.x86_64 135/198 2024-03-29T04:06:42.397 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-29T04:06:42.397 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-29T04:06:42.397 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-29T04:06:42.397 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-29T04:06:42.397 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:06:42.834 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mon-2:19.0.0-2520.g69e2cd73.el9.x86_64 136/198 2024-03-29T04:06:42.856 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mon-2:19.0.0-2520.g69e2cd73.el9.x86_64 136/198 2024-03-29T04:06:42.856 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-29T04:06:42.856 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-29T04:06:42.856 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-29T04:06:42.856 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-29T04:06:42.856 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:06:42.898 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2520.g69e2cd73.el9.noa 141/198 2024-03-29T04:06:42.935 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2520.g69e2cd73.el9.n 142/198 2024-03-29T04:06:42.960 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-29T04:06:43.387 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephadm-2:19.0.0-2520.g69e2cd73.el9.noarch 138/198 2024-03-29T04:06:43.417 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephadm-2:19.0.0-2520.g69e2cd73.el9.noarch 138/198 2024-03-29T04:06:43.449 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2520.g69e2cd73.e 139/198 2024-03-29T04:06:43.513 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2520.g69e2cd73. 140/198 2024-03-29T04:06:43.540 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2520.g69e2cd73.el9.noa 141/198 2024-03-29T04:06:43.892 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2520.g69e2cd73.el9.n 142/198 2024-03-29T04:06:43.928 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2520.g69e 143/198 2024-03-29T04:06:44.028 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2520.g69e 143/198 2024-03-29T04:06:44.182 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2520.g69e2cd73.el 144/198 2024-03-29T04:06:44.213 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-2:19.0.0-2520.g69e2cd73.el9.x86_64 145/198 2024-03-29T04:06:44.235 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2520.g69e2cd73.el9.x86_64 145/198 2024-03-29T04:06:44.235 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-29T04:06:44.235 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-29T04:06:44.236 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-29T04:06:44.236 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-29T04:06:44.236 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:06:44.280 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-rook-2:19.0.0-2520.g69e2cd73.el9.noarch 146/198 2024-03-29T04:06:44.291 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2520.g69e2cd73.el9.noarch 146/198 2024-03-29T04:06:44.338 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-2:19.0.0-2520.g69e2cd73.el9.x86_64 147/198 2024-03-29T04:06:44.598 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2520.g69e2cd73.el9.noa 141/198 2024-03-29T04:06:44.642 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2520.g69e2cd73.el9.n 142/198 2024-03-29T04:06:45.227 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-29T04:06:45.258 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-radosgw-2:19.0.0-2520.g69e2cd73.el9.x86_64 149/198 2024-03-29T04:06:45.280 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2520.g69e2cd73.el9.x86_64 149/198 2024-03-29T04:06:45.281 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-29T04:06:45.281 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-29T04:06:45.281 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-29T04:06:45.281 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-29T04:06:45.281 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:06:45.325 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2520.g69e2c 150/198 2024-03-29T04:06:45.347 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2520.g69e2c 150/198 2024-03-29T04:06:45.347 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-29T04:06:45.347 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-29T04:06:45.347 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:06:45.392 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephfs-mirror-2:19.0.0-2520.g69e2cd73.el9.x86_64 151/198 2024-03-29T04:06:45.414 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2520.g69e2cd73.el9.x86_64 151/198 2024-03-29T04:06:45.415 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-29T04:06:45.415 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-29T04:06:45.415 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-29T04:06:45.415 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-29T04:06:45.415 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:06:45.603 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2520.g69e2cd73.el9.n 142/198 2024-03-29T04:06:45.634 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2520.g69e 143/198 2024-03-29T04:06:45.726 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-mirror-2:19.0.0-2520.g69e2cd73.el9.x86_64 152/198 2024-03-29T04:06:45.739 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2520.g69e 143/198 2024-03-29T04:06:45.749 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2520.g69e2cd73.el9.x86_64 152/198 2024-03-29T04:06:45.749 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-29T04:06:45.749 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-29T04:06:45.749 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-29T04:06:45.749 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-29T04:06:45.749 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:06:45.906 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2520.g69e2cd73.el 144/198 2024-03-29T04:06:45.936 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-2:19.0.0-2520.g69e2cd73.el9.x86_64 145/198 2024-03-29T04:06:45.959 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2520.g69e2cd73.el9.x86_64 145/198 2024-03-29T04:06:45.959 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-29T04:06:45.959 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-29T04:06:45.959 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-29T04:06:45.959 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-29T04:06:45.959 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:06:46.020 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-rook-2:19.0.0-2520.g69e2cd73.el9.noarch 146/198 2024-03-29T04:06:46.031 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2520.g69e2cd73.el9.noarch 146/198 2024-03-29T04:06:46.085 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-2:19.0.0-2520.g69e2cd73.el9.x86_64 147/198 2024-03-29T04:06:46.962 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-29T04:06:46.988 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-radosgw-2:19.0.0-2520.g69e2cd73.el9.x86_64 149/198 2024-03-29T04:06:47.011 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2520.g69e2cd73.el9.x86_64 149/198 2024-03-29T04:06:47.011 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-29T04:06:47.011 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-29T04:06:47.011 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-29T04:06:47.011 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-29T04:06:47.012 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:06:47.056 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2520.g69e2c 150/198 2024-03-29T04:06:47.077 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2520.g69e2c 150/198 2024-03-29T04:06:47.078 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-29T04:06:47.078 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-29T04:06:47.078 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:06:47.123 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephfs-mirror-2:19.0.0-2520.g69e2cd73.el9.x86_64 151/198 2024-03-29T04:06:47.145 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2520.g69e2cd73.el9.x86_64 151/198 2024-03-29T04:06:47.145 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-29T04:06:47.145 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-29T04:06:47.145 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-29T04:06:47.145 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-29T04:06:47.145 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:06:47.449 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-mirror-2:19.0.0-2520.g69e2cd73.el9.x86_64 152/198 2024-03-29T04:06:47.471 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2520.g69e2cd73.el9.x86_64 152/198 2024-03-29T04:06:47.471 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-29T04:06:47.472 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-29T04:06:47.472 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-29T04:06:47.472 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-29T04:06:47.472 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:06:50.190 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-test-2:19.0.0-2520.g69e2cd73.el9.x86_64 153/198 2024-03-29T04:06:50.230 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-fuse-2:19.0.0-2520.g69e2cd73.el9.x86_64 154/198 2024-03-29T04:06:50.261 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-nbd-2:19.0.0-2520.g69e2cd73.el9.x86_64 155/198 2024-03-29T04:06:50.288 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-29T04:06:50.471 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephfs-shell-2:19.0.0-2520.g69e2cd73.el9.x86_64 157/198 2024-03-29T04:06:50.589 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-03-29T04:06:50.627 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-fuse-2:19.0.0-2520.g69e2cd73.el9.x86_64 159/198 2024-03-29T04:06:50.679 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-29T04:06:50.744 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-29T04:06:50.788 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-29T04:06:50.820 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs-devel-2:19.0.0-2520.g69e2cd73.el9.x86_ 163/198 2024-03-29T04:06:50.869 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-29T04:06:50.898 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 165/198 2024-03-29T04:06:50.951 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 166/198 2024-03-29T04:06:51.021 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-29T04:06:51.055 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-29T04:06:51.661 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-29T04:06:51.711 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-29T04:06:51.731 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-29T04:06:51.944 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-test-2:19.0.0-2520.g69e2cd73.el9.x86_64 153/198 2024-03-29T04:06:51.986 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-fuse-2:19.0.0-2520.g69e2cd73.el9.x86_64 154/198 2024-03-29T04:06:52.017 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-nbd-2:19.0.0-2520.g69e2cd73.el9.x86_64 155/198 2024-03-29T04:06:52.044 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-29T04:06:52.230 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephfs-shell-2:19.0.0-2520.g69e2cd73.el9.x86_64 157/198 2024-03-29T04:06:52.342 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-03-29T04:06:52.384 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-fuse-2:19.0.0-2520.g69e2cd73.el9.x86_64 159/198 2024-03-29T04:06:52.434 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-29T04:06:52.492 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-29T04:06:52.535 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-29T04:06:52.553 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephfs-top-2:19.0.0-2520.g69e2cd73.el9.noarch 170/198 2024-03-29T04:06:52.567 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs-devel-2:19.0.0-2520.g69e2cd73.el9.x86_ 163/198 2024-03-29T04:06:52.599 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-29T04:06:52.629 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 165/198 2024-03-29T04:06:52.640 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-29T04:06:52.681 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-29T04:06:52.697 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 166/198 2024-03-29T04:06:52.766 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-29T04:06:52.772 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-29T04:06:52.802 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-29T04:06:52.802 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-29T04:06:52.827 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-29T04:06:52.854 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-29T04:06:52.879 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-29T04:06:52.879 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-29T04:06:52.975 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-29T04:06:53.005 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-29T04:06:53.005 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-29T04:06:53.089 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-29T04:06:53.116 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-29T04:06:53.149 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-29T04:06:53.183 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-29T04:06:53.207 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-29T04:06:53.250 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-29T04:06:53.289 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-29T04:06:53.321 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-29T04:06:53.346 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-29T04:06:53.371 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-29T04:06:53.374 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-29T04:06:53.396 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-29T04:06:53.417 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-29T04:06:53.421 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-29T04:06:53.428 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-29T04:06:53.428 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-29T04:06:53.438 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-29T04:06:53.617 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-29T04:06:53.617 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-29T04:06:53.700 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-29T04:06:53.723 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-29T04:06:53.756 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-29T04:06:53.783 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-29T04:06:53.808 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-29T04:06:53.874 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-29T04:06:54.304 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephfs-top-2:19.0.0-2520.g69e2cd73.el9.noarch 170/198 2024-03-29T04:06:54.378 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-29T04:06:54.421 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-29T04:06:54.511 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-29T04:06:54.549 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-29T04:06:54.574 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-29T04:06:54.599 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-29T04:06:54.626 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-29T04:06:54.626 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-29T04:06:54.713 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-29T04:06:54.743 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-29T04:06:54.743 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-29T04:06:54.836 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-29T04:06:54.862 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-29T04:06:54.898 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-29T04:06:54.921 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-29T04:06:54.945 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-29T04:06:54.980 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-29T04:06:55.026 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-29T04:06:55.067 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-29T04:06:55.092 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-29T04:06:55.117 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-29T04:06:55.142 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-29T04:06:55.168 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-29T04:06:55.174 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-29T04:06:55.174 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-29T04:06:55.354 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-29T04:06:55.354 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-29T04:06:55.420 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-29T04:06:55.437 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-29T04:06:55.470 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-29T04:06:55.505 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-29T04:06:55.530 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-29T04:06:55.595 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-29T04:06:59.375 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-29T04:06:59.375 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-2:19.0.0-2520.g69e2cd73.el9.x86_64 1/198 2024-03-29T04:06:59.376 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-base-2:19.0.0-2520.g69e2cd73.el9.x86_64 2/198 2024-03-29T04:06:59.376 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-common-2:19.0.0-2520.g69e2cd73.el9.x86_64 3/198 2024-03-29T04:06:59.376 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-fuse-2:19.0.0-2520.g69e2cd73.el9.x86_64 4/198 2024-03-29T04:06:59.376 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2520.g69e2c 5/198 2024-03-29T04:06:59.376 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mds-2:19.0.0-2520.g69e2cd73.el9.x86_64 6/198 2024-03-29T04:06:59.376 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-2:19.0.0-2520.g69e2cd73.el9.x86_64 7/198 2024-03-29T04:06:59.376 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mon-2:19.0.0-2520.g69e2cd73.el9.x86_64 8/198 2024-03-29T04:06:59.376 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-osd-2:19.0.0-2520.g69e2cd73.el9.x86_64 9/198 2024-03-29T04:06:59.376 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-radosgw-2:19.0.0-2520.g69e2cd73.el9.x86_64 10/198 2024-03-29T04:06:59.376 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-selinux-2:19.0.0-2520.g69e2cd73.el9.x86_64 11/198 2024-03-29T04:06:59.376 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-test-2:19.0.0-2520.g69e2cd73.el9.x86_64 12/198 2024-03-29T04:06:59.376 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephfs-mirror-2:19.0.0-2520.g69e2cd73.el9.x86_64 13/198 2024-03-29T04:06:59.376 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephfs-shell-2:19.0.0-2520.g69e2cd73.el9.x86_64 14/198 2024-03-29T04:06:59.377 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs-devel-2:19.0.0-2520.g69e2cd73.el9.x86_ 15/198 2024-03-29T04:06:59.377 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs2-2:19.0.0-2520.g69e2cd73.el9.x86_64 16/198 2024-03-29T04:06:59.377 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephsqlite-2:19.0.0-2520.g69e2cd73.el9.x86_64 17/198 2024-03-29T04:06:59.377 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados-devel-2:19.0.0-2520.g69e2cd73.el9.x86_6 18/198 2024-03-29T04:06:59.377 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libradosstriper1-2:19.0.0-2520.g69e2cd73.el9.x86 19/198 2024-03-29T04:06:59.377 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librgw2-2:19.0.0-2520.g69e2cd73.el9.x86_64 20/198 2024-03-29T04:06:59.377 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2520.g69e2cd73.el 21/198 2024-03-29T04:06:59.377 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-common-2:19.0.0-2520.g69e2cd73.el9. 22/198 2024-03-29T04:06:59.377 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cephfs-2:19.0.0-2520.g69e2cd73.el9.x86_6 23/198 2024-03-29T04:06:59.377 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rados-2:19.0.0-2520.g69e2cd73.el9.x86_64 24/198 2024-03-29T04:06:59.377 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rbd-2:19.0.0-2520.g69e2cd73.el9.x86_64 25/198 2024-03-29T04:06:59.377 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rgw-2:19.0.0-2520.g69e2cd73.el9.x86_64 26/198 2024-03-29T04:06:59.377 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-fuse-2:19.0.0-2520.g69e2cd73.el9.x86_64 27/198 2024-03-29T04:06:59.377 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-mirror-2:19.0.0-2520.g69e2cd73.el9.x86_64 28/198 2024-03-29T04:06:59.377 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-nbd-2:19.0.0-2520.g69e2cd73.el9.x86_64 29/198 2024-03-29T04:06:59.393 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2520.g69e2cd73. 30/198 2024-03-29T04:06:59.393 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2520.g69e2cd73.el9.noa 31/198 2024-03-29T04:06:59.393 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2520.g69e2cd73.el9.n 32/198 2024-03-29T04:06:59.393 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2520.g69e 33/198 2024-03-29T04:06:59.393 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2520.g69e2cd73.el 34/198 2024-03-29T04:06:59.393 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2520.g69e2cd73.el9.noarch 35/198 2024-03-29T04:06:59.393 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2520.g69e2cd73.e 36/198 2024-03-29T04:06:59.394 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-volume-2:19.0.0-2520.g69e2cd73.el9.noarch 37/198 2024-03-29T04:06:59.394 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephadm-2:19.0.0-2520.g69e2cd73.el9.noarch 38/198 2024-03-29T04:06:59.394 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephfs-top-2:19.0.0-2520.g69e2cd73.el9.noarch 39/198 2024-03-29T04:06:59.394 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-29T04:06:59.394 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-29T04:06:59.394 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-29T04:06:59.394 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-29T04:06:59.394 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-29T04:06:59.394 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-29T04:06:59.394 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-29T04:06:59.394 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-29T04:06:59.394 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-29T04:06:59.394 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-29T04:06:59.395 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-29T04:06:59.395 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-29T04:06:59.395 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-29T04:06:59.395 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-29T04:06:59.395 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-29T04:06:59.395 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-29T04:06:59.395 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-29T04:06:59.395 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-29T04:06:59.395 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-13.14-1.el9.x86_64 58/198 2024-03-29T04:06:59.395 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 59/198 2024-03-29T04:06:59.395 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 60/198 2024-03-29T04:06:59.395 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 61/198 2024-03-29T04:06:59.395 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-03-29T04:06:59.395 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-03-29T04:06:59.395 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-03-29T04:06:59.396 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-03-29T04:06:59.396 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-03-29T04:06:59.396 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-03-29T04:06:59.396 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-03-29T04:06:59.396 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-03-29T04:06:59.396 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-03-29T04:06:59.396 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-03-29T04:06:59.396 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-03-29T04:06:59.396 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-03-29T04:06:59.396 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-03-29T04:06:59.396 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-03-29T04:06:59.396 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-03-29T04:06:59.396 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-03-29T04:06:59.396 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-03-29T04:06:59.397 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-03-29T04:06:59.397 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-03-29T04:06:59.397 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-03-29T04:06:59.397 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 82/198 2024-03-29T04:06:59.397 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 83/198 2024-03-29T04:06:59.397 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 84/198 2024-03-29T04:06:59.397 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 85/198 2024-03-29T04:06:59.397 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 86/198 2024-03-29T04:06:59.397 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 87/198 2024-03-29T04:06:59.397 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 88/198 2024-03-29T04:06:59.397 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-29T04:06:59.397 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/198 2024-03-29T04:06:59.397 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/198 2024-03-29T04:06:59.397 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/198 2024-03-29T04:06:59.397 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/198 2024-03-29T04:06:59.398 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 94/198 2024-03-29T04:06:59.398 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : jq-1.6-16.el9.x86_64 95/198 2024-03-29T04:06:59.398 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 96/198 2024-03-29T04:06:59.398 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 97/198 2024-03-29T04:06:59.398 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 98/198 2024-03-29T04:06:59.398 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 99/198 2024-03-29T04:06:59.398 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 100/198 2024-03-29T04:06:59.398 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 101/198 2024-03-29T04:06:59.398 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 102/198 2024-03-29T04:06:59.398 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 103/198 2024-03-29T04:06:59.398 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-29T04:06:59.398 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-29T04:06:59.398 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-29T04:06:59.398 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-29T04:06:59.399 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-29T04:06:59.399 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-29T04:06:59.399 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-29T04:06:59.399 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-29T04:06:59.399 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-29T04:06:59.399 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-29T04:06:59.399 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-29T04:06:59.399 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-29T04:06:59.399 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-03-29T04:06:59.399 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-29T04:06:59.399 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-29T04:06:59.399 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-29T04:06:59.399 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-29T04:06:59.399 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-29T04:06:59.399 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-29T04:06:59.400 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-29T04:06:59.400 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-03-29T04:06:59.400 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-29T04:06:59.400 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-29T04:06:59.400 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-29T04:06:59.400 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-29T04:06:59.400 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-29T04:06:59.400 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-29T04:06:59.400 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-29T04:06:59.400 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-29T04:06:59.400 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-29T04:06:59.400 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-29T04:06:59.400 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-29T04:06:59.400 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-29T04:06:59.401 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-29T04:06:59.401 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-29T04:06:59.401 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-29T04:06:59.401 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-29T04:06:59.401 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-29T04:06:59.401 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-29T04:06:59.401 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-29T04:06:59.401 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-29T04:06:59.401 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-29T04:06:59.401 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-29T04:06:59.401 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-29T04:06:59.401 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-29T04:06:59.401 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-29T04:06:59.401 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-29T04:06:59.402 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:19.0.0-2520.g69e2cd73.el9.x86_64 151/198 2024-03-29T04:06:59.402 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-29T04:06:59.402 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:19.0.0-2520.g69e2cd73.el9.x86_64 153/198 2024-03-29T04:06:59.402 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-29T04:06:59.402 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 155/198 2024-03-29T04:06:59.402 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-03-29T04:06:59.402 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 157/198 2024-03-29T04:06:59.402 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-03-29T04:06:59.402 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 159/198 2024-03-29T04:06:59.402 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-03-29T04:06:59.402 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 161/198 2024-03-29T04:06:59.402 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-03-29T04:06:59.402 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 163/198 2024-03-29T04:06:59.403 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 164/198 2024-03-29T04:06:59.403 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-29T04:06:59.403 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-29T04:06:59.403 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-29T04:06:59.403 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-29T04:06:59.403 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-29T04:06:59.403 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-29T04:06:59.403 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-29T04:06:59.403 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-29T04:06:59.403 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-29T04:06:59.403 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-29T04:06:59.403 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-29T04:06:59.403 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-29T04:06:59.403 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-29T04:06:59.403 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-29T04:06:59.404 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-29T04:06:59.404 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-29T04:06:59.404 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-29T04:06:59.404 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-29T04:06:59.404 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-29T04:06:59.404 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-29T04:06:59.404 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-29T04:06:59.404 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-29T04:06:59.404 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-29T04:06:59.404 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-29T04:06:59.404 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-29T04:06:59.404 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-29T04:06:59.404 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-29T04:06:59.404 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-29T04:06:59.404 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-29T04:06:59.405 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-29T04:06:59.405 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-29T04:06:59.405 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-29T04:06:59.405 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-29T04:07:00.699 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-29T04:07:00.699 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-2:19.0.0-2520.g69e2cd73.el9.x86_64 1/198 2024-03-29T04:07:00.699 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-base-2:19.0.0-2520.g69e2cd73.el9.x86_64 2/198 2024-03-29T04:07:00.699 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-common-2:19.0.0-2520.g69e2cd73.el9.x86_64 3/198 2024-03-29T04:07:00.699 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-fuse-2:19.0.0-2520.g69e2cd73.el9.x86_64 4/198 2024-03-29T04:07:00.699 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2520.g69e2c 5/198 2024-03-29T04:07:00.699 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mds-2:19.0.0-2520.g69e2cd73.el9.x86_64 6/198 2024-03-29T04:07:00.699 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-2:19.0.0-2520.g69e2cd73.el9.x86_64 7/198 2024-03-29T04:07:00.699 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mon-2:19.0.0-2520.g69e2cd73.el9.x86_64 8/198 2024-03-29T04:07:00.700 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-osd-2:19.0.0-2520.g69e2cd73.el9.x86_64 9/198 2024-03-29T04:07:00.700 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-radosgw-2:19.0.0-2520.g69e2cd73.el9.x86_64 10/198 2024-03-29T04:07:00.700 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-selinux-2:19.0.0-2520.g69e2cd73.el9.x86_64 11/198 2024-03-29T04:07:00.700 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-test-2:19.0.0-2520.g69e2cd73.el9.x86_64 12/198 2024-03-29T04:07:00.700 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephfs-mirror-2:19.0.0-2520.g69e2cd73.el9.x86_64 13/198 2024-03-29T04:07:00.700 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephfs-shell-2:19.0.0-2520.g69e2cd73.el9.x86_64 14/198 2024-03-29T04:07:00.700 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs-devel-2:19.0.0-2520.g69e2cd73.el9.x86_ 15/198 2024-03-29T04:07:00.701 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs2-2:19.0.0-2520.g69e2cd73.el9.x86_64 16/198 2024-03-29T04:07:00.701 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephsqlite-2:19.0.0-2520.g69e2cd73.el9.x86_64 17/198 2024-03-29T04:07:00.701 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados-devel-2:19.0.0-2520.g69e2cd73.el9.x86_6 18/198 2024-03-29T04:07:00.701 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libradosstriper1-2:19.0.0-2520.g69e2cd73.el9.x86 19/198 2024-03-29T04:07:00.701 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librgw2-2:19.0.0-2520.g69e2cd73.el9.x86_64 20/198 2024-03-29T04:07:00.701 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2520.g69e2cd73.el 21/198 2024-03-29T04:07:00.701 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-common-2:19.0.0-2520.g69e2cd73.el9. 22/198 2024-03-29T04:07:00.701 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cephfs-2:19.0.0-2520.g69e2cd73.el9.x86_6 23/198 2024-03-29T04:07:00.701 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rados-2:19.0.0-2520.g69e2cd73.el9.x86_64 24/198 2024-03-29T04:07:00.701 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rbd-2:19.0.0-2520.g69e2cd73.el9.x86_64 25/198 2024-03-29T04:07:00.701 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rgw-2:19.0.0-2520.g69e2cd73.el9.x86_64 26/198 2024-03-29T04:07:00.701 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-fuse-2:19.0.0-2520.g69e2cd73.el9.x86_64 27/198 2024-03-29T04:07:00.702 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-mirror-2:19.0.0-2520.g69e2cd73.el9.x86_64 28/198 2024-03-29T04:07:00.702 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-nbd-2:19.0.0-2520.g69e2cd73.el9.x86_64 29/198 2024-03-29T04:07:00.702 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2520.g69e2cd73. 30/198 2024-03-29T04:07:00.702 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2520.g69e2cd73.el9.noa 31/198 2024-03-29T04:07:00.702 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2520.g69e2cd73.el9.n 32/198 2024-03-29T04:07:00.702 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2520.g69e 33/198 2024-03-29T04:07:00.702 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2520.g69e2cd73.el 34/198 2024-03-29T04:07:00.702 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2520.g69e2cd73.el9.noarch 35/198 2024-03-29T04:07:00.702 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2520.g69e2cd73.e 36/198 2024-03-29T04:07:00.702 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-volume-2:19.0.0-2520.g69e2cd73.el9.noarch 37/198 2024-03-29T04:07:00.703 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephadm-2:19.0.0-2520.g69e2cd73.el9.noarch 38/198 2024-03-29T04:07:00.703 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephfs-top-2:19.0.0-2520.g69e2cd73.el9.noarch 39/198 2024-03-29T04:07:00.703 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-29T04:07:00.703 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-29T04:07:00.703 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-29T04:07:00.703 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-29T04:07:00.703 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-29T04:07:00.703 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-29T04:07:00.703 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-29T04:07:00.703 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-29T04:07:00.703 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-29T04:07:00.704 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-29T04:07:00.704 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-29T04:07:00.704 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-29T04:07:00.704 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-29T04:07:00.704 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-29T04:07:00.704 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-29T04:07:00.704 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-29T04:07:00.704 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-29T04:07:00.704 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-29T04:07:00.705 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-13.14-1.el9.x86_64 58/198 2024-03-29T04:07:00.705 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 59/198 2024-03-29T04:07:00.705 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 60/198 2024-03-29T04:07:00.705 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 61/198 2024-03-29T04:07:00.705 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-03-29T04:07:00.705 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-03-29T04:07:00.705 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-03-29T04:07:00.706 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-03-29T04:07:00.706 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-03-29T04:07:00.706 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-03-29T04:07:00.706 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-03-29T04:07:00.706 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-03-29T04:07:00.706 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-03-29T04:07:00.706 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-03-29T04:07:00.706 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-03-29T04:07:00.706 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-03-29T04:07:00.706 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-03-29T04:07:00.706 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-03-29T04:07:00.707 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-03-29T04:07:00.707 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-03-29T04:07:00.707 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-03-29T04:07:00.707 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-03-29T04:07:00.707 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-03-29T04:07:00.707 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-03-29T04:07:00.707 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 82/198 2024-03-29T04:07:00.707 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 83/198 2024-03-29T04:07:00.707 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 84/198 2024-03-29T04:07:00.708 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 85/198 2024-03-29T04:07:00.708 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 86/198 2024-03-29T04:07:00.708 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 87/198 2024-03-29T04:07:00.708 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 88/198 2024-03-29T04:07:00.708 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-29T04:07:00.708 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/198 2024-03-29T04:07:00.708 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/198 2024-03-29T04:07:00.708 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/198 2024-03-29T04:07:00.708 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/198 2024-03-29T04:07:00.708 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 94/198 2024-03-29T04:07:00.708 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : jq-1.6-16.el9.x86_64 95/198 2024-03-29T04:07:00.709 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 96/198 2024-03-29T04:07:00.709 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 97/198 2024-03-29T04:07:00.709 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 98/198 2024-03-29T04:07:00.709 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 99/198 2024-03-29T04:07:00.709 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 100/198 2024-03-29T04:07:00.709 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 101/198 2024-03-29T04:07:00.709 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 102/198 2024-03-29T04:07:00.709 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 103/198 2024-03-29T04:07:00.709 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-29T04:07:00.709 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-29T04:07:00.709 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-29T04:07:00.709 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-29T04:07:00.710 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-29T04:07:00.710 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-29T04:07:00.710 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-29T04:07:00.710 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-29T04:07:00.710 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-29T04:07:00.710 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-29T04:07:00.710 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-29T04:07:00.710 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-29T04:07:00.710 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-03-29T04:07:00.710 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-29T04:07:00.710 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-29T04:07:00.711 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-29T04:07:00.711 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-29T04:07:00.711 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-29T04:07:00.711 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-29T04:07:00.711 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-29T04:07:00.711 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-03-29T04:07:00.711 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-29T04:07:00.711 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-29T04:07:00.711 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-29T04:07:00.711 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-29T04:07:00.711 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-29T04:07:00.711 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-29T04:07:00.712 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-29T04:07:00.712 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-29T04:07:00.712 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-29T04:07:00.712 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-29T04:07:00.712 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-29T04:07:00.712 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-29T04:07:00.712 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-29T04:07:00.712 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-29T04:07:00.712 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-29T04:07:00.712 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-29T04:07:00.712 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-29T04:07:00.712 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-29T04:07:00.713 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-29T04:07:00.713 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-29T04:07:00.713 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-29T04:07:00.713 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-29T04:07:00.713 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-29T04:07:00.713 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-29T04:07:00.713 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-29T04:07:00.713 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-29T04:07:00.713 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:19.0.0-2520.g69e2cd73.el9.x86_64 151/198 2024-03-29T04:07:00.713 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-29T04:07:00.713 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:19.0.0-2520.g69e2cd73.el9.x86_64 153/198 2024-03-29T04:07:00.713 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-29T04:07:00.713 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 155/198 2024-03-29T04:07:00.714 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-03-29T04:07:00.714 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 157/198 2024-03-29T04:07:00.714 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-03-29T04:07:00.714 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 159/198 2024-03-29T04:07:00.714 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-03-29T04:07:00.714 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 161/198 2024-03-29T04:07:00.714 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-03-29T04:07:00.714 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 163/198 2024-03-29T04:07:00.714 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 164/198 2024-03-29T04:07:00.714 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-29T04:07:00.714 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-29T04:07:00.714 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-29T04:07:00.715 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-29T04:07:00.715 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-29T04:07:00.715 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-29T04:07:00.715 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-29T04:07:00.715 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-29T04:07:00.715 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-29T04:07:00.715 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-29T04:07:00.715 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-29T04:07:00.715 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-29T04:07:00.715 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-29T04:07:00.715 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-29T04:07:00.715 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-29T04:07:00.715 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-29T04:07:00.716 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-29T04:07:00.716 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-29T04:07:00.716 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-29T04:07:00.716 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-29T04:07:00.716 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-29T04:07:00.716 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-29T04:07:00.716 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-29T04:07:00.717 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-29T04:07:00.717 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-29T04:07:00.717 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-29T04:07:00.717 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-29T04:07:00.717 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-29T04:07:00.717 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-29T04:07:00.717 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-29T04:07:00.718 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-29T04:07:00.718 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-29T04:07:00.718 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-29T04:07:02.263 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-29T04:07:02.263 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:07:02.263 INFO:teuthology.orchestra.run.smithi073.stdout:Upgraded: 2024-03-29T04:07:02.263 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-29T04:07:02.263 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-29T04:07:02.263 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-29T04:07:02.263 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-29T04:07:02.263 INFO:teuthology.orchestra.run.smithi073.stdout: acl-2.3.1-4.el9.x86_64 2024-03-29T04:07:02.264 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-29T04:07:02.264 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-29T04:07:02.264 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-29T04:07:02.264 INFO:teuthology.orchestra.run.smithi073.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-29T04:07:02.264 INFO:teuthology.orchestra.run.smithi073.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-29T04:07:02.264 INFO:teuthology.orchestra.run.smithi073.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-29T04:07:02.264 INFO:teuthology.orchestra.run.smithi073.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-29T04:07:02.264 INFO:teuthology.orchestra.run.smithi073.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-29T04:07:02.264 INFO:teuthology.orchestra.run.smithi073.stdout: librados2-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:02.264 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:02.264 INFO:teuthology.orchestra.run.smithi073.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-29T04:07:02.264 INFO:teuthology.orchestra.run.smithi073.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-29T04:07:02.264 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-29T04:07:02.265 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-29T04:07:02.265 INFO:teuthology.orchestra.run.smithi073.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-29T04:07:02.265 INFO:teuthology.orchestra.run.smithi073.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-29T04:07:02.265 INFO:teuthology.orchestra.run.smithi073.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-29T04:07:02.265 INFO:teuthology.orchestra.run.smithi073.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-29T04:07:02.265 INFO:teuthology.orchestra.run.smithi073.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-29T04:07:02.265 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-03-29T04:07:02.265 INFO:teuthology.orchestra.run.smithi073.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-29T04:07:02.265 INFO:teuthology.orchestra.run.smithi073.stdout: automake-1.16.2-8.el9.noarch 2024-03-29T04:07:02.265 INFO:teuthology.orchestra.run.smithi073.stdout: bison-3.7.4-5.el9.x86_64 2024-03-29T04:07:02.265 INFO:teuthology.orchestra.run.smithi073.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-29T04:07:02.265 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:02.265 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:02.265 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:02.266 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:02.266 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards-2:19.0.0-2520.g69e2cd73.el9.noarch 2024-03-29T04:07:02.266 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:02.266 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:02.266 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:02.266 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm-2:19.0.0-2520.g69e2cd73.el9.noarch 2024-03-29T04:07:02.266 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard-2:19.0.0-2520.g69e2cd73.el9.noarch 2024-03-29T04:07:02.266 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2520.g69e2cd73.el9.noarch 2024-03-29T04:07:02.266 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core-2:19.0.0-2520.g69e2cd73.el9.noarch 2024-03-29T04:07:02.266 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook-2:19.0.0-2520.g69e2cd73.el9.noarch 2024-03-29T04:07:02.266 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:02.266 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:02.267 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts-2:19.0.0-2520.g69e2cd73.el9.noarch 2024-03-29T04:07:02.267 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:02.267 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:02.267 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:02.267 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume-2:19.0.0-2520.g69e2cd73.el9.noarch 2024-03-29T04:07:02.267 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm-2:19.0.0-2520.g69e2cd73.el9.noarch 2024-03-29T04:07:02.267 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-mirror-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:02.267 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-shell-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:02.267 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-top-2:19.0.0-2520.g69e2cd73.el9.noarch 2024-03-29T04:07:02.267 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-29T04:07:02.267 INFO:teuthology.orchestra.run.smithi073.stdout: flex-2.6.4-9.el9.x86_64 2024-03-29T04:07:02.267 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-29T04:07:02.267 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-29T04:07:02.267 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-29T04:07:02.267 INFO:teuthology.orchestra.run.smithi073.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-29T04:07:02.268 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-29T04:07:02.268 INFO:teuthology.orchestra.run.smithi073.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-29T04:07:02.268 INFO:teuthology.orchestra.run.smithi073.stdout: jq-1.6-16.el9.x86_64 2024-03-29T04:07:02.268 INFO:teuthology.orchestra.run.smithi073.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-29T04:07:02.268 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-29T04:07:02.268 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-29T04:07:02.268 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:02.268 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:02.268 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:02.268 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-29T04:07:02.268 INFO:teuthology.orchestra.run.smithi073.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-29T04:07:02.268 INFO:teuthology.orchestra.run.smithi073.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-29T04:07:02.268 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-29T04:07:02.268 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-29T04:07:02.268 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:02.269 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:02.269 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-29T04:07:02.269 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:02.269 INFO:teuthology.orchestra.run.smithi073.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-29T04:07:02.269 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-29T04:07:02.269 INFO:teuthology.orchestra.run.smithi073.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-29T04:07:02.269 INFO:teuthology.orchestra.run.smithi073.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-29T04:07:02.269 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-29T04:07:02.269 INFO:teuthology.orchestra.run.smithi073.stdout: lua-5.4.4-4.el9.x86_64 2024-03-29T04:07:02.269 INFO:teuthology.orchestra.run.smithi073.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-29T04:07:02.269 INFO:teuthology.orchestra.run.smithi073.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-29T04:07:02.269 INFO:teuthology.orchestra.run.smithi073.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-29T04:07:02.269 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-29T04:07:02.269 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-29T04:07:02.269 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-29T04:07:02.270 INFO:teuthology.orchestra.run.smithi073.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-29T04:07:02.270 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-13.14-1.el9.x86_64 2024-03-29T04:07:02.270 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-03-29T04:07:02.270 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-03-29T04:07:02.270 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-server-13.14-1.el9.x86_64 2024-03-29T04:07:02.270 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-29T04:07:02.270 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-29T04:07:02.270 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-29T04:07:02.270 INFO:teuthology.orchestra.run.smithi073.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-29T04:07:02.270 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-29T04:07:02.270 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-29T04:07:02.270 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-29T04:07:02.270 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:02.271 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:02.271 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:02.271 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-29T04:07:02.271 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-29T04:07:02.271 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-29T04:07:02.271 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-29T04:07:02.271 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-29T04:07:02.271 INFO:teuthology.orchestra.run.smithi073.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-29T04:07:02.271 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-29T04:07:02.271 INFO:teuthology.orchestra.run.smithi073.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-29T04:07:02.271 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-29T04:07:02.271 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-29T04:07:02.271 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-29T04:07:02.271 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-29T04:07:02.272 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-29T04:07:02.272 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-29T04:07:02.272 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-29T04:07:02.272 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-29T04:07:02.272 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-29T04:07:02.272 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-29T04:07:02.272 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-29T04:07:02.272 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-29T04:07:02.272 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-29T04:07:02.272 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-29T04:07:02.272 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-29T04:07:02.272 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-29T04:07:02.272 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-29T04:07:02.273 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-29T04:07:02.273 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-29T04:07:02.273 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-29T04:07:02.273 INFO:teuthology.orchestra.run.smithi073.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-29T04:07:02.273 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-29T04:07:02.273 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ply-3.11-14.el9.noarch 2024-03-29T04:07:02.273 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-29T04:07:02.273 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-29T04:07:02.273 INFO:teuthology.orchestra.run.smithi073.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-29T04:07:02.273 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-29T04:07:02.273 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-29T04:07:02.273 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-29T04:07:02.273 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-29T04:07:02.273 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-29T04:07:02.274 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-29T04:07:02.274 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:02.274 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:02.274 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-29T04:07:02.274 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-29T04:07:02.274 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-29T04:07:02.274 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:02.274 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-29T04:07:02.274 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-29T04:07:02.274 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-29T04:07:02.274 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-29T04:07:02.274 INFO:teuthology.orchestra.run.smithi073.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-29T04:07:02.274 INFO:teuthology.orchestra.run.smithi073.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-29T04:07:02.275 INFO:teuthology.orchestra.run.smithi073.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-29T04:07:02.275 INFO:teuthology.orchestra.run.smithi073.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-29T04:07:02.275 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-29T04:07:02.275 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-29T04:07:02.275 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-29T04:07:02.275 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-29T04:07:02.275 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib-24.02.0-1.el9.x86_64 2024-03-29T04:07:02.275 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-03-29T04:07:02.275 INFO:teuthology.orchestra.run.smithi073.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-03-29T04:07:02.275 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:02.275 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:02.275 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:02.275 INFO:teuthology.orchestra.run.smithi073.stdout: re2-1:20211101-3.el9.x86_64 2024-03-29T04:07:02.275 INFO:teuthology.orchestra.run.smithi073.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-29T04:07:02.276 INFO:teuthology.orchestra.run.smithi073.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-29T04:07:02.276 INFO:teuthology.orchestra.run.smithi073.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-29T04:07:02.276 INFO:teuthology.orchestra.run.smithi073.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-29T04:07:02.276 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-29T04:07:02.276 INFO:teuthology.orchestra.run.smithi073.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-29T04:07:02.276 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:07:02.276 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-03-29T04:07:02.761 DEBUG:teuthology.parallel:result is None 2024-03-29T04:07:03.706 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-29T04:07:03.706 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:07:03.706 INFO:teuthology.orchestra.run.smithi142.stdout:Upgraded: 2024-03-29T04:07:03.706 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-29T04:07:03.706 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-29T04:07:03.706 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-29T04:07:03.706 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-29T04:07:03.706 INFO:teuthology.orchestra.run.smithi142.stdout: acl-2.3.1-4.el9.x86_64 2024-03-29T04:07:03.707 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-29T04:07:03.707 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-29T04:07:03.707 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-29T04:07:03.707 INFO:teuthology.orchestra.run.smithi142.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-29T04:07:03.707 INFO:teuthology.orchestra.run.smithi142.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-29T04:07:03.707 INFO:teuthology.orchestra.run.smithi142.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-29T04:07:03.707 INFO:teuthology.orchestra.run.smithi142.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-29T04:07:03.707 INFO:teuthology.orchestra.run.smithi142.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-29T04:07:03.707 INFO:teuthology.orchestra.run.smithi142.stdout: librados2-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:03.707 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:03.707 INFO:teuthology.orchestra.run.smithi142.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-29T04:07:03.707 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-29T04:07:03.707 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-29T04:07:03.707 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-29T04:07:03.708 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-29T04:07:03.708 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-29T04:07:03.708 INFO:teuthology.orchestra.run.smithi142.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-29T04:07:03.708 INFO:teuthology.orchestra.run.smithi142.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-29T04:07:03.708 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-29T04:07:03.708 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-03-29T04:07:03.708 INFO:teuthology.orchestra.run.smithi142.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-29T04:07:03.708 INFO:teuthology.orchestra.run.smithi142.stdout: automake-1.16.2-8.el9.noarch 2024-03-29T04:07:03.708 INFO:teuthology.orchestra.run.smithi142.stdout: bison-3.7.4-5.el9.x86_64 2024-03-29T04:07:03.708 INFO:teuthology.orchestra.run.smithi142.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-29T04:07:03.708 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:03.708 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:03.709 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:03.709 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:03.709 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards-2:19.0.0-2520.g69e2cd73.el9.noarch 2024-03-29T04:07:03.709 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:03.709 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:03.709 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:03.709 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm-2:19.0.0-2520.g69e2cd73.el9.noarch 2024-03-29T04:07:03.709 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard-2:19.0.0-2520.g69e2cd73.el9.noarch 2024-03-29T04:07:03.709 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2520.g69e2cd73.el9.noarch 2024-03-29T04:07:03.709 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core-2:19.0.0-2520.g69e2cd73.el9.noarch 2024-03-29T04:07:03.709 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook-2:19.0.0-2520.g69e2cd73.el9.noarch 2024-03-29T04:07:03.709 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:03.709 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:03.709 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts-2:19.0.0-2520.g69e2cd73.el9.noarch 2024-03-29T04:07:03.710 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:03.710 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:03.710 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:03.710 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume-2:19.0.0-2520.g69e2cd73.el9.noarch 2024-03-29T04:07:03.710 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm-2:19.0.0-2520.g69e2cd73.el9.noarch 2024-03-29T04:07:03.710 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-mirror-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:03.710 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-shell-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:03.710 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-top-2:19.0.0-2520.g69e2cd73.el9.noarch 2024-03-29T04:07:03.710 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-29T04:07:03.710 INFO:teuthology.orchestra.run.smithi142.stdout: flex-2.6.4-9.el9.x86_64 2024-03-29T04:07:03.710 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-29T04:07:03.710 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-29T04:07:03.710 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-29T04:07:03.710 INFO:teuthology.orchestra.run.smithi142.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-29T04:07:03.711 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-29T04:07:03.711 INFO:teuthology.orchestra.run.smithi142.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-29T04:07:03.711 INFO:teuthology.orchestra.run.smithi142.stdout: jq-1.6-16.el9.x86_64 2024-03-29T04:07:03.711 INFO:teuthology.orchestra.run.smithi142.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-29T04:07:03.711 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-29T04:07:03.711 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-29T04:07:03.711 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:03.711 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:03.711 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:03.711 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-29T04:07:03.711 INFO:teuthology.orchestra.run.smithi142.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-29T04:07:03.711 INFO:teuthology.orchestra.run.smithi142.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-29T04:07:03.711 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-29T04:07:03.711 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-29T04:07:03.712 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:03.712 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:03.712 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-29T04:07:03.712 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:03.712 INFO:teuthology.orchestra.run.smithi142.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-29T04:07:03.712 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-29T04:07:03.712 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-29T04:07:03.712 INFO:teuthology.orchestra.run.smithi142.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-29T04:07:03.712 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-29T04:07:03.712 INFO:teuthology.orchestra.run.smithi142.stdout: lua-5.4.4-4.el9.x86_64 2024-03-29T04:07:03.712 INFO:teuthology.orchestra.run.smithi142.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-29T04:07:03.712 INFO:teuthology.orchestra.run.smithi142.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-29T04:07:03.712 INFO:teuthology.orchestra.run.smithi142.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-29T04:07:03.712 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-29T04:07:03.713 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-29T04:07:03.713 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-29T04:07:03.713 INFO:teuthology.orchestra.run.smithi142.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-29T04:07:03.713 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-13.14-1.el9.x86_64 2024-03-29T04:07:03.713 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-03-29T04:07:03.713 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-03-29T04:07:03.713 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-server-13.14-1.el9.x86_64 2024-03-29T04:07:03.713 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-29T04:07:03.713 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-29T04:07:03.713 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-29T04:07:03.713 INFO:teuthology.orchestra.run.smithi142.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-29T04:07:03.713 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-29T04:07:03.713 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-29T04:07:03.713 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-29T04:07:03.713 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:03.714 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:03.714 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:03.714 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-29T04:07:03.714 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-29T04:07:03.714 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-29T04:07:03.714 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-29T04:07:03.714 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-29T04:07:03.714 INFO:teuthology.orchestra.run.smithi142.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-29T04:07:03.714 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-29T04:07:03.714 INFO:teuthology.orchestra.run.smithi142.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-29T04:07:03.714 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-29T04:07:03.714 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-29T04:07:03.715 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-29T04:07:03.715 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-29T04:07:03.715 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-29T04:07:03.715 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-29T04:07:03.715 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-29T04:07:03.715 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-29T04:07:03.715 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-29T04:07:03.715 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-29T04:07:03.715 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-29T04:07:03.715 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-29T04:07:03.715 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-29T04:07:03.715 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-29T04:07:03.716 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-29T04:07:03.716 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-29T04:07:03.716 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-29T04:07:03.716 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-29T04:07:03.716 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-29T04:07:03.716 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-29T04:07:03.716 INFO:teuthology.orchestra.run.smithi142.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-29T04:07:03.716 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-29T04:07:03.716 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ply-3.11-14.el9.noarch 2024-03-29T04:07:03.716 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-29T04:07:03.716 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-29T04:07:03.716 INFO:teuthology.orchestra.run.smithi142.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-29T04:07:03.716 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-29T04:07:03.716 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-29T04:07:03.717 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-29T04:07:03.717 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-29T04:07:03.717 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-29T04:07:03.717 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-29T04:07:03.717 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:03.717 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:03.717 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-29T04:07:03.717 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-29T04:07:03.717 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-29T04:07:03.717 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:03.717 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-29T04:07:03.717 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-29T04:07:03.717 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-29T04:07:03.718 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-29T04:07:03.718 INFO:teuthology.orchestra.run.smithi142.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-29T04:07:03.718 INFO:teuthology.orchestra.run.smithi142.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-29T04:07:03.718 INFO:teuthology.orchestra.run.smithi142.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-29T04:07:03.718 INFO:teuthology.orchestra.run.smithi142.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-29T04:07:03.718 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-29T04:07:03.718 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-29T04:07:03.718 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-29T04:07:03.718 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-29T04:07:03.718 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib-24.02.0-1.el9.x86_64 2024-03-29T04:07:03.718 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-03-29T04:07:03.718 INFO:teuthology.orchestra.run.smithi142.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-03-29T04:07:03.718 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:03.719 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:03.719 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd-2:19.0.0-2520.g69e2cd73.el9.x86_64 2024-03-29T04:07:03.719 INFO:teuthology.orchestra.run.smithi142.stdout: re2-1:20211101-3.el9.x86_64 2024-03-29T04:07:03.719 INFO:teuthology.orchestra.run.smithi142.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-29T04:07:03.719 INFO:teuthology.orchestra.run.smithi142.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-29T04:07:03.719 INFO:teuthology.orchestra.run.smithi142.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-29T04:07:03.719 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-29T04:07:03.719 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-29T04:07:03.719 INFO:teuthology.orchestra.run.smithi142.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-29T04:07:03.719 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:07:03.719 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-03-29T04:07:04.171 DEBUG:teuthology.parallel:result is None 2024-03-29T04:07:04.172 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=69e2cd73c52284dfd5096c66b60c6e6b26a3c447 2024-03-29T04:07:04.318 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-29T04:07:04.344 INFO:teuthology.orchestra.run.smithi073.stdout:19.0.0-2520.g69e2cd73.el9 2024-03-29T04:07:04.345 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2520.g69e2cd73.el9 2024-03-29T04:07:04.345 INFO:teuthology.task.install:The correct ceph version 19.0.0-2520.g69e2cd73 is installed. 2024-03-29T04:07:04.346 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=69e2cd73c52284dfd5096c66b60c6e6b26a3c447 2024-03-29T04:07:04.563 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-29T04:07:04.585 INFO:teuthology.orchestra.run.smithi142.stdout:19.0.0-2520.g69e2cd73.el9 2024-03-29T04:07:04.585 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2520.g69e2cd73.el9 2024-03-29T04:07:04.585 INFO:teuthology.task.install:The correct ceph version 19.0.0-2520.g69e2cd73 is installed. 2024-03-29T04:07:04.587 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-29T04:07:04.587 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-29T04:07:04.587 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-29T04:07:04.623 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-03-29T04:07:04.623 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-29T04:07:04.655 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-29T04:07:04.655 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-29T04:07:04.655 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/daemon-helper 2024-03-29T04:07:04.695 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-29T04:07:04.764 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-03-29T04:07:04.765 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/daemon-helper 2024-03-29T04:07:04.792 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-29T04:07:04.857 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-29T04:07:04.858 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-29T04:07:04.858 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-29T04:07:04.886 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-29T04:07:04.955 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-03-29T04:07:04.955 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-29T04:07:04.982 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-29T04:07:05.049 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-29T04:07:05.049 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-29T04:07:05.049 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/stdin-killer 2024-03-29T04:07:05.077 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-29T04:07:05.146 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-03-29T04:07:05.146 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/stdin-killer 2024-03-29T04:07:05.172 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-29T04:07:05.239 INFO:teuthology.run_tasks:Running task ceph... 2024-03-29T04:07:05.325 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-29T04:07:05.325 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 777 /var/log/ceph 2024-03-29T04:07:05.328 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 777 /var/log/ceph 2024-03-29T04:07:05.355 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-29T04:07:05.355 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-29T04:07:05.399 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-29T04:07:05.425 INFO:tasks.ceph:Creating extra log directories... 2024-03-29T04:07:05.425 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-29T04:07:05.467 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-29T04:07:05.500 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-03-29T04:07:05.500 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-03-29T04:07:05.500 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-03-29T04:07:05.500 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-29T04:07:05.500 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-29T04:07:05.549 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-29T04:07:05.676 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-29T04:07:05.703 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-03-29T04:07:05.704 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-29T04:07:05.718 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-29T04:07:05.836 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-29T04:07:05.867 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-29T04:07:05.867 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-29T04:07:05.867 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/mchangir-2024-03-29_02:01:30-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629079', 'branch': 'wip-mchangir-testing1-main-20240328-072412', 'description': 'fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/uninlining}', 'email': 'mchangir@redhat.com', 'first_in_suite': False, 'job_id': '7629079', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'mchangir-2024-03-29_02:01:30-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-mchangir-testing1-main-20240328-072412'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'log-whitelist': ['OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '69e2cd73c52284dfd5096c66b60c6e6b26a3c447'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '69e2cd73c52284dfd5096c66b60c6e6b26a3c447'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-mchangir-testing1-main-20240328-072412', 'sha1': '69e2cd73c52284dfd5096c66b60c6e6b26a3c447'}}, 'owner': 'scheduled_mchangir@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 8207, 'sha1': '69e2cd73c52284dfd5096c66b60c6e6b26a3c447', 'sleep_before_teardown': 0, 'suite': 'fs:functional', 'suite_branch': 'wip-mchangir-testing1-main-20240328-072412', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_69e2cd73c52284dfd5096c66b60c6e6b26a3c447/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '69e2cd73c52284dfd5096c66b60c6e6b26a3c447', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi073.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI4Ax4u1lAgFsWLs5ESi5tpuehTRg0FRB0+vfAHwr/KO29aNjk4W0DsWrZMAGFfrq5Snk2BJ03OryLC7ByC/ctQ=', 'smithi142.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCpFhUf5tCEKq5adp87Qd5MYoDuMKAXwJCchRCoZgAO2mw2wDoCcH5s0QIau8OOLXBgc+O0rKIPTXdfT3blRVk0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '69e2cd73c52284dfd5096c66b60c6e6b26a3c447'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'log-whitelist': ['OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '69e2cd73c52284dfd5096c66b60c6e6b26a3c447', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_uninlining']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-29_02:01:30', 'tube': 'smithi', 'user': 'mchangir', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-29T04:07:05.868 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-29T04:07:05.870 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-29T04:07:05.917 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/run/ceph 2024-03-29T04:07:05.926 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/run/ceph 2024-03-29T04:07:05.984 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-29T04:07:05.984 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/scratch_devs of=/dev/stdout 2024-03-29T04:07:06.007 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-29T04:07:06.007 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_1 2024-03-29T04:07:06.061 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-29T04:07:06.062 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-29T04:07:06.062 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-03-29T04:07:06.062 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-29T04:07:06.062 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-03-29T04:07:06.062 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-03-29 04:06:54.213358812 +0000 2024-03-29T04:07:06.062 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-03-29 04:04:34.422983274 +0000 2024-03-29T04:07:06.062 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-03-29 04:04:34.422983274 +0000 2024-03-29T04:07:06.062 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-03-29 04:04:34.422983274 +0000 2024-03-29T04:07:06.062 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-29T04:07:06.127 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-03-29T04:07:06.127 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-03-29T04:07:06.127 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000206986 s, 2.5 MB/s 2024-03-29T04:07:06.128 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-29T04:07:06.186 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_2 2024-03-29T04:07:06.240 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-29T04:07:06.240 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-29T04:07:06.241 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-03-29T04:07:06.241 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-29T04:07:06.241 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-03-29T04:07:06.241 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-03-29 04:06:54.213358812 +0000 2024-03-29T04:07:06.241 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-03-29 04:04:34.774974686 +0000 2024-03-29T04:07:06.241 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-03-29 04:04:34.774974686 +0000 2024-03-29T04:07:06.241 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-03-29 04:04:34.774974686 +0000 2024-03-29T04:07:06.241 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-29T04:07:06.306 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-03-29T04:07:06.306 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-03-29T04:07:06.306 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000210753 s, 2.4 MB/s 2024-03-29T04:07:06.307 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-29T04:07:06.363 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_3 2024-03-29T04:07:06.418 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-29T04:07:06.418 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-29T04:07:06.418 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-03-29T04:07:06.418 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-29T04:07:06.418 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-03-29T04:07:06.418 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-03-29 04:06:54.213358812 +0000 2024-03-29T04:07:06.418 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-03-29 04:04:35.116966343 +0000 2024-03-29T04:07:06.418 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-03-29 04:04:35.116966343 +0000 2024-03-29T04:07:06.419 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-03-29 04:04:35.116966343 +0000 2024-03-29T04:07:06.419 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-29T04:07:06.484 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-03-29T04:07:06.484 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-03-29T04:07:06.484 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000213016 s, 2.4 MB/s 2024-03-29T04:07:06.485 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-29T04:07:06.541 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_4 2024-03-29T04:07:06.596 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-29T04:07:06.596 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-29T04:07:06.597 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-03-29T04:07:06.597 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-29T04:07:06.597 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-03-29T04:07:06.597 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-03-29 04:06:54.214358788 +0000 2024-03-29T04:07:06.597 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-03-29 04:04:35.438958487 +0000 2024-03-29T04:07:06.597 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-03-29 04:04:35.438958487 +0000 2024-03-29T04:07:06.597 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-03-29 04:04:35.438958487 +0000 2024-03-29T04:07:06.597 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-29T04:07:06.661 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-03-29T04:07:06.661 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-03-29T04:07:06.661 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000203407 s, 2.5 MB/s 2024-03-29T04:07:06.663 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-29T04:07:06.718 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-29T04:07:06.718 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-03-29T04:07:06.718 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/scratch_devs of=/dev/stdout 2024-03-29T04:07:06.734 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-29T04:07:06.735 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_1 2024-03-29T04:07:06.789 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-29T04:07:06.789 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-29T04:07:06.789 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-03-29T04:07:06.789 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-29T04:07:06.789 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-03-29T04:07:06.789 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-03-29 04:06:55.959316826 +0000 2024-03-29T04:07:06.790 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-03-29 04:04:34.425541778 +0000 2024-03-29T04:07:06.790 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-03-29 04:04:34.425541778 +0000 2024-03-29T04:07:06.790 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-03-29 04:04:34.425541778 +0000 2024-03-29T04:07:06.790 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-29T04:07:06.855 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-03-29T04:07:06.855 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-03-29T04:07:06.855 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000203075 s, 2.5 MB/s 2024-03-29T04:07:06.856 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-29T04:07:06.912 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_2 2024-03-29T04:07:06.967 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-29T04:07:06.967 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-29T04:07:06.967 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-03-29T04:07:06.967 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-29T04:07:06.967 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-03-29T04:07:06.967 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-03-29 04:06:55.959316826 +0000 2024-03-29T04:07:06.967 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-03-29 04:04:34.771535164 +0000 2024-03-29T04:07:06.968 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-03-29 04:04:34.771535164 +0000 2024-03-29T04:07:06.968 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-03-29 04:04:34.771535164 +0000 2024-03-29T04:07:06.968 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-29T04:07:07.033 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-03-29T04:07:07.033 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-03-29T04:07:07.033 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000180017 s, 2.8 MB/s 2024-03-29T04:07:07.034 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-29T04:07:07.090 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_3 2024-03-29T04:07:07.145 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-29T04:07:07.145 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-29T04:07:07.145 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-03-29T04:07:07.145 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-29T04:07:07.145 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-03-29T04:07:07.145 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-03-29 04:06:55.959316826 +0000 2024-03-29T04:07:07.145 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-03-29 04:04:35.101528855 +0000 2024-03-29T04:07:07.145 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-03-29 04:04:35.101528855 +0000 2024-03-29T04:07:07.145 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-03-29 04:04:35.101528855 +0000 2024-03-29T04:07:07.146 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-29T04:07:07.211 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-03-29T04:07:07.211 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-03-29T04:07:07.211 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000191426 s, 2.7 MB/s 2024-03-29T04:07:07.212 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-29T04:07:07.268 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_4 2024-03-29T04:07:07.323 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-29T04:07:07.323 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-29T04:07:07.323 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-03-29T04:07:07.323 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-29T04:07:07.323 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-03-29T04:07:07.324 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-03-29 04:06:55.960316807 +0000 2024-03-29T04:07:07.324 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-03-29 04:04:35.446522260 +0000 2024-03-29T04:07:07.324 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-03-29 04:04:35.446522260 +0000 2024-03-29T04:07:07.324 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-03-29 04:04:35.446522260 +0000 2024-03-29T04:07:07.324 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-29T04:07:07.389 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-03-29T04:07:07.389 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-03-29T04:07:07.390 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000231773 s, 2.2 MB/s 2024-03-29T04:07:07.391 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-29T04:07:07.448 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-29T04:07:07.448 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-29T04:07:07.448 INFO:tasks.ceph:Generating config... 2024-03-29T04:07:07.451 INFO:tasks.ceph:[client] client mount timeout = 600 2024-03-29T04:07:07.451 INFO:tasks.ceph:[client] debug client = 20 2024-03-29T04:07:07.451 INFO:tasks.ceph:[client] debug ms = 1 2024-03-29T04:07:07.451 INFO:tasks.ceph:[client] pid file = 2024-03-29T04:07:07.451 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-03-29T04:07:07.452 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-03-29T04:07:07.452 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-03-29T04:07:07.452 INFO:tasks.ceph:[mds] debug mds = 20 2024-03-29T04:07:07.452 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-03-29T04:07:07.452 INFO:tasks.ceph:[mds] debug ms = 1 2024-03-29T04:07:07.452 INFO:tasks.ceph:[mds] mds debug frag = True 2024-03-29T04:07:07.453 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-03-29T04:07:07.453 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-03-29T04:07:07.453 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-03-29T04:07:07.453 INFO:tasks.ceph:[mds] mds_bal_replicate_threshold = 1 2024-03-29T04:07:07.453 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-03-29T04:07:07.453 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-03-29T04:07:07.454 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-03-29T04:07:07.454 INFO:tasks.ceph:[mgr] debug client = 20 2024-03-29T04:07:07.454 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-03-29T04:07:07.454 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-29T04:07:07.454 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-29T04:07:07.455 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-29T04:07:07.455 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-29T04:07:07.455 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-29T04:07:07.455 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-03-29T04:07:07.455 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-03-29T04:07:07.455 INFO:tasks.ceph:[osd] bdev async discard = True 2024-03-29T04:07:07.456 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-03-29T04:07:07.456 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-03-29T04:07:07.456 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-29T04:07:07.456 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-29T04:07:07.456 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-03-29T04:07:07.456 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-03-29T04:07:07.457 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-29T04:07:07.457 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-29T04:07:07.457 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-03-29T04:07:07.457 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-29T04:07:07.457 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-29T04:07:07.458 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-29T04:07:07.458 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-29T04:07:07.458 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-29T04:07:07.458 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-03-29T04:07:07.458 INFO:tasks.ceph:Setting up mon.a... 2024-03-29T04:07:07.459 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-29T04:07:07.525 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.keyring 2024-03-29T04:07:07.528 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-29T04:07:07.572 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-29T04:07:07.640 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.73'), ('mon.b', '172.21.15.142'), ('mon.c', '[v2:172.21.15.142:3301,v1:172.21.15.142:6790]')] 2024-03-29T04:07:07.640 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.73,172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-03-29T04:07:07.641 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-29T04:07:07.641 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-29T04:07:07.697 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.73 --add b 172.21.15.142 --addv c '[v2:172.21.15.142:3301,v1:172.21.15.142:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-03-29T04:07:07.781 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-29T04:07:07.782 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: generated fsid 6bff1617-b138-4517-acca-3ecaae3f2bb3 2024-03-29T04:07:07.782 INFO:teuthology.orchestra.run.smithi073.stdout:setting min_mon_release = quincy 2024-03-29T04:07:07.782 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 0 2024-03-29T04:07:07.782 INFO:teuthology.orchestra.run.smithi073.stdout:fsid 6bff1617-b138-4517-acca-3ecaae3f2bb3 2024-03-29T04:07:07.782 INFO:teuthology.orchestra.run.smithi073.stdout:last_changed 2024-03-29T04:07:07.802916+0000 2024-03-29T04:07:07.782 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-03-29T04:07:07.802916+0000 2024-03-29T04:07:07.782 INFO:teuthology.orchestra.run.smithi073.stdout:min_mon_release 17 (quincy) 2024-03-29T04:07:07.782 INFO:teuthology.orchestra.run.smithi073.stdout:election_strategy: 1 2024-03-29T04:07:07.782 INFO:teuthology.orchestra.run.smithi073.stdout:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-03-29T04:07:07.782 INFO:teuthology.orchestra.run.smithi073.stdout:1: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.b 2024-03-29T04:07:07.782 INFO:teuthology.orchestra.run.smithi073.stdout:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2024-03-29T04:07:07.782 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-03-29T04:07:07.784 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-29T04:07:07.839 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 6bff1617-b138-4517-acca-3ecaae3f2bb3... 2024-03-29T04:07:07.840 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-29T04:07:07.882 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-29T04:07:07.929 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2024-03-29T04:07:07.930 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2024-03-29T04:07:07.930 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-29T04:07:07.930 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2024-03-29T04:07:07.930 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:07:07.930 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2024-03-29T04:07:07.930 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:07:07.930 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2024-03-29T04:07:07.930 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:07:07.930 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2024-03-29T04:07:07.930 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2024-03-29T04:07:07.930 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:07:07.930 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2024-03-29T04:07:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2024-03-29T04:07:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:07:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-29T04:07:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2024-03-29T04:07:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:07:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2024-03-29T04:07:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-29T04:07:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:07:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2024-03-29T04:07:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:07:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2024-03-29T04:07:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2024-03-29T04:07:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2024-03-29T04:07:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2024-03-29T04:07:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2024-03-29T04:07:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2024-03-29T04:07:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2024-03-29T04:07:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-29T04:07:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-29T04:07:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2024-03-29T04:07:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:07:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-29T04:07:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:07:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2024-03-29T04:07:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:07:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2024-03-29T04:07:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:07:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2024-03-29T04:07:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2024-03-29T04:07:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2024-03-29T04:07:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "172.21.15.73,172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790]" 2024-03-29T04:07:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on skipped message = False 2024-03-29T04:07:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = 6bff1617-b138-4517-acca-3ecaae3f2bb3 2024-03-29T04:07:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:07:07.933 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2024-03-29T04:07:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2024-03-29T04:07:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:07:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2024-03-29T04:07:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2024-03-29T04:07:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock profile = high_recovery_ops 2024-03-29T04:07:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:07:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2024-03-29T04:07:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2024-03-29T04:07:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:07:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2024-03-29T04:07:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2024-03-29T04:07:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2024-03-29T04:07:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug trim objects = true 2024-03-29T04:07:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:07:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2024-03-29T04:07:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2024-03-29T04:07:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:07:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2024-03-29T04:07:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:07:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2024-03-29T04:07:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:07:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2024-03-29T04:07:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:07:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2024-03-29T04:07:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2024-03-29T04:07:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:07:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2024-03-29T04:07:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2024-03-29T04:07:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: bdev async discard = True 2024-03-29T04:07:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: bdev enable discard = True 2024-03-29T04:07:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore allocator = bitmap 2024-03-29T04:07:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore block size = 96636764160 2024-03-29T04:07:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore fsck on mount = True 2024-03-29T04:07:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluefs = 1/20 2024-03-29T04:07:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluestore = 1/20 2024-03-29T04:07:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-03-29T04:07:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2024-03-29T04:07:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: debug rocksdb = 4/10 2024-03-29T04:07:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd backfillfull_ratio = 0.85 2024-03-29T04:07:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd full ratio = 0.9 2024-03-29T04:07:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd nearfull ratio = 0.8 2024-03-29T04:07:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: osd failsafe full ratio = 0.95 2024-03-29T04:07:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = bluestore 2024-03-29T04:07:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2024-03-29T04:07:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:07:07.936 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2024-03-29T04:07:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-03-29T04:07:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2024-03-29T04:07:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2024-03-29T04:07:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2024-03-29T04:07:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2024-03-29T04:07:07.937 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2024-03-29T04:07:07.937 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2024-03-29T04:07:07.937 INFO:teuthology.orchestra.run.smithi073.stdout: debug client = 20 2024-03-29T04:07:07.937 INFO:teuthology.orchestra.run.smithi073.stdout: debug finisher = 20 2024-03-29T04:07:07.937 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:07:07.937 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2024-03-29T04:07:07.937 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-03-29T04:07:07.937 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2024-03-29T04:07:07.937 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2024-03-29T04:07:07.937 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2024-03-29T04:07:07.937 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2024-03-29T04:07:07.937 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2024-03-29T04:07:07.937 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2024-03-29T04:07:07.937 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2024-03-29T04:07:07.937 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2024-03-29T04:07:07.938 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2024-03-29T04:07:07.938 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:07:07.938 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-29T04:07:07.938 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2024-03-29T04:07:07.938 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2024-03-29T04:07:07.938 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:07:07.938 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2024-03-29T04:07:07.938 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-29T04:07:07.938 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-29T04:07:07.938 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:07:07.938 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2024-03-29T04:07:07.938 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2024-03-29T04:07:07.938 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:07:07.938 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2024-03-29T04:07:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: mon down mkfs grace = 300 2024-03-29T04:07:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: mon op complaint time = 120 2024-03-29T04:07:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:07:07.939 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2024-03-29T04:07:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2024-03-29T04:07:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2024-03-29T04:07:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2024-03-29T04:07:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-29T04:07:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-29T04:07:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: client mount timeout = 600 2024-03-29T04:07:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: debug client = 20 2024-03-29T04:07:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-03-29T04:07:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = "" 2024-03-29T04:07:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2024-03-29T04:07:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2024-03-29T04:07:07.939 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2024-03-29T04:07:07.940 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2024-03-29T04:07:07.940 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2024-03-29T04:07:07.940 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2024-03-29T04:07:07.940 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.c] 2024-03-29T04:07:07.940 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2024-03-29T04:07:07.940 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.d] 2024-03-29T04:07:07.940 INFO:teuthology.orchestra.run.smithi073.stdout:[mds] 2024-03-29T04:07:07.940 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds = 20 2024-03-29T04:07:07.940 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds balancer = 20 2024-03-29T04:07:07.940 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-03-29T04:07:07.940 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug frag = True 2024-03-29T04:07:07.940 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug scatterstat = True 2024-03-29T04:07:07.940 INFO:teuthology.orchestra.run.smithi073.stdout: mds op complaint time = 180 2024-03-29T04:07:07.940 INFO:teuthology.orchestra.run.smithi073.stdout: mds verify scatter = True 2024-03-29T04:07:07.940 INFO:teuthology.orchestra.run.smithi073.stdout: mds_bal_replicate_threshold = 1 2024-03-29T04:07:07.941 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2024-03-29T04:07:07.941 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2024-03-29T04:07:07.941 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2024-03-29T04:07:07.941 INFO:teuthology.orchestra.run.smithi142.stdout:[global] 2024-03-29T04:07:07.941 INFO:teuthology.orchestra.run.smithi142.stdout: chdir = "" 2024-03-29T04:07:07.941 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-29T04:07:07.941 INFO:teuthology.orchestra.run.smithi142.stdout: auth supported = cephx 2024-03-29T04:07:07.941 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:07:07.941 INFO:teuthology.orchestra.run.smithi142.stdout: filestore xattr use omap = true 2024-03-29T04:07:07.941 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:07:07.942 INFO:teuthology.orchestra.run.smithi142.stdout: mon clock drift allowed = 1.000 2024-03-29T04:07:07.942 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:07:07.942 INFO:teuthology.orchestra.run.smithi142.stdout: osd crush chooseleaf type = 0 2024-03-29T04:07:07.942 INFO:teuthology.orchestra.run.smithi142.stdout: auth debug = true 2024-03-29T04:07:07.942 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:07:07.942 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on old message = true 2024-03-29T04:07:07.942 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on bug = true 2024-03-29T04:07:07.942 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:07:07.942 INFO:teuthology.orchestra.run.smithi142.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-29T04:07:07.942 INFO:teuthology.orchestra.run.smithi142.stdout: mon pg warn max object skew = 0 2024-03-29T04:07:07.942 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:07:07.942 INFO:teuthology.orchestra.run.smithi142.stdout: # disable pg_autoscaler by default for new pools 2024-03-29T04:07:07.942 INFO:teuthology.orchestra.run.smithi142.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-29T04:07:07.942 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:07:07.943 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default size = 2 2024-03-29T04:07:07.943 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:07:07.943 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow primary affinity = true 2024-03-29T04:07:07.943 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow pg remap = true 2024-03-29T04:07:07.943 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on legacy crush tunables = false 2024-03-29T04:07:07.943 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on crush straw calc version zero = false 2024-03-29T04:07:07.943 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on no sortbitwise = false 2024-03-29T04:07:07.943 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on osd down out interval zero = false 2024-03-29T04:07:07.943 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on too few osds = false 2024-03-29T04:07:07.943 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-29T04:07:07.943 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-29T04:07:07.943 INFO:teuthology.orchestra.run.smithi142.stdout: mon_allow_pool_size_one = true 2024-03-29T04:07:07.943 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:07:07.944 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-29T04:07:07.944 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:07:07.944 INFO:teuthology.orchestra.run.smithi142.stdout: osd default data pool replay window = 5 2024-03-29T04:07:07.944 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:07:07.944 INFO:teuthology.orchestra.run.smithi142.stdout: mon allow pool delete = true 2024-03-29T04:07:07.944 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:07:07.944 INFO:teuthology.orchestra.run.smithi142.stdout: mon cluster log file level = debug 2024-03-29T04:07:07.944 INFO:teuthology.orchestra.run.smithi142.stdout: debug asserts on shutdown = true 2024-03-29T04:07:07.944 INFO:teuthology.orchestra.run.smithi142.stdout: mon health detail to clog = false 2024-03-29T04:07:07.944 INFO:teuthology.orchestra.run.smithi142.stdout: mon host = "172.21.15.73,172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790]" 2024-03-29T04:07:07.944 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on skipped message = False 2024-03-29T04:07:07.944 INFO:teuthology.orchestra.run.smithi142.stdout: fsid = 6bff1617-b138-4517-acca-3ecaae3f2bb3 2024-03-29T04:07:07.944 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:07:07.944 INFO:teuthology.orchestra.run.smithi142.stdout:[osd] 2024-03-29T04:07:07.944 INFO:teuthology.orchestra.run.smithi142.stdout: osd journal size = 100 2024-03-29T04:07:07.945 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:07:07.945 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub load threshold = 5.0 2024-03-29T04:07:07.945 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub max interval = 600 2024-03-29T04:07:07.945 INFO:teuthology.orchestra.run.smithi142.stdout: osd mclock profile = high_recovery_ops 2024-03-29T04:07:07.945 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:07:07.945 INFO:teuthology.orchestra.run.smithi142.stdout: osd recover clone overlap = true 2024-03-29T04:07:07.945 INFO:teuthology.orchestra.run.smithi142.stdout: osd recovery max chunk = 1048576 2024-03-29T04:07:07.945 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:07:07.945 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug shutdown = true 2024-03-29T04:07:07.945 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug op order = true 2024-03-29T04:07:07.945 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug verify stray on activate = true 2024-03-29T04:07:07.945 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug trim objects = true 2024-03-29T04:07:07.945 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:07:07.945 INFO:teuthology.orchestra.run.smithi142.stdout: osd open classes on start = true 2024-03-29T04:07:07.945 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug pg log writeout = true 2024-03-29T04:07:07.946 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:07:07.946 INFO:teuthology.orchestra.run.smithi142.stdout: osd deep scrub update digest min age = 30 2024-03-29T04:07:07.946 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:07:07.946 INFO:teuthology.orchestra.run.smithi142.stdout: osd map max advance = 10 2024-03-29T04:07:07.946 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:07:07.946 INFO:teuthology.orchestra.run.smithi142.stdout: journal zero on create = true 2024-03-29T04:07:07.946 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:07:07.946 INFO:teuthology.orchestra.run.smithi142.stdout: filestore ondisk finisher threads = 3 2024-03-29T04:07:07.946 INFO:teuthology.orchestra.run.smithi142.stdout: filestore apply finisher threads = 3 2024-03-29T04:07:07.946 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:07:07.946 INFO:teuthology.orchestra.run.smithi142.stdout: bdev debug aio = true 2024-03-29T04:07:07.946 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug misdirected ops = true 2024-03-29T04:07:07.946 INFO:teuthology.orchestra.run.smithi142.stdout: bdev async discard = True 2024-03-29T04:07:07.946 INFO:teuthology.orchestra.run.smithi142.stdout: bdev enable discard = True 2024-03-29T04:07:07.947 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore allocator = bitmap 2024-03-29T04:07:07.947 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore block size = 96636764160 2024-03-29T04:07:07.947 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore fsck on mount = True 2024-03-29T04:07:07.947 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluefs = 1/20 2024-03-29T04:07:07.947 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluestore = 1/20 2024-03-29T04:07:07.947 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-03-29T04:07:07.947 INFO:teuthology.orchestra.run.smithi142.stdout: debug osd = 20 2024-03-29T04:07:07.947 INFO:teuthology.orchestra.run.smithi142.stdout: debug rocksdb = 4/10 2024-03-29T04:07:07.947 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd backfillfull_ratio = 0.85 2024-03-29T04:07:07.947 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd full ratio = 0.9 2024-03-29T04:07:07.947 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd nearfull ratio = 0.8 2024-03-29T04:07:07.947 INFO:teuthology.orchestra.run.smithi142.stdout: osd failsafe full ratio = 0.95 2024-03-29T04:07:07.947 INFO:teuthology.orchestra.run.smithi142.stdout: osd objectstore = bluestore 2024-03-29T04:07:07.947 INFO:teuthology.orchestra.run.smithi142.stdout: osd op complaint time = 180 2024-03-29T04:07:07.947 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:07:07.948 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr] 2024-03-29T04:07:07.948 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-03-29T04:07:07.948 INFO:teuthology.orchestra.run.smithi142.stdout: debug mgr = 20 2024-03-29T04:07:07.948 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2024-03-29T04:07:07.948 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2024-03-29T04:07:07.948 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2024-03-29T04:07:07.948 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2024-03-29T04:07:07.948 INFO:teuthology.orchestra.run.smithi142.stdout: mgr/telemetry/nag = false 2024-03-29T04:07:07.948 INFO:teuthology.orchestra.run.smithi142.stdout: debug client = 20 2024-03-29T04:07:07.948 INFO:teuthology.orchestra.run.smithi142.stdout: debug finisher = 20 2024-03-29T04:07:07.948 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:07:07.948 INFO:teuthology.orchestra.run.smithi142.stdout:[mon] 2024-03-29T04:07:07.948 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-03-29T04:07:07.948 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2024-03-29T04:07:07.949 INFO:teuthology.orchestra.run.smithi142.stdout: debug paxos = 20 2024-03-29T04:07:07.949 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2024-03-29T04:07:07.949 INFO:teuthology.orchestra.run.smithi142.stdout: mon data avail warn = 5 2024-03-29T04:07:07.949 INFO:teuthology.orchestra.run.smithi142.stdout: mon mgr mkfs grace = 240 2024-03-29T04:07:07.949 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2024-03-29T04:07:07.949 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd reporter subtree level = osd 2024-03-29T04:07:07.949 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd prime pg temp = true 2024-03-29T04:07:07.949 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2024-03-29T04:07:07.949 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:07:07.949 INFO:teuthology.orchestra.run.smithi142.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-29T04:07:07.949 INFO:teuthology.orchestra.run.smithi142.stdout: auth mon ticket ttl = 660 # 11m 2024-03-29T04:07:07.949 INFO:teuthology.orchestra.run.smithi142.stdout: auth service ticket ttl = 240 # 4m 2024-03-29T04:07:07.949 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:07:07.949 INFO:teuthology.orchestra.run.smithi142.stdout: # don't complain about insecure global_id in the test suite 2024-03-29T04:07:07.949 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-29T04:07:07.950 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-29T04:07:07.950 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:07:07.950 INFO:teuthology.orchestra.run.smithi142.stdout: # 1m isn't quite enough 2024-03-29T04:07:07.950 INFO:teuthology.orchestra.run.smithi142.stdout: mon_down_mkfs_grace = 2m 2024-03-29T04:07:07.950 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:07:07.950 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_filestore_osds = false 2024-03-29T04:07:07.950 INFO:teuthology.orchestra.run.smithi142.stdout: mon down mkfs grace = 300 2024-03-29T04:07:07.950 INFO:teuthology.orchestra.run.smithi142.stdout: mon op complaint time = 120 2024-03-29T04:07:07.950 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-03-29T04:07:07.950 INFO:teuthology.orchestra.run.smithi142.stdout:[client] 2024-03-29T04:07:07.950 INFO:teuthology.orchestra.run.smithi142.stdout: rgw cache enabled = true 2024-03-29T04:07:07.950 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable ops log = true 2024-03-29T04:07:07.950 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable usage log = true 2024-03-29T04:07:07.951 INFO:teuthology.orchestra.run.smithi142.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-29T04:07:07.951 INFO:teuthology.orchestra.run.smithi142.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-29T04:07:07.951 INFO:teuthology.orchestra.run.smithi142.stdout: client mount timeout = 600 2024-03-29T04:07:07.951 INFO:teuthology.orchestra.run.smithi142.stdout: debug client = 20 2024-03-29T04:07:07.951 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-03-29T04:07:07.951 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = "" 2024-03-29T04:07:07.951 INFO:teuthology.orchestra.run.smithi142.stdout: rados mon op timeout = 900 2024-03-29T04:07:07.951 INFO:teuthology.orchestra.run.smithi142.stdout: rados osd op timeout = 900 2024-03-29T04:07:07.951 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.a] 2024-03-29T04:07:07.951 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.b] 2024-03-29T04:07:07.951 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.c] 2024-03-29T04:07:07.951 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.a] 2024-03-29T04:07:07.951 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.c] 2024-03-29T04:07:07.951 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.b] 2024-03-29T04:07:07.952 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.d] 2024-03-29T04:07:07.952 INFO:teuthology.orchestra.run.smithi142.stdout:[mds] 2024-03-29T04:07:07.952 INFO:teuthology.orchestra.run.smithi142.stdout: debug mds = 20 2024-03-29T04:07:07.952 INFO:teuthology.orchestra.run.smithi142.stdout: debug mds balancer = 20 2024-03-29T04:07:07.952 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-03-29T04:07:07.952 INFO:teuthology.orchestra.run.smithi142.stdout: mds debug frag = True 2024-03-29T04:07:07.952 INFO:teuthology.orchestra.run.smithi142.stdout: mds debug scatterstat = True 2024-03-29T04:07:07.952 INFO:teuthology.orchestra.run.smithi142.stdout: mds op complaint time = 180 2024-03-29T04:07:07.952 INFO:teuthology.orchestra.run.smithi142.stdout: mds verify scatter = True 2024-03-29T04:07:07.952 INFO:teuthology.orchestra.run.smithi142.stdout: mds_bal_replicate_threshold = 1 2024-03-29T04:07:07.952 INFO:teuthology.orchestra.run.smithi142.stdout: osd op complaint time = 180 2024-03-29T04:07:07.952 INFO:teuthology.orchestra.run.smithi142.stdout: rados mon op timeout = 900 2024-03-29T04:07:07.952 INFO:teuthology.orchestra.run.smithi142.stdout: rados osd op timeout = 900 2024-03-29T04:07:07.954 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-29T04:07:07.954 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-29T04:07:08.049 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-29T04:07:08.049 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-29T04:07:08.049 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-29T04:07:08.064 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-29T04:07:08.064 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-29T04:07:08.120 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi073.front.sepia.ceph.com 2024-03-29T04:07:08.120 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-29T04:07:08.120 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-29T04:07:08.120 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-29T04:07:08.200 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-29T04:07:08.200 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-29T04:07:08.255 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi142.front.sepia.ceph.com 2024-03-29T04:07:08.256 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-03-29T04:07:08.256 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-29T04:07:08.256 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-29T04:07:08.296 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-03-29T04:07:08.296 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-29T04:07:08.350 INFO:tasks.ceph:Setting up mon nodes... 2024-03-29T04:07:08.350 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-29T04:07:08.351 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-03-29T04:07:08.405 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-03-29T04:07:08.408 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-29T04:07:08.472 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-29T04:07:08.474 INFO:tasks.ceph:Setting up mds nodes... 2024-03-29T04:07:08.475 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-03-29T04:07:08.529 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-03-29T04:07:08.532 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-03-29T04:07:08.558 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-03-29T04:07:08.653 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-03-29T04:07:08.655 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-03-29T04:07:08.682 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-03-29T04:07:08.737 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-03-29T04:07:08.739 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-03-29T04:07:08.766 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-03-29T04:07:08.861 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-03-29T04:07:08.863 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-03-29T04:07:08.889 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-29T04:07:08.890 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-29T04:07:08.932 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-29T04:07:08.947 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-03-29T04:07:09.029 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-03-29T04:07:09.044 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-03-29T04:07:09.088 INFO:teuthology.orchestra.run.smithi142.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-03-29T04:07:09.104 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-03-29T04:07:09.145 INFO:teuthology.orchestra.run.smithi142.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-03-29T04:07:09.160 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-29T04:07:09.160 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-29T04:07:09.160 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-29T04:07:09.187 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-29T04:07:09.188 INFO:tasks.ceph:role: osd.0 2024-03-29T04:07:09.188 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com 2024-03-29T04:07:09.188 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-29T04:07:09.261 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-29T04:07:09.261 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-29T04:07:09.262 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-29T04:07:09.262 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-29T04:07:09.262 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-29T04:07:09.262 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-03-29T04:07:09.262 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-29T04:07:09.262 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-29T04:07:09.262 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-29T04:07:09.262 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-29T04:07:09.779 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-03-29T04:07:09.781 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-03-29T04:07:09.781 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-29T04:07:09.910 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-29T04:07:09.945 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-29T04:07:10.014 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-29T04:07:10.014 INFO:tasks.ceph:role: osd.1 2024-03-29T04:07:10.015 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com 2024-03-29T04:07:10.015 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-29T04:07:10.090 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-29T04:07:10.091 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-29T04:07:10.091 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-29T04:07:10.091 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-29T04:07:10.091 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-29T04:07:10.091 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-03-29T04:07:10.091 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-29T04:07:10.091 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-29T04:07:10.091 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-29T04:07:10.091 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-29T04:07:10.549 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-03-29T04:07:10.551 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-03-29T04:07:10.551 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-29T04:07:10.647 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-29T04:07:10.680 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-29T04:07:10.747 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-29T04:07:10.747 INFO:tasks.ceph:role: osd.2 2024-03-29T04:07:10.747 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com 2024-03-29T04:07:10.747 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-29T04:07:10.822 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-29T04:07:10.822 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-29T04:07:10.823 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-29T04:07:10.823 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-29T04:07:10.823 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-29T04:07:10.823 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-03-29T04:07:10.823 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-29T04:07:10.823 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-29T04:07:10.823 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-29T04:07:10.823 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-29T04:07:11.318 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-03-29T04:07:11.321 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-03-29T04:07:11.321 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-29T04:07:11.481 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-29T04:07:11.519 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-29T04:07:11.588 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-29T04:07:11.588 INFO:tasks.ceph:role: osd.3 2024-03-29T04:07:11.588 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi073.front.sepia.ceph.com 2024-03-29T04:07:11.589 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-29T04:07:11.665 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-29T04:07:11.665 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-29T04:07:11.665 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-29T04:07:11.665 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-29T04:07:11.665 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-29T04:07:11.666 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-03-29T04:07:11.666 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-29T04:07:11.666 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-29T04:07:11.666 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-29T04:07:11.666 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-29T04:07:12.174 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-03-29T04:07:12.177 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-03-29T04:07:12.177 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-03-29T04:07:12.303 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-29T04:07:12.343 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-29T04:07:12.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:12.469+0000 7f592d3df640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-29T04:07:12.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:12.470+0000 7f592d3df640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-29T04:07:12.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:12.470+0000 7f592d3df640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-29T04:07:12.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:12.470+0000 7f592d3df640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-29T04:07:12.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:12.470+0000 7f592d3df640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-29T04:07:12.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:12.470+0000 7f592d3df640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-29T04:07:15.309 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-29T04:07:15.341 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-29T04:07:15.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:15.451+0000 7f88d8193640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-29T04:07:15.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:15.452+0000 7f88d8193640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-29T04:07:15.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:15.452+0000 7f88d8193640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-29T04:07:15.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:15.452+0000 7f88d8193640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-29T04:07:15.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:15.452+0000 7f88d8193640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-29T04:07:15.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:15.452+0000 7f88d8193640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-29T04:07:18.277 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-29T04:07:18.307 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-29T04:07:18.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:18.419+0000 7fde4dff6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-29T04:07:18.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:18.419+0000 7fde4dff6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-29T04:07:18.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:18.419+0000 7fde4dff6640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-29T04:07:18.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:18.419+0000 7fde4dff6640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-29T04:07:18.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:18.419+0000 7fde4dff6640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-29T04:07:18.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:18.419+0000 7fde4dff6640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-29T04:07:21.256 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-29T04:07:21.288 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-29T04:07:21.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:21.400+0000 7f2a5d617640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-29T04:07:21.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:21.400+0000 7f2a5d617640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-29T04:07:21.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:21.400+0000 7f2a5d617640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-29T04:07:21.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:21.401+0000 7f2a5d617640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-29T04:07:21.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:21.401+0000 7f2a5d617640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-29T04:07:21.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:21.401+0000 7f2a5d617640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-29T04:07:24.236 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-29T04:07:24.268 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-03-29T04:07:24.300 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-29T04:07:24.300 INFO:tasks.ceph:role: osd.4 2024-03-29T04:07:24.300 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com 2024-03-29T04:07:24.300 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-29T04:07:24.379 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-29T04:07:24.380 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-29T04:07:24.380 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-29T04:07:24.380 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-29T04:07:24.380 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-29T04:07:24.380 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-03-29T04:07:24.380 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-29T04:07:24.380 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-29T04:07:24.380 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-29T04:07:24.380 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-29T04:07:24.882 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-03-29T04:07:24.884 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-03-29T04:07:24.884 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-03-29T04:07:25.004 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-03-29T04:07:25.042 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-03-29T04:07:25.112 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-29T04:07:25.112 INFO:tasks.ceph:role: osd.5 2024-03-29T04:07:25.113 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com 2024-03-29T04:07:25.113 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-29T04:07:25.189 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-29T04:07:25.189 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-29T04:07:25.189 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-29T04:07:25.189 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-29T04:07:25.189 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-29T04:07:25.189 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-03-29T04:07:25.189 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-29T04:07:25.189 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-29T04:07:25.189 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-29T04:07:25.189 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-29T04:07:25.638 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-03-29T04:07:25.640 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-03-29T04:07:25.640 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-03-29T04:07:25.732 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-03-29T04:07:25.762 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-03-29T04:07:25.830 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-29T04:07:25.830 INFO:tasks.ceph:role: osd.6 2024-03-29T04:07:25.830 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com 2024-03-29T04:07:25.830 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-29T04:07:25.905 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-29T04:07:25.905 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-29T04:07:25.905 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-29T04:07:25.905 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-29T04:07:25.906 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-29T04:07:25.906 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-03-29T04:07:25.906 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-29T04:07:25.906 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-29T04:07:25.906 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-29T04:07:25.906 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-29T04:07:26.393 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-03-29T04:07:26.395 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-03-29T04:07:26.395 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-03-29T04:07:26.535 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-03-29T04:07:26.567 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-03-29T04:07:26.633 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-29T04:07:26.633 INFO:tasks.ceph:role: osd.7 2024-03-29T04:07:26.634 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi142.front.sepia.ceph.com 2024-03-29T04:07:26.634 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-29T04:07:26.707 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-29T04:07:26.707 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-29T04:07:26.707 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-29T04:07:26.707 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-29T04:07:26.707 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-29T04:07:26.707 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-03-29T04:07:26.707 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-29T04:07:26.707 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-29T04:07:26.708 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-29T04:07:26.708 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-29T04:07:27.215 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-03-29T04:07:27.216 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-03-29T04:07:27.217 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-03-29T04:07:27.351 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-03-29T04:07:27.383 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-29T04:07:27.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:27.503+0000 7f870a6aa640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-03-29T04:07:27.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:27.503+0000 7f870a6aa640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-03-29T04:07:27.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:27.503+0000 7f870a6aa640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-29T04:07:27.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:27.503+0000 7f870a6aa640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-29T04:07:27.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:27.503+0000 7f870a6aa640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-29T04:07:27.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:27.504+0000 7f870a6aa640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-03-29T04:07:30.347 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-29T04:07:30.379 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-29T04:07:30.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:30.491+0000 7f2205aae640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-03-29T04:07:30.471 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:30.491+0000 7f2205aae640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-03-29T04:07:30.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:30.491+0000 7f2205aae640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-29T04:07:30.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:30.491+0000 7f2205aae640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-29T04:07:30.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:30.491+0000 7f2205aae640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-29T04:07:30.472 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:30.492+0000 7f2205aae640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-03-29T04:07:33.323 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-29T04:07:33.355 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-29T04:07:33.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:33.466+0000 7fa008419640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-03-29T04:07:33.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:33.467+0000 7fa008419640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-03-29T04:07:33.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:33.467+0000 7fa008419640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-29T04:07:33.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:33.467+0000 7fa008419640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-29T04:07:33.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:33.467+0000 7fa008419640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-29T04:07:33.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:33.467+0000 7fa008419640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-03-29T04:07:35.869 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-29T04:07:35.872 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-29T04:07:36.295 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-29T04:07:36.325 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-29T04:07:36.423 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:36.443+0000 7fda9ee15640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-03-29T04:07:36.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:36.444+0000 7fda9ee15640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-03-29T04:07:36.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:36.444+0000 7fda9ee15640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-29T04:07:36.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:36.444+0000 7fda9ee15640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-29T04:07:36.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:36.444+0000 7fda9ee15640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-29T04:07:36.424 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:36.444+0000 7fda9ee15640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-03-29T04:07:39.282 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-29T04:07:39.314 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-29T04:07:39.314 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-29T04:07:39.314 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-03-29T04:07:39.346 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-29T04:07:39.346 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-03-29T04:07:39.417 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-29T04:07:39.417 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-03-29T04:07:39.486 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-29T04:07:39.487 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-29T04:07:39.555 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-29T04:07:39.555 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-29T04:07:39.623 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-29T04:07:39.623 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-29T04:07:39.691 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-29T04:07:39.691 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-29T04:07:39.757 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-03-29T04:07:39.758 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-29T04:07:39.790 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-03-29T04:07:39.790 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-03-29T04:07:39.862 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-03-29T04:07:39.862 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-03-29T04:07:39.932 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-03-29T04:07:39.932 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-03-29T04:07:40.002 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-03-29T04:07:40.002 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-03-29T04:07:40.072 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-03-29T04:07:40.072 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-03-29T04:07:40.141 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-03-29T04:07:40.141 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-03-29T04:07:40.209 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-29T04:07:40.210 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-29T04:07:40.226 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-29T04:07:40.226 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-03-29T04:07:40.281 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-03-29T04:07:40.281 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-03-29T04:07:40.297 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-03-29T04:07:40.297 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-03-29T04:07:40.353 INFO:tasks.ceph:Adding keys to all mons... 2024-03-29T04:07:40.353 DEBUG:teuthology.orchestra.run.smithi073:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-29T04:07:40.356 DEBUG:teuthology.orchestra.run.smithi142:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-29T04:07:40.397 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.y] 2024-03-29T04:07:40.397 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBsPgZmk+9wGRAANXyu+CsicjdtWrrcdyNsSw== 2024-03-29T04:07:40.397 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2024-03-29T04:07:40.397 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBsPgZmbtrWIBAAmGRwkJNfTBMaITR8H8NhHw== 2024-03-29T04:07:40.397 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.c] 2024-03-29T04:07:40.397 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBsPgZmuTk1KBAAYLpWNId/qCOTs2lezhvi2g== 2024-03-29T04:07:40.397 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.0] 2024-03-29T04:07:40.397 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBwPgZmCjcOHBAA/unr5MXeoszbia8j49R+FQ== 2024-03-29T04:07:40.397 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.1] 2024-03-29T04:07:40.397 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBzPgZmCZP/GhAAZHP2KwvOJbcqbDAPylV1Vg== 2024-03-29T04:07:40.397 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.2] 2024-03-29T04:07:40.398 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQB2PgZmArgIGRAAmVnKN0lm0flaVX5Ffh2bfw== 2024-03-29T04:07:40.398 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.3] 2024-03-29T04:07:40.398 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQB5PgZmCBzxFxAARl70C8xea/p0m/EUbu2wKg== 2024-03-29T04:07:40.398 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.x] 2024-03-29T04:07:40.398 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBsPgZmScduHRAAHZaC0AXkDLCLjbgq/b+kRA== 2024-03-29T04:07:40.398 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2024-03-29T04:07:40.398 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBsPgZmoKE0LRAAH+HRzN4Dv6qWaNe1jpgteQ== 2024-03-29T04:07:40.398 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.d] 2024-03-29T04:07:40.398 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBsPgZm556YNBAABXBNlnBVlX+xrqxiVIgwHg== 2024-03-29T04:07:40.398 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.4] 2024-03-29T04:07:40.398 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQB/PgZmgF8SHhAAtBYaoMvuQyvvuzrleZqVqw== 2024-03-29T04:07:40.398 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.5] 2024-03-29T04:07:40.399 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCCPgZmhBxbHRAA6BHSen4zRfZRdnmacUQ4bg== 2024-03-29T04:07:40.399 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.6] 2024-03-29T04:07:40.399 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCFPgZmPDfgGxAAsxeU6LMQGc4EVgKPHq+pyQ== 2024-03-29T04:07:40.399 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.7] 2024-03-29T04:07:40.399 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCIPgZmtBeCGhAAUI+egjXzjuruPlLnEEf7MA== 2024-03-29T04:07:40.399 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2024-03-29T04:07:40.399 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBsPgZm/zLXOBAAAojJQ+pg3lyn0+VyZVyLKw== 2024-03-29T04:07:40.399 INFO:teuthology.orchestra.run.smithi073.stdout:[client.2] 2024-03-29T04:07:40.399 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBtPgZmtMcKAxAAxRLI4wRGUT3ts8OUVrxPWQ== 2024-03-29T04:07:40.399 INFO:teuthology.orchestra.run.smithi073.stdout:[client.1] 2024-03-29T04:07:40.399 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBtPgZmSCKOBhAA4YXl0zs1aLQ+bnawYPPBUw== 2024-03-29T04:07:40.399 INFO:teuthology.orchestra.run.smithi073.stdout:[client.3] 2024-03-29T04:07:40.400 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBtPgZmlKfwCRAAsXfKUvhO/pyIrMUMcoeJqg== 2024-03-29T04:07:40.420 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.y] 2024-03-29T04:07:40.420 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBsPgZmk+9wGRAANXyu+CsicjdtWrrcdyNsSw== 2024-03-29T04:07:40.420 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.a] 2024-03-29T04:07:40.420 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBsPgZmbtrWIBAAmGRwkJNfTBMaITR8H8NhHw== 2024-03-29T04:07:40.420 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.c] 2024-03-29T04:07:40.420 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBsPgZmuTk1KBAAYLpWNId/qCOTs2lezhvi2g== 2024-03-29T04:07:40.421 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.0] 2024-03-29T04:07:40.421 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBwPgZmCjcOHBAA/unr5MXeoszbia8j49R+FQ== 2024-03-29T04:07:40.421 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.1] 2024-03-29T04:07:40.421 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBzPgZmCZP/GhAAZHP2KwvOJbcqbDAPylV1Vg== 2024-03-29T04:07:40.421 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.2] 2024-03-29T04:07:40.421 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQB2PgZmArgIGRAAmVnKN0lm0flaVX5Ffh2bfw== 2024-03-29T04:07:40.421 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.3] 2024-03-29T04:07:40.421 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQB5PgZmCBzxFxAARl70C8xea/p0m/EUbu2wKg== 2024-03-29T04:07:40.421 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.x] 2024-03-29T04:07:40.421 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBsPgZmScduHRAAHZaC0AXkDLCLjbgq/b+kRA== 2024-03-29T04:07:40.421 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.b] 2024-03-29T04:07:40.421 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBsPgZmoKE0LRAAH+HRzN4Dv6qWaNe1jpgteQ== 2024-03-29T04:07:40.421 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.d] 2024-03-29T04:07:40.421 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBsPgZm556YNBAABXBNlnBVlX+xrqxiVIgwHg== 2024-03-29T04:07:40.421 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.4] 2024-03-29T04:07:40.422 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQB/PgZmgF8SHhAAtBYaoMvuQyvvuzrleZqVqw== 2024-03-29T04:07:40.422 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.5] 2024-03-29T04:07:40.422 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCCPgZmhBxbHRAA6BHSen4zRfZRdnmacUQ4bg== 2024-03-29T04:07:40.422 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.6] 2024-03-29T04:07:40.422 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCFPgZmPDfgGxAAsxeU6LMQGc4EVgKPHq+pyQ== 2024-03-29T04:07:40.422 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.7] 2024-03-29T04:07:40.422 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQCIPgZmtBeCGhAAUI+egjXzjuruPlLnEEf7MA== 2024-03-29T04:07:40.422 INFO:teuthology.orchestra.run.smithi142.stdout:[client.0] 2024-03-29T04:07:40.422 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBsPgZm/zLXOBAAAojJQ+pg3lyn0+VyZVyLKw== 2024-03-29T04:07:40.422 INFO:teuthology.orchestra.run.smithi142.stdout:[client.2] 2024-03-29T04:07:40.422 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBtPgZmtMcKAxAAxRLI4wRGUT3ts8OUVrxPWQ== 2024-03-29T04:07:40.422 INFO:teuthology.orchestra.run.smithi142.stdout:[client.1] 2024-03-29T04:07:40.422 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBtPgZmSCKOBhAA4YXl0zs1aLQ+bnawYPPBUw== 2024-03-29T04:07:40.423 INFO:teuthology.orchestra.run.smithi142.stdout:[client.3] 2024-03-29T04:07:40.423 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBtPgZmlKfwCRAAsXfKUvhO/pyIrMUMcoeJqg== 2024-03-29T04:07:40.423 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-29T04:07:40.443 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-29T04:07:40.517 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-29T04:07:40.519 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-29T04:07:40.573 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-29T04:07:40.576 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-29T04:07:40.630 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-29T04:07:40.632 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-29T04:07:40.684 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-29T04:07:40.686 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-29T04:07:40.738 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-29T04:07:40.740 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-29T04:07:40.794 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-29T04:07:40.796 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-29T04:07:40.848 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-29T04:07:40.850 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-29T04:07:40.902 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-29T04:07:40.905 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-29T04:07:40.960 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-29T04:07:40.962 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-29T04:07:41.018 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-29T04:07:41.020 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-29T04:07:41.072 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-29T04:07:41.074 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-29T04:07:41.127 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-29T04:07:41.129 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-29T04:07:41.183 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-29T04:07:41.185 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-29T04:07:41.237 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-29T04:07:41.239 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-29T04:07:41.294 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-29T04:07:41.296 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-29T04:07:41.350 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-29T04:07:41.353 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-29T04:07:41.410 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-29T04:07:41.414 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-29T04:07:41.470 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-29T04:07:41.470 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-29T04:07:41.497 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-29T04:07:41.593 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-29T04:07:41.621 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-03-29T04:07:41.648 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-29T04:07:41.746 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-03-29T04:07:41.773 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-03-29T04:07:41.840 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-29T04:07:41.939 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-03-29T04:07:41.965 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-29T04:07:41.968 DEBUG:teuthology.orchestra.run.smithi142:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-29T04:07:42.021 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-29T04:07:42.022 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-29T04:07:42.022 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-29T04:07:42.027 INFO:tasks.ceph.mon.a:Started 2024-03-29T04:07:42.027 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-29T04:07:42.027 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-29T04:07:42.064 INFO:tasks.ceph.mon.b:Started 2024-03-29T04:07:42.064 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-29T04:07:42.064 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-29T04:07:42.066 INFO:tasks.ceph.mon.c:Started 2024-03-29T04:07:42.066 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-29T04:07:42.066 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-03-29T04:07:42.066 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-03-29T04:07:42.068 INFO:tasks.ceph.mgr.y:Started 2024-03-29T04:07:42.069 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-29T04:07:42.069 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-03-29T04:07:42.071 INFO:tasks.ceph.mgr.x:Started 2024-03-29T04:07:42.071 INFO:tasks.ceph:Setting crush tunables to default 2024-03-29T04:07:42.071 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd crush tunables default 2024-03-29T04:07:42.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:42.193+0000 7fea85b31640 1 Processor -- start 2024-03-29T04:07:42.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:42.193+0000 7fea85b31640 1 -- start start 2024-03-29T04:07:42.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:42.194+0000 7fea85b31640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fea80161db0 0x7fea800b0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:42.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:42.194+0000 7fea85b31640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea800b61b0 0x7fea800b07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:42.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:42.194+0000 7fea85b31640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea800b6690 con 0x7fea8009aa30 2024-03-29T04:07:42.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:42.194+0000 7fea85b31640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fea8006b510 con 0x7fea80161db0 2024-03-29T04:07:42.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:42.194+0000 7fea85b31640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fea8006bdb0 con 0x7fea800b61b0 2024-03-29T04:07:42.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:42.194+0000 7fea7ffff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fea8009aa30 0x7fea80162560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:54080/0 (socket says 172.21.15.73:54080) 2024-03-29T04:07:42.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:42.194+0000 7fea7ffff640 1 -- 172.21.15.73:0/2841870465 learned_addr learned my addr 172.21.15.73:0/2841870465 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:07:42.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:42.194+0000 7fea7effd640 1 --2- 172.21.15.73:0/2841870465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea800b61b0 0x7fea800b07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:42.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:42.194+0000 7fea7f7fe640 1 --2- 172.21.15.73:0/2841870465 >> v2:172.21.15.142:3300/0 conn(0x7fea80161db0 0x7fea800b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:42.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:42.194+0000 7fea7effd640 1 -- 172.21.15.73:0/2841870465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea800b61b0 msgr2=0x7fea800b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-29T04:07:42.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:42.194+0000 7fea7effd640 1 -- 172.21.15.73:0/2841870465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea800b61b0 msgr2=0x7fea800b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-29T04:07:42.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:42.194+0000 7fea7effd640 1 --2- 172.21.15.73:0/2841870465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea800b61b0 0x7fea800b07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-29T04:07:42.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:42.194+0000 7fea7effd640 1 --2- 172.21.15.73:0/2841870465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea800b61b0 0x7fea800b07b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-29T04:07:42.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:42.194+0000 7fea7f7fe640 1 -- 172.21.15.73:0/2841870465 >> v2:172.21.15.142:3300/0 conn(0x7fea80161db0 msgr2=0x7fea800b0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-29T04:07:42.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:42.194+0000 7fea7f7fe640 1 -- 172.21.15.73:0/2841870465 >> v2:172.21.15.142:3300/0 conn(0x7fea80161db0 msgr2=0x7fea800b0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-29T04:07:42.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:42.194+0000 7fea7f7fe640 1 --2- 172.21.15.73:0/2841870465 >> v2:172.21.15.142:3300/0 conn(0x7fea80161db0 0x7fea800b0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-29T04:07:42.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:42.194+0000 7fea7f7fe640 1 --2- 172.21.15.73:0/2841870465 >> v2:172.21.15.142:3300/0 conn(0x7fea80161db0 0x7fea800b0270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-29T04:07:42.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:42.395+0000 7fea7f7fe640 1 --2- 172.21.15.73:0/2841870465 >> v2:172.21.15.142:3300/0 conn(0x7fea80161db0 0x7fea800b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:42.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:42.395+0000 7fea7effd640 1 --2- 172.21.15.73:0/2841870465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea800b61b0 0x7fea800b07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:42.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:42.395+0000 7fea7effd640 1 -- 172.21.15.73:0/2841870465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea800b61b0 msgr2=0x7fea800b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-29T04:07:42.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:42.395+0000 7fea7effd640 1 -- 172.21.15.73:0/2841870465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea800b61b0 msgr2=0x7fea800b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-29T04:07:42.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:42.395+0000 7fea7effd640 1 --2- 172.21.15.73:0/2841870465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea800b61b0 0x7fea800b07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-29T04:07:42.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:42.395+0000 7fea7effd640 1 --2- 172.21.15.73:0/2841870465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea800b61b0 0x7fea800b07b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-29T04:07:42.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:42.395+0000 7fea7f7fe640 1 -- 172.21.15.73:0/2841870465 >> v2:172.21.15.142:3300/0 conn(0x7fea80161db0 msgr2=0x7fea800b0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-29T04:07:42.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:42.395+0000 7fea7f7fe640 1 -- 172.21.15.73:0/2841870465 >> v2:172.21.15.142:3300/0 conn(0x7fea80161db0 msgr2=0x7fea800b0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-29T04:07:42.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:42.395+0000 7fea7f7fe640 1 --2- 172.21.15.73:0/2841870465 >> v2:172.21.15.142:3300/0 conn(0x7fea80161db0 0x7fea800b0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-29T04:07:42.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:42.395+0000 7fea7f7fe640 1 --2- 172.21.15.73:0/2841870465 >> v2:172.21.15.142:3300/0 conn(0x7fea80161db0 0x7fea800b0270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-29T04:07:42.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:42.796+0000 7fea7effd640 1 --2- 172.21.15.73:0/2841870465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea800b61b0 0x7fea800b07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:42.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:42.796+0000 7fea7f7fe640 1 --2- 172.21.15.73:0/2841870465 >> v2:172.21.15.142:3300/0 conn(0x7fea80161db0 0x7fea800b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:42.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:42.796+0000 7fea7effd640 1 -- 172.21.15.73:0/2841870465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea800b61b0 msgr2=0x7fea800b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-29T04:07:42.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:42.796+0000 7fea7effd640 1 -- 172.21.15.73:0/2841870465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea800b61b0 msgr2=0x7fea800b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-29T04:07:42.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:42.796+0000 7fea7effd640 1 --2- 172.21.15.73:0/2841870465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea800b61b0 0x7fea800b07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-29T04:07:42.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:42.796+0000 7fea7effd640 1 --2- 172.21.15.73:0/2841870465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea800b61b0 0x7fea800b07b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-29T04:07:42.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:42.796+0000 7fea7f7fe640 1 -- 172.21.15.73:0/2841870465 >> v2:172.21.15.142:3300/0 conn(0x7fea80161db0 msgr2=0x7fea800b0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-29T04:07:42.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:42.796+0000 7fea7f7fe640 1 -- 172.21.15.73:0/2841870465 >> v2:172.21.15.142:3300/0 conn(0x7fea80161db0 msgr2=0x7fea800b0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-29T04:07:42.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:42.796+0000 7fea7f7fe640 1 --2- 172.21.15.73:0/2841870465 >> v2:172.21.15.142:3300/0 conn(0x7fea80161db0 0x7fea800b0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-29T04:07:42.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:42.796+0000 7fea7f7fe640 1 --2- 172.21.15.73:0/2841870465 >> v2:172.21.15.142:3300/0 conn(0x7fea80161db0 0x7fea800b0270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-29T04:07:43.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:43.597+0000 7fea7effd640 1 --2- 172.21.15.73:0/2841870465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea800b61b0 0x7fea800b07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:43.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:43.597+0000 7fea7f7fe640 1 --2- 172.21.15.73:0/2841870465 >> v2:172.21.15.142:3300/0 conn(0x7fea80161db0 0x7fea800b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:43.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:43.597+0000 7fea7effd640 1 -- 172.21.15.73:0/2841870465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea800b61b0 msgr2=0x7fea800b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-29T04:07:43.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:43.597+0000 7fea7effd640 1 -- 172.21.15.73:0/2841870465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea800b61b0 msgr2=0x7fea800b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-29T04:07:43.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:43.597+0000 7fea7effd640 1 --2- 172.21.15.73:0/2841870465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea800b61b0 0x7fea800b07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-29T04:07:43.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:43.597+0000 7fea7effd640 1 --2- 172.21.15.73:0/2841870465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea800b61b0 0x7fea800b07b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-29T04:07:43.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:43.597+0000 7fea7f7fe640 1 -- 172.21.15.73:0/2841870465 >> v2:172.21.15.142:3300/0 conn(0x7fea80161db0 msgr2=0x7fea800b0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-29T04:07:43.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:43.597+0000 7fea7f7fe640 1 -- 172.21.15.73:0/2841870465 >> v2:172.21.15.142:3300/0 conn(0x7fea80161db0 msgr2=0x7fea800b0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-29T04:07:43.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:43.597+0000 7fea7f7fe640 1 --2- 172.21.15.73:0/2841870465 >> v2:172.21.15.142:3300/0 conn(0x7fea80161db0 0x7fea800b0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-29T04:07:43.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:43.597+0000 7fea7f7fe640 1 --2- 172.21.15.73:0/2841870465 >> v2:172.21.15.142:3300/0 conn(0x7fea80161db0 0x7fea800b0270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-29T04:07:45.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:45.195+0000 7fea7d7fa640 1 -- 172.21.15.73:0/2841870465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea800b61b0 msgr2=0x7fea800b07b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-29T04:07:45.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:45.195+0000 7fea7d7fa640 1 --2- 172.21.15.73:0/2841870465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea800b61b0 0x7fea800b07b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:45.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:45.195+0000 7fea7d7fa640 1 -- 172.21.15.73:0/2841870465 >> v2:172.21.15.142:3300/0 conn(0x7fea80161db0 msgr2=0x7fea800b0270 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-29T04:07:45.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:45.195+0000 7fea7d7fa640 1 --2- 172.21.15.73:0/2841870465 >> v2:172.21.15.142:3300/0 conn(0x7fea80161db0 0x7fea800b0270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:45.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:45.195+0000 7fea7d7fa640 1 -- 172.21.15.73:0/2841870465 >> v1:172.21.15.73:6789/0 conn(0x7fea8009aa30 legacy=0x7fea80162560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:45.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:45.195+0000 7fea7d7fa640 1 --2- 172.21.15.73:0/2841870465 >> v2:172.21.15.73:3300/0 conn(0x7fea6c007350 0x7fea6c009810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:45.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:45.195+0000 7fea7d7fa640 1 -- 172.21.15.73:0/2841870465 --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea8006b760 con 0x7fea6c0036e0 2024-03-29T04:07:45.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:45.195+0000 7fea7d7fa640 1 -- 172.21.15.73:0/2841870465 --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fea8006b510 con 0x7fea6c007350 2024-03-29T04:07:45.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:45.195+0000 7fea7effd640 1 --2- 172.21.15.73:0/2841870465 >> v2:172.21.15.73:3300/0 conn(0x7fea6c007350 0x7fea6c009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:45.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:45.195+0000 7fea7effd640 1 -- 172.21.15.73:0/2841870465 >> v2:172.21.15.73:3300/0 conn(0x7fea6c007350 msgr2=0x7fea6c009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-29T04:07:45.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:45.195+0000 7fea7effd640 1 -- 172.21.15.73:0/2841870465 >> v2:172.21.15.73:3300/0 conn(0x7fea6c007350 msgr2=0x7fea6c009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-29T04:07:45.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:45.195+0000 7fea7effd640 1 --2- 172.21.15.73:0/2841870465 >> v2:172.21.15.73:3300/0 conn(0x7fea6c007350 0x7fea6c009810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-29T04:07:45.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:45.195+0000 7fea7effd640 1 --2- 172.21.15.73:0/2841870465 >> v2:172.21.15.73:3300/0 conn(0x7fea6c007350 0x7fea6c009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-29T04:07:45.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:45.396+0000 7fea7effd640 1 --2- 172.21.15.73:0/2841870465 >> v2:172.21.15.73:3300/0 conn(0x7fea6c007350 0x7fea6c009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:45.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:45.396+0000 7fea7effd640 1 -- 172.21.15.73:0/2841870465 >> v2:172.21.15.73:3300/0 conn(0x7fea6c007350 msgr2=0x7fea6c009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-29T04:07:45.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:45.396+0000 7fea7effd640 1 -- 172.21.15.73:0/2841870465 >> v2:172.21.15.73:3300/0 conn(0x7fea6c007350 msgr2=0x7fea6c009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-29T04:07:45.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:45.396+0000 7fea7effd640 1 --2- 172.21.15.73:0/2841870465 >> v2:172.21.15.73:3300/0 conn(0x7fea6c007350 0x7fea6c009810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-29T04:07:45.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:45.396+0000 7fea7effd640 1 --2- 172.21.15.73:0/2841870465 >> v2:172.21.15.73:3300/0 conn(0x7fea6c007350 0x7fea6c009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-29T04:07:45.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:45.797+0000 7fea7effd640 1 --2- 172.21.15.73:0/2841870465 >> v2:172.21.15.73:3300/0 conn(0x7fea6c007350 0x7fea6c009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:45.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:45.797+0000 7fea7effd640 1 -- 172.21.15.73:0/2841870465 >> v2:172.21.15.73:3300/0 conn(0x7fea6c007350 msgr2=0x7fea6c009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-29T04:07:45.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:45.797+0000 7fea7effd640 1 -- 172.21.15.73:0/2841870465 >> v2:172.21.15.73:3300/0 conn(0x7fea6c007350 msgr2=0x7fea6c009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-29T04:07:45.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:45.797+0000 7fea7effd640 1 --2- 172.21.15.73:0/2841870465 >> v2:172.21.15.73:3300/0 conn(0x7fea6c007350 0x7fea6c009810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-29T04:07:45.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:45.797+0000 7fea7effd640 1 --2- 172.21.15.73:0/2841870465 >> v2:172.21.15.73:3300/0 conn(0x7fea6c007350 0x7fea6c009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-29T04:07:46.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:46.598+0000 7fea7effd640 1 --2- 172.21.15.73:0/2841870465 >> v2:172.21.15.73:3300/0 conn(0x7fea6c007350 0x7fea6c009810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:46.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:46.598+0000 7fea7effd640 1 -- 172.21.15.73:0/2841870465 >> v2:172.21.15.73:3300/0 conn(0x7fea6c007350 msgr2=0x7fea6c009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-29T04:07:46.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:46.598+0000 7fea7effd640 1 -- 172.21.15.73:0/2841870465 >> v2:172.21.15.73:3300/0 conn(0x7fea6c007350 msgr2=0x7fea6c009810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-29T04:07:46.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:46.598+0000 7fea7effd640 1 --2- 172.21.15.73:0/2841870465 >> v2:172.21.15.73:3300/0 conn(0x7fea6c007350 0x7fea6c009810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-29T04:07:46.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:46.598+0000 7fea7effd640 1 --2- 172.21.15.73:0/2841870465 >> v2:172.21.15.73:3300/0 conn(0x7fea6c007350 0x7fea6c009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-29T04:07:47.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.357+0000 7fea7e7fc640 1 -- 172.21.15.73:0/2841870465 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1697038333 0 0) 0x7fea8006b760 con 0x7fea6c0036e0 2024-03-29T04:07:47.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.357+0000 7fea7e7fc640 1 -- 172.21.15.73:0/2841870465 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea68003520 con 0x7fea6c0036e0 2024-03-29T04:07:47.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.358+0000 7fea7e7fc640 1 -- 172.21.15.73:0/2841870465 <== mon.1 v1:172.21.15.142:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2061463203 0 0) 0x7fea68003520 con 0x7fea6c0036e0 2024-03-29T04:07:47.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.358+0000 7fea7e7fc640 1 -- 172.21.15.73:0/2841870465 >> v2:172.21.15.73:3300/0 conn(0x7fea6c007350 msgr2=0x7fea6c009810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-29T04:07:47.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.358+0000 7fea7e7fc640 1 --2- 172.21.15.73:0/2841870465 >> v2:172.21.15.73:3300/0 conn(0x7fea6c007350 0x7fea6c009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:47.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.358+0000 7fea7e7fc640 1 -- 172.21.15.73:0/2841870465 --> v1:172.21.15.142:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea6c00af70 con 0x7fea6c0036e0 2024-03-29T04:07:47.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.358+0000 7fea7e7fc640 1 -- 172.21.15.73:0/2841870465 <== mon.1 v1:172.21.15.142:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1290421750 0 0) 0x7fea7000d580 con 0x7fea6c0036e0 2024-03-29T04:07:47.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.358+0000 7fea7e7fc640 1 -- 172.21.15.73:0/2841870465 >> v1:172.21.15.142:6789/0 conn(0x7fea6c0036e0 legacy=0x7fea6c005b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:47.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.358+0000 7fea7ffff640 1 -- 172.21.15.73:0/2841870465 reap_dead start 2024-03-29T04:07:47.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.358+0000 7fea7e7fc640 1 --2- 172.21.15.73:0/2841870465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea68003a00 0x7fea68003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:47.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.358+0000 7fea7e7fc640 1 --2- 172.21.15.73:0/2841870465 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea68004800 0x7fea68004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:47.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.358+0000 7fea7e7fc640 1 --2- 172.21.15.73:0/2841870465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea680053c0 0x7fea6800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:47.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.358+0000 7fea7e7fc640 1 -- 172.21.15.73:0/2841870465 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fea8006b510 con 0x7fea68004800 2024-03-29T04:07:47.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.358+0000 7fea7e7fc640 1 -- 172.21.15.73:0/2841870465 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fea6800c280 con 0x7fea680053c0 2024-03-29T04:07:47.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.358+0000 7fea7e7fc640 1 -- 172.21.15.73:0/2841870465 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fea6800c480 con 0x7fea68003a00 2024-03-29T04:07:47.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.358+0000 7fea7effd640 1 --2- 172.21.15.73:0/2841870465 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea68004800 0x7fea68004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:47.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.358+0000 7fea7ffff640 1 --2- 172.21.15.73:0/2841870465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea680053c0 0x7fea6800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:47.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.358+0000 7fea7f7fe640 1 --2- 172.21.15.73:0/2841870465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea68003a00 0x7fea68003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:47.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.359+0000 7fea7effd640 1 -- 172.21.15.73:0/2841870465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea68003a00 msgr2=0x7fea68003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:07:47.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.359+0000 7fea7effd640 1 --2- 172.21.15.73:0/2841870465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea68003a00 0x7fea68003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:47.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.359+0000 7fea7effd640 1 -- 172.21.15.73:0/2841870465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea680053c0 msgr2=0x7fea6800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:07:47.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.359+0000 7fea7effd640 1 --2- 172.21.15.73:0/2841870465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea680053c0 0x7fea6800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:47.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.359+0000 7fea7effd640 1 -- 172.21.15.73:0/2841870465 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea68003520 con 0x7fea68004800 2024-03-29T04:07:47.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.359+0000 7fea7ffff640 1 --2- 172.21.15.73:0/2841870465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea680053c0 0x7fea6800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:07:47.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.360+0000 7fea7effd640 1 --2- 172.21.15.73:0/2841870465 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea68004800 0x7fea68004c80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fea74019cc0 tx=0x7fea68005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5101150ff818a050 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:07:47.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.362+0000 7fea7e7fc640 1 -- 172.21.15.73:0/2841870465 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea74019940 con 0x7fea68004800 2024-03-29T04:07:47.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.362+0000 7fea7e7fc640 1 -- 172.21.15.73:0/2841870465 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea7402f500 con 0x7fea68004800 2024-03-29T04:07:47.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.362+0000 7fea7e7fc640 1 -- 172.21.15.73:0/2841870465 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7402f910 con 0x7fea68004800 2024-03-29T04:07:47.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.363+0000 7fea85b31640 1 -- 172.21.15.73:0/2841870465 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea68004800 msgr2=0x7fea68004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:47.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.363+0000 7fea85b31640 1 --2- 172.21.15.73:0/2841870465 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea68004800 0x7fea68004c80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fea74019cc0 tx=0x7fea68005830 comp rx=0 tx=0).stop 2024-03-29T04:07:47.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.363+0000 7fea85b31640 1 -- 172.21.15.73:0/2841870465 shutdown_connections 2024-03-29T04:07:47.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.363+0000 7fea85b31640 1 --2- 172.21.15.73:0/2841870465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea680053c0 0x7fea6800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:47.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.363+0000 7fea85b31640 1 --2- 172.21.15.73:0/2841870465 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea68004800 0x7fea68004c80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:47.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.363+0000 7fea85b31640 1 --2- 172.21.15.73:0/2841870465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea68003a00 0x7fea68003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:47.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.363+0000 7fea85b31640 1 -- 172.21.15.73:0/2841870465 >> 172.21.15.73:0/2841870465 conn(0x7fea800b6a80 msgr2=0x7fea800b3040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:07:47.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.363+0000 7fea85b31640 1 -- 172.21.15.73:0/2841870465 shutdown_connections 2024-03-29T04:07:47.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.363+0000 7fea85b31640 1 -- 172.21.15.73:0/2841870465 wait complete. 2024-03-29T04:07:47.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.364+0000 7fea85b31640 1 Processor -- start 2024-03-29T04:07:47.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.365+0000 7fea85b31640 1 -- start start 2024-03-29T04:07:47.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.366+0000 7fea85b31640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea68003a00 0x7fea80159c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:47.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.366+0000 7fea85b31640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea68004800 0x7fea8014dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:47.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.366+0000 7fea85b31640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea680053c0 0x7fea8015d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:47.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.366+0000 7fea85b31640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fea80162310 con 0x7fea68004800 2024-03-29T04:07:47.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.366+0000 7fea85b31640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fea80162190 con 0x7fea680053c0 2024-03-29T04:07:47.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.366+0000 7fea85b31640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fea80070860 con 0x7fea68003a00 2024-03-29T04:07:47.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.366+0000 7fea7effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea68004800 0x7fea8014dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:47.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.366+0000 7fea7f7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea68003a00 0x7fea80159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:47.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.366+0000 7fea7effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea68004800 0x7fea8014dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53656/0 (socket says 172.21.15.73:53656) 2024-03-29T04:07:47.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.366+0000 7fea7effd640 1 -- 172.21.15.73:0/18885112 learned_addr learned my addr 172.21.15.73:0/18885112 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:07:47.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.366+0000 7fea7ffff640 1 --2- 172.21.15.73:0/18885112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea680053c0 0x7fea8015d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:47.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.366+0000 7fea7effd640 1 -- 172.21.15.73:0/18885112 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea68003a00 msgr2=0x7fea80159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:47.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.366+0000 7fea7effd640 1 --2- 172.21.15.73:0/18885112 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea68003a00 0x7fea80159c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:47.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.366+0000 7fea7effd640 1 -- 172.21.15.73:0/18885112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea680053c0 msgr2=0x7fea8015d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:47.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.366+0000 7fea7effd640 1 --2- 172.21.15.73:0/18885112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea680053c0 0x7fea8015d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:47.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.366+0000 7fea7effd640 1 -- 172.21.15.73:0/18885112 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea80158ac0 con 0x7fea68004800 2024-03-29T04:07:47.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.366+0000 7fea7effd640 1 --2- 172.21.15.73:0/18885112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea68004800 0x7fea8014dea0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fea74019de0 tx=0x7fea740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:07:47.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.368+0000 7fea67fff640 1 -- 172.21.15.73:0/18885112 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7403e040 con 0x7fea68004800 2024-03-29T04:07:47.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.368+0000 7fea67fff640 1 -- 172.21.15.73:0/18885112 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea74049070 con 0x7fea68004800 2024-03-29T04:07:47.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.368+0000 7fea85b31640 1 -- 172.21.15.73:0/18885112 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea80157f40 con 0x7fea68004800 2024-03-29T04:07:47.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.368+0000 7fea67fff640 1 -- 172.21.15.73:0/18885112 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea74019940 con 0x7fea68004800 2024-03-29T04:07:47.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.368+0000 7fea85b31640 1 -- 172.21.15.73:0/18885112 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea80158500 con 0x7fea68004800 2024-03-29T04:07:47.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.368+0000 7fea67fff640 1 -- 172.21.15.73:0/18885112 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fea7404e460 con 0x7fea68004800 2024-03-29T04:07:47.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.368+0000 7fea67fff640 1 -- 172.21.15.73:0/18885112 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fea74018540 con 0x7fea68004800 2024-03-29T04:07:47.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.369+0000 7fea85b31640 1 -- 172.21.15.73:0/18885112 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea8009f6a0 con 0x7fea68004800 2024-03-29T04:07:47.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.371+0000 7fea67fff640 1 -- 172.21.15.73:0/18885112 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fea74018790 con 0x7fea68004800 2024-03-29T04:07:47.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.440+0000 7fea85b31640 1 -- 172.21.15.73:0/18885112 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fea800cda40 con 0x7fea68004800 2024-03-29T04:07:47.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.443+0000 7fea67fff640 1 -- 172.21.15.73:0/18885112 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fea74018970 con 0x7fea68004800 2024-03-29T04:07:47.423 INFO:teuthology.orchestra.run.smithi073.stderr:adjusted tunables profile to default 2024-03-29T04:07:47.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.444+0000 7fea85b31640 1 -- 172.21.15.73:0/18885112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea68004800 msgr2=0x7fea8014dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:47.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.444+0000 7fea85b31640 1 --2- 172.21.15.73:0/18885112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea68004800 0x7fea8014dea0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fea74019de0 tx=0x7fea740046c0 comp rx=0 tx=0).stop 2024-03-29T04:07:47.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.444+0000 7fea85b31640 1 -- 172.21.15.73:0/18885112 shutdown_connections 2024-03-29T04:07:47.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.444+0000 7fea85b31640 1 --2- 172.21.15.73:0/18885112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea680053c0 0x7fea8015d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:47.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.444+0000 7fea85b31640 1 --2- 172.21.15.73:0/18885112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea68004800 0x7fea8014dea0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:47.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.444+0000 7fea85b31640 1 --2- 172.21.15.73:0/18885112 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea68003a00 0x7fea80159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:47.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.444+0000 7fea85b31640 1 -- 172.21.15.73:0/18885112 >> 172.21.15.73:0/18885112 conn(0x7fea800b6a80 msgr2=0x7fea80161140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:07:47.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.445+0000 7fea85b31640 1 -- 172.21.15.73:0/18885112 shutdown_connections 2024-03-29T04:07:47.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:47.445+0000 7fea85b31640 1 -- 172.21.15.73:0/18885112 wait complete. 2024-03-29T04:07:47.436 INFO:tasks.ceph:check_enable_crimson: False 2024-03-29T04:07:47.436 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-29T04:07:47.436 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-29T04:07:47.437 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-29T04:07:47.464 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-29T04:07:47.464 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-29T04:07:47.531 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-29T04:07:47.531 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-29T04:07:47.598 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-29T04:07:47.598 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-29T04:07:47.665 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-03-29T04:07:47.665 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-03-29T04:07:47.693 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-03-29T04:07:47.694 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-03-29T04:07:47.761 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-03-29T04:07:47.761 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-03-29T04:07:47.812 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-03-29T04:07:47.832+0000 7fdd900fa040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-29T04:07:47.812 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-29T04:07:47.832+0000 7fde0a845040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-29T04:07:47.828 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-03-29T04:07:47.829 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-03-29T04:07:47.866 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-29T04:07:47.886+0000 7fde0a845040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-29T04:07:47.868 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-03-29T04:07:47.888+0000 7fdd900fa040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-29T04:07:47.894 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 925d7de1-14ab-48c0-aebd-7bded108f808 0 2024-03-29T04:07:48.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.056+0000 7fcc03eb7640 1 Processor -- start 2024-03-29T04:07:48.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.056+0000 7fcc03eb7640 1 -- start start 2024-03-29T04:07:48.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.057+0000 7fcc03eb7640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcbfc15c7c0 0x7fcbfc09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:48.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.057+0000 7fcc03eb7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcbfc0ce260 0x7fcbfc09af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:48.038 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.057+0000 7fcc03eb7640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbfc0d1140 con 0x7fcbfc09b770 2024-03-29T04:07:48.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.057+0000 7fcc03eb7640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fcbfc15cba0 con 0x7fcbfc15c7c0 2024-03-29T04:07:48.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.057+0000 7fcc03eb7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fcbfc06feb0 con 0x7fcbfc0ce260 2024-03-29T04:07:48.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.057+0000 7fcc01452640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fcbfc09b770 0x7fcbfc070340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:39182/0 (socket says 172.21.15.142:39182) 2024-03-29T04:07:48.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.057+0000 7fcc01452640 1 -- 172.21.15.142:0/1274285465 learned_addr learned my addr 172.21.15.142:0/1274285465 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-03-29T04:07:48.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.057+0000 7fcc02454640 1 --2- 172.21.15.142:0/1274285465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcbfc0ce260 0x7fcbfc09af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:48.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.057+0000 7fcc01c53640 1 --2- 172.21.15.142:0/1274285465 >> v2:172.21.15.73:3300/0 conn(0x7fcbfc15c7c0 0x7fcbfc09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:48.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.057+0000 7fcc00c51640 1 -- 172.21.15.142:0/1274285465 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 873699498 0 0) 0x7fcbfc0d1140 con 0x7fcbfc09b770 2024-03-29T04:07:48.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.057+0000 7fcc00c51640 1 -- 172.21.15.142:0/1274285465 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbe8003520 con 0x7fcbfc09b770 2024-03-29T04:07:48.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.057+0000 7fcc02454640 1 -- 172.21.15.142:0/1274285465 >> v2:172.21.15.73:3300/0 conn(0x7fcbfc15c7c0 msgr2=0x7fcbfc09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:07:48.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.057+0000 7fcc02454640 1 --2- 172.21.15.142:0/1274285465 >> v2:172.21.15.73:3300/0 conn(0x7fcbfc15c7c0 0x7fcbfc09aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:48.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.057+0000 7fcc02454640 1 -- 172.21.15.142:0/1274285465 >> v1:172.21.15.142:6789/0 conn(0x7fcbfc09b770 legacy=0x7fcbfc070340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:48.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.057+0000 7fcc02454640 1 -- 172.21.15.142:0/1274285465 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbfc0d1420 con 0x7fcbfc0ce260 2024-03-29T04:07:48.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.058+0000 7fcc02454640 1 --2- 172.21.15.142:0/1274285465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcbfc0ce260 0x7fcbfc09af70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4009d90 tx=0x7fcbf402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afbaef65748ce549 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:07:48.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.058+0000 7fcc00c51640 1 -- 172.21.15.142:0/1274285465 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf4039070 con 0x7fcbfc0ce260 2024-03-29T04:07:48.039 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.058+0000 7fcc00c51640 1 -- 172.21.15.142:0/1274285465 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbf402cc50 con 0x7fcbfc0ce260 2024-03-29T04:07:48.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.058+0000 7fcc00c51640 1 -- 172.21.15.142:0/1274285465 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf4034440 con 0x7fcbfc0ce260 2024-03-29T04:07:48.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.058+0000 7fcc03eb7640 1 -- 172.21.15.142:0/1274285465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcbfc0ce260 msgr2=0x7fcbfc09af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:48.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.058+0000 7fcc03eb7640 1 --2- 172.21.15.142:0/1274285465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcbfc0ce260 0x7fcbfc09af70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4009d90 tx=0x7fcbf402bea0 comp rx=0 tx=0).stop 2024-03-29T04:07:48.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.058+0000 7fcc03eb7640 1 -- 172.21.15.142:0/1274285465 shutdown_connections 2024-03-29T04:07:48.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.058+0000 7fcc03eb7640 1 --2- 172.21.15.142:0/1274285465 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcbfc0ce260 0x7fcbfc09af70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:48.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.058+0000 7fcc03eb7640 1 --2- 172.21.15.142:0/1274285465 >> v2:172.21.15.73:3300/0 conn(0x7fcbfc15c7c0 0x7fcbfc09aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:48.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.058+0000 7fcc03eb7640 1 -- 172.21.15.142:0/1274285465 >> 172.21.15.142:0/1274285465 conn(0x7fcbfc0d24b0 msgr2=0x7fcbfc0d28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:07:48.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.059+0000 7fcc03eb7640 1 -- 172.21.15.142:0/1274285465 shutdown_connections 2024-03-29T04:07:48.040 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.059+0000 7fcc03eb7640 1 -- 172.21.15.142:0/1274285465 wait complete. 2024-03-29T04:07:48.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.060+0000 7fcc03eb7640 1 Processor -- start 2024-03-29T04:07:48.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.060+0000 7fcc03eb7640 1 -- start start 2024-03-29T04:07:48.042 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.060+0000 7fcc03eb7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbfc09b770 0x7fcbfc0cad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:48.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.060+0000 7fcc03eb7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbfc0ce260 0x7fcbfc1f5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:48.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.060+0000 7fcc03eb7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcbfc15c7c0 0x7fcbfc0cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:48.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.060+0000 7fcc03eb7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fcbfc070a50 con 0x7fcbfc0ce260 2024-03-29T04:07:48.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.060+0000 7fcc03eb7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fcbfc0d0080 con 0x7fcbfc09b770 2024-03-29T04:07:48.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.060+0000 7fcc03eb7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fcbfc070bd0 con 0x7fcbfc15c7c0 2024-03-29T04:07:48.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.060+0000 7fcc01c53640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbfc09b770 0x7fcbfc0cad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:48.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.060+0000 7fcc02454640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcbfc15c7c0 0x7fcbfc0cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:48.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.061+0000 7fcc02454640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcbfc15c7c0 0x7fcbfc0cba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:33820/0 (socket says 172.21.15.142:33820) 2024-03-29T04:07:48.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.061+0000 7fcc01c53640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbfc09b770 0x7fcbfc0cad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38510/0 (socket says 172.21.15.142:38510) 2024-03-29T04:07:48.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.061+0000 7fcc02454640 1 -- 172.21.15.142:0/4492203 learned_addr learned my addr 172.21.15.142:0/4492203 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-03-29T04:07:48.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.061+0000 7fcc01452640 1 --2- 172.21.15.142:0/4492203 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbfc0ce260 0x7fcbfc1f5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:48.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.061+0000 7fcc02454640 1 -- 172.21.15.142:0/4492203 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbfc09b770 msgr2=0x7fcbfc0cad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:48.043 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.061+0000 7fcc02454640 1 --2- 172.21.15.142:0/4492203 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbfc09b770 0x7fcbfc0cad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:48.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.061+0000 7fcc02454640 1 -- 172.21.15.142:0/4492203 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbfc0ce260 msgr2=0x7fcbfc1f5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:48.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.061+0000 7fcc02454640 1 --2- 172.21.15.142:0/4492203 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbfc0ce260 0x7fcbfc1f5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:48.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.061+0000 7fcc02454640 1 -- 172.21.15.142:0/4492203 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbfc0c75e0 con 0x7fcbfc15c7c0 2024-03-29T04:07:48.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.061+0000 7fcc02454640 1 --2- 172.21.15.142:0/4492203 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcbfc15c7c0 0x7fcbfc0cba70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4009eb0 tx=0x7fcbf4004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:07:48.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.061+0000 7fcbf27fc640 1 -- 172.21.15.142:0/4492203 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf4039050 con 0x7fcbfc15c7c0 2024-03-29T04:07:48.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.061+0000 7fcbf27fc640 1 -- 172.21.15.142:0/4492203 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbf4045070 con 0x7fcbfc15c7c0 2024-03-29T04:07:48.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.061+0000 7fcc03eb7640 1 -- 172.21.15.142:0/4492203 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbfc0c78a0 con 0x7fcbfc15c7c0 2024-03-29T04:07:48.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.061+0000 7fcbf27fc640 1 -- 172.21.15.142:0/4492203 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf4009450 con 0x7fcbfc15c7c0 2024-03-29T04:07:48.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.061+0000 7fcc03eb7640 1 -- 172.21.15.142:0/4492203 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbfc0c7e60 con 0x7fcbfc15c7c0 2024-03-29T04:07:48.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.061+0000 7fcbf27fc640 1 -- 172.21.15.142:0/4492203 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcbf403e610 con 0x7fcbfc15c7c0 2024-03-29T04:07:48.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.061+0000 7fcbf27fc640 1 -- 172.21.15.142:0/4492203 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fcbf404a800 con 0x7fcbfc15c7c0 2024-03-29T04:07:48.044 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.062+0000 7fcc03eb7640 1 -- 172.21.15.142:0/4492203 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbfc0a0630 con 0x7fcbfc15c7c0 2024-03-29T04:07:48.045 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.065+0000 7fcbf27fc640 1 -- 172.21.15.142:0/4492203 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fcbf403ea40 con 0x7fcbfc15c7c0 2024-03-29T04:07:48.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.136+0000 7fcc03eb7640 1 -- 172.21.15.142:0/4492203 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "925d7de1-14ab-48c0-aebd-7bded108f808", "id": 0} v 0) -- 0x7fcbfc04f9d0 con 0x7fcbfc15c7c0 2024-03-29T04:07:48.119 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.139+0000 7fcbf27fc640 1 -- 172.21.15.142:0/4492203 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "925d7de1-14ab-48c0-aebd-7bded108f808", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fcbf403ec20 con 0x7fcbfc15c7c0 2024-03-29T04:07:48.119 INFO:teuthology.orchestra.run.smithi142.stdout:0 2024-03-29T04:07:48.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.140+0000 7fcc03eb7640 1 -- 172.21.15.142:0/4492203 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcbfc15c7c0 msgr2=0x7fcbfc0cba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:48.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.140+0000 7fcc03eb7640 1 --2- 172.21.15.142:0/4492203 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcbfc15c7c0 0x7fcbfc0cba70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4009eb0 tx=0x7fcbf4004a40 comp rx=0 tx=0).stop 2024-03-29T04:07:48.120 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.140+0000 7fcc03eb7640 1 -- 172.21.15.142:0/4492203 shutdown_connections 2024-03-29T04:07:48.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.140+0000 7fcc03eb7640 1 --2- 172.21.15.142:0/4492203 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcbfc15c7c0 0x7fcbfc0cba70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:48.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.140+0000 7fcc03eb7640 1 --2- 172.21.15.142:0/4492203 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbfc0ce260 0x7fcbfc1f5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:48.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.140+0000 7fcc03eb7640 1 --2- 172.21.15.142:0/4492203 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcbfc09b770 0x7fcbfc0cad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:48.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.140+0000 7fcc03eb7640 1 -- 172.21.15.142:0/4492203 >> 172.21.15.142:0/4492203 conn(0x7fcbfc0d24b0 msgr2=0x7fcbfc0b1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:07:48.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.140+0000 7fcc03eb7640 1 -- 172.21.15.142:0/4492203 shutdown_connections 2024-03-29T04:07:48.121 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.140+0000 7fcc03eb7640 1 -- 172.21.15.142:0/4492203 wait complete. 2024-03-29T04:07:48.134 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 6b182102-882a-4e0c-99db-0afae5cfb38b 1 2024-03-29T04:07:48.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.254+0000 7f8d88c70640 1 Processor -- start 2024-03-29T04:07:48.234 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.254+0000 7f8d88c70640 1 -- start start 2024-03-29T04:07:48.235 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.255+0000 7f8d88c70640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8d8415b640 0x7f8d840afda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:48.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.255+0000 7f8d88c70640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d840b59c0 0x7f8d8406de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:48.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.255+0000 7f8d88c70640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d840b4ff0 con 0x7f8d8406cac0 2024-03-29T04:07:48.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.255+0000 7f8d88c70640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f8d8415ba20 con 0x7f8d8415b640 2024-03-29T04:07:48.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.255+0000 7f8d88c70640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f8d840b3f00 con 0x7f8d840b59c0 2024-03-29T04:07:48.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.256+0000 7f8d82d9d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d840b59c0 0x7f8d8406de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:48.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.256+0000 7f8d8259c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8d8415b640 0x7f8d840afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:48.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.256+0000 7f8d8259c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8d8415b640 0x7f8d840afda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38518/0 (socket says 172.21.15.142:38518) 2024-03-29T04:07:48.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.256+0000 7f8d8259c640 1 -- 172.21.15.142:0/706613962 learned_addr learned my addr 172.21.15.142:0/706613962 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-03-29T04:07:48.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.256+0000 7f8d82d9d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d840b59c0 0x7f8d8406de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:33828/0 (socket says 172.21.15.142:33828) 2024-03-29T04:07:48.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.256+0000 7f8d82d9d640 1 -- 172.21.15.142:0/706613962 >> v2:172.21.15.142:3300/0 conn(0x7f8d8415b640 msgr2=0x7f8d840afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:07:48.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.256+0000 7f8d82d9d640 1 --2- 172.21.15.142:0/706613962 >> v2:172.21.15.142:3300/0 conn(0x7f8d8415b640 0x7f8d840afda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:48.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.256+0000 7f8d82d9d640 1 -- 172.21.15.142:0/706613962 >> v1:172.21.15.73:6789/0 conn(0x7f8d8406cac0 legacy=0x7f8d840b52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:07:48.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.256+0000 7f8d82d9d640 1 -- 172.21.15.142:0/706613962 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d840b3c20 con 0x7f8d840b59c0 2024-03-29T04:07:48.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.256+0000 7f8d8259c640 1 --2- 172.21.15.142:0/706613962 >> v2:172.21.15.142:3300/0 conn(0x7f8d8415b640 0x7f8d840afda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:07:48.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.257+0000 7f8d82d9d640 1 --2- 172.21.15.142:0/706613962 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d840b59c0 0x7f8d8406de30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8d740097a0 tx=0x7f8d7402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20b04912a85a3bad server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:07:48.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.257+0000 7f8d8159a640 1 -- 172.21.15.142:0/706613962 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d740315a0 con 0x7f8d840b59c0 2024-03-29T04:07:48.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.257+0000 7f8d8159a640 1 -- 172.21.15.142:0/706613962 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d74037070 con 0x7f8d840b59c0 2024-03-29T04:07:48.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.257+0000 7f8d8159a640 1 -- 172.21.15.142:0/706613962 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d74031960 con 0x7f8d840b59c0 2024-03-29T04:07:48.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.257+0000 7f8d88c70640 1 -- 172.21.15.142:0/706613962 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d840b59c0 msgr2=0x7f8d8406de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:48.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.257+0000 7f8d88c70640 1 --2- 172.21.15.142:0/706613962 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d840b59c0 0x7f8d8406de30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8d740097a0 tx=0x7f8d7402b840 comp rx=0 tx=0).stop 2024-03-29T04:07:48.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.257+0000 7f8d88c70640 1 -- 172.21.15.142:0/706613962 shutdown_connections 2024-03-29T04:07:48.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.257+0000 7f8d88c70640 1 --2- 172.21.15.142:0/706613962 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d840b59c0 0x7f8d8406de30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:48.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.257+0000 7f8d88c70640 1 --2- 172.21.15.142:0/706613962 >> v2:172.21.15.142:3300/0 conn(0x7f8d8415b640 0x7f8d840afda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:48.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.257+0000 7f8d88c70640 1 -- 172.21.15.142:0/706613962 >> 172.21.15.142:0/706613962 conn(0x7f8d840d0bb0 msgr2=0x7f8d840d0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:07:48.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.257+0000 7f8d88c70640 1 -- 172.21.15.142:0/706613962 shutdown_connections 2024-03-29T04:07:48.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.257+0000 7f8d88c70640 1 -- 172.21.15.142:0/706613962 wait complete. 2024-03-29T04:07:48.241 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.259+0000 7f8d88c70640 1 Processor -- start 2024-03-29T04:07:48.241 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.259+0000 7f8d88c70640 1 -- start start 2024-03-29T04:07:48.241 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.259+0000 7f8d88c70640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d8406cac0 0x7f8d8414fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:48.241 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.259+0000 7f8d88c70640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d840b59c0 0x7f8d84146590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:48.241 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.259+0000 7f8d88c70640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d8415b640 0x7f8d840ca820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:48.241 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.259+0000 7f8d88c70640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8d840af5a0 con 0x7f8d8406cac0 2024-03-29T04:07:48.241 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.259+0000 7f8d88c70640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8d840af2c0 con 0x7f8d840b59c0 2024-03-29T04:07:48.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.259+0000 7f8d88c70640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f8d840af880 con 0x7f8d8415b640 2024-03-29T04:07:48.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.259+0000 7f8d81d9b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d840b59c0 0x7f8d84146590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:48.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.259+0000 7f8d82d9d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d8415b640 0x7f8d840ca820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:48.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.259+0000 7f8d81d9b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d840b59c0 0x7f8d84146590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38524/0 (socket says 172.21.15.142:38524) 2024-03-29T04:07:48.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.259+0000 7f8d81d9b640 1 -- 172.21.15.142:0/1961314690 learned_addr learned my addr 172.21.15.142:0/1961314690 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-03-29T04:07:48.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.260+0000 7f8d8259c640 1 --2- 172.21.15.142:0/1961314690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d8406cac0 0x7f8d8414fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:48.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.260+0000 7f8d82d9d640 1 -- 172.21.15.142:0/1961314690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d840b59c0 msgr2=0x7f8d84146590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:48.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.260+0000 7f8d82d9d640 1 --2- 172.21.15.142:0/1961314690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d840b59c0 0x7f8d84146590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:48.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.260+0000 7f8d82d9d640 1 -- 172.21.15.142:0/1961314690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d8406cac0 msgr2=0x7f8d8414fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:48.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.260+0000 7f8d82d9d640 1 --2- 172.21.15.142:0/1961314690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d8406cac0 0x7f8d8414fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:48.242 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.260+0000 7f8d82d9d640 1 -- 172.21.15.142:0/1961314690 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d8414eab0 con 0x7f8d8415b640 2024-03-29T04:07:48.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.260+0000 7f8d81d9b640 1 --2- 172.21.15.142:0/1961314690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d840b59c0 0x7f8d84146590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:07:48.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.260+0000 7f8d82d9d640 1 --2- 172.21.15.142:0/1961314690 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d8415b640 0x7f8d840ca820 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8d74033000 tx=0x7f8d740046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:07:48.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.260+0000 7f8d72ffd640 1 -- 172.21.15.142:0/1961314690 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d74032630 con 0x7f8d8415b640 2024-03-29T04:07:48.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.260+0000 7f8d72ffd640 1 -- 172.21.15.142:0/1961314690 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d740327d0 con 0x7f8d8415b640 2024-03-29T04:07:48.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.260+0000 7f8d88c70640 1 -- 172.21.15.142:0/1961314690 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d8414ed90 con 0x7f8d8415b640 2024-03-29T04:07:48.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.260+0000 7f8d72ffd640 1 -- 172.21.15.142:0/1961314690 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d74032bc0 con 0x7f8d8415b640 2024-03-29T04:07:48.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.260+0000 7f8d88c70640 1 -- 172.21.15.142:0/1961314690 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d8414f350 con 0x7f8d8415b640 2024-03-29T04:07:48.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.260+0000 7f8d72ffd640 1 -- 172.21.15.142:0/1961314690 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8d7404e7c0 con 0x7f8d8415b640 2024-03-29T04:07:48.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.260+0000 7f8d72ffd640 1 -- 172.21.15.142:0/1961314690 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f8d7402f030 con 0x7f8d8415b640 2024-03-29T04:07:48.243 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.261+0000 7f8d88c70640 1 -- 172.21.15.142:0/1961314690 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d8409f0f0 con 0x7f8d8415b640 2024-03-29T04:07:48.244 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.263+0000 7f8d72ffd640 1 -- 172.21.15.142:0/1961314690 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f8d74040070 con 0x7f8d8415b640 2024-03-29T04:07:48.314 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.334+0000 7f8d88c70640 1 -- 172.21.15.142:0/1961314690 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6b182102-882a-4e0c-99db-0afae5cfb38b", "id": 1} v 0) -- 0x7f8d8404f9d0 con 0x7f8d8415b640 2024-03-29T04:07:48.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.340+0000 7f8d72ffd640 1 -- 172.21.15.142:0/1961314690 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6b182102-882a-4e0c-99db-0afae5cfb38b", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f8d74032d60 con 0x7f8d8415b640 2024-03-29T04:07:48.320 INFO:teuthology.orchestra.run.smithi142.stdout:1 2024-03-29T04:07:48.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.341+0000 7f8d88c70640 1 -- 172.21.15.142:0/1961314690 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d8415b640 msgr2=0x7f8d840ca820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:48.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.341+0000 7f8d88c70640 1 --2- 172.21.15.142:0/1961314690 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d8415b640 0x7f8d840ca820 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8d74033000 tx=0x7f8d740046c0 comp rx=0 tx=0).stop 2024-03-29T04:07:48.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.341+0000 7f8d88c70640 1 -- 172.21.15.142:0/1961314690 shutdown_connections 2024-03-29T04:07:48.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.341+0000 7f8d88c70640 1 --2- 172.21.15.142:0/1961314690 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8d8415b640 0x7f8d840ca820 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:48.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.341+0000 7f8d88c70640 1 --2- 172.21.15.142:0/1961314690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d840b59c0 0x7f8d84146590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:48.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.341+0000 7f8d88c70640 1 --2- 172.21.15.142:0/1961314690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d8406cac0 0x7f8d8414fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:48.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.341+0000 7f8d88c70640 1 -- 172.21.15.142:0/1961314690 >> 172.21.15.142:0/1961314690 conn(0x7f8d840d0bb0 msgr2=0x7f8d840afca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:07:48.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.341+0000 7f8d88c70640 1 -- 172.21.15.142:0/1961314690 shutdown_connections 2024-03-29T04:07:48.321 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.341+0000 7f8d88c70640 1 -- 172.21.15.142:0/1961314690 wait complete. 2024-03-29T04:07:48.331 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 8040902e-b0b8-4a21-bf64-ce1c222115ea 2 2024-03-29T04:07:48.417 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-29T04:07:48.437+0000 7fde0a845040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-29T04:07:48.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.452+0000 7fb7d397c640 1 Processor -- start 2024-03-29T04:07:48.432 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.452+0000 7fb7d397c640 1 -- start start 2024-03-29T04:07:48.432 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-03-29T04:07:48.453+0000 7fdd900fa040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-29T04:07:48.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.453+0000 7fb7d397c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb7cc15b6c0 0x7fb7cc0b4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:48.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.453+0000 7fb7d397c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb7cc0b5b90 0x7fb7cc0b4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:48.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.453+0000 7fb7d397c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7cc0b0b50 con 0x7fb7cc15baa0 2024-03-29T04:07:48.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.453+0000 7fb7d397c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fb7cc0aeb50 con 0x7fb7cc15b6c0 2024-03-29T04:07:48.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.453+0000 7fb7d397c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fb7cc0b3c50 con 0x7fb7cc0b5b90 2024-03-29T04:07:48.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.453+0000 7fb7d1f19640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb7cc0b5b90 0x7fb7cc0b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:48.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.453+0000 7fb7d1f19640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb7cc0b5b90 0x7fb7cc0b4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38530/0 (socket says 172.21.15.142:38530) 2024-03-29T04:07:48.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.453+0000 7fb7d1f19640 1 -- 172.21.15.142:0/4096149982 learned_addr learned my addr 172.21.15.142:0/4096149982 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-03-29T04:07:48.434 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.453+0000 7fb7d1718640 1 --2- 172.21.15.142:0/4096149982 >> v2:172.21.15.73:3300/0 conn(0x7fb7cc15b6c0 0x7fb7cc0b4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:48.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.453+0000 7fb7d1f19640 1 -- 172.21.15.142:0/4096149982 >> v2:172.21.15.73:3300/0 conn(0x7fb7cc15b6c0 msgr2=0x7fb7cc0b4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:07:48.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.453+0000 7fb7d1f19640 1 --2- 172.21.15.142:0/4096149982 >> v2:172.21.15.73:3300/0 conn(0x7fb7cc15b6c0 0x7fb7cc0b4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:48.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.453+0000 7fb7d1f19640 1 -- 172.21.15.142:0/4096149982 >> v1:172.21.15.142:6789/0 conn(0x7fb7cc15baa0 legacy=0x7fb7cc15f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:48.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.453+0000 7fb7d1f19640 1 -- 172.21.15.142:0/4096149982 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7cc0aed80 con 0x7fb7cc0b5b90 2024-03-29T04:07:48.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.454+0000 7fb7d1f19640 1 --2- 172.21.15.142:0/4096149982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7cc0b5b90 0x7fb7cc0b4880 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc073a60 tx=0x7fb7c402e180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e79db1eba5a4b04a server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:07:48.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.454+0000 7fb7c3fff640 1 -- 172.21.15.142:0/4096149982 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c400b0d0 con 0x7fb7cc0b5b90 2024-03-29T04:07:48.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.454+0000 7fb7c3fff640 1 -- 172.21.15.142:0/4096149982 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7c400b270 con 0x7fb7cc0b5b90 2024-03-29T04:07:48.435 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.454+0000 7fb7c3fff640 1 -- 172.21.15.142:0/4096149982 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c4009600 con 0x7fb7cc0b5b90 2024-03-29T04:07:48.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.455+0000 7fb7d397c640 1 -- 172.21.15.142:0/4096149982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7cc0b5b90 msgr2=0x7fb7cc0b4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:48.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.455+0000 7fb7d397c640 1 --2- 172.21.15.142:0/4096149982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7cc0b5b90 0x7fb7cc0b4880 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc073a60 tx=0x7fb7c402e180 comp rx=0 tx=0).stop 2024-03-29T04:07:48.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.455+0000 7fb7d397c640 1 -- 172.21.15.142:0/4096149982 shutdown_connections 2024-03-29T04:07:48.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.455+0000 7fb7d397c640 1 --2- 172.21.15.142:0/4096149982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7cc0b5b90 0x7fb7cc0b4880 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:48.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.455+0000 7fb7d397c640 1 --2- 172.21.15.142:0/4096149982 >> v2:172.21.15.73:3300/0 conn(0x7fb7cc15b6c0 0x7fb7cc0b4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:48.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.455+0000 7fb7d397c640 1 -- 172.21.15.142:0/4096149982 >> 172.21.15.142:0/4096149982 conn(0x7fb7cc0b6a80 msgr2=0x7fb7cc0b3040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:07:48.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.455+0000 7fb7d397c640 1 -- 172.21.15.142:0/4096149982 shutdown_connections 2024-03-29T04:07:48.438 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.455+0000 7fb7d397c640 1 -- 172.21.15.142:0/4096149982 wait complete. 2024-03-29T04:07:48.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.456+0000 7fb7d397c640 1 Processor -- start 2024-03-29T04:07:48.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.456+0000 7fb7d397c640 1 -- start start 2024-03-29T04:07:48.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.457+0000 7fb7d397c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7cc0b5b90 0x7fb7cc1497a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:48.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.457+0000 7fb7d397c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7cc15b6c0 0x7fb7cc156420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:48.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.457+0000 7fb7d397c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7cc15baa0 0x7fb7cc159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:48.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.457+0000 7fb7d397c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb7cc0af620 con 0x7fb7cc15b6c0 2024-03-29T04:07:48.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.457+0000 7fb7d397c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb7cc0af340 con 0x7fb7cc0b5b90 2024-03-29T04:07:48.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.457+0000 7fb7d397c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fb7cc06e9d0 con 0x7fb7cc15baa0 2024-03-29T04:07:48.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.457+0000 7fb7d1718640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7cc0b5b90 0x7fb7cc1497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:48.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.457+0000 7fb7d1f19640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7cc15baa0 0x7fb7cc159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:48.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.457+0000 7fb7d1718640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7cc0b5b90 0x7fb7cc1497a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38534/0 (socket says 172.21.15.142:38534) 2024-03-29T04:07:48.439 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.457+0000 7fb7d1718640 1 -- 172.21.15.142:0/1806088918 learned_addr learned my addr 172.21.15.142:0/1806088918 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-03-29T04:07:48.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.457+0000 7fb7d0f17640 1 --2- 172.21.15.142:0/1806088918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7cc15b6c0 0x7fb7cc156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:48.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.457+0000 7fb7d1f19640 1 -- 172.21.15.142:0/1806088918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7cc0b5b90 msgr2=0x7fb7cc1497a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:48.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.457+0000 7fb7d1f19640 1 --2- 172.21.15.142:0/1806088918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7cc0b5b90 0x7fb7cc1497a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:48.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.457+0000 7fb7d1f19640 1 -- 172.21.15.142:0/1806088918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7cc15b6c0 msgr2=0x7fb7cc156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:48.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.457+0000 7fb7d1f19640 1 --2- 172.21.15.142:0/1806088918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7cc15b6c0 0x7fb7cc156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:48.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.457+0000 7fb7d1f19640 1 -- 172.21.15.142:0/1806088918 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7cc156cc0 con 0x7fb7cc15baa0 2024-03-29T04:07:48.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.457+0000 7fb7d1718640 1 --2- 172.21.15.142:0/1806088918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7cc0b5b90 0x7fb7cc1497a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:07:48.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.457+0000 7fb7d1f19640 1 --2- 172.21.15.142:0/1806088918 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7cc15baa0 0x7fb7cc159d00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb7c4034000 tx=0x7fb7c4004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:07:48.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.458+0000 7fb7c1ffb640 1 -- 172.21.15.142:0/1806088918 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c4045020 con 0x7fb7cc15baa0 2024-03-29T04:07:48.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.458+0000 7fb7c1ffb640 1 -- 172.21.15.142:0/1806088918 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7c400b420 con 0x7fb7cc15baa0 2024-03-29T04:07:48.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.458+0000 7fb7d397c640 1 -- 172.21.15.142:0/1806088918 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7cc15d310 con 0x7fb7cc15baa0 2024-03-29T04:07:48.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.458+0000 7fb7c1ffb640 1 -- 172.21.15.142:0/1806088918 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c400b0d0 con 0x7fb7cc15baa0 2024-03-29T04:07:48.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.458+0000 7fb7d397c640 1 -- 172.21.15.142:0/1806088918 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7cc15d8d0 con 0x7fb7cc15baa0 2024-03-29T04:07:48.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.458+0000 7fb7c1ffb640 1 -- 172.21.15.142:0/1806088918 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb7c4048020 con 0x7fb7cc15baa0 2024-03-29T04:07:48.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.458+0000 7fb7c1ffb640 1 -- 172.21.15.142:0/1806088918 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fb7c4040d20 con 0x7fb7cc15baa0 2024-03-29T04:07:48.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.459+0000 7fb7d397c640 1 -- 172.21.15.142:0/1806088918 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7cc09f6a0 con 0x7fb7cc15baa0 2024-03-29T04:07:48.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.461+0000 7fb7c1ffb640 1 -- 172.21.15.142:0/1806088918 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fb7c404f030 con 0x7fb7cc15baa0 2024-03-29T04:07:48.470 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-29T04:07:48.491+0000 7fde0a845040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-29T04:07:48.488 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-03-29T04:07:48.508+0000 7fdd900fa040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-29T04:07:48.511 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.531+0000 7fb7d397c640 1 -- 172.21.15.142:0/1806088918 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8040902e-b0b8-4a21-bf64-ce1c222115ea", "id": 2} v 0) -- 0x7fb7cc04f9d0 con 0x7fb7cc15baa0 2024-03-29T04:07:48.514 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-29T04:07:48.535+0000 7fde0a845040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-29T04:07:48.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.537+0000 7fb7c1ffb640 1 -- 172.21.15.142:0/1806088918 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8040902e-b0b8-4a21-bf64-ce1c222115ea", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fb7c4040450 con 0x7fb7cc15baa0 2024-03-29T04:07:48.516 INFO:teuthology.orchestra.run.smithi142.stdout:2 2024-03-29T04:07:48.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.538+0000 7fb7d397c640 1 -- 172.21.15.142:0/1806088918 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7cc15baa0 msgr2=0x7fb7cc159d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:48.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.538+0000 7fb7d397c640 1 --2- 172.21.15.142:0/1806088918 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7cc15baa0 0x7fb7cc159d00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb7c4034000 tx=0x7fb7c4004a40 comp rx=0 tx=0).stop 2024-03-29T04:07:48.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.538+0000 7fb7d397c640 1 -- 172.21.15.142:0/1806088918 shutdown_connections 2024-03-29T04:07:48.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.538+0000 7fb7d397c640 1 --2- 172.21.15.142:0/1806088918 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb7cc15baa0 0x7fb7cc159d00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:48.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.538+0000 7fb7d397c640 1 --2- 172.21.15.142:0/1806088918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7cc15b6c0 0x7fb7cc156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:48.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.538+0000 7fb7d397c640 1 --2- 172.21.15.142:0/1806088918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb7cc0b5b90 0x7fb7cc1497a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:48.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.538+0000 7fb7d397c640 1 -- 172.21.15.142:0/1806088918 >> 172.21.15.142:0/1806088918 conn(0x7fb7cc0b6a80 msgr2=0x7fb7cc06f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:07:48.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.538+0000 7fb7d397c640 1 -- 172.21.15.142:0/1806088918 shutdown_connections 2024-03-29T04:07:48.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.538+0000 7fb7d397c640 1 -- 172.21.15.142:0/1806088918 wait complete. 2024-03-29T04:07:48.528 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 1bab19ee-3775-4ce1-a4ce-cf7cda3bbbf8 3 2024-03-29T04:07:48.536 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-03-29T04:07:48.556+0000 7fdd900fa040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-29T04:07:48.567 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-29T04:07:48.588+0000 7fde0a845040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-29T04:07:48.595 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-03-29T04:07:48.613+0000 7fdd900fa040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-29T04:07:48.610 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-29T04:07:48.630+0000 7fde0a845040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-29T04:07:48.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.649+0000 7fa5d959d640 1 Processor -- start 2024-03-29T04:07:48.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.649+0000 7fa5d959d640 1 -- start start 2024-03-29T04:07:48.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.650+0000 7fa5d959d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa5d415eed0 0x7fa5d40cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:48.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.650+0000 7fa5d959d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5d415f4b0 con 0x7fa5d40cfbb0 2024-03-29T04:07:48.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.650+0000 7fa5d959d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5d415f790 con 0x7fa5d40afdd0 2024-03-29T04:07:48.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.650+0000 7fa5d959d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fa5d415fa70 con 0x7fa5d415eed0 2024-03-29T04:07:48.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.650+0000 7fa5d37fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa5d415eed0 0x7fa5d40cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:48.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.650+0000 7fa5d37fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa5d415eed0 0x7fa5d40cf670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38540/0 (socket says 172.21.15.142:38540) 2024-03-29T04:07:48.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.650+0000 7fa5d37fe640 1 -- 172.21.15.142:0/1103647813 learned_addr learned my addr 172.21.15.142:0/1103647813 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-03-29T04:07:48.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.650+0000 7fa5d37fe640 1 -- 172.21.15.142:0/1103647813 >> v1:172.21.15.142:6789/0 conn(0x7fa5d40afdd0 legacy=0x7fa5d415c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:48.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.650+0000 7fa5d37fe640 1 -- 172.21.15.142:0/1103647813 >> v1:172.21.15.73:6789/0 conn(0x7fa5d40cfbb0 legacy=0x7fa5d406c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:48.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.650+0000 7fa5d37fe640 1 -- 172.21.15.142:0/1103647813 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5d406eb00 con 0x7fa5d415eed0 2024-03-29T04:07:48.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.651+0000 7fa5d37fe640 1 --2- 172.21.15.142:0/1103647813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5d415eed0 0x7fa5d40cf670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8009870 tx=0x7fa5c802b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a8d20f6c4aafdd2 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:07:48.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.651+0000 7fa5d2ffd640 1 -- 172.21.15.142:0/1103647813 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c8035020 con 0x7fa5d415eed0 2024-03-29T04:07:48.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.651+0000 7fa5d2ffd640 1 -- 172.21.15.142:0/1103647813 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5c8031870 con 0x7fa5d415eed0 2024-03-29T04:07:48.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.651+0000 7fa5d2ffd640 1 -- 172.21.15.142:0/1103647813 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c8031c40 con 0x7fa5d415eed0 2024-03-29T04:07:48.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.651+0000 7fa5d959d640 1 -- 172.21.15.142:0/1103647813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5d415eed0 msgr2=0x7fa5d40cf670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:48.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.651+0000 7fa5d959d640 1 --2- 172.21.15.142:0/1103647813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5d415eed0 0x7fa5d40cf670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8009870 tx=0x7fa5c802b910 comp rx=0 tx=0).stop 2024-03-29T04:07:48.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.652+0000 7fa5d959d640 1 -- 172.21.15.142:0/1103647813 shutdown_connections 2024-03-29T04:07:48.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.652+0000 7fa5d959d640 1 --2- 172.21.15.142:0/1103647813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5d415eed0 0x7fa5d40cf670 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:48.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.652+0000 7fa5d959d640 1 -- 172.21.15.142:0/1103647813 >> 172.21.15.142:0/1103647813 conn(0x7fa5d4071eb0 msgr2=0x7fa5d40722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:07:48.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.652+0000 7fa5d959d640 1 -- 172.21.15.142:0/1103647813 shutdown_connections 2024-03-29T04:07:48.632 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.652+0000 7fa5d959d640 1 -- 172.21.15.142:0/1103647813 wait complete. 2024-03-29T04:07:48.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.653+0000 7fa5d959d640 1 Processor -- start 2024-03-29T04:07:48.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.653+0000 7fa5d959d640 1 -- start start 2024-03-29T04:07:48.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.654+0000 7fa5d959d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5d40afdd0 0x7fa5d4150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:48.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.654+0000 7fa5d959d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5d40cfbb0 0x7fa5d414f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:48.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.654+0000 7fa5d959d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5d415eed0 0x7fa5d413fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:48.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.654+0000 7fa5d959d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa5d406cc30 con 0x7fa5d40cfbb0 2024-03-29T04:07:48.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.654+0000 7fa5d959d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa5d40b01b0 con 0x7fa5d415eed0 2024-03-29T04:07:48.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.654+0000 7fa5d959d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa5d406cdb0 con 0x7fa5d40afdd0 2024-03-29T04:07:48.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.654+0000 7fa5d8d9c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5d415eed0 0x7fa5d413fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:48.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.654+0000 7fa5d3fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5d40afdd0 0x7fa5d4150fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:48.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.654+0000 7fa5d8d9c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5d415eed0 0x7fa5d413fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38542/0 (socket says 172.21.15.142:38542) 2024-03-29T04:07:48.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.654+0000 7fa5d8d9c640 1 -- 172.21.15.142:0/3765041927 learned_addr learned my addr 172.21.15.142:0/3765041927 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-03-29T04:07:48.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.654+0000 7fa5d37fe640 1 --2- 172.21.15.142:0/3765041927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5d40cfbb0 0x7fa5d414f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:48.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.654+0000 7fa5d3fff640 1 -- 172.21.15.142:0/3765041927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5d415eed0 msgr2=0x7fa5d413fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:48.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.654+0000 7fa5d3fff640 1 --2- 172.21.15.142:0/3765041927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5d415eed0 0x7fa5d413fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:48.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.654+0000 7fa5d3fff640 1 -- 172.21.15.142:0/3765041927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5d40cfbb0 msgr2=0x7fa5d414f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:48.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.654+0000 7fa5d3fff640 1 --2- 172.21.15.142:0/3765041927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5d40cfbb0 0x7fa5d414f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:48.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.654+0000 7fa5d3fff640 1 -- 172.21.15.142:0/3765041927 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5d4140330 con 0x7fa5d40afdd0 2024-03-29T04:07:48.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.654+0000 7fa5d8d9c640 1 --2- 172.21.15.142:0/3765041927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5d415eed0 0x7fa5d413fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:07:48.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.654+0000 7fa5d3fff640 1 --2- 172.21.15.142:0/3765041927 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5d40afdd0 0x7fa5d4150fc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa5c400c390 tx=0x7fa5c400c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:07:48.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.654+0000 7fa5d0ff9640 1 -- 172.21.15.142:0/3765041927 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c4017070 con 0x7fa5d40afdd0 2024-03-29T04:07:48.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.654+0000 7fa5d0ff9640 1 -- 172.21.15.142:0/3765041927 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5c40052d0 con 0x7fa5d40afdd0 2024-03-29T04:07:48.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.654+0000 7fa5d0ff9640 1 -- 172.21.15.142:0/3765041927 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c4003830 con 0x7fa5d40afdd0 2024-03-29T04:07:48.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.654+0000 7fa5d959d640 1 -- 172.21.15.142:0/3765041927 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5d4140610 con 0x7fa5d40afdd0 2024-03-29T04:07:48.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.654+0000 7fa5d959d640 1 -- 172.21.15.142:0/3765041927 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5d41410f0 con 0x7fa5d40afdd0 2024-03-29T04:07:48.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.655+0000 7fa5d0ff9640 1 -- 172.21.15.142:0/3765041927 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa5c401a070 con 0x7fa5d40afdd0 2024-03-29T04:07:48.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.655+0000 7fa5d0ff9640 1 -- 172.21.15.142:0/3765041927 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fa5c4012420 con 0x7fa5d40afdd0 2024-03-29T04:07:48.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.655+0000 7fa5d959d640 1 -- 172.21.15.142:0/3765041927 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5d404f8f0 con 0x7fa5d40afdd0 2024-03-29T04:07:48.637 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.657+0000 7fa5d0ff9640 1 -- 172.21.15.142:0/3765041927 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fa5c4021070 con 0x7fa5d40afdd0 2024-03-29T04:07:48.639 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-03-29T04:07:48.659+0000 7fdd900fa040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-29T04:07:48.710 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.730+0000 7fa5d959d640 1 -- 172.21.15.142:0/3765041927 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1bab19ee-3775-4ce1-a4ce-cf7cda3bbbf8", "id": 3} v 0) -- 0x7fa5d406e330 con 0x7fa5d40afdd0 2024-03-29T04:07:48.715 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.736+0000 7fa5d0ff9640 1 -- 172.21.15.142:0/3765041927 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1bab19ee-3775-4ce1-a4ce-cf7cda3bbbf8", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fa5c40115f0 con 0x7fa5d40afdd0 2024-03-29T04:07:48.715 INFO:teuthology.orchestra.run.smithi142.stdout:3 2024-03-29T04:07:48.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.736+0000 7fa5d959d640 1 -- 172.21.15.142:0/3765041927 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5d40afdd0 msgr2=0x7fa5d4150fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:48.716 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.736+0000 7fa5d959d640 1 --2- 172.21.15.142:0/3765041927 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5d40afdd0 0x7fa5d4150fc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa5c400c390 tx=0x7fa5c400c850 comp rx=0 tx=0).stop 2024-03-29T04:07:48.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.736+0000 7fa5d959d640 1 -- 172.21.15.142:0/3765041927 shutdown_connections 2024-03-29T04:07:48.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.736+0000 7fa5d959d640 1 --2- 172.21.15.142:0/3765041927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5d415eed0 0x7fa5d413fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:48.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.736+0000 7fa5d959d640 1 --2- 172.21.15.142:0/3765041927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5d40cfbb0 0x7fa5d414f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:48.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.736+0000 7fa5d959d640 1 --2- 172.21.15.142:0/3765041927 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa5d40afdd0 0x7fa5d4150fc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:48.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.737+0000 7fa5d959d640 1 -- 172.21.15.142:0/3765041927 >> 172.21.15.142:0/3765041927 conn(0x7fa5d4071eb0 msgr2=0x7fa5d4072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:07:48.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.737+0000 7fa5d959d640 1 -- 172.21.15.142:0/3765041927 shutdown_connections 2024-03-29T04:07:48.717 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.737+0000 7fa5d959d640 1 -- 172.21.15.142:0/3765041927 wait complete. 2024-03-29T04:07:48.725 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-29T04:07:48.745+0000 7fde0a845040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-29T04:07:48.726 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new b0c74337-8fe4-47dc-b3da-2d07591b1f6e 4 2024-03-29T04:07:48.761 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-03-29T04:07:48.782+0000 7fdd900fa040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-29T04:07:48.794 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-29T04:07:48.814+0000 7fde0a845040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-29T04:07:48.836 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-03-29T04:07:48.856+0000 7fdd900fa040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-29T04:07:48.838 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-29T04:07:48.859+0000 7fde0a845040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-29T04:07:48.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.882+0000 7f5c70cd3640 1 Processor -- start 2024-03-29T04:07:48.862 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.883+0000 7f5c70cd3640 1 -- start start 2024-03-29T04:07:48.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.883+0000 7f5c70cd3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5c6c0d0610 0x7f5c6c06c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:48.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.883+0000 7f5c70cd3640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c6c073130 con 0x7f5c6c072b70 2024-03-29T04:07:48.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.883+0000 7f5c70cd3640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c6c0cf850 con 0x7f5c6c15c560 2024-03-29T04:07:48.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.883+0000 7f5c70cd3640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f5c6c0d0180 con 0x7f5c6c0d0610 2024-03-29T04:07:48.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.883+0000 7f5c63fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5c6c0d0610 0x7f5c6c06c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:48.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.883+0000 7f5c63fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5c6c0d0610 0x7f5c6c06c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38546/0 (socket says 172.21.15.142:38546) 2024-03-29T04:07:48.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.884+0000 7f5c63fff640 1 -- 172.21.15.142:0/3565536878 learned_addr learned my addr 172.21.15.142:0/3565536878 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-03-29T04:07:48.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.884+0000 7f5c6a59c640 1 --1- 172.21.15.142:0/3565536878 >> v1:172.21.15.142:6789/0 conn(0x7f5c6c15c560 0x7f5c6c160bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:39212/0 (socket says 172.21.15.142:39212) 2024-03-29T04:07:48.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.884+0000 7f5c63fff640 1 -- 172.21.15.142:0/3565536878 >> v1:172.21.15.142:6789/0 conn(0x7f5c6c15c560 legacy=0x7f5c6c160bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:48.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.884+0000 7f5c63fff640 1 -- 172.21.15.142:0/3565536878 >> v1:172.21.15.73:6789/0 conn(0x7f5c6c072b70 legacy=0x7f5c6c06ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:48.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.884+0000 7f5c63fff640 1 -- 172.21.15.142:0/3565536878 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c6c0cfb30 con 0x7f5c6c0d0610 2024-03-29T04:07:48.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.885+0000 7f5c63fff640 1 --2- 172.21.15.142:0/3565536878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c6c0d0610 0x7f5c6c06c520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5c54009870 tx=0x7f5c5402b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c305003deea9251 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:07:48.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.885+0000 7f5c69d9b640 1 -- 172.21.15.142:0/3565536878 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c54034070 con 0x7f5c6c0d0610 2024-03-29T04:07:48.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.885+0000 7f5c69d9b640 1 -- 172.21.15.142:0/3565536878 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c54030860 con 0x7f5c6c0d0610 2024-03-29T04:07:48.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.885+0000 7f5c69d9b640 1 -- 172.21.15.142:0/3565536878 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c54030c30 con 0x7f5c6c0d0610 2024-03-29T04:07:48.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.885+0000 7f5c70cd3640 1 -- 172.21.15.142:0/3565536878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c6c0d0610 msgr2=0x7f5c6c06c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:48.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.885+0000 7f5c70cd3640 1 --2- 172.21.15.142:0/3565536878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c6c0d0610 0x7f5c6c06c520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5c54009870 tx=0x7f5c5402b9a0 comp rx=0 tx=0).stop 2024-03-29T04:07:48.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.885+0000 7f5c70cd3640 1 -- 172.21.15.142:0/3565536878 shutdown_connections 2024-03-29T04:07:48.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.885+0000 7f5c70cd3640 1 --2- 172.21.15.142:0/3565536878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c6c0d0610 0x7f5c6c06c520 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:48.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.885+0000 7f5c70cd3640 1 -- 172.21.15.142:0/3565536878 >> 172.21.15.142:0/3565536878 conn(0x7f5c6c072050 msgr2=0x7f5c6c072460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:07:48.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.885+0000 7f5c70cd3640 1 -- 172.21.15.142:0/3565536878 shutdown_connections 2024-03-29T04:07:48.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.885+0000 7f5c70cd3640 1 -- 172.21.15.142:0/3565536878 wait complete. 2024-03-29T04:07:48.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.887+0000 7f5c70cd3640 1 Processor -- start 2024-03-29T04:07:48.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.887+0000 7f5c70cd3640 1 -- start start 2024-03-29T04:07:48.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.887+0000 7f5c70cd3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c6c072b70 0x7f5c6c1573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:48.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.887+0000 7f5c70cd3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c6c0d0610 0x7f5c6c1e5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:48.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.887+0000 7f5c70cd3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c6c15c560 0x7f5c6c1e3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:48.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.887+0000 7f5c70cd3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5c6c15cac0 con 0x7f5c6c072b70 2024-03-29T04:07:48.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.887+0000 7f5c70cd3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5c6c15c940 con 0x7f5c6c15c560 2024-03-29T04:07:48.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.887+0000 7f5c70cd3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f5c6c06ca60 con 0x7f5c6c0d0610 2024-03-29T04:07:48.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.887+0000 7f5c6ad9d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c6c15c560 0x7f5c6c1e3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:48.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.888+0000 7f5c6ad9d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c6c15c560 0x7f5c6c1e3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38548/0 (socket says 172.21.15.142:38548) 2024-03-29T04:07:48.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.888+0000 7f5c63fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c6c0d0610 0x7f5c6c1e5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:48.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.888+0000 7f5c6ad9d640 1 -- 172.21.15.142:0/3171922675 learned_addr learned my addr 172.21.15.142:0/3171922675 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-03-29T04:07:48.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.888+0000 7f5c6a59c640 1 --2- 172.21.15.142:0/3171922675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c6c072b70 0x7f5c6c1573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:48.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.888+0000 7f5c6ad9d640 1 -- 172.21.15.142:0/3171922675 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c6c0d0610 msgr2=0x7f5c6c1e5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:48.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.888+0000 7f5c6ad9d640 1 --2- 172.21.15.142:0/3171922675 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c6c0d0610 0x7f5c6c1e5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:48.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.888+0000 7f5c6ad9d640 1 -- 172.21.15.142:0/3171922675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c6c072b70 msgr2=0x7f5c6c1573b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:48.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.888+0000 7f5c6ad9d640 1 --2- 172.21.15.142:0/3171922675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c6c072b70 0x7f5c6c1573b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:48.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.888+0000 7f5c6ad9d640 1 -- 172.21.15.142:0/3171922675 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c6c1e5b50 con 0x7f5c6c15c560 2024-03-29T04:07:48.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.888+0000 7f5c63fff640 1 --2- 172.21.15.142:0/3171922675 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c6c0d0610 0x7f5c6c1e5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:07:48.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.888+0000 7f5c6ad9d640 1 --2- 172.21.15.142:0/3171922675 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c6c15c560 0x7f5c6c1e3800 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5c6400c7a0 tx=0x7f5c6400cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:07:48.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.888+0000 7f5c62ffd640 1 -- 172.21.15.142:0/3171922675 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c64003b70 con 0x7f5c6c15c560 2024-03-29T04:07:48.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.888+0000 7f5c62ffd640 1 -- 172.21.15.142:0/3171922675 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c64003d30 con 0x7f5c6c15c560 2024-03-29T04:07:48.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.888+0000 7f5c70cd3640 1 -- 172.21.15.142:0/3171922675 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c6c0acbd0 con 0x7f5c6c15c560 2024-03-29T04:07:48.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.888+0000 7f5c62ffd640 1 -- 172.21.15.142:0/3171922675 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c6400aa30 con 0x7f5c6c15c560 2024-03-29T04:07:48.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.888+0000 7f5c70cd3640 1 -- 172.21.15.142:0/3171922675 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c6c0ad470 con 0x7f5c6c15c560 2024-03-29T04:07:48.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.888+0000 7f5c62ffd640 1 -- 172.21.15.142:0/3171922675 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5c6400abd0 con 0x7f5c6c15c560 2024-03-29T04:07:48.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.888+0000 7f5c62ffd640 1 -- 172.21.15.142:0/3171922675 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f5c64012ac0 con 0x7f5c6c15c560 2024-03-29T04:07:48.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.889+0000 7f5c70cd3640 1 -- 172.21.15.142:0/3171922675 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c6c0afd50 con 0x7f5c6c15c560 2024-03-29T04:07:48.872 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.893+0000 7f5c62ffd640 1 -- 172.21.15.142:0/3171922675 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f5c64012d60 con 0x7f5c6c15c560 2024-03-29T04:07:48.886 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-03-29T04:07:48.907+0000 7fdd900fa040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-29T04:07:48.891 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-29T04:07:48.911+0000 7fde0a845040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-29T04:07:48.937 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-29T04:07:48.957+0000 7fde0a845040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-29T04:07:48.939 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-03-29T04:07:48.960+0000 7fdd900fa040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-29T04:07:48.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.964+0000 7f5c70cd3640 1 -- 172.21.15.142:0/3171922675 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b0c74337-8fe4-47dc-b3da-2d07591b1f6e", "id": 4} v 0) -- 0x7f5c6c06fbd0 con 0x7f5c6c15c560 2024-03-29T04:07:48.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.970+0000 7f5c62ffd640 1 -- 172.21.15.142:0/3171922675 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b0c74337-8fe4-47dc-b3da-2d07591b1f6e", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f5c640125b0 con 0x7f5c6c15c560 2024-03-29T04:07:48.950 INFO:teuthology.orchestra.run.smithi142.stdout:4 2024-03-29T04:07:48.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.971+0000 7f5c70cd3640 1 -- 172.21.15.142:0/3171922675 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c6c15c560 msgr2=0x7f5c6c1e3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:48.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.971+0000 7f5c70cd3640 1 --2- 172.21.15.142:0/3171922675 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c6c15c560 0x7f5c6c1e3800 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5c6400c7a0 tx=0x7f5c6400cc60 comp rx=0 tx=0).stop 2024-03-29T04:07:48.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.971+0000 7f5c70cd3640 1 -- 172.21.15.142:0/3171922675 shutdown_connections 2024-03-29T04:07:48.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.971+0000 7f5c70cd3640 1 --2- 172.21.15.142:0/3171922675 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5c6c15c560 0x7f5c6c1e3800 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:48.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.971+0000 7f5c70cd3640 1 --2- 172.21.15.142:0/3171922675 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5c6c0d0610 0x7f5c6c1e5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:48.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.971+0000 7f5c70cd3640 1 --2- 172.21.15.142:0/3171922675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c6c072b70 0x7f5c6c1573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:48.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.971+0000 7f5c70cd3640 1 -- 172.21.15.142:0/3171922675 >> 172.21.15.142:0/3171922675 conn(0x7f5c6c072050 msgr2=0x7f5c6c15a500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:07:48.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.971+0000 7f5c70cd3640 1 -- 172.21.15.142:0/3171922675 shutdown_connections 2024-03-29T04:07:48.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:48.971+0000 7f5c70cd3640 1 -- 172.21.15.142:0/3171922675 wait complete. 2024-03-29T04:07:48.965 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new 9ce36410-a29a-42c6-99f4-f95d4afdd7b5 5 2024-03-29T04:07:48.995 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-03-29T04:07:49.016+0000 7fdd900fa040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-29T04:07:49.065 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.086+0000 7f7f473f4640 1 Processor -- start 2024-03-29T04:07:49.066 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.086+0000 7f7f473f4640 1 -- start start 2024-03-29T04:07:49.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.087+0000 7f7f473f4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f4015b710 0x7f7f400cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:49.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.087+0000 7f7f473f4640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7f4015baf0 0x7f7f400ce250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:49.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.087+0000 7f7f473f4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7f4006f550 0x7f7f4006f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:49.067 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.087+0000 7f7f473f4640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f7f400cd780 con 0x7f7f4015baf0 2024-03-29T04:07:49.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.087+0000 7f7f473f4640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f7f400cda60 con 0x7f7f4006f550 2024-03-29T04:07:49.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.087+0000 7f7f473f4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7f4006ea70 con 0x7f7f4015b710 2024-03-29T04:07:49.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.087+0000 7f7f45190640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f4015b710 0x7f7f400cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:49.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.087+0000 7f7f45991640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7f4006f550 0x7f7f4006f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:49.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.087+0000 7f7f45190640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f4015b710 0x7f7f400cdd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:33862/0 (socket says 172.21.15.142:33862) 2024-03-29T04:07:49.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.087+0000 7f7f45190640 1 -- 172.21.15.142:0/1016822554 learned_addr learned my addr 172.21.15.142:0/1016822554 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-03-29T04:07:49.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.087+0000 7f7f45991640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7f4006f550 0x7f7f4006f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38552/0 (socket says 172.21.15.142:38552) 2024-03-29T04:07:49.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.087+0000 7f7f4498f640 1 --2- 172.21.15.142:0/1016822554 >> v2:172.21.15.73:3300/0 conn(0x7f7f4015baf0 0x7f7f400ce250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:49.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.087+0000 7f7f45991640 1 -- 172.21.15.142:0/1016822554 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f4015b710 msgr2=0x7f7f400cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:07:49.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.087+0000 7f7f45991640 1 --2- 172.21.15.142:0/1016822554 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f4015b710 0x7f7f400cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:49.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.087+0000 7f7f45991640 1 -- 172.21.15.142:0/1016822554 >> v2:172.21.15.73:3300/0 conn(0x7f7f4015baf0 msgr2=0x7f7f400ce250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:07:49.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.087+0000 7f7f45991640 1 --2- 172.21.15.142:0/1016822554 >> v2:172.21.15.73:3300/0 conn(0x7f7f4015baf0 0x7f7f400ce250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:49.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.087+0000 7f7f45991640 1 -- 172.21.15.142:0/1016822554 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f4006ed50 con 0x7f7f4006f550 2024-03-29T04:07:49.068 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.087+0000 7f7f45190640 1 --2- 172.21.15.142:0/1016822554 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f4015b710 0x7f7f400cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:07:49.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.088+0000 7f7f45991640 1 --2- 172.21.15.142:0/1016822554 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f4006f550 0x7f7f4006f9e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7f4015f410 tx=0x7f7f3802be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64b90ba6ce754130 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:07:49.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.088+0000 7f7f37fff640 1 -- 172.21.15.142:0/1016822554 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f38039070 con 0x7f7f4006f550 2024-03-29T04:07:49.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.088+0000 7f7f37fff640 1 -- 172.21.15.142:0/1016822554 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f3802cbd0 con 0x7f7f4006f550 2024-03-29T04:07:49.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.088+0000 7f7f37fff640 1 -- 172.21.15.142:0/1016822554 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f38034440 con 0x7f7f4006f550 2024-03-29T04:07:49.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.089+0000 7f7f473f4640 1 -- 172.21.15.142:0/1016822554 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f4006f550 msgr2=0x7f7f4006f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:49.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.089+0000 7f7f473f4640 1 --2- 172.21.15.142:0/1016822554 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f4006f550 0x7f7f4006f9e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7f4015f410 tx=0x7f7f3802be20 comp rx=0 tx=0).stop 2024-03-29T04:07:49.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.089+0000 7f7f473f4640 1 -- 172.21.15.142:0/1016822554 shutdown_connections 2024-03-29T04:07:49.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.089+0000 7f7f473f4640 1 --2- 172.21.15.142:0/1016822554 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f4006f550 0x7f7f4006f9e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:49.070 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.089+0000 7f7f473f4640 1 --2- 172.21.15.142:0/1016822554 >> v2:172.21.15.73:3300/0 conn(0x7f7f4015baf0 0x7f7f400ce250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:49.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.089+0000 7f7f473f4640 1 --2- 172.21.15.142:0/1016822554 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f4015b710 0x7f7f400cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:49.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.089+0000 7f7f473f4640 1 -- 172.21.15.142:0/1016822554 >> 172.21.15.142:0/1016822554 conn(0x7f7f400b2ed0 msgr2=0x7f7f400b32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:07:49.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.089+0000 7f7f473f4640 1 -- 172.21.15.142:0/1016822554 shutdown_connections 2024-03-29T04:07:49.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.089+0000 7f7f473f4640 1 -- 172.21.15.142:0/1016822554 wait complete. 2024-03-29T04:07:49.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.090+0000 7f7f473f4640 1 Processor -- start 2024-03-29T04:07:49.071 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.090+0000 7f7f473f4640 1 -- start start 2024-03-29T04:07:49.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.091+0000 7f7f473f4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f4006f550 0x7f7f4015ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:49.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.091+0000 7f7f473f4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f4015b710 0x7f7f4015c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:49.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.091+0000 7f7f473f4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f4015baf0 0x7f7f400ae480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:49.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.091+0000 7f7f473f4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7f400b3d20 con 0x7f7f4015baf0 2024-03-29T04:07:49.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.091+0000 7f7f473f4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7f400b3ba0 con 0x7f7f4006f550 2024-03-29T04:07:49.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.091+0000 7f7f473f4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7f4006ff20 con 0x7f7f4015b710 2024-03-29T04:07:49.073 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.091+0000 7f7f45190640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f4006f550 0x7f7f4015ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:49.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.091+0000 7f7f4498f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f4015b710 0x7f7f4015c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:49.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.091+0000 7f7f45190640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f4006f550 0x7f7f4015ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38556/0 (socket says 172.21.15.142:38556) 2024-03-29T04:07:49.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.091+0000 7f7f45190640 1 -- 172.21.15.142:0/2617112614 learned_addr learned my addr 172.21.15.142:0/2617112614 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-03-29T04:07:49.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.091+0000 7f7f4498f640 1 --2- 172.21.15.142:0/2617112614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f4015b710 0x7f7f4015c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:33868/0 (socket says 172.21.15.142:33868) 2024-03-29T04:07:49.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.091+0000 7f7f45991640 1 --2- 172.21.15.142:0/2617112614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f4015baf0 0x7f7f400ae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:49.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.091+0000 7f7f45190640 1 -- 172.21.15.142:0/2617112614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f4015b710 msgr2=0x7f7f4015c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:49.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.091+0000 7f7f45190640 1 --2- 172.21.15.142:0/2617112614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f4015b710 0x7f7f4015c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:49.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.091+0000 7f7f45190640 1 -- 172.21.15.142:0/2617112614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f4015baf0 msgr2=0x7f7f400ae480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:49.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.091+0000 7f7f45190640 1 --2- 172.21.15.142:0/2617112614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f4015baf0 0x7f7f400ae480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:49.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.091+0000 7f7f45190640 1 -- 172.21.15.142:0/2617112614 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f4015c300 con 0x7f7f4006f550 2024-03-29T04:07:49.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.091+0000 7f7f45991640 1 --2- 172.21.15.142:0/2617112614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f4015baf0 0x7f7f400ae480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:07:49.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.091+0000 7f7f45190640 1 --2- 172.21.15.142:0/2617112614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f4006f550 0x7f7f4015ea60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c00e980 tx=0x7f7f3c00ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:07:49.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.092+0000 7f7f35ffb640 1 -- 172.21.15.142:0/2617112614 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c00ca00 con 0x7f7f4006f550 2024-03-29T04:07:49.074 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.092+0000 7f7f35ffb640 1 -- 172.21.15.142:0/2617112614 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f3c00cba0 con 0x7f7f4006f550 2024-03-29T04:07:49.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.092+0000 7f7f35ffb640 1 -- 172.21.15.142:0/2617112614 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c004030 con 0x7f7f4006f550 2024-03-29T04:07:49.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.092+0000 7f7f473f4640 1 -- 172.21.15.142:0/2617112614 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f400b43a0 con 0x7f7f4006f550 2024-03-29T04:07:49.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.092+0000 7f7f35ffb640 1 -- 172.21.15.142:0/2617112614 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7f3c003610 con 0x7f7f4006f550 2024-03-29T04:07:49.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.092+0000 7f7f473f4640 1 -- 172.21.15.142:0/2617112614 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f400b4960 con 0x7f7f4006f550 2024-03-29T04:07:49.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.092+0000 7f7f35ffb640 1 -- 172.21.15.142:0/2617112614 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f7f3c013470 con 0x7f7f4006f550 2024-03-29T04:07:49.075 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.093+0000 7f7f473f4640 1 -- 172.21.15.142:0/2617112614 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f4009f530 con 0x7f7f4006f550 2024-03-29T04:07:49.076 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.096+0000 7f7f35ffb640 1 -- 172.21.15.142:0/2617112614 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f7f4015c300 con 0x7f7f4006f550 2024-03-29T04:07:49.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.169+0000 7f7f473f4640 1 -- 172.21.15.142:0/2617112614 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9ce36410-a29a-42c6-99f4-f95d4afdd7b5", "id": 5} v 0) -- 0x7f7f4015af30 con 0x7f7f4006f550 2024-03-29T04:07:49.154 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.174+0000 7f7f35ffb640 1 -- 172.21.15.142:0/2617112614 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9ce36410-a29a-42c6-99f4-f95d4afdd7b5", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f7f3c017020 con 0x7f7f4006f550 2024-03-29T04:07:49.154 INFO:teuthology.orchestra.run.smithi142.stdout:5 2024-03-29T04:07:49.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.175+0000 7f7f473f4640 1 -- 172.21.15.142:0/2617112614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f4006f550 msgr2=0x7f7f4015ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:49.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.175+0000 7f7f473f4640 1 --2- 172.21.15.142:0/2617112614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f4006f550 0x7f7f4015ea60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c00e980 tx=0x7f7f3c00ee40 comp rx=0 tx=0).stop 2024-03-29T04:07:49.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.175+0000 7f7f473f4640 1 -- 172.21.15.142:0/2617112614 shutdown_connections 2024-03-29T04:07:49.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.175+0000 7f7f473f4640 1 --2- 172.21.15.142:0/2617112614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f4015baf0 0x7f7f400ae480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:49.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.175+0000 7f7f473f4640 1 --2- 172.21.15.142:0/2617112614 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f4015b710 0x7f7f4015c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:49.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.175+0000 7f7f473f4640 1 --2- 172.21.15.142:0/2617112614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f4006f550 0x7f7f4015ea60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:49.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.175+0000 7f7f473f4640 1 -- 172.21.15.142:0/2617112614 >> 172.21.15.142:0/2617112614 conn(0x7f7f400b2ed0 msgr2=0x7f7f400d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:07:49.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.175+0000 7f7f473f4640 1 -- 172.21.15.142:0/2617112614 shutdown_connections 2024-03-29T04:07:49.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.175+0000 7f7f473f4640 1 -- 172.21.15.142:0/2617112614 wait complete. 2024-03-29T04:07:49.166 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new aec4264a-64ac-428e-a860-d2920a304019 6 2024-03-29T04:07:49.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.327+0000 7f7681bc8640 1 Processor -- start 2024-03-29T04:07:49.307 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.328+0000 7f7681bc8640 1 -- start start 2024-03-29T04:07:49.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.328+0000 7f7681bc8640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f767c15f6e0 0x7f767c0b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:49.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.328+0000 7f7681bc8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f767c0b2a70 0x7f767c15fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:49.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.328+0000 7f7681bc8640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f767c0cf3f0 0x7f767c0afcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:49.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.328+0000 7f7681bc8640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f767c160140 con 0x7f767c15f6e0 2024-03-29T04:07:49.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.328+0000 7f7681bc8640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f767c0b1b60 con 0x7f767c0cf3f0 2024-03-29T04:07:49.310 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.328+0000 7f7681bc8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f767c0b01f0 con 0x7f767c0b2a70 2024-03-29T04:07:49.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.328+0000 7f767bfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f767c0cf3f0 0x7f767c0afcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:49.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.329+0000 7f767affd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f767c0b2a70 0x7f767c15fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:49.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.329+0000 7f767bfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f767c0cf3f0 0x7f767c0afcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38572/0 (socket says 172.21.15.142:38572) 2024-03-29T04:07:49.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.329+0000 7f767bfff640 1 -- 172.21.15.142:0/1613808662 learned_addr learned my addr 172.21.15.142:0/1613808662 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-03-29T04:07:49.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.329+0000 7f767b7fe640 1 --2- 172.21.15.142:0/1613808662 >> v2:172.21.15.73:3300/0 conn(0x7f767c15f6e0 0x7f767c0b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:49.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.329+0000 7f767bfff640 1 -- 172.21.15.142:0/1613808662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f767c0b2a70 msgr2=0x7f767c15fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:07:49.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.329+0000 7f767bfff640 1 --2- 172.21.15.142:0/1613808662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f767c0b2a70 0x7f767c15fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:49.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.329+0000 7f767bfff640 1 -- 172.21.15.142:0/1613808662 >> v2:172.21.15.73:3300/0 conn(0x7f767c15f6e0 msgr2=0x7f767c0b1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:07:49.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.329+0000 7f767bfff640 1 --2- 172.21.15.142:0/1613808662 >> v2:172.21.15.73:3300/0 conn(0x7f767c15f6e0 0x7f767c0b1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:49.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.329+0000 7f767bfff640 1 -- 172.21.15.142:0/1613808662 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f767c0b03a0 con 0x7f767c0cf3f0 2024-03-29T04:07:49.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.329+0000 7f767b7fe640 1 --2- 172.21.15.142:0/1613808662 >> v2:172.21.15.73:3300/0 conn(0x7f767c15f6e0 0x7f767c0b1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:07:49.311 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.329+0000 7f767bfff640 1 --2- 172.21.15.142:0/1613808662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f767c0cf3f0 0x7f767c0afcb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f767c0726f0 tx=0x7f767402e050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55e5c383e7786edd server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:07:49.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.330+0000 7f767a7fc640 1 -- 172.21.15.142:0/1613808662 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767402ebf0 con 0x7f767c0cf3f0 2024-03-29T04:07:49.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.330+0000 7f767a7fc640 1 -- 172.21.15.142:0/1613808662 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f767402ed90 con 0x7f767c0cf3f0 2024-03-29T04:07:49.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.330+0000 7f767a7fc640 1 -- 172.21.15.142:0/1613808662 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7674036610 con 0x7f767c0cf3f0 2024-03-29T04:07:49.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.330+0000 7f7681bc8640 1 -- 172.21.15.142:0/1613808662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f767c0cf3f0 msgr2=0x7f767c0afcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:49.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.330+0000 7f7681bc8640 1 --2- 172.21.15.142:0/1613808662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f767c0cf3f0 0x7f767c0afcb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f767c0726f0 tx=0x7f767402e050 comp rx=0 tx=0).stop 2024-03-29T04:07:49.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.330+0000 7f7681bc8640 1 -- 172.21.15.142:0/1613808662 shutdown_connections 2024-03-29T04:07:49.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.330+0000 7f7681bc8640 1 --2- 172.21.15.142:0/1613808662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f767c0cf3f0 0x7f767c0afcb0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:49.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.330+0000 7f7681bc8640 1 --2- 172.21.15.142:0/1613808662 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f767c0b2a70 0x7f767c15fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:49.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.330+0000 7f7681bc8640 1 --2- 172.21.15.142:0/1613808662 >> v2:172.21.15.73:3300/0 conn(0x7f767c15f6e0 0x7f767c0b1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:49.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.330+0000 7f7681bc8640 1 -- 172.21.15.142:0/1613808662 >> 172.21.15.142:0/1613808662 conn(0x7f767c0b2ed0 msgr2=0x7f767c0b32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:07:49.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.330+0000 7f7681bc8640 1 -- 172.21.15.142:0/1613808662 shutdown_connections 2024-03-29T04:07:49.313 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.330+0000 7f7681bc8640 1 -- 172.21.15.142:0/1613808662 wait complete. 2024-03-29T04:07:49.313 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-29T04:07:49.330+0000 7fde0a845040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-29T04:07:49.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.331+0000 7f7681bc8640 1 Processor -- start 2024-03-29T04:07:49.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.332+0000 7f7681bc8640 1 -- start start 2024-03-29T04:07:49.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.332+0000 7f7681bc8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f767c0b2a70 0x7f767c14ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:49.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.332+0000 7f7681bc8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f767c0cf3f0 0x7f767c0c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:49.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.332+0000 7f7681bc8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f767c15f6e0 0x7f767c0c9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:49.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.332+0000 7f7681bc8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f767c06b510 con 0x7f767c15f6e0 2024-03-29T04:07:49.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.332+0000 7f7681bc8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f767c06b690 con 0x7f767c0cf3f0 2024-03-29T04:07:49.317 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.332+0000 7f7681bc8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f767c06b810 con 0x7f767c0b2a70 2024-03-29T04:07:49.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.333+0000 7f767b7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f767c0b2a70 0x7f767c14ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:49.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.333+0000 7f767affd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f767c0cf3f0 0x7f767c0c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:49.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.333+0000 7f767b7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f767c0b2a70 0x7f767c14ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.142:33888/0 (socket says 172.21.15.142:33888) 2024-03-29T04:07:49.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.333+0000 7f767b7fe640 1 -- 172.21.15.142:0/3077711225 learned_addr learned my addr 172.21.15.142:0/3077711225 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-03-29T04:07:49.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.333+0000 7f767bfff640 1 --2- 172.21.15.142:0/3077711225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f767c15f6e0 0x7f767c0c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:49.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.333+0000 7f767affd640 1 -- 172.21.15.142:0/3077711225 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f767c0b2a70 msgr2=0x7f767c14ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:49.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.333+0000 7f767affd640 1 --2- 172.21.15.142:0/3077711225 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f767c0b2a70 0x7f767c14ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:49.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.333+0000 7f767affd640 1 -- 172.21.15.142:0/3077711225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f767c15f6e0 msgr2=0x7f767c0c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:49.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.333+0000 7f767affd640 1 --2- 172.21.15.142:0/3077711225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f767c15f6e0 0x7f767c0c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:49.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.333+0000 7f767affd640 1 -- 172.21.15.142:0/3077711225 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f767c0c9490 con 0x7f767c0cf3f0 2024-03-29T04:07:49.318 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.333+0000 7f767affd640 1 --2- 172.21.15.142:0/3077711225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f767c0cf3f0 0x7f767c0c8450 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f766c00e840 tx=0x7f766c00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:07:49.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.333+0000 7f7663fff640 1 -- 172.21.15.142:0/3077711225 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f766c017070 con 0x7f767c0cf3f0 2024-03-29T04:07:49.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.333+0000 7f7663fff640 1 -- 172.21.15.142:0/3077711225 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f766c00c940 con 0x7f767c0cf3f0 2024-03-29T04:07:49.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.333+0000 7f7681bc8640 1 -- 172.21.15.142:0/3077711225 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f767c0c8ed0 con 0x7f767c0cf3f0 2024-03-29T04:07:49.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.333+0000 7f7663fff640 1 -- 172.21.15.142:0/3077711225 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f766c00ccf0 con 0x7f767c0cf3f0 2024-03-29T04:07:49.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.333+0000 7f7681bc8640 1 -- 172.21.15.142:0/3077711225 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f767c0cc0b0 con 0x7f767c0cf3f0 2024-03-29T04:07:49.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.333+0000 7f7663fff640 1 -- 172.21.15.142:0/3077711225 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f766c01a070 con 0x7f767c0cf3f0 2024-03-29T04:07:49.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.333+0000 7f7663fff640 1 -- 172.21.15.142:0/3077711225 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f766c006550 con 0x7f767c0cf3f0 2024-03-29T04:07:49.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.334+0000 7f7681bc8640 1 -- 172.21.15.142:0/3077711225 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f767c0d01f0 con 0x7f767c0cf3f0 2024-03-29T04:07:49.319 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.336+0000 7f7663fff640 1 -- 172.21.15.142:0/3077711225 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f767c0d01f0 con 0x7f767c0cf3f0 2024-03-29T04:07:49.390 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.410+0000 7f7681bc8640 1 -- 172.21.15.142:0/3077711225 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "aec4264a-64ac-428e-a860-d2920a304019", "id": 6} v 0) -- 0x7f767c09f530 con 0x7f767c0cf3f0 2024-03-29T04:07:49.396 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.416+0000 7f7663fff640 1 -- 172.21.15.142:0/3077711225 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "aec4264a-64ac-428e-a860-d2920a304019", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f766c0067f0 con 0x7f767c0cf3f0 2024-03-29T04:07:49.396 INFO:teuthology.orchestra.run.smithi142.stdout:6 2024-03-29T04:07:49.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.417+0000 7f7681bc8640 1 -- 172.21.15.142:0/3077711225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f767c0cf3f0 msgr2=0x7f767c0c8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:49.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.417+0000 7f7681bc8640 1 --2- 172.21.15.142:0/3077711225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f767c0cf3f0 0x7f767c0c8450 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f766c00e840 tx=0x7f766c00ed00 comp rx=0 tx=0).stop 2024-03-29T04:07:49.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.417+0000 7f7681bc8640 1 -- 172.21.15.142:0/3077711225 shutdown_connections 2024-03-29T04:07:49.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.417+0000 7f7681bc8640 1 --2- 172.21.15.142:0/3077711225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f767c15f6e0 0x7f767c0c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:49.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.417+0000 7f7681bc8640 1 --2- 172.21.15.142:0/3077711225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f767c0cf3f0 0x7f767c0c8450 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:49.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.417+0000 7f7681bc8640 1 --2- 172.21.15.142:0/3077711225 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f767c0b2a70 0x7f767c14ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:49.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.417+0000 7f7681bc8640 1 -- 172.21.15.142:0/3077711225 >> 172.21.15.142:0/3077711225 conn(0x7f767c0b2ed0 msgr2=0x7f767c0b0990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:07:49.397 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.417+0000 7f7681bc8640 1 -- 172.21.15.142:0/3077711225 shutdown_connections 2024-03-29T04:07:49.398 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.417+0000 7f7681bc8640 1 -- 172.21.15.142:0/3077711225 wait complete. 2024-03-29T04:07:49.398 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-03-29T04:07:49.418+0000 7fdd900fa040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-29T04:07:49.410 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd new fe599052-8e5a-4c7a-91e7-52d1bae24a42 7 2024-03-29T04:07:49.444 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-29T04:07:49.465+0000 7fde0a845040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-29T04:07:49.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.530+0000 7fa282760640 1 Processor -- start 2024-03-29T04:07:49.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.530+0000 7fa282760640 1 -- start start 2024-03-29T04:07:49.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.531+0000 7fa282760640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa27c0ce7a0 0x7fa27c0ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:49.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.531+0000 7fa282760640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa27c06f050 0x7fa27c15f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:49.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.531+0000 7fa282760640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa27c0ced60 con 0x7fa27c15b790 2024-03-29T04:07:49.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.531+0000 7fa282760640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fa27c15bb70 con 0x7fa27c06f050 2024-03-29T04:07:49.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.531+0000 7fa282760640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa27c0b3d70 con 0x7fa27c0ce7a0 2024-03-29T04:07:49.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.532+0000 7fa280cfd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa27c06f050 0x7fa27c15f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:49.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.532+0000 7fa27b7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa27c0ce7a0 0x7fa27c0ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:49.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.532+0000 7fa280cfd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa27c06f050 0x7fa27c15f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38584/0 (socket says 172.21.15.142:38584) 2024-03-29T04:07:49.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.532+0000 7fa280cfd640 1 -- 172.21.15.142:0/3914446506 learned_addr learned my addr 172.21.15.142:0/3914446506 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-03-29T04:07:49.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.532+0000 7fa280cfd640 1 -- 172.21.15.142:0/3914446506 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa27c0ce7a0 msgr2=0x7fa27c0ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:07:49.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.532+0000 7fa280cfd640 1 --2- 172.21.15.142:0/3914446506 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa27c0ce7a0 0x7fa27c0ccef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:49.512 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.532+0000 7fa280cfd640 1 -- 172.21.15.142:0/3914446506 >> v1:172.21.15.73:6789/0 conn(0x7fa27c15b790 legacy=0x7fa27c06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:49.513 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.532+0000 7fa280cfd640 1 -- 172.21.15.142:0/3914446506 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa27c0cc130 con 0x7fa27c06f050 2024-03-29T04:07:49.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.533+0000 7fa280cfd640 1 --2- 172.21.15.142:0/3914446506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa27c06f050 0x7fa27c15f1f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa274009e50 tx=0x7fa27402bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=347155a4a796a824 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:07:49.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.533+0000 7fa27affd640 1 -- 172.21.15.142:0/3914446506 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27402cb00 con 0x7fa27c06f050 2024-03-29T04:07:49.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.533+0000 7fa27affd640 1 -- 172.21.15.142:0/3914446506 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa27402cca0 con 0x7fa27c06f050 2024-03-29T04:07:49.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.533+0000 7fa27affd640 1 -- 172.21.15.142:0/3914446506 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa274034610 con 0x7fa27c06f050 2024-03-29T04:07:49.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.533+0000 7fa282760640 1 -- 172.21.15.142:0/3914446506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa27c06f050 msgr2=0x7fa27c15f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:49.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.533+0000 7fa282760640 1 --2- 172.21.15.142:0/3914446506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa27c06f050 0x7fa27c15f1f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa274009e50 tx=0x7fa27402bf60 comp rx=0 tx=0).stop 2024-03-29T04:07:49.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.533+0000 7fa282760640 1 -- 172.21.15.142:0/3914446506 shutdown_connections 2024-03-29T04:07:49.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.533+0000 7fa282760640 1 --2- 172.21.15.142:0/3914446506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa27c06f050 0x7fa27c15f1f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:49.514 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.533+0000 7fa282760640 1 --2- 172.21.15.142:0/3914446506 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa27c0ce7a0 0x7fa27c0ccef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:49.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.533+0000 7fa282760640 1 -- 172.21.15.142:0/3914446506 >> 172.21.15.142:0/3914446506 conn(0x7fa27c0b2ed0 msgr2=0x7fa27c0b32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:07:49.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.533+0000 7fa282760640 1 -- 172.21.15.142:0/3914446506 shutdown_connections 2024-03-29T04:07:49.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.533+0000 7fa282760640 1 -- 172.21.15.142:0/3914446506 wait complete. 2024-03-29T04:07:49.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.535+0000 7fa282760640 1 Processor -- start 2024-03-29T04:07:49.515 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.535+0000 7fa282760640 1 -- start start 2024-03-29T04:07:49.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.537+0000 7fa282760640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa27c06f050 0x7fa27c149670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:49.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.537+0000 7fa282760640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa27c0ce7a0 0x7fa27c0af330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:49.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.537+0000 7fa282760640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa27c15b790 0x7fa27c0af870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:49.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.537+0000 7fa282760640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa27c0cc9d0 con 0x7fa27c06f050 2024-03-29T04:07:49.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.537+0000 7fa282760640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa27c0cc6f0 con 0x7fa27c0ce7a0 2024-03-29T04:07:49.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.537+0000 7fa282760640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa27c06f4c0 con 0x7fa27c15b790 2024-03-29T04:07:49.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.537+0000 7fa27b7fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa27c0ce7a0 0x7fa27c0af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:49.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.537+0000 7fa27b7fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa27c0ce7a0 0x7fa27c0af330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38598/0 (socket says 172.21.15.142:38598) 2024-03-29T04:07:49.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.537+0000 7fa280cfd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa27c15b790 0x7fa27c0af870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:49.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.537+0000 7fa27b7fe640 1 -- 172.21.15.142:0/1868614485 learned_addr learned my addr 172.21.15.142:0/1868614485 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-03-29T04:07:49.518 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.537+0000 7fa27bfff640 1 --2- 172.21.15.142:0/1868614485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa27c06f050 0x7fa27c149670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:49.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.537+0000 7fa27b7fe640 1 -- 172.21.15.142:0/1868614485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa27c15b790 msgr2=0x7fa27c0af870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:49.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.537+0000 7fa27b7fe640 1 --2- 172.21.15.142:0/1868614485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa27c15b790 0x7fa27c0af870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:49.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.537+0000 7fa27b7fe640 1 -- 172.21.15.142:0/1868614485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa27c06f050 msgr2=0x7fa27c149670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:49.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.537+0000 7fa27b7fe640 1 --2- 172.21.15.142:0/1868614485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa27c06f050 0x7fa27c149670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:49.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.537+0000 7fa27b7fe640 1 -- 172.21.15.142:0/1868614485 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa27c0b4b10 con 0x7fa27c0ce7a0 2024-03-29T04:07:49.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.537+0000 7fa280cfd640 1 --2- 172.21.15.142:0/1868614485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa27c15b790 0x7fa27c0af870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:07:49.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.537+0000 7fa27b7fe640 1 --2- 172.21.15.142:0/1868614485 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa27c0ce7a0 0x7fa27c0af330 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa26c00e9b0 tx=0x7fa26c00ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:07:49.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.537+0000 7fa278ff9640 1 -- 172.21.15.142:0/1868614485 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa26c017070 con 0x7fa27c0ce7a0 2024-03-29T04:07:49.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.537+0000 7fa278ff9640 1 -- 172.21.15.142:0/1868614485 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa26c00c9a0 con 0x7fa27c0ce7a0 2024-03-29T04:07:49.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.537+0000 7fa278ff9640 1 -- 172.21.15.142:0/1868614485 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa26c00cd90 con 0x7fa27c0ce7a0 2024-03-29T04:07:49.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.537+0000 7fa282760640 1 -- 172.21.15.142:0/1868614485 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa27c0b4df0 con 0x7fa27c0ce7a0 2024-03-29T04:07:49.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.537+0000 7fa282760640 1 -- 172.21.15.142:0/1868614485 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa27c0b53b0 con 0x7fa27c0ce7a0 2024-03-29T04:07:49.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.538+0000 7fa278ff9640 1 -- 172.21.15.142:0/1868614485 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa26c01a070 con 0x7fa27c0ce7a0 2024-03-29T04:07:49.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.538+0000 7fa278ff9640 1 -- 172.21.15.142:0/1868614485 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fa26c013ad0 con 0x7fa27c0ce7a0 2024-03-29T04:07:49.520 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.539+0000 7fa282760640 1 -- 172.21.15.142:0/1868614485 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa27c09f530 con 0x7fa27c0ce7a0 2024-03-29T04:07:49.520 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.541+0000 7fa278ff9640 1 -- 172.21.15.142:0/1868614485 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fa26c013470 con 0x7fa27c0ce7a0 2024-03-29T04:07:49.554 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-03-29T04:07:49.575+0000 7fdd900fa040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-29T04:07:49.566 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-29T04:07:49.586+0000 7fde0a845040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-29T04:07:49.611 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-29T04:07:49.631+0000 7fde0a845040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-29T04:07:49.615 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.636+0000 7fa282760640 1 -- 172.21.15.142:0/1868614485 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fe599052-8e5a-4c7a-91e7-52d1bae24a42", "id": 7} v 0) -- 0x7fa27c04f9d0 con 0x7fa27c0ce7a0 2024-03-29T04:07:49.621 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.642+0000 7fa278ff9640 1 -- 172.21.15.142:0/1868614485 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fe599052-8e5a-4c7a-91e7-52d1bae24a42", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fa26c013650 con 0x7fa27c0ce7a0 2024-03-29T04:07:49.621 INFO:teuthology.orchestra.run.smithi142.stdout:7 2024-03-29T04:07:49.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.642+0000 7fa282760640 1 -- 172.21.15.142:0/1868614485 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa27c0ce7a0 msgr2=0x7fa27c0af330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:49.622 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.642+0000 7fa282760640 1 --2- 172.21.15.142:0/1868614485 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa27c0ce7a0 0x7fa27c0af330 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa26c00e9b0 tx=0x7fa26c00ee70 comp rx=0 tx=0).stop 2024-03-29T04:07:49.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.643+0000 7fa282760640 1 -- 172.21.15.142:0/1868614485 shutdown_connections 2024-03-29T04:07:49.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.643+0000 7fa282760640 1 --2- 172.21.15.142:0/1868614485 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa27c15b790 0x7fa27c0af870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:49.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.643+0000 7fa282760640 1 --2- 172.21.15.142:0/1868614485 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa27c0ce7a0 0x7fa27c0af330 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:49.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.643+0000 7fa282760640 1 --2- 172.21.15.142:0/1868614485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa27c06f050 0x7fa27c149670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:49.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.643+0000 7fa282760640 1 -- 172.21.15.142:0/1868614485 >> 172.21.15.142:0/1868614485 conn(0x7fa27c0b2ed0 msgr2=0x7fa27c0b1380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:07:49.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.643+0000 7fa282760640 1 -- 172.21.15.142:0/1868614485 shutdown_connections 2024-03-29T04:07:49.623 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:07:49.643+0000 7fa282760640 1 -- 172.21.15.142:0/1868614485 wait complete. 2024-03-29T04:07:49.632 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-29T04:07:49.633 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-03-29T04:07:49.635 INFO:tasks.ceph.osd.0:Started 2024-03-29T04:07:49.635 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-29T04:07:49.635 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-03-29T04:07:49.639 INFO:tasks.ceph.osd.1:Started 2024-03-29T04:07:49.640 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-29T04:07:49.640 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-03-29T04:07:49.641 INFO:tasks.ceph.osd.2:Started 2024-03-29T04:07:49.642 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-29T04:07:49.642 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-03-29T04:07:49.644 INFO:tasks.ceph.osd.3:Started 2024-03-29T04:07:49.644 INFO:tasks.ceph.osd.4:Restarting daemon 2024-03-29T04:07:49.644 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-03-29T04:07:49.646 INFO:tasks.ceph.osd.4:Started 2024-03-29T04:07:49.646 INFO:tasks.ceph.osd.5:Restarting daemon 2024-03-29T04:07:49.646 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-03-29T04:07:49.648 INFO:tasks.ceph.osd.5:Started 2024-03-29T04:07:49.648 INFO:tasks.ceph.osd.6:Restarting daemon 2024-03-29T04:07:49.648 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-03-29T04:07:49.650 INFO:tasks.ceph.osd.6:Started 2024-03-29T04:07:49.650 INFO:tasks.ceph.osd.7:Restarting daemon 2024-03-29T04:07:49.650 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-03-29T04:07:49.652 INFO:tasks.ceph.osd.7:Started 2024-03-29T04:07:49.652 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-29T04:07:49.680 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-03-29T04:07:49.700+0000 7fdd900fa040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-29T04:07:49.738 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-03-29T04:07:49.759+0000 7fdd900fa040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-29T04:07:49.758 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-29T04:07:49.779+0000 7fde0a845040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-29T04:07:49.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.797+0000 7f0117e75640 1 Processor -- start 2024-03-29T04:07:49.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.797+0000 7f0117e75640 1 -- start start 2024-03-29T04:07:49.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.798+0000 7f0117e75640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f011015e6e0 0x7f011009b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:49.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.798+0000 7f0117e75640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0110162ab0 0x7f01100b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:49.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.798+0000 7f0117e75640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01100d1a10 con 0x7f01100d0660 2024-03-29T04:07:49.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.798+0000 7f0117e75640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f01100d0e90 con 0x7f011015e6e0 2024-03-29T04:07:49.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.798+0000 7f0117e75640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f01100d1170 con 0x7f0110162ab0 2024-03-29T04:07:49.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.798+0000 7f0115410640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f01100d0660 0x7f01101623a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49974/0 (socket says 172.21.15.73:49974) 2024-03-29T04:07:49.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.798+0000 7f0115410640 1 -- 172.21.15.73:0/3817315324 learned_addr learned my addr 172.21.15.73:0/3817315324 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:07:49.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.798+0000 7f0116412640 1 --2- 172.21.15.73:0/3817315324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0110162ab0 0x7f01100b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:49.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.798+0000 7f0115c11640 1 --2- 172.21.15.73:0/3817315324 >> v2:172.21.15.142:3300/0 conn(0x7f011015e6e0 0x7f011009b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:49.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.798+0000 7f0114c0f640 1 -- 172.21.15.73:0/3817315324 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3440751243 0 0) 0x7f01100d1a10 con 0x7f01100d0660 2024-03-29T04:07:49.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.799+0000 7f0114c0f640 1 -- 172.21.15.73:0/3817315324 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00fc003520 con 0x7f01100d0660 2024-03-29T04:07:49.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.799+0000 7f0116412640 1 -- 172.21.15.73:0/3817315324 >> v2:172.21.15.142:3300/0 conn(0x7f011015e6e0 msgr2=0x7f011009b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:07:49.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.799+0000 7f0116412640 1 --2- 172.21.15.73:0/3817315324 >> v2:172.21.15.142:3300/0 conn(0x7f011015e6e0 0x7f011009b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:49.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.799+0000 7f0116412640 1 -- 172.21.15.73:0/3817315324 >> v1:172.21.15.73:6789/0 conn(0x7f01100d0660 legacy=0x7f01101623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:49.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.799+0000 7f0116412640 1 -- 172.21.15.73:0/3817315324 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01100d1450 con 0x7f0110162ab0 2024-03-29T04:07:49.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.799+0000 7f0115c11640 1 --2- 172.21.15.73:0/3817315324 >> v2:172.21.15.142:3300/0 conn(0x7f011015e6e0 0x7f011009b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:07:49.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.799+0000 7f0116412640 1 --2- 172.21.15.73:0/3817315324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0110162ab0 0x7f01100b30e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0108009d90 tx=0x7f010802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4268727024c1af17 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:07:49.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.800+0000 7f0114c0f640 1 -- 172.21.15.73:0/3817315324 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0108039070 con 0x7f0110162ab0 2024-03-29T04:07:49.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.800+0000 7f0114c0f640 1 -- 172.21.15.73:0/3817315324 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f010802cc50 con 0x7f0110162ab0 2024-03-29T04:07:49.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.800+0000 7f0114c0f640 1 -- 172.21.15.73:0/3817315324 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0108034440 con 0x7f0110162ab0 2024-03-29T04:07:49.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.800+0000 7f0117e75640 1 -- 172.21.15.73:0/3817315324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0110162ab0 msgr2=0x7f01100b30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:49.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.800+0000 7f0117e75640 1 --2- 172.21.15.73:0/3817315324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0110162ab0 0x7f01100b30e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0108009d90 tx=0x7f010802bea0 comp rx=0 tx=0).stop 2024-03-29T04:07:49.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.800+0000 7f0117e75640 1 -- 172.21.15.73:0/3817315324 shutdown_connections 2024-03-29T04:07:49.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.800+0000 7f0117e75640 1 --2- 172.21.15.73:0/3817315324 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0110162ab0 0x7f01100b30e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:49.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.800+0000 7f0117e75640 1 --2- 172.21.15.73:0/3817315324 >> v2:172.21.15.142:3300/0 conn(0x7f011015e6e0 0x7f011009b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:49.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.800+0000 7f0117e75640 1 -- 172.21.15.73:0/3817315324 >> 172.21.15.73:0/3817315324 conn(0x7f01100b3f10 msgr2=0x7f01100b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:07:49.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.800+0000 7f0117e75640 1 -- 172.21.15.73:0/3817315324 shutdown_connections 2024-03-29T04:07:49.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.800+0000 7f0117e75640 1 -- 172.21.15.73:0/3817315324 wait complete. 2024-03-29T04:07:49.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.801+0000 7f0117e75640 1 Processor -- start 2024-03-29T04:07:49.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.801+0000 7f0117e75640 1 -- start start 2024-03-29T04:07:49.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.802+0000 7f0117e75640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01100d0660 0x7f01100c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:49.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.802+0000 7f0117e75640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f011015e6e0 0x7f01101f89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:49.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.802+0000 7f0117e75640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0110162ab0 0x7f01100b5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:49.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.802+0000 7f0117e75640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f011006d910 con 0x7f011015e6e0 2024-03-29T04:07:49.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.802+0000 7f0117e75640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f01100b1d80 con 0x7f01100d0660 2024-03-29T04:07:49.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.802+0000 7f0117e75640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f01100b7180 con 0x7f0110162ab0 2024-03-29T04:07:49.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.802+0000 7f0115410640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f011015e6e0 0x7f01101f89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:49.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.802+0000 7f0115410640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f011015e6e0 0x7f01101f89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52582/0 (socket says 172.21.15.73:52582) 2024-03-29T04:07:49.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.802+0000 7f0115410640 1 -- 172.21.15.73:0/95008303 learned_addr learned my addr 172.21.15.73:0/95008303 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:07:49.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.802+0000 7f0116412640 1 --2- 172.21.15.73:0/95008303 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0110162ab0 0x7f01100b5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:49.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.802+0000 7f0115c11640 1 --2- 172.21.15.73:0/95008303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01100d0660 0x7f01100c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:49.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.802+0000 7f0115410640 1 -- 172.21.15.73:0/95008303 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0110162ab0 msgr2=0x7f01100b5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:49.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.802+0000 7f0115410640 1 --2- 172.21.15.73:0/95008303 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0110162ab0 0x7f01100b5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:49.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.803+0000 7f0115410640 1 -- 172.21.15.73:0/95008303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01100d0660 msgr2=0x7f01100c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:49.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.803+0000 7f0115410640 1 --2- 172.21.15.73:0/95008303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01100d0660 0x7f01100c8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:49.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.803+0000 7f0115410640 1 -- 172.21.15.73:0/95008303 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01100b7460 con 0x7f011015e6e0 2024-03-29T04:07:49.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.803+0000 7f0115410640 1 --2- 172.21.15.73:0/95008303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f011015e6e0 0x7f01101f89d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f010400c430 tx=0x7f010400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:07:49.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.803+0000 7f01027fc640 1 -- 172.21.15.73:0/95008303 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0104017070 con 0x7f011015e6e0 2024-03-29T04:07:49.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.803+0000 7f01027fc640 1 -- 172.21.15.73:0/95008303 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0104005ce0 con 0x7f011015e6e0 2024-03-29T04:07:49.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.803+0000 7f0117e75640 1 -- 172.21.15.73:0/95008303 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01100b7740 con 0x7f011015e6e0 2024-03-29T04:07:49.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.803+0000 7f01027fc640 1 -- 172.21.15.73:0/95008303 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01040072f0 con 0x7f011015e6e0 2024-03-29T04:07:49.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.803+0000 7f0117e75640 1 -- 172.21.15.73:0/95008303 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01100b7d00 con 0x7f011015e6e0 2024-03-29T04:07:49.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.803+0000 7f01027fc640 1 -- 172.21.15.73:0/95008303 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f010401a070 con 0x7f011015e6e0 2024-03-29T04:07:49.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.803+0000 7f01027fc640 1 -- 172.21.15.73:0/95008303 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f0104007490 con 0x7f011015e6e0 2024-03-29T04:07:49.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.804+0000 7f0117e75640 1 -- 172.21.15.73:0/95008303 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01100d0030 con 0x7f011015e6e0 2024-03-29T04:07:49.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.806+0000 7f01027fc640 1 -- 172.21.15.73:0/95008303 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f01100d0030 con 0x7f011015e6e0 2024-03-29T04:07:49.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.865+0000 7f0117e75640 1 -- 172.21.15.73:0/95008303 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0110068640 con 0x7f011015e6e0 2024-03-29T04:07:49.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.866+0000 7f01027fc640 1 -- 172.21.15.73:0/95008303 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f0104021020 con 0x7f011015e6e0 2024-03-29T04:07:49.846 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:07:49.846 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":10,"fsid":"6bff1617-b138-4517-acca-3ecaae3f2bb3","created":"2024-03-29T04:07:47.346864+0000","modified":"2024-03-29T04:07:49.637816+0000","last_up_change":"0.000000","last_in_change":"2024-03-29T04:07:49.637816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"925d7de1-14ab-48c0-aebd-7bded108f808","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6b182102-882a-4e0c-99db-0afae5cfb38b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8040902e-b0b8-4a21-bf64-ce1c222115ea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1bab19ee-3775-4ce1-a4ce-cf7cda3bbbf8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b0c74337-8fe4-47dc-b3da-2d07591b1f6e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9ce36410-a29a-42c6-99f4-f95d4afdd7b5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"aec4264a-64ac-428e-a860-d2920a304019","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fe599052-8e5a-4c7a-91e7-52d1bae24a42","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:07:49.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.867+0000 7f0117e75640 1 -- 172.21.15.73:0/95008303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f011015e6e0 msgr2=0x7f01101f89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:49.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.867+0000 7f0117e75640 1 --2- 172.21.15.73:0/95008303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f011015e6e0 0x7f01101f89d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f010400c430 tx=0x7f010400c8f0 comp rx=0 tx=0).stop 2024-03-29T04:07:49.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.867+0000 7f0117e75640 1 -- 172.21.15.73:0/95008303 shutdown_connections 2024-03-29T04:07:49.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.867+0000 7f0117e75640 1 --2- 172.21.15.73:0/95008303 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0110162ab0 0x7f01100b5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:49.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.867+0000 7f0117e75640 1 --2- 172.21.15.73:0/95008303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f011015e6e0 0x7f01101f89d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:49.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.867+0000 7f0117e75640 1 --2- 172.21.15.73:0/95008303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01100d0660 0x7f01100c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:49.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.867+0000 7f0117e75640 1 -- 172.21.15.73:0/95008303 >> 172.21.15.73:0/95008303 conn(0x7f01100b3f10 msgr2=0x7f011015d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:07:49.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.867+0000 7f0117e75640 1 -- 172.21.15.73:0/95008303 shutdown_connections 2024-03-29T04:07:49.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:07:49.867+0000 7f0117e75640 1 -- 172.21.15.73:0/95008303 wait complete. 2024-03-29T04:07:49.855 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-03-29T04:07:49.876+0000 7fdd900fa040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-29T04:07:49.858 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-29T04:07:49.858 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-29T04:07:49.858 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-29T04:07:49.878+0000 7fde0a845040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-29T04:07:49.950 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-03-29T04:07:49.970+0000 7fdd900fa040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-29T04:07:50.010 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-03-29T04:07:50.030+0000 7f265a412640 -1 Falling back to public interface 2024-03-29T04:07:50.013 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-29T04:07:50.033+0000 7fde0a845040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-29T04:07:50.056 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-29T04:07:50.077+0000 7fde0a845040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-29T04:07:50.107 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-03-29T04:07:50.127+0000 7fdd900fa040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-29T04:07:50.150 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-03-29T04:07:50.170+0000 7fdd900fa040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-29T04:07:50.210 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-29T04:07:50.230+0000 7fde0a845040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-29T04:07:50.249 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-03-29T04:07:50.269+0000 7f3de000c640 -1 Falling back to public interface 2024-03-29T04:07:50.252 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-03-29T04:07:50.272+0000 7f1c14411640 -1 Falling back to public interface 2024-03-29T04:07:50.256 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-03-29T04:07:50.277+0000 7f8e4f066640 -1 Falling back to public interface 2024-03-29T04:07:50.268 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-03-29T04:07:50.288+0000 7fcd346f9640 -1 Falling back to public interface 2024-03-29T04:07:50.268 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-03-29T04:07:50.289+0000 7f149c4bf640 -1 Falling back to public interface 2024-03-29T04:07:50.272 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-03-29T04:07:50.292+0000 7f93e70a0640 -1 Falling back to public interface 2024-03-29T04:07:50.276 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-03-29T04:07:50.296+0000 7fd692a0c640 -1 Falling back to public interface 2024-03-29T04:07:50.309 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-03-29T04:07:50.329+0000 7fdd900fa040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-29T04:07:50.665 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-29T04:07:50.754 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.774+0000 7ff187ae0640 1 Processor -- start 2024-03-29T04:07:50.754 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.774+0000 7ff187ae0640 1 -- start start 2024-03-29T04:07:50.755 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.775+0000 7ff187ae0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff18015eaf0 0x7ff1800ba1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:50.755 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.775+0000 7ff187ae0640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff1800d29c0 0x7ff1800cf430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:50.755 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.775+0000 7ff187ae0640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1800d3130 con 0x7ff1800cf970 2024-03-29T04:07:50.755 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.775+0000 7ff187ae0640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7ff1800cfda0 con 0x7ff1800d29c0 2024-03-29T04:07:50.756 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.775+0000 7ff187ae0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7ff1800d3410 con 0x7ff18015eaf0 2024-03-29T04:07:50.756 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.775+0000 7ff18507b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff1800d29c0 0x7ff1800cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:50.756 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.775+0000 7ff18507b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff1800d29c0 0x7ff1800cf430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52586/0 (socket says 172.21.15.73:52586) 2024-03-29T04:07:50.756 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.775+0000 7ff18607d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff1800cf970 0x7ff1800d1050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:49982/0 (socket says 172.21.15.73:49982) 2024-03-29T04:07:50.756 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.775+0000 7ff18507b640 1 -- 172.21.15.73:0/873609178 learned_addr learned my addr 172.21.15.73:0/873609178 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:07:50.756 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.775+0000 7ff18587c640 1 --2- 172.21.15.73:0/873609178 >> v2:172.21.15.142:3300/0 conn(0x7ff18015eaf0 0x7ff1800ba1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:50.756 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.775+0000 7ff18507b640 1 -- 172.21.15.73:0/873609178 >> v2:172.21.15.142:3300/0 conn(0x7ff18015eaf0 msgr2=0x7ff1800ba1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:07:50.756 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.775+0000 7ff18507b640 1 --2- 172.21.15.73:0/873609178 >> v2:172.21.15.142:3300/0 conn(0x7ff18015eaf0 0x7ff1800ba1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:50.756 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.775+0000 7ff18507b640 1 -- 172.21.15.73:0/873609178 >> v1:172.21.15.73:6789/0 conn(0x7ff1800cf970 legacy=0x7ff1800d1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:50.756 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.775+0000 7ff18487a640 1 -- 172.21.15.73:0/873609178 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2708901869 0 0) 0x7ff1800d3130 con 0x7ff1800cf970 2024-03-29T04:07:50.756 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.775+0000 7ff18507b640 1 -- 172.21.15.73:0/873609178 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1800d36f0 con 0x7ff1800d29c0 2024-03-29T04:07:50.758 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.776+0000 7ff18507b640 1 --2- 172.21.15.73:0/873609178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1800d29c0 0x7ff1800cf430 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff1800cb6e0 tx=0x7ff17002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1245e44e0c083cf1 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:07:50.758 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.776+0000 7ff18487a640 1 -- 172.21.15.73:0/873609178 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff170034070 con 0x7ff1800d29c0 2024-03-29T04:07:50.758 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.776+0000 7ff18487a640 1 -- 172.21.15.73:0/873609178 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff170030860 con 0x7ff1800d29c0 2024-03-29T04:07:50.758 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.776+0000 7ff18487a640 1 -- 172.21.15.73:0/873609178 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff170030c30 con 0x7ff1800d29c0 2024-03-29T04:07:50.758 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.777+0000 7ff187ae0640 1 -- 172.21.15.73:0/873609178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1800d29c0 msgr2=0x7ff1800cf430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:50.758 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.777+0000 7ff187ae0640 1 --2- 172.21.15.73:0/873609178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1800d29c0 0x7ff1800cf430 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff1800cb6e0 tx=0x7ff17002b9a0 comp rx=0 tx=0).stop 2024-03-29T04:07:50.758 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.777+0000 7ff187ae0640 1 -- 172.21.15.73:0/873609178 shutdown_connections 2024-03-29T04:07:50.758 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.777+0000 7ff187ae0640 1 --2- 172.21.15.73:0/873609178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1800d29c0 0x7ff1800cf430 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:50.758 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.777+0000 7ff187ae0640 1 --2- 172.21.15.73:0/873609178 >> v2:172.21.15.142:3300/0 conn(0x7ff18015eaf0 0x7ff1800ba1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:50.758 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.777+0000 7ff187ae0640 1 -- 172.21.15.73:0/873609178 >> 172.21.15.73:0/873609178 conn(0x7ff18006c8a0 msgr2=0x7ff18006ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:07:50.759 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.777+0000 7ff187ae0640 1 -- 172.21.15.73:0/873609178 shutdown_connections 2024-03-29T04:07:50.759 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.777+0000 7ff187ae0640 1 -- 172.21.15.73:0/873609178 wait complete. 2024-03-29T04:07:50.759 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.778+0000 7ff187ae0640 1 Processor -- start 2024-03-29T04:07:50.759 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.778+0000 7ff187ae0640 1 -- start start 2024-03-29T04:07:50.761 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.779+0000 7ff187ae0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1800cf970 0x7ff180161990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:50.761 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.779+0000 7ff187ae0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1800d29c0 0x7ff18014fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:50.761 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.779+0000 7ff187ae0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff18015eaf0 0x7ff180150720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:50.761 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.779+0000 7ff187ae0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff1800d2e50 con 0x7ff18015eaf0 2024-03-29T04:07:50.761 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.779+0000 7ff187ae0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff1800d3cb0 con 0x7ff1800cf970 2024-03-29T04:07:50.761 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.779+0000 7ff187ae0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff1800b87a0 con 0x7ff1800d29c0 2024-03-29T04:07:50.761 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.779+0000 7ff18607d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff18015eaf0 0x7ff180150720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:50.761 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.779+0000 7ff18607d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff18015eaf0 0x7ff180150720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:52588/0 (socket says 172.21.15.73:52588) 2024-03-29T04:07:50.761 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.779+0000 7ff18607d640 1 -- 172.21.15.73:0/1368379856 learned_addr learned my addr 172.21.15.73:0/1368379856 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:07:50.761 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.779+0000 7ff18587c640 1 --2- 172.21.15.73:0/1368379856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1800cf970 0x7ff180161990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:50.761 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.779+0000 7ff18507b640 1 --2- 172.21.15.73:0/1368379856 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1800d29c0 0x7ff18014fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:50.762 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.779+0000 7ff18607d640 1 -- 172.21.15.73:0/1368379856 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1800d29c0 msgr2=0x7ff18014fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:50.762 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.779+0000 7ff18607d640 1 --2- 172.21.15.73:0/1368379856 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1800d29c0 0x7ff18014fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:50.762 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.779+0000 7ff18607d640 1 -- 172.21.15.73:0/1368379856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1800cf970 msgr2=0x7ff180161990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:50.762 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.779+0000 7ff18607d640 1 --2- 172.21.15.73:0/1368379856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1800cf970 0x7ff180161990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:50.762 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.779+0000 7ff18607d640 1 -- 172.21.15.73:0/1368379856 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff18015fa50 con 0x7ff18015eaf0 2024-03-29T04:07:50.762 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.779+0000 7ff18587c640 1 --2- 172.21.15.73:0/1368379856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1800cf970 0x7ff180161990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:07:50.762 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.779+0000 7ff18507b640 1 --2- 172.21.15.73:0/1368379856 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1800d29c0 0x7ff18014fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:07:50.762 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.779+0000 7ff18607d640 1 --2- 172.21.15.73:0/1368379856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff18015eaf0 0x7ff180150720 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff17800c780 tx=0x7ff17800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:07:50.762 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.780+0000 7ff1767fc640 1 -- 172.21.15.73:0/1368379856 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff178018070 con 0x7ff18015eaf0 2024-03-29T04:07:50.762 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.780+0000 7ff1767fc640 1 -- 172.21.15.73:0/1368379856 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff17800ce30 con 0x7ff18015eaf0 2024-03-29T04:07:50.762 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.780+0000 7ff187ae0640 1 -- 172.21.15.73:0/1368379856 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff18015fd30 con 0x7ff18015eaf0 2024-03-29T04:07:50.762 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.780+0000 7ff1767fc640 1 -- 172.21.15.73:0/1368379856 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff17800a840 con 0x7ff18015eaf0 2024-03-29T04:07:50.762 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.780+0000 7ff187ae0640 1 -- 172.21.15.73:0/1368379856 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1801602f0 con 0x7ff18015eaf0 2024-03-29T04:07:50.762 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.780+0000 7ff1767fc640 1 -- 172.21.15.73:0/1368379856 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff17801b070 con 0x7ff18015eaf0 2024-03-29T04:07:50.763 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.780+0000 7ff1767fc640 1 -- 172.21.15.73:0/1368379856 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7ff178007800 con 0x7ff18015eaf0 2024-03-29T04:07:50.763 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.781+0000 7ff187ae0640 1 -- 172.21.15.73:0/1368379856 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff18006de10 con 0x7ff18015eaf0 2024-03-29T04:07:50.764 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.784+0000 7ff1767fc640 1 -- 172.21.15.73:0/1368379856 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7ff178022020 con 0x7ff18015eaf0 2024-03-29T04:07:50.827 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.847+0000 7ff187ae0640 1 -- 172.21.15.73:0/1368379856 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff1800b9f80 con 0x7ff18015eaf0 2024-03-29T04:07:50.827 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.847+0000 7ff1767fc640 1 -- 172.21.15.73:0/1368379856 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7ff178007180 con 0x7ff18015eaf0 2024-03-29T04:07:50.827 INFO:teuthology.misc.health.smithi073.stdout: 2024-03-29T04:07:50.828 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":10,"fsid":"6bff1617-b138-4517-acca-3ecaae3f2bb3","created":"2024-03-29T04:07:47.346864+0000","modified":"2024-03-29T04:07:49.637816+0000","last_up_change":"0.000000","last_in_change":"2024-03-29T04:07:49.637816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"925d7de1-14ab-48c0-aebd-7bded108f808","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6b182102-882a-4e0c-99db-0afae5cfb38b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8040902e-b0b8-4a21-bf64-ce1c222115ea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1bab19ee-3775-4ce1-a4ce-cf7cda3bbbf8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b0c74337-8fe4-47dc-b3da-2d07591b1f6e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9ce36410-a29a-42c6-99f4-f95d4afdd7b5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"aec4264a-64ac-428e-a860-d2920a304019","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fe599052-8e5a-4c7a-91e7-52d1bae24a42","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:07:50.828 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.848+0000 7ff187ae0640 1 -- 172.21.15.73:0/1368379856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff18015eaf0 msgr2=0x7ff180150720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:50.828 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.848+0000 7ff187ae0640 1 --2- 172.21.15.73:0/1368379856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff18015eaf0 0x7ff180150720 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff17800c780 tx=0x7ff17800cc40 comp rx=0 tx=0).stop 2024-03-29T04:07:50.829 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.848+0000 7ff187ae0640 1 -- 172.21.15.73:0/1368379856 shutdown_connections 2024-03-29T04:07:50.829 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.848+0000 7ff187ae0640 1 --2- 172.21.15.73:0/1368379856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff18015eaf0 0x7ff180150720 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:50.829 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.848+0000 7ff187ae0640 1 --2- 172.21.15.73:0/1368379856 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1800d29c0 0x7ff18014fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:50.829 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.848+0000 7ff187ae0640 1 --2- 172.21.15.73:0/1368379856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1800cf970 0x7ff180161990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:50.829 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.848+0000 7ff187ae0640 1 -- 172.21.15.73:0/1368379856 >> 172.21.15.73:0/1368379856 conn(0x7ff18006c8a0 msgr2=0x7ff180158ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:07:50.829 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.849+0000 7ff187ae0640 1 -- 172.21.15.73:0/1368379856 shutdown_connections 2024-03-29T04:07:50.829 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:50.849+0000 7ff187ae0640 1 -- 172.21.15.73:0/1368379856 wait complete. 2024-03-29T04:07:50.837 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-29T04:07:51.046 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-29T04:07:51.066+0000 7fde0a845040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-29T04:07:51.148 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-03-29T04:07:51.169+0000 7fdd900fa040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-29T04:07:51.324 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-29T04:07:51.343+0000 7fde0a845040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-29T04:07:51.377 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-29T04:07:51.396+0000 7fde0a845040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-29T04:07:51.426 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-03-29T04:07:51.446+0000 7fdd900fa040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-29T04:07:51.477 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-03-29T04:07:51.498+0000 7fdd900fa040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-29T04:07:51.492 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-29T04:07:51.511+0000 7fde0a845040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-29T04:07:51.597 INFO:tasks.ceph.mgr.x.smithi142.stderr:2024-03-29T04:07:51.617+0000 7fdd900fa040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-29T04:07:52.505 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-29T04:07:52.525+0000 7fddab4dd640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-29T04:07:52.506 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-03-29T04:07:52.525+0000 7fddab4dd640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-29T04:07:53.516 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-03-29T04:07:53.536+0000 7f265a412640 -1 osd.1 0 log_to_monitors true 2024-03-29T04:07:53.712 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-03-29T04:07:53.732+0000 7f8e4f066640 -1 osd.7 0 log_to_monitors true 2024-03-29T04:07:53.769 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-03-29T04:07:53.789+0000 7f3de000c640 -1 osd.6 0 log_to_monitors true 2024-03-29T04:07:53.772 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-03-29T04:07:53.793+0000 7f93e70a0640 -1 osd.4 0 log_to_monitors true 2024-03-29T04:07:53.780 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-03-29T04:07:53.801+0000 7f1c14411640 -1 osd.2 0 log_to_monitors true 2024-03-29T04:07:53.780 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-03-29T04:07:53.801+0000 7fd692a0c640 -1 osd.5 0 log_to_monitors true 2024-03-29T04:07:53.781 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-03-29T04:07:53.802+0000 7fcd346f9640 -1 osd.3 0 log_to_monitors true 2024-03-29T04:07:53.800 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-03-29T04:07:53.820+0000 7f149c4bf640 -1 osd.0 0 log_to_monitors true 2024-03-29T04:07:57.452 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-03-29T04:07:57.472+0000 7f3ddb9d3640 -1 osd.6 0 waiting for initial osdmap 2024-03-29T04:07:57.483 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-03-29T04:07:57.503+0000 7fd68e475640 -1 osd.5 0 waiting for initial osdmap 2024-03-29T04:07:57.486 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-03-29T04:07:57.507+0000 7f3dd37f3640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-29T04:07:57.503 INFO:tasks.ceph.osd.5.smithi142.stderr:2024-03-29T04:07:57.524+0000 7fd686295640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-29T04:07:57.518 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-03-29T04:07:57.538+0000 7f93e3036640 -1 osd.4 0 waiting for initial osdmap 2024-03-29T04:07:57.549 INFO:tasks.ceph.osd.4.smithi142.stderr:2024-03-29T04:07:57.570+0000 7f93dae56640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-29T04:07:57.574 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-03-29T04:07:57.594+0000 7f26565f8640 -1 osd.1 0 waiting for initial osdmap 2024-03-29T04:07:57.587 INFO:tasks.ceph.osd.1.smithi073.stderr:2024-03-29T04:07:57.607+0000 7f264dc04640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-29T04:07:57.605 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-03-29T04:07:57.624+0000 7fcd3068f640 -1 osd.3 0 waiting for initial osdmap 2024-03-29T04:07:57.606 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-03-29T04:07:57.624+0000 7f1c0fdc0640 -1 osd.2 0 waiting for initial osdmap 2024-03-29T04:07:57.616 INFO:tasks.ceph.osd.2.smithi073.stderr:2024-03-29T04:07:57.637+0000 7f1c07be0640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-29T04:07:57.617 INFO:tasks.ceph.osd.3.smithi073.stderr:2024-03-29T04:07:57.637+0000 7fcd284af640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-29T04:07:57.620 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-03-29T04:07:57.641+0000 7f1498455640 -1 osd.0 0 waiting for initial osdmap 2024-03-29T04:07:57.630 INFO:tasks.ceph.osd.0.smithi073.stderr:2024-03-29T04:07:57.651+0000 7f1490275640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-29T04:07:57.644 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-29T04:07:57.732 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.752+0000 7f7c23455640 1 Processor -- start 2024-03-29T04:07:57.733 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.753+0000 7f7c23455640 1 -- start start 2024-03-29T04:07:57.734 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.753+0000 7f7c23455640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c1c06c5c0 0x7f7c1c15ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:57.735 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.753+0000 7f7c23455640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7c1c06fc10 0x7f7c1c15dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:57.735 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.753+0000 7f7c23455640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c1c06eb70 con 0x7f7c1c06c9a0 2024-03-29T04:07:57.735 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.753+0000 7f7c23455640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f7c1c06f780 con 0x7f7c1c06fc10 2024-03-29T04:07:57.735 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.753+0000 7f7c23455640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7c1c06ee50 con 0x7f7c1c06c5c0 2024-03-29T04:07:57.735 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.754+0000 7f7c211f1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c1c06c5c0 0x7f7c1c15ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:57.735 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.754+0000 7f7c219f2640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7c1c06fc10 0x7f7c1c15dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:57.735 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.754+0000 7f7c211f1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c1c06c5c0 0x7f7c1c15ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:56794/0 (socket says 172.21.15.73:56794) 2024-03-29T04:07:57.735 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.754+0000 7f7c219f2640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7c1c06fc10 0x7f7c1c15dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:46824/0 (socket says 172.21.15.73:46824) 2024-03-29T04:07:57.735 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.754+0000 7f7c211f1640 1 -- 172.21.15.73:0/2659546236 learned_addr learned my addr 172.21.15.73:0/2659546236 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:07:57.735 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.754+0000 7f7c211f1640 1 -- 172.21.15.73:0/2659546236 >> v2:172.21.15.142:3300/0 conn(0x7f7c1c06fc10 msgr2=0x7f7c1c15dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:07:57.735 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.754+0000 7f7c211f1640 1 --2- 172.21.15.73:0/2659546236 >> v2:172.21.15.142:3300/0 conn(0x7f7c1c06fc10 0x7f7c1c15dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:57.735 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.754+0000 7f7c211f1640 1 -- 172.21.15.73:0/2659546236 >> v1:172.21.15.142:6789/0 conn(0x7f7c1c06c9a0 legacy=0x7f7c1c06e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:57.736 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.754+0000 7f7c211f1640 1 -- 172.21.15.73:0/2659546236 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c1c06f130 con 0x7f7c1c06c5c0 2024-03-29T04:07:57.736 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.754+0000 7f7c219f2640 1 --2- 172.21.15.73:0/2659546236 >> v2:172.21.15.142:3300/0 conn(0x7f7c1c06fc10 0x7f7c1c15dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:07:57.736 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.755+0000 7f7c211f1640 1 --2- 172.21.15.73:0/2659546236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c1c06c5c0 0x7f7c1c15ca50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7c14009e50 tx=0x7f7c1402bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6dd49ee78d02963 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:07:57.736 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.755+0000 7f7c1bfff640 1 -- 172.21.15.73:0/2659546236 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1402ca70 con 0x7f7c1c06c5c0 2024-03-29T04:07:57.736 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.755+0000 7f7c1bfff640 1 -- 172.21.15.73:0/2659546236 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c1402cc10 con 0x7f7c1c06c5c0 2024-03-29T04:07:57.736 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.755+0000 7f7c1bfff640 1 -- 172.21.15.73:0/2659546236 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c140343f0 con 0x7f7c1c06c5c0 2024-03-29T04:07:57.739 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.755+0000 7f7c23455640 1 -- 172.21.15.73:0/2659546236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c1c06c5c0 msgr2=0x7f7c1c15ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:57.739 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.755+0000 7f7c23455640 1 --2- 172.21.15.73:0/2659546236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c1c06c5c0 0x7f7c1c15ca50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7c14009e50 tx=0x7f7c1402bed0 comp rx=0 tx=0).stop 2024-03-29T04:07:57.739 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.756+0000 7f7c23455640 1 -- 172.21.15.73:0/2659546236 shutdown_connections 2024-03-29T04:07:57.739 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.756+0000 7f7c23455640 1 --2- 172.21.15.73:0/2659546236 >> v2:172.21.15.142:3300/0 conn(0x7f7c1c06fc10 0x7f7c1c15dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:57.739 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.756+0000 7f7c23455640 1 --2- 172.21.15.73:0/2659546236 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c1c06c5c0 0x7f7c1c15ca50 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:57.739 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.756+0000 7f7c23455640 1 -- 172.21.15.73:0/2659546236 >> 172.21.15.73:0/2659546236 conn(0x7f7c1c0726e0 msgr2=0x7f7c1c072af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:07:57.739 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.756+0000 7f7c23455640 1 -- 172.21.15.73:0/2659546236 shutdown_connections 2024-03-29T04:07:57.739 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.756+0000 7f7c23455640 1 -- 172.21.15.73:0/2659546236 wait complete. 2024-03-29T04:07:57.739 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.757+0000 7f7c23455640 1 Processor -- start 2024-03-29T04:07:57.740 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.757+0000 7f7c23455640 1 -- start start 2024-03-29T04:07:57.740 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.757+0000 7f7c23455640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c1c06c5c0 0x7f7c1c14b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:57.740 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.757+0000 7f7c23455640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c1c06c9a0 0x7f7c1c157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:57.740 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.757+0000 7f7c23455640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c1c06fc10 0x7f7c1c0cec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:57.740 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.757+0000 7f7c23455640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7c1c070070 con 0x7f7c1c06fc10 2024-03-29T04:07:57.740 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.757+0000 7f7c23455640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7c1c06ce20 con 0x7f7c1c06c5c0 2024-03-29T04:07:57.740 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.757+0000 7f7c23455640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7c1c0701f0 con 0x7f7c1c06c9a0 2024-03-29T04:07:57.740 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.758+0000 7f7c219f2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c1c06fc10 0x7f7c1c0cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:57.740 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.758+0000 7f7c211f1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c1c06c5c0 0x7f7c1c14b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:57.740 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.758+0000 7f7c211f1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c1c06c5c0 0x7f7c1c14b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:46830/0 (socket says 172.21.15.73:46830) 2024-03-29T04:07:57.740 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.758+0000 7f7c219f2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c1c06fc10 0x7f7c1c0cec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51516/0 (socket says 172.21.15.73:51516) 2024-03-29T04:07:57.740 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.758+0000 7f7c209f0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c1c06c9a0 0x7f7c1c157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:57.740 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.758+0000 7f7c211f1640 1 -- 172.21.15.73:0/2649370632 learned_addr learned my addr 172.21.15.73:0/2649370632 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:07:57.741 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.758+0000 7f7c211f1640 1 -- 172.21.15.73:0/2649370632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c1c06c9a0 msgr2=0x7f7c1c157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:57.741 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.758+0000 7f7c211f1640 1 --2- 172.21.15.73:0/2649370632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c1c06c9a0 0x7f7c1c157110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:57.741 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.758+0000 7f7c211f1640 1 -- 172.21.15.73:0/2649370632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c1c06fc10 msgr2=0x7f7c1c0cec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:57.741 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.758+0000 7f7c211f1640 1 --2- 172.21.15.73:0/2649370632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c1c06fc10 0x7f7c1c0cec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:57.741 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.758+0000 7f7c211f1640 1 -- 172.21.15.73:0/2649370632 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c1c157a80 con 0x7f7c1c06c5c0 2024-03-29T04:07:57.741 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.758+0000 7f7c211f1640 1 --2- 172.21.15.73:0/2649370632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c1c06c5c0 0x7f7c1c14b630 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7c14036040 tx=0x7f7c14004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:07:57.741 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.758+0000 7f7c19ffb640 1 -- 172.21.15.73:0/2649370632 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c14043020 con 0x7f7c1c06c5c0 2024-03-29T04:07:57.741 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.758+0000 7f7c19ffb640 1 -- 172.21.15.73:0/2649370632 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c1403e450 con 0x7f7c1c06c5c0 2024-03-29T04:07:57.741 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.758+0000 7f7c23455640 1 -- 172.21.15.73:0/2649370632 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c1c157d60 con 0x7f7c1c06c5c0 2024-03-29T04:07:57.741 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.758+0000 7f7c19ffb640 1 -- 172.21.15.73:0/2649370632 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c14009510 con 0x7f7c1c06c5c0 2024-03-29T04:07:57.741 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.758+0000 7f7c23455640 1 -- 172.21.15.73:0/2649370632 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c1c158320 con 0x7f7c1c06c5c0 2024-03-29T04:07:57.741 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.759+0000 7f7c23455640 1 -- 172.21.15.73:0/2649370632 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c1c09f0a0 con 0x7f7c1c06c5c0 2024-03-29T04:07:57.742 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.760+0000 7f7c19ffb640 1 -- 172.21.15.73:0/2649370632 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) ==== 90800+0+0 (secure 0 0 0) 0x7f7c14046020 con 0x7f7c1c06c5c0 2024-03-29T04:07:57.742 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.760+0000 7f7c19ffb640 1 --2- 172.21.15.73:0/2649370632 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7c0806c4a0 0x7f7c0806e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:07:57.742 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.761+0000 7f7c209f0640 1 --2- 172.21.15.73:0/2649370632 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7c0806c4a0 0x7f7c0806e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:07:57.742 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.761+0000 7f7c19ffb640 1 -- 172.21.15.73:0/2649370632 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f7c140acfa0 con 0x7f7c1c06c5c0 2024-03-29T04:07:57.743 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.761+0000 7f7c209f0640 1 --2- 172.21.15.73:0/2649370632 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7c0806c4a0 0x7f7c0806e960 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c153500 tx=0x7f7c10009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:07:57.748 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.768+0000 7f7c19ffb640 1 -- 172.21.15.73:0/2649370632 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f7c1404d030 con 0x7f7c1c06c5c0 2024-03-29T04:07:57.923 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.944+0000 7f7c23455640 1 -- 172.21.15.73:0/2649370632 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7c1c15e610 con 0x7f7c1c06c5c0 2024-03-29T04:07:57.924 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.945+0000 7f7c19ffb640 1 -- 172.21.15.73:0/2649370632 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f7c1407c630 con 0x7f7c1c06c5c0 2024-03-29T04:07:57.924 INFO:teuthology.misc.health.smithi073.stdout: 2024-03-29T04:07:57.925 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":12,"fsid":"6bff1617-b138-4517-acca-3ecaae3f2bb3","created":"2024-03-29T04:07:47.346864+0000","modified":"2024-03-29T04:07:55.527322+0000","last_up_change":"0.000000","last_in_change":"2024-03-29T04:07:49.637816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"925d7de1-14ab-48c0-aebd-7bded108f808","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6b182102-882a-4e0c-99db-0afae5cfb38b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8040902e-b0b8-4a21-bf64-ce1c222115ea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1bab19ee-3775-4ce1-a4ce-cf7cda3bbbf8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b0c74337-8fe4-47dc-b3da-2d07591b1f6e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9ce36410-a29a-42c6-99f4-f95d4afdd7b5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"aec4264a-64ac-428e-a860-d2920a304019","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fe599052-8e5a-4c7a-91e7-52d1bae24a42","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:07:57.927 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.947+0000 7f7c23455640 1 -- 172.21.15.73:0/2649370632 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7c0806c4a0 msgr2=0x7f7c0806e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:57.927 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.947+0000 7f7c23455640 1 --2- 172.21.15.73:0/2649370632 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7c0806c4a0 0x7f7c0806e960 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c153500 tx=0x7f7c10009040 comp rx=0 tx=0).stop 2024-03-29T04:07:57.927 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.947+0000 7f7c23455640 1 -- 172.21.15.73:0/2649370632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c1c06c5c0 msgr2=0x7f7c1c14b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:07:57.927 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.947+0000 7f7c23455640 1 --2- 172.21.15.73:0/2649370632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c1c06c5c0 0x7f7c1c14b630 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7c14036040 tx=0x7f7c14004a40 comp rx=0 tx=0).stop 2024-03-29T04:07:57.927 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.947+0000 7f7c23455640 1 -- 172.21.15.73:0/2649370632 shutdown_connections 2024-03-29T04:07:57.927 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.947+0000 7f7c23455640 1 --2- 172.21.15.73:0/2649370632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c1c06fc10 0x7f7c1c0cec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:57.927 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.947+0000 7f7c23455640 1 --2- 172.21.15.73:0/2649370632 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c1c06c9a0 0x7f7c1c157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:57.927 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.947+0000 7f7c23455640 1 --2- 172.21.15.73:0/2649370632 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7c0806c4a0 0x7f7c0806e960 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:57.927 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.947+0000 7f7c23455640 1 --2- 172.21.15.73:0/2649370632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c1c06c5c0 0x7f7c1c14b630 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:07:57.928 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.947+0000 7f7c23455640 1 -- 172.21.15.73:0/2649370632 >> 172.21.15.73:0/2649370632 conn(0x7f7c1c0726e0 msgr2=0x7f7c1c0add20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:07:57.928 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.947+0000 7f7c23455640 1 -- 172.21.15.73:0/2649370632 shutdown_connections 2024-03-29T04:07:57.928 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:07:57.947+0000 7f7c23455640 1 -- 172.21.15.73:0/2649370632 wait complete. 2024-03-29T04:07:57.936 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-29T04:07:58.042 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-03-29T04:07:58.062+0000 7f8e4affc640 -1 osd.7 0 waiting for initial osdmap 2024-03-29T04:07:58.062 INFO:tasks.ceph.osd.7.smithi142.stderr:2024-03-29T04:07:58.083+0000 7f8e42e1c640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-29T04:08:04.743 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-29T04:08:04.844 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.864+0000 7f923c29a640 1 Processor -- start 2024-03-29T04:08:04.844 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.864+0000 7f923c29a640 1 -- start start 2024-03-29T04:08:04.848 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.865+0000 7f923c29a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f923415e8c0 0x7f92340d10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:04.848 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.865+0000 7f923c29a640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f923409a9e0 con 0x7f923409ba80 2024-03-29T04:08:04.848 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.865+0000 7f923c29a640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f923409acc0 con 0x7f9234162bc0 2024-03-29T04:08:04.848 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.865+0000 7f923c29a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f923409afa0 con 0x7f923415e8c0 2024-03-29T04:08:04.848 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.865+0000 7f9239835640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f923409ba80 0x7f92341624b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51574/0 (socket says 172.21.15.73:51574) 2024-03-29T04:08:04.848 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.865+0000 7f9239835640 1 -- 172.21.15.73:0/158433436 learned_addr learned my addr 172.21.15.73:0/158433436 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:04.848 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.866+0000 7f923a036640 1 --2- 172.21.15.73:0/158433436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f923415e8c0 0x7f92340d10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:04.848 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.866+0000 7f9239034640 1 -- 172.21.15.73:0/158433436 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4040723798 0 0) 0x7f923409a9e0 con 0x7f923409ba80 2024-03-29T04:08:04.848 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.866+0000 7f9239034640 1 -- 172.21.15.73:0/158433436 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9220003520 con 0x7f923409ba80 2024-03-29T04:08:04.848 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.866+0000 7f9239034640 1 -- 172.21.15.73:0/158433436 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1376487316 0 0) 0x7f9220003520 con 0x7f923409ba80 2024-03-29T04:08:04.848 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.866+0000 7f9239034640 1 -- 172.21.15.73:0/158433436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f923415e8c0 msgr2=0x7f92340d10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:04.849 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.866+0000 7f9239034640 1 --2- 172.21.15.73:0/158433436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f923415e8c0 0x7f92340d10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:04.849 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.866+0000 7f9239034640 1 -- 172.21.15.73:0/158433436 >> v1:172.21.15.142:6789/0 conn(0x7f9234162bc0 legacy=0x7f92340ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:04.849 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.866+0000 7f9239034640 1 -- 172.21.15.73:0/158433436 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f923409b280 con 0x7f923409ba80 2024-03-29T04:08:04.849 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.866+0000 7f9239034640 1 -- 172.21.15.73:0/158433436 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1290421750 0 0) 0x7f9224001670 con 0x7f923409ba80 2024-03-29T04:08:04.849 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.866+0000 7f9239034640 1 -- 172.21.15.73:0/158433436 >> v1:172.21.15.73:6789/0 conn(0x7f923409ba80 legacy=0x7f92341624b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:04.849 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.866+0000 7f9239034640 1 --2- 172.21.15.73:0/158433436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92200039e0 0x7f9220003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:04.849 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.866+0000 7f9239034640 1 --2- 172.21.15.73:0/158433436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f923415e8c0 0x7f9220004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:04.849 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.866+0000 7f9239034640 1 --2- 172.21.15.73:0/158433436 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9220004d40 0x7f92200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:04.849 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.866+0000 7f9239034640 1 -- 172.21.15.73:0/158433436 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f923409afa0 con 0x7f9220004d40 2024-03-29T04:08:04.849 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.866+0000 7f9239034640 1 -- 172.21.15.73:0/158433436 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f922000ba70 con 0x7f92200039e0 2024-03-29T04:08:04.849 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.866+0000 7f9239034640 1 -- 172.21.15.73:0/158433436 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f922000bc70 con 0x7f923415e8c0 2024-03-29T04:08:04.849 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.866+0000 7f923a837640 1 --2- 172.21.15.73:0/158433436 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9220004d40 0x7f92200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:04.849 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.866+0000 7f923a036640 1 --2- 172.21.15.73:0/158433436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92200039e0 0x7f9220003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:04.849 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.866+0000 7f9239835640 1 --2- 172.21.15.73:0/158433436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f923415e8c0 0x7f9220004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:04.849 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.866+0000 7f923a837640 1 -- 172.21.15.73:0/158433436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f923415e8c0 msgr2=0x7f9220004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:04.850 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.866+0000 7f923a837640 1 --2- 172.21.15.73:0/158433436 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f923415e8c0 0x7f9220004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:04.850 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.866+0000 7f923a837640 1 -- 172.21.15.73:0/158433436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92200039e0 msgr2=0x7f9220003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:04.850 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.866+0000 7f923a837640 1 --2- 172.21.15.73:0/158433436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92200039e0 0x7f9220003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:04.850 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.866+0000 7f923a837640 1 -- 172.21.15.73:0/158433436 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9220003520 con 0x7f9220004d40 2024-03-29T04:08:04.850 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.867+0000 7f923a837640 1 --2- 172.21.15.73:0/158433436 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9220004d40 0x7f92200051c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9234073c30 tx=0x7f9220005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd641f90fb1b225f server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:04.850 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.867+0000 7f9239034640 1 -- 172.21.15.73:0/158433436 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922c001370 con 0x7f9220004d40 2024-03-29T04:08:04.850 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.867+0000 7f9239034640 1 -- 172.21.15.73:0/158433436 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f922c0052d0 con 0x7f9220004d40 2024-03-29T04:08:04.850 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.867+0000 7f9239034640 1 -- 172.21.15.73:0/158433436 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922c003830 con 0x7f9220004d40 2024-03-29T04:08:04.850 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.868+0000 7f923c29a640 1 -- 172.21.15.73:0/158433436 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9220004d40 msgr2=0x7f92200051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:04.850 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.868+0000 7f923c29a640 1 --2- 172.21.15.73:0/158433436 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9220004d40 0x7f92200051c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9234073c30 tx=0x7f9220005830 comp rx=0 tx=0).stop 2024-03-29T04:08:04.850 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.868+0000 7f923a837640 1 -- 172.21.15.73:0/158433436 reap_dead start 2024-03-29T04:08:04.850 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.868+0000 7f923c29a640 1 -- 172.21.15.73:0/158433436 shutdown_connections 2024-03-29T04:08:04.850 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.868+0000 7f923c29a640 1 -- 172.21.15.73:0/158433436 >> 172.21.15.73:0/158433436 conn(0x7f92340d2460 msgr2=0x7f92340d2870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:04.851 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.868+0000 7f923c29a640 1 -- 172.21.15.73:0/158433436 shutdown_connections 2024-03-29T04:08:04.851 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.868+0000 7f923c29a640 1 -- 172.21.15.73:0/158433436 wait complete. 2024-03-29T04:08:04.853 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.869+0000 7f923c29a640 1 Processor -- start 2024-03-29T04:08:04.853 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.869+0000 7f923c29a640 1 -- start start 2024-03-29T04:08:04.853 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.870+0000 7f923c29a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9220004d40 0x7f9234156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:04.854 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.870+0000 7f923c29a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92340ca040 0x7f92340ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:04.854 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.870+0000 7f923c29a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f923406d9b0 0x7f923406de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:04.854 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.870+0000 7f923c29a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f923415eca0 con 0x7f92340ca040 2024-03-29T04:08:04.854 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.870+0000 7f923c29a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9234163270 con 0x7f923406d9b0 2024-03-29T04:08:04.854 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.870+0000 7f923c29a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f92340cb360 con 0x7f9220004d40 2024-03-29T04:08:04.854 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.870+0000 7f9239835640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92340ca040 0x7f92340ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:04.854 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.870+0000 7f9239835640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92340ca040 0x7f92340ca4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51544/0 (socket says 172.21.15.73:51544) 2024-03-29T04:08:04.854 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.870+0000 7f9239835640 1 -- 172.21.15.73:0/2031311753 learned_addr learned my addr 172.21.15.73:0/2031311753 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:04.854 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.870+0000 7f9239835640 1 -- 172.21.15.73:0/2031311753 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9220004d40 msgr2=0x7f9234156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:04.854 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.870+0000 7f9239835640 1 --2- 172.21.15.73:0/2031311753 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9220004d40 0x7f9234156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:04.854 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.870+0000 7f9239835640 1 -- 172.21.15.73:0/2031311753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f923406d9b0 msgr2=0x7f923406de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:04.854 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.870+0000 7f9239835640 1 --2- 172.21.15.73:0/2031311753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f923406d9b0 0x7f923406de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:04.854 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.870+0000 7f9239835640 1 -- 172.21.15.73:0/2031311753 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92340cb640 con 0x7f92340ca040 2024-03-29T04:08:04.854 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.870+0000 7f9239835640 1 --2- 172.21.15.73:0/2031311753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92340ca040 0x7f92340ca4c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f92240072f0 tx=0x7f92240077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:04.855 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.870+0000 7f922affd640 1 -- 172.21.15.73:0/2031311753 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922400f8e0 con 0x7f92340ca040 2024-03-29T04:08:04.855 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.871+0000 7f922affd640 1 -- 172.21.15.73:0/2031311753 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9224018070 con 0x7f92340ca040 2024-03-29T04:08:04.855 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.871+0000 7f923c29a640 1 -- 172.21.15.73:0/2031311753 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92340cb920 con 0x7f92340ca040 2024-03-29T04:08:04.855 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.871+0000 7f922affd640 1 -- 172.21.15.73:0/2031311753 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922400fce0 con 0x7f92340ca040 2024-03-29T04:08:04.855 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.871+0000 7f923c29a640 1 -- 172.21.15.73:0/2031311753 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92340cbee0 con 0x7f92340ca040 2024-03-29T04:08:04.855 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.871+0000 7f923c29a640 1 -- 172.21.15.73:0/2031311753 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92340a0630 con 0x7f92340ca040 2024-03-29T04:08:04.855 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.872+0000 7f922affd640 1 -- 172.21.15.73:0/2031311753 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f922401d460 con 0x7f92340ca040 2024-03-29T04:08:04.855 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.872+0000 7f922affd640 1 --2- 172.21.15.73:0/2031311753 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f921806c530 0x7f921806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:04.855 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.872+0000 7f922affd640 1 -- 172.21.15.73:0/2031311753 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f922408b350 con 0x7f92340ca040 2024-03-29T04:08:04.855 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.872+0000 7f923a036640 1 --2- 172.21.15.73:0/2031311753 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f921806c530 0x7f921806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:04.855 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.873+0000 7f923a036640 1 --2- 172.21.15.73:0/2031311753 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f921806c530 0x7f921806e9f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9230009fc0 tx=0x7f9230009750 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:04.856 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:04.877+0000 7f922affd640 1 -- 172.21.15.73:0/2031311753 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f9224059700 con 0x7f92340ca040 2024-03-29T04:08:05.030 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:05.051+0000 7f923c29a640 1 -- 172.21.15.73:0/2031311753 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f92340cc0b0 con 0x7f92340ca040 2024-03-29T04:08:05.031 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:05.051+0000 7f922affd640 1 -- 172.21.15.73:0/2031311753 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12884 (secure 0 0 0) 0x7f922405da00 con 0x7f92340ca040 2024-03-29T04:08:05.031 INFO:teuthology.misc.health.smithi073.stdout: 2024-03-29T04:08:05.031 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":17,"fsid":"6bff1617-b138-4517-acca-3ecaae3f2bb3","created":"2024-03-29T04:07:47.346864+0000","modified":"2024-03-29T04:08:02.518163+0000","last_up_change":"2024-03-29T04:07:58.507139+0000","last_in_change":"2024-03-29T04:07:49.637816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-29T04:07:59.537301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"925d7de1-14ab-48c0-aebd-7bded108f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6820","nonce":2387335359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6824","nonce":2387335359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6831","nonce":2387335359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6828","nonce":2387335359}]},"public_addr":"172.21.15.73:6820/2387335359","cluster_addr":"172.21.15.73:6824/2387335359","heartbeat_back_addr":"172.21.15.73:6831/2387335359","heartbeat_front_addr":"172.21.15.73:6828/2387335359","state":["exists","up"]},{"osd":1,"uuid":"6b182102-882a-4e0c-99db-0afae5cfb38b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6801","nonce":2431315515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6803","nonce":2431315515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6807","nonce":2431315515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6805","nonce":2431315515}]},"public_addr":"172.21.15.73:6801/2431315515","cluster_addr":"172.21.15.73:6803/2431315515","heartbeat_back_addr":"172.21.15.73:6807/2431315515","heartbeat_front_addr":"172.21.15.73:6805/2431315515","state":["exists","up"]},{"osd":2,"uuid":"8040902e-b0b8-4a21-bf64-ce1c222115ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6809","nonce":407236597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6811","nonce":407236597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6815","nonce":407236597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6813","nonce":407236597}]},"public_addr":"172.21.15.73:6809/407236597","cluster_addr":"172.21.15.73:6811/407236597","heartbeat_back_addr":"172.21.15.73:6815/407236597","heartbeat_front_addr":"172.21.15.73:6813/407236597","state":["exists","up"]},{"osd":3,"uuid":"1bab19ee-3775-4ce1-a4ce-cf7cda3bbbf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6817","nonce":4291100709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6821","nonce":4291100709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6829","nonce":4291100709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6825","nonce":4291100709}]},"public_addr":"172.21.15.73:6817/4291100709","cluster_addr":"172.21.15.73:6821/4291100709","heartbeat_back_addr":"172.21.15.73:6829/4291100709","heartbeat_front_addr":"172.21.15.73:6825/4291100709","state":["exists","up"]},{"osd":4,"uuid":"b0c74337-8fe4-47dc-b3da-2d07591b1f6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6817","nonce":3703256194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6819","nonce":3703256194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6823","nonce":3703256194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6821","nonce":3703256194}]},"public_addr":"172.21.15.142:6817/3703256194","cluster_addr":"172.21.15.142:6819/3703256194","heartbeat_back_addr":"172.21.15.142:6823/3703256194","heartbeat_front_addr":"172.21.15.142:6821/3703256194","state":["exists","up"]},{"osd":5,"uuid":"9ce36410-a29a-42c6-99f4-f95d4afdd7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6825","nonce":4271575803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6827","nonce":4271575803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6831","nonce":4271575803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6829","nonce":4271575803}]},"public_addr":"172.21.15.142:6825/4271575803","cluster_addr":"172.21.15.142:6827/4271575803","heartbeat_back_addr":"172.21.15.142:6831/4271575803","heartbeat_front_addr":"172.21.15.142:6829/4271575803","state":["exists","up"]},{"osd":6,"uuid":"aec4264a-64ac-428e-a860-d2920a304019","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6801","nonce":1772722570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6803","nonce":1772722570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6807","nonce":1772722570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6805","nonce":1772722570}]},"public_addr":"172.21.15.142:6801/1772722570","cluster_addr":"172.21.15.142:6803/1772722570","heartbeat_back_addr":"172.21.15.142:6807/1772722570","heartbeat_front_addr":"172.21.15.142:6805/1772722570","state":["exists","up"]},{"osd":7,"uuid":"fe599052-8e5a-4c7a-91e7-52d1bae24a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6809","nonce":3910589675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6811","nonce":3910589675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6815","nonce":3910589675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6813","nonce":3910589675}]},"public_addr":"172.21.15.142:6809/3910589675","cluster_addr":"172.21.15.142:6811/3910589675","heartbeat_back_addr":"172.21.15.142:6815/3910589675","heartbeat_front_addr":"172.21.15.142:6813/3910589675","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.835096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.587210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.786547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.778004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.843740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.791160+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.837992+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.718722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:08:05.034 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:05.053+0000 7f923c29a640 1 -- 172.21.15.73:0/2031311753 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f921806c530 msgr2=0x7f921806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:05.034 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:05.053+0000 7f923c29a640 1 --2- 172.21.15.73:0/2031311753 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f921806c530 0x7f921806e9f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9230009fc0 tx=0x7f9230009750 comp rx=0 tx=0).stop 2024-03-29T04:08:05.034 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:05.053+0000 7f923c29a640 1 -- 172.21.15.73:0/2031311753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92340ca040 msgr2=0x7f92340ca4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:05.034 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:05.053+0000 7f923c29a640 1 --2- 172.21.15.73:0/2031311753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92340ca040 0x7f92340ca4c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f92240072f0 tx=0x7f92240077b0 comp rx=0 tx=0).stop 2024-03-29T04:08:05.034 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:05.053+0000 7f923c29a640 1 -- 172.21.15.73:0/2031311753 shutdown_connections 2024-03-29T04:08:05.034 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:05.053+0000 7f923c29a640 1 --2- 172.21.15.73:0/2031311753 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f921806c530 0x7f921806e9f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:05.034 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:05.053+0000 7f923c29a640 1 --2- 172.21.15.73:0/2031311753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f923406d9b0 0x7f923406de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:05.034 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:05.054+0000 7f923c29a640 1 --2- 172.21.15.73:0/2031311753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92340ca040 0x7f92340ca4c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:05.034 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:05.054+0000 7f923c29a640 1 --2- 172.21.15.73:0/2031311753 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9220004d40 0x7f9234156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:05.034 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:05.054+0000 7f923c29a640 1 -- 172.21.15.73:0/2031311753 >> 172.21.15.73:0/2031311753 conn(0x7f92340d2460 msgr2=0x7f92340b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:05.035 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:05.054+0000 7f923c29a640 1 -- 172.21.15.73:0/2031311753 shutdown_connections 2024-03-29T04:08:05.035 INFO:teuthology.misc.health.smithi073.stderr:2024-03-29T04:08:05.054+0000 7f923c29a640 1 -- 172.21.15.73:0/2031311753 wait complete. 2024-03-29T04:08:05.043 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-03-29T04:08:05.043 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-29T04:08:05.043 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-29T04:08:05.043 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-29T04:08:05.046 INFO:tasks.ceph.mds.a:Started 2024-03-29T04:08:05.046 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-29T04:08:05.046 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-29T04:08:05.048 INFO:tasks.ceph.mds.c:Started 2024-03-29T04:08:05.048 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-29T04:08:05.048 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-29T04:08:05.050 INFO:tasks.ceph.mds.b:Started 2024-03-29T04:08:05.051 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-29T04:08:05.051 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-29T04:08:05.053 INFO:tasks.ceph.mds.d:Started 2024-03-29T04:08:05.053 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-03-29T04:08:05.053 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-29T04:08:05.122 INFO:tasks.ceph.mds.c.smithi073.stdout:starting mds.c at 2024-03-29T04:08:05.122 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2024-03-29T04:08:05.123 INFO:tasks.ceph.mds.c.smithi073.stderr:2024-03-29T04:08:05.143+0000 7feb20aea640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-03-29T04:08:05.136 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2024-03-29T04:08:05.137 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2024-03-29T04:08:05.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.178+0000 7f9e58a88640 1 Processor -- start 2024-03-29T04:08:05.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.178+0000 7f9e58a88640 1 -- start start 2024-03-29T04:08:05.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.179+0000 7f9e58a88640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e54163070 0x7f9e540b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:05.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.179+0000 7f9e58a88640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e54070370 con 0x7f9e54162c90 2024-03-29T04:08:05.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.179+0000 7f9e58a88640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e54070650 con 0x7f9e540b3c90 2024-03-29T04:08:05.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.179+0000 7f9e58a88640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9e540d1050 con 0x7f9e54163070 2024-03-29T04:08:05.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.179+0000 7f9e5259c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9e54162c90 0x7f9e540ce530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51586/0 (socket says 172.21.15.73:51586) 2024-03-29T04:08:05.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.179+0000 7f9e5259c640 1 -- 172.21.15.73:0/4054320225 learned_addr learned my addr 172.21.15.73:0/4054320225 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:05.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.179+0000 7f9e4bfff640 1 --2- 172.21.15.73:0/4054320225 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e54163070 0x7f9e540b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:05.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.179+0000 7f9e51d9b640 1 -- 172.21.15.73:0/4054320225 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2643488641 0 0) 0x7f9e54070370 con 0x7f9e54162c90 2024-03-29T04:08:05.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.180+0000 7f9e51d9b640 1 -- 172.21.15.73:0/4054320225 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e40003520 con 0x7f9e54162c90 2024-03-29T04:08:05.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.180+0000 7f9e51d9b640 1 -- 172.21.15.73:0/4054320225 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 237671822 0 0) 0x7f9e54070650 con 0x7f9e540b3c90 2024-03-29T04:08:05.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.180+0000 7f9e4bfff640 1 -- 172.21.15.73:0/4054320225 >> v1:172.21.15.142:6789/0 conn(0x7f9e540b3c90 legacy=0x7f9e540c78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:05.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.180+0000 7f9e4bfff640 1 -- 172.21.15.73:0/4054320225 >> v1:172.21.15.73:6789/0 conn(0x7f9e54162c90 legacy=0x7f9e540ce530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:05.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.180+0000 7f9e4bfff640 1 -- 172.21.15.73:0/4054320225 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e540cdd30 con 0x7f9e54163070 2024-03-29T04:08:05.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.180+0000 7f9e4bfff640 1 --2- 172.21.15.73:0/4054320225 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e54163070 0x7f9e540b3750 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c0097d0 tx=0x7f9e3c02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41d64b0530568893 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:05.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.181+0000 7f9e51d9b640 1 -- 172.21.15.73:0/4054320225 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c035020 con 0x7f9e54163070 2024-03-29T04:08:05.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.181+0000 7f9e51d9b640 1 -- 172.21.15.73:0/4054320225 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e3c031890 con 0x7f9e54163070 2024-03-29T04:08:05.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.181+0000 7f9e51d9b640 1 -- 172.21.15.73:0/4054320225 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c031c60 con 0x7f9e54163070 2024-03-29T04:08:05.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.181+0000 7f9e58a88640 1 -- 172.21.15.73:0/4054320225 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e54163070 msgr2=0x7f9e540b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:05.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.181+0000 7f9e58a88640 1 --2- 172.21.15.73:0/4054320225 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e54163070 0x7f9e540b3750 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c0097d0 tx=0x7f9e3c02b930 comp rx=0 tx=0).stop 2024-03-29T04:08:05.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.181+0000 7f9e58a88640 1 -- 172.21.15.73:0/4054320225 shutdown_connections 2024-03-29T04:08:05.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.181+0000 7f9e58a88640 1 --2- 172.21.15.73:0/4054320225 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e54163070 0x7f9e540b3750 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:05.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.181+0000 7f9e58a88640 1 -- 172.21.15.73:0/4054320225 >> 172.21.15.73:0/4054320225 conn(0x7f9e5409aa30 msgr2=0x7f9e540b3040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:05.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.181+0000 7f9e58a88640 1 -- 172.21.15.73:0/4054320225 shutdown_connections 2024-03-29T04:08:05.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.181+0000 7f9e58a88640 1 -- 172.21.15.73:0/4054320225 wait complete. 2024-03-29T04:08:05.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.182+0000 7f9e58a88640 1 Processor -- start 2024-03-29T04:08:05.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.182+0000 7f9e58a88640 1 -- start start 2024-03-29T04:08:05.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.183+0000 7f9e58a88640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e540b3c90 0x7f9e541f7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:05.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.183+0000 7f9e58a88640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e54162c90 0x7f9e540c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:05.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.183+0000 7f9e58a88640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e54163070 0x7f9e5415f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:05.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.183+0000 7f9e58a88640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9e54070930 con 0x7f9e540b3c90 2024-03-29T04:08:05.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.183+0000 7f9e58a88640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9e540ce0a0 con 0x7f9e54162c90 2024-03-29T04:08:05.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.183+0000 7f9e58a88640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9e54070020 con 0x7f9e54163070 2024-03-29T04:08:05.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.183+0000 7f9e5259c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e540b3c90 0x7f9e541f7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:05.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.183+0000 7f9e5259c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e540b3c90 0x7f9e541f7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51592/0 (socket says 172.21.15.73:51592) 2024-03-29T04:08:05.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.183+0000 7f9e5259c640 1 -- 172.21.15.73:0/2822845999 learned_addr learned my addr 172.21.15.73:0/2822845999 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:05.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.183+0000 7f9e4bfff640 1 --2- 172.21.15.73:0/2822845999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e54162c90 0x7f9e540c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:05.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.183+0000 7f9e52d9d640 1 --2- 172.21.15.73:0/2822845999 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e54163070 0x7f9e5415f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:05.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.183+0000 7f9e5259c640 1 -- 172.21.15.73:0/2822845999 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e54163070 msgr2=0x7f9e5415f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:05.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.183+0000 7f9e5259c640 1 --2- 172.21.15.73:0/2822845999 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e54163070 0x7f9e5415f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:05.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.183+0000 7f9e5259c640 1 -- 172.21.15.73:0/2822845999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e54162c90 msgr2=0x7f9e540c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:05.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.183+0000 7f9e5259c640 1 --2- 172.21.15.73:0/2822845999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e54162c90 0x7f9e540c8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:05.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.184+0000 7f9e5259c640 1 -- 172.21.15.73:0/2822845999 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e541604a0 con 0x7f9e540b3c90 2024-03-29T04:08:05.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.184+0000 7f9e5259c640 1 --2- 172.21.15.73:0/2822845999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e540b3c90 0x7f9e541f7e20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9e4400c430 tx=0x7f9e4400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:05.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.184+0000 7f9e4affd640 1 -- 172.21.15.73:0/2822845999 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e44017070 con 0x7f9e540b3c90 2024-03-29T04:08:05.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.184+0000 7f9e4affd640 1 -- 172.21.15.73:0/2822845999 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e44005ce0 con 0x7f9e540b3c90 2024-03-29T04:08:05.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.184+0000 7f9e4affd640 1 -- 172.21.15.73:0/2822845999 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e440072f0 con 0x7f9e540b3c90 2024-03-29T04:08:05.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.184+0000 7f9e58a88640 1 -- 172.21.15.73:0/2822845999 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e5415fee0 con 0x7f9e540b3c90 2024-03-29T04:08:05.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.184+0000 7f9e58a88640 1 -- 172.21.15.73:0/2822845999 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e540c88f0 con 0x7f9e540b3c90 2024-03-29T04:08:05.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.185+0000 7f9e58a88640 1 -- 172.21.15.73:0/2822845999 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e54068d50 con 0x7f9e540b3c90 2024-03-29T04:08:05.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.185+0000 7f9e4affd640 1 -- 172.21.15.73:0/2822845999 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f9e4401a070 con 0x7f9e540b3c90 2024-03-29T04:08:05.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.185+0000 7f9e4affd640 1 --2- 172.21.15.73:0/2822845999 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9e3406c530 0x7f9e3406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:05.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.186+0000 7f9e4bfff640 1 --2- 172.21.15.73:0/2822845999 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9e3406c530 0x7f9e3406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:05.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.186+0000 7f9e4affd640 1 -- 172.21.15.73:0/2822845999 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f9e4408a750 con 0x7f9e540b3c90 2024-03-29T04:08:05.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.186+0000 7f9e4bfff640 1 --2- 172.21.15.73:0/2822845999 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9e3406c530 0x7f9e3406e9f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c036000 tx=0x7f9e3c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:05.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.190+0000 7f9e4affd640 1 -- 172.21.15.73:0/2822845999 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f9e44058b00 con 0x7f9e540b3c90 2024-03-29T04:08:05.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.365+0000 7f9e58a88640 1 -- 172.21.15.73:0/2822845999 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9e540c8b30 con 0x7f9e540b3c90 2024-03-29T04:08:05.345 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.366+0000 7f9e4affd640 1 -- 172.21.15.73:0/2822845999 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12884 (secure 0 0 0) 0x7f9e4405ce00 con 0x7f9e540b3c90 2024-03-29T04:08:05.345 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:05.346 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":17,"fsid":"6bff1617-b138-4517-acca-3ecaae3f2bb3","created":"2024-03-29T04:07:47.346864+0000","modified":"2024-03-29T04:08:02.518163+0000","last_up_change":"2024-03-29T04:07:58.507139+0000","last_in_change":"2024-03-29T04:07:49.637816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-29T04:07:59.537301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"925d7de1-14ab-48c0-aebd-7bded108f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6820","nonce":2387335359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6824","nonce":2387335359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6831","nonce":2387335359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6828","nonce":2387335359}]},"public_addr":"172.21.15.73:6820/2387335359","cluster_addr":"172.21.15.73:6824/2387335359","heartbeat_back_addr":"172.21.15.73:6831/2387335359","heartbeat_front_addr":"172.21.15.73:6828/2387335359","state":["exists","up"]},{"osd":1,"uuid":"6b182102-882a-4e0c-99db-0afae5cfb38b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6801","nonce":2431315515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6803","nonce":2431315515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6807","nonce":2431315515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6805","nonce":2431315515}]},"public_addr":"172.21.15.73:6801/2431315515","cluster_addr":"172.21.15.73:6803/2431315515","heartbeat_back_addr":"172.21.15.73:6807/2431315515","heartbeat_front_addr":"172.21.15.73:6805/2431315515","state":["exists","up"]},{"osd":2,"uuid":"8040902e-b0b8-4a21-bf64-ce1c222115ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6809","nonce":407236597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6811","nonce":407236597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6815","nonce":407236597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6813","nonce":407236597}]},"public_addr":"172.21.15.73:6809/407236597","cluster_addr":"172.21.15.73:6811/407236597","heartbeat_back_addr":"172.21.15.73:6815/407236597","heartbeat_front_addr":"172.21.15.73:6813/407236597","state":["exists","up"]},{"osd":3,"uuid":"1bab19ee-3775-4ce1-a4ce-cf7cda3bbbf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6817","nonce":4291100709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6821","nonce":4291100709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6829","nonce":4291100709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6825","nonce":4291100709}]},"public_addr":"172.21.15.73:6817/4291100709","cluster_addr":"172.21.15.73:6821/4291100709","heartbeat_back_addr":"172.21.15.73:6829/4291100709","heartbeat_front_addr":"172.21.15.73:6825/4291100709","state":["exists","up"]},{"osd":4,"uuid":"b0c74337-8fe4-47dc-b3da-2d07591b1f6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6817","nonce":3703256194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6819","nonce":3703256194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6823","nonce":3703256194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6821","nonce":3703256194}]},"public_addr":"172.21.15.142:6817/3703256194","cluster_addr":"172.21.15.142:6819/3703256194","heartbeat_back_addr":"172.21.15.142:6823/3703256194","heartbeat_front_addr":"172.21.15.142:6821/3703256194","state":["exists","up"]},{"osd":5,"uuid":"9ce36410-a29a-42c6-99f4-f95d4afdd7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6825","nonce":4271575803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6827","nonce":4271575803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6831","nonce":4271575803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6829","nonce":4271575803}]},"public_addr":"172.21.15.142:6825/4271575803","cluster_addr":"172.21.15.142:6827/4271575803","heartbeat_back_addr":"172.21.15.142:6831/4271575803","heartbeat_front_addr":"172.21.15.142:6829/4271575803","state":["exists","up"]},{"osd":6,"uuid":"aec4264a-64ac-428e-a860-d2920a304019","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6801","nonce":1772722570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6803","nonce":1772722570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6807","nonce":1772722570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6805","nonce":1772722570}]},"public_addr":"172.21.15.142:6801/1772722570","cluster_addr":"172.21.15.142:6803/1772722570","heartbeat_back_addr":"172.21.15.142:6807/1772722570","heartbeat_front_addr":"172.21.15.142:6805/1772722570","state":["exists","up"]},{"osd":7,"uuid":"fe599052-8e5a-4c7a-91e7-52d1bae24a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6809","nonce":3910589675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6811","nonce":3910589675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6815","nonce":3910589675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6813","nonce":3910589675}]},"public_addr":"172.21.15.142:6809/3910589675","cluster_addr":"172.21.15.142:6811/3910589675","heartbeat_back_addr":"172.21.15.142:6815/3910589675","heartbeat_front_addr":"172.21.15.142:6813/3910589675","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.835096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.587210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.786547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.778004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.843740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.791160+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.837992+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.718722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:08:05.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.368+0000 7f9e58a88640 1 -- 172.21.15.73:0/2822845999 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9e3406c530 msgr2=0x7f9e3406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:05.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.368+0000 7f9e58a88640 1 --2- 172.21.15.73:0/2822845999 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9e3406c530 0x7f9e3406e9f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c036000 tx=0x7f9e3c008030 comp rx=0 tx=0).stop 2024-03-29T04:08:05.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.368+0000 7f9e58a88640 1 -- 172.21.15.73:0/2822845999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e540b3c90 msgr2=0x7f9e541f7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:05.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.368+0000 7f9e58a88640 1 --2- 172.21.15.73:0/2822845999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e540b3c90 0x7f9e541f7e20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9e4400c430 tx=0x7f9e4400c8f0 comp rx=0 tx=0).stop 2024-03-29T04:08:05.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.368+0000 7f9e58a88640 1 -- 172.21.15.73:0/2822845999 shutdown_connections 2024-03-29T04:08:05.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.368+0000 7f9e58a88640 1 --2- 172.21.15.73:0/2822845999 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e54163070 0x7f9e5415f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:05.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.368+0000 7f9e58a88640 1 --2- 172.21.15.73:0/2822845999 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9e3406c530 0x7f9e3406e9f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:05.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.368+0000 7f9e58a88640 1 --2- 172.21.15.73:0/2822845999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e54162c90 0x7f9e540c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:05.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.368+0000 7f9e58a88640 1 --2- 172.21.15.73:0/2822845999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e540b3c90 0x7f9e541f7e20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:05.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.368+0000 7f9e58a88640 1 -- 172.21.15.73:0/2822845999 >> 172.21.15.73:0/2822845999 conn(0x7f9e5409aa30 msgr2=0x7f9e540cf650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:05.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.368+0000 7f9e58a88640 1 -- 172.21.15.73:0/2822845999 shutdown_connections 2024-03-29T04:08:05.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.368+0000 7f9e58a88640 1 -- 172.21.15.73:0/2822845999 wait complete. 2024-03-29T04:08:05.358 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-29T04:07:59.537301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-29T04:08:05.359 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-29T04:08:05.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.481+0000 7f7a5d237640 1 Processor -- start 2024-03-29T04:08:05.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.481+0000 7f7a5d237640 1 -- start start 2024-03-29T04:08:05.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.482+0000 7f7a5d237640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a581624b0 0x7f7a580b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:05.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.482+0000 7f7a5d237640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7a580cca60 0x7f7a580d0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:05.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.482+0000 7f7a5d237640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a5806d1b0 con 0x7f7a580ccea0 2024-03-29T04:08:05.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.482+0000 7f7a5d237640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f7a580d0a10 con 0x7f7a580cca60 2024-03-29T04:08:05.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.482+0000 7f7a5d237640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7a5806d470 con 0x7f7a581624b0 2024-03-29T04:08:05.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.482+0000 7f7a5759e640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7a580ccea0 0x7f7a58162890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51600/0 (socket says 172.21.15.73:51600) 2024-03-29T04:08:05.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.482+0000 7f7a5759e640 1 -- 172.21.15.73:0/18782868 learned_addr learned my addr 172.21.15.73:0/18782868 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:05.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.482+0000 7f7a56d9d640 1 --2- 172.21.15.73:0/18782868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a581624b0 0x7f7a580b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:05.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.482+0000 7f7a5659c640 1 --2- 172.21.15.73:0/18782868 >> v2:172.21.15.142:3300/0 conn(0x7f7a580cca60 0x7f7a580d0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:05.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.482+0000 7f7a55d9b640 1 -- 172.21.15.73:0/18782868 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2141568119 0 0) 0x7f7a5806d1b0 con 0x7f7a580ccea0 2024-03-29T04:08:05.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.482+0000 7f7a55d9b640 1 -- 172.21.15.73:0/18782868 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a40003520 con 0x7f7a580ccea0 2024-03-29T04:08:05.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.482+0000 7f7a55d9b640 1 -- 172.21.15.73:0/18782868 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1177807569 0 0) 0x7f7a40003520 con 0x7f7a580ccea0 2024-03-29T04:08:05.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.482+0000 7f7a55d9b640 1 -- 172.21.15.73:0/18782868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a581624b0 msgr2=0x7f7a580b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:05.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.482+0000 7f7a55d9b640 1 --2- 172.21.15.73:0/18782868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a581624b0 0x7f7a580b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:05.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.482+0000 7f7a55d9b640 1 -- 172.21.15.73:0/18782868 >> v2:172.21.15.142:3300/0 conn(0x7f7a580cca60 msgr2=0x7f7a580d0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:05.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.482+0000 7f7a55d9b640 1 --2- 172.21.15.73:0/18782868 >> v2:172.21.15.142:3300/0 conn(0x7f7a580cca60 0x7f7a580d0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:05.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.482+0000 7f7a55d9b640 1 -- 172.21.15.73:0/18782868 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a5806d750 con 0x7f7a580ccea0 2024-03-29T04:08:05.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.482+0000 7f7a55d9b640 1 -- 172.21.15.73:0/18782868 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1290421750 0 0) 0x7f7a500019f0 con 0x7f7a580ccea0 2024-03-29T04:08:05.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.482+0000 7f7a56d9d640 1 --2- 172.21.15.73:0/18782868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a581624b0 0x7f7a580b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:08:05.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.483+0000 7f7a55d9b640 1 -- 172.21.15.73:0/18782868 >> v1:172.21.15.73:6789/0 conn(0x7f7a580ccea0 legacy=0x7f7a58162890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:05.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.483+0000 7f7a55d9b640 1 --2- 172.21.15.73:0/18782868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a400039b0 0x7f7a40003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:05.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.483+0000 7f7a55d9b640 1 --2- 172.21.15.73:0/18782868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a581624b0 0x7f7a40004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:05.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.483+0000 7f7a55d9b640 1 --2- 172.21.15.73:0/18782868 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a40004d40 0x7f7a400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:05.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.483+0000 7f7a55d9b640 1 -- 172.21.15.73:0/18782868 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7a580d0a10 con 0x7f7a40004d40 2024-03-29T04:08:05.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.483+0000 7f7a55d9b640 1 -- 172.21.15.73:0/18782868 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7a5806d470 con 0x7f7a400039b0 2024-03-29T04:08:05.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.483+0000 7f7a55d9b640 1 -- 172.21.15.73:0/18782868 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7a4000b9c0 con 0x7f7a581624b0 2024-03-29T04:08:05.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.483+0000 7f7a56d9d640 1 --2- 172.21.15.73:0/18782868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a400039b0 0x7f7a40003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:05.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.483+0000 7f7a5759e640 1 --2- 172.21.15.73:0/18782868 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a40004d40 0x7f7a400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:05.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.483+0000 7f7a5659c640 1 --2- 172.21.15.73:0/18782868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a581624b0 0x7f7a40004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:05.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.483+0000 7f7a5759e640 1 -- 172.21.15.73:0/18782868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a581624b0 msgr2=0x7f7a40004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:05.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.483+0000 7f7a5759e640 1 --2- 172.21.15.73:0/18782868 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a581624b0 0x7f7a40004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:05.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.483+0000 7f7a5759e640 1 -- 172.21.15.73:0/18782868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a400039b0 msgr2=0x7f7a40003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:05.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.483+0000 7f7a5759e640 1 --2- 172.21.15.73:0/18782868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a400039b0 0x7f7a40003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:05.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.483+0000 7f7a5759e640 1 -- 172.21.15.73:0/18782868 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a40003520 con 0x7f7a40004d40 2024-03-29T04:08:05.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.484+0000 7f7a5759e640 1 --2- 172.21.15.73:0/18782868 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a40004d40 0x7f7a400051c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7a5000a870 tx=0x7f7a40005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be6efc61573da936 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:05.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.484+0000 7f7a55d9b640 1 -- 172.21.15.73:0/18782868 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5000a4c0 con 0x7f7a40004d40 2024-03-29T04:08:05.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.484+0000 7f7a55d9b640 1 -- 172.21.15.73:0/18782868 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a50034650 con 0x7f7a40004d40 2024-03-29T04:08:05.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.484+0000 7f7a55d9b640 1 -- 172.21.15.73:0/18782868 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a50034a40 con 0x7f7a40004d40 2024-03-29T04:08:05.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.484+0000 7f7a5d237640 1 -- 172.21.15.73:0/18782868 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a40004d40 msgr2=0x7f7a400051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:05.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.484+0000 7f7a5d237640 1 --2- 172.21.15.73:0/18782868 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a40004d40 0x7f7a400051c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7a5000a870 tx=0x7f7a40005830 comp rx=0 tx=0).stop 2024-03-29T04:08:05.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.484+0000 7f7a5759e640 1 -- 172.21.15.73:0/18782868 reap_dead start 2024-03-29T04:08:05.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.484+0000 7f7a5d237640 1 -- 172.21.15.73:0/18782868 shutdown_connections 2024-03-29T04:08:05.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.484+0000 7f7a5d237640 1 -- 172.21.15.73:0/18782868 >> 172.21.15.73:0/18782868 conn(0x7f7a580b3f00 msgr2=0x7f7a580b4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:05.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.484+0000 7f7a5d237640 1 -- 172.21.15.73:0/18782868 shutdown_connections 2024-03-29T04:08:05.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.484+0000 7f7a5d237640 1 -- 172.21.15.73:0/18782868 wait complete. 2024-03-29T04:08:05.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.486+0000 7f7a5d237640 1 Processor -- start 2024-03-29T04:08:05.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.486+0000 7f7a5d237640 1 -- start start 2024-03-29T04:08:05.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.486+0000 7f7a5d237640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a40004d40 0x7f7a580b5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:05.470 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.486+0000 7f7a5d237640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a580b7990 0x7f7a5814c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:05.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.487+0000 7f7a5d237640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a580b7e10 0x7f7a5814c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:05.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.487+0000 7f7a5d237640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7a5815feb0 con 0x7f7a40004d40 2024-03-29T04:08:05.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.487+0000 7f7a5d237640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7a5815fd30 con 0x7f7a580b7990 2024-03-29T04:08:05.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.487+0000 7f7a5d237640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7a580b33b0 con 0x7f7a580b7e10 2024-03-29T04:08:05.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.487+0000 7f7a56d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a40004d40 0x7f7a580b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:05.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.487+0000 7f7a56d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a40004d40 0x7f7a580b5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51606/0 (socket says 172.21.15.73:51606) 2024-03-29T04:08:05.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.487+0000 7f7a56d9d640 1 -- 172.21.15.73:0/3110441671 learned_addr learned my addr 172.21.15.73:0/3110441671 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:05.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.487+0000 7f7a5659c640 1 --2- 172.21.15.73:0/3110441671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a580b7990 0x7f7a5814c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:05.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.487+0000 7f7a5759e640 1 --2- 172.21.15.73:0/3110441671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a580b7e10 0x7f7a5814c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:05.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.487+0000 7f7a56d9d640 1 -- 172.21.15.73:0/3110441671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a580b7e10 msgr2=0x7f7a5814c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:05.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.487+0000 7f7a56d9d640 1 --2- 172.21.15.73:0/3110441671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a580b7e10 0x7f7a5814c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:05.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.487+0000 7f7a56d9d640 1 -- 172.21.15.73:0/3110441671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a580b7990 msgr2=0x7f7a5814c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:05.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.487+0000 7f7a56d9d640 1 --2- 172.21.15.73:0/3110441671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a580b7990 0x7f7a5814c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:05.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.487+0000 7f7a56d9d640 1 -- 172.21.15.73:0/3110441671 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a580b5a00 con 0x7f7a40004d40 2024-03-29T04:08:05.471 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.487+0000 7f7a5759e640 1 --2- 172.21.15.73:0/3110441671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a580b7e10 0x7f7a5814c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:08:05.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.487+0000 7f7a5659c640 1 --2- 172.21.15.73:0/3110441671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a580b7990 0x7f7a5814c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:08:05.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.487+0000 7f7a56d9d640 1 --2- 172.21.15.73:0/3110441671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a40004d40 0x7f7a580b5260 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7a48011930 tx=0x7f7a48011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:05.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.487+0000 7f7a3f7fe640 1 -- 172.21.15.73:0/3110441671 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a4800faf0 con 0x7f7a40004d40 2024-03-29T04:08:05.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.487+0000 7f7a3f7fe640 1 -- 172.21.15.73:0/3110441671 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a4800fc90 con 0x7f7a40004d40 2024-03-29T04:08:05.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.487+0000 7f7a5d237640 1 -- 172.21.15.73:0/3110441671 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a580b5ce0 con 0x7f7a40004d40 2024-03-29T04:08:05.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.487+0000 7f7a3f7fe640 1 -- 172.21.15.73:0/3110441671 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a48004030 con 0x7f7a40004d40 2024-03-29T04:08:05.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.487+0000 7f7a5d237640 1 -- 172.21.15.73:0/3110441671 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a580b62a0 con 0x7f7a40004d40 2024-03-29T04:08:05.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.488+0000 7f7a5d237640 1 -- 172.21.15.73:0/3110441671 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a580a04c0 con 0x7f7a40004d40 2024-03-29T04:08:05.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.488+0000 7f7a3f7fe640 1 -- 172.21.15.73:0/3110441671 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f7a48012040 con 0x7f7a40004d40 2024-03-29T04:08:05.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.489+0000 7f7a3f7fe640 1 --2- 172.21.15.73:0/3110441671 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7a4406c530 0x7f7a4406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:05.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.489+0000 7f7a3f7fe640 1 -- 172.21.15.73:0/3110441671 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f7a4808b780 con 0x7f7a40004d40 2024-03-29T04:08:05.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.489+0000 7f7a5659c640 1 --2- 172.21.15.73:0/3110441671 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7a4406c530 0x7f7a4406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:05.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.489+0000 7f7a5659c640 1 --2- 172.21.15.73:0/3110441671 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7a4406c530 0x7f7a4406e9f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7a5815b780 tx=0x7f7a4c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:05.473 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.493+0000 7f7a3f7fe640 1 -- 172.21.15.73:0/3110441671 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f7a48019070 con 0x7f7a40004d40 2024-03-29T04:08:05.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.670+0000 7f7a5d237640 1 -- 172.21.15.73:0/3110441671 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7a58162290 con 0x7f7a40004d40 2024-03-29T04:08:05.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.670+0000 7f7a3f7fe640 1 -- 172.21.15.73:0/3110441671 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7f7a4805a0f0 con 0x7f7a40004d40 2024-03-29T04:08:05.650 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-03-29T04:08:05.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.672+0000 7f7a5d237640 1 -- 172.21.15.73:0/3110441671 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7a4406c530 msgr2=0x7f7a4406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:05.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.672+0000 7f7a5d237640 1 --2- 172.21.15.73:0/3110441671 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7a4406c530 0x7f7a4406e9f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7a5815b780 tx=0x7f7a4c008040 comp rx=0 tx=0).stop 2024-03-29T04:08:05.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.672+0000 7f7a5d237640 1 -- 172.21.15.73:0/3110441671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a40004d40 msgr2=0x7f7a580b5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:05.652 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.672+0000 7f7a5d237640 1 --2- 172.21.15.73:0/3110441671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a40004d40 0x7f7a580b5260 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7a48011930 tx=0x7f7a48011df0 comp rx=0 tx=0).stop 2024-03-29T04:08:05.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.672+0000 7f7a5d237640 1 -- 172.21.15.73:0/3110441671 shutdown_connections 2024-03-29T04:08:05.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.672+0000 7f7a5d237640 1 --2- 172.21.15.73:0/3110441671 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a580b7e10 0x7f7a5814c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:05.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.672+0000 7f7a5d237640 1 --2- 172.21.15.73:0/3110441671 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7a4406c530 0x7f7a4406e9f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:05.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.672+0000 7f7a5d237640 1 --2- 172.21.15.73:0/3110441671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a580b7990 0x7f7a5814c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:05.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.672+0000 7f7a5d237640 1 --2- 172.21.15.73:0/3110441671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a40004d40 0x7f7a580b5260 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:05.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.672+0000 7f7a5d237640 1 -- 172.21.15.73:0/3110441671 >> 172.21.15.73:0/3110441671 conn(0x7f7a580b3f00 msgr2=0x7f7a580cf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:05.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.672+0000 7f7a5d237640 1 -- 172.21.15.73:0/3110441671 shutdown_connections 2024-03-29T04:08:05.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.672+0000 7f7a5d237640 1 -- 172.21.15.73:0/3110441671 wait complete. 2024-03-29T04:08:05.662 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-29T04:08:05.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.782+0000 7f232fcb1640 1 Processor -- start 2024-03-29T04:08:05.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.782+0000 7f232fcb1640 1 -- start start 2024-03-29T04:08:05.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.783+0000 7f232fcb1640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f232809b6e0 0x7f23281623a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:05.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.783+0000 7f232fcb1640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f23281628e0 0x7f23280b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:05.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.783+0000 7f232fcb1640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23280d1a10 con 0x7f232815e6e0 2024-03-29T04:08:05.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.783+0000 7f232fcb1640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f232809bb40 con 0x7f232809b6e0 2024-03-29T04:08:05.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.783+0000 7f232fcb1640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f23280d0e90 con 0x7f23281628e0 2024-03-29T04:08:05.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.783+0000 7f232d24c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f232809b6e0 0x7f23281623a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:05.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.783+0000 7f232d24c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f232809b6e0 0x7f23281623a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51618/0 (socket says 172.21.15.73:51618) 2024-03-29T04:08:05.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.783+0000 7f232d24c640 1 -- 172.21.15.73:0/3830848126 learned_addr learned my addr 172.21.15.73:0/3830848126 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:05.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.783+0000 7f232e24e640 1 --2- 172.21.15.73:0/3830848126 >> v2:172.21.15.142:3300/0 conn(0x7f23281628e0 0x7f23280b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:05.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.783+0000 7f232d24c640 1 -- 172.21.15.73:0/3830848126 >> v2:172.21.15.142:3300/0 conn(0x7f23281628e0 msgr2=0x7f23280b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:05.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.783+0000 7f232d24c640 1 --2- 172.21.15.73:0/3830848126 >> v2:172.21.15.142:3300/0 conn(0x7f23281628e0 0x7f23280b30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:05.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.783+0000 7f232d24c640 1 -- 172.21.15.73:0/3830848126 >> v1:172.21.15.142:6789/0 conn(0x7f232815e6e0 legacy=0x7f23280d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:05.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.783+0000 7f232d24c640 1 -- 172.21.15.73:0/3830848126 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23280d1170 con 0x7f232809b6e0 2024-03-29T04:08:05.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.783+0000 7f232e24e640 1 --2- 172.21.15.73:0/3830848126 >> v2:172.21.15.142:3300/0 conn(0x7f23281628e0 0x7f23280b30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:08:05.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.784+0000 7f232d24c640 1 --2- 172.21.15.73:0/3830848126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f232809b6e0 0x7f23281623a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2328073770 tx=0x7f231802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae317aafac180519 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:05.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.784+0000 7f232ca4b640 1 -- 172.21.15.73:0/3830848126 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2318034070 con 0x7f232809b6e0 2024-03-29T04:08:05.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.784+0000 7f232ca4b640 1 -- 172.21.15.73:0/3830848126 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2318030860 con 0x7f232809b6e0 2024-03-29T04:08:05.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.784+0000 7f232ca4b640 1 -- 172.21.15.73:0/3830848126 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2318030c30 con 0x7f232809b6e0 2024-03-29T04:08:05.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.785+0000 7f232fcb1640 1 -- 172.21.15.73:0/3830848126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f232809b6e0 msgr2=0x7f23281623a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:05.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.785+0000 7f232fcb1640 1 --2- 172.21.15.73:0/3830848126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f232809b6e0 0x7f23281623a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2328073770 tx=0x7f231802b9a0 comp rx=0 tx=0).stop 2024-03-29T04:08:05.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.785+0000 7f232fcb1640 1 -- 172.21.15.73:0/3830848126 shutdown_connections 2024-03-29T04:08:05.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.785+0000 7f232fcb1640 1 --2- 172.21.15.73:0/3830848126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f232809b6e0 0x7f23281623a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:05.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.785+0000 7f232fcb1640 1 --2- 172.21.15.73:0/3830848126 >> v2:172.21.15.142:3300/0 conn(0x7f23281628e0 0x7f23280b30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:05.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.785+0000 7f232fcb1640 1 -- 172.21.15.73:0/3830848126 >> 172.21.15.73:0/3830848126 conn(0x7f23280b3f10 msgr2=0x7f23280b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:05.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.785+0000 7f232fcb1640 1 -- 172.21.15.73:0/3830848126 shutdown_connections 2024-03-29T04:08:05.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.785+0000 7f232fcb1640 1 -- 172.21.15.73:0/3830848126 wait complete. 2024-03-29T04:08:05.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.786+0000 7f232fcb1640 1 Processor -- start 2024-03-29T04:08:05.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.786+0000 7f232fcb1640 1 -- start start 2024-03-29T04:08:05.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.787+0000 7f232fcb1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f232809b6e0 0x7f23280c94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:05.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.787+0000 7f232fcb1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f232815e6e0 0x7f23280af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:05.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.787+0000 7f232fcb1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23281628e0 0x7f2328154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:05.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.787+0000 7f232fcb1640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f23280b1d80 con 0x7f232809b6e0 2024-03-29T04:08:05.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.787+0000 7f232fcb1640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f23280d1730 con 0x7f232815e6e0 2024-03-29T04:08:05.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.787+0000 7f232fcb1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f232806d910 con 0x7f23281628e0 2024-03-29T04:08:05.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.787+0000 7f232da4d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f232809b6e0 0x7f23280c94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:05.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.787+0000 7f232da4d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f232809b6e0 0x7f23280c94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51630/0 (socket says 172.21.15.73:51630) 2024-03-29T04:08:05.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.787+0000 7f232da4d640 1 -- 172.21.15.73:0/937986704 learned_addr learned my addr 172.21.15.73:0/937986704 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:05.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.787+0000 7f232e24e640 1 --2- 172.21.15.73:0/937986704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23281628e0 0x7f2328154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:05.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.787+0000 7f232d24c640 1 --2- 172.21.15.73:0/937986704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f232815e6e0 0x7f23280af1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:05.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.787+0000 7f232da4d640 1 -- 172.21.15.73:0/937986704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23281628e0 msgr2=0x7f2328154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:05.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.787+0000 7f232da4d640 1 --2- 172.21.15.73:0/937986704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23281628e0 0x7f2328154950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:05.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.787+0000 7f232da4d640 1 -- 172.21.15.73:0/937986704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f232815e6e0 msgr2=0x7f23280af1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:05.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.787+0000 7f232da4d640 1 --2- 172.21.15.73:0/937986704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f232815e6e0 0x7f23280af1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:05.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.787+0000 7f232da4d640 1 -- 172.21.15.73:0/937986704 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2328154e90 con 0x7f232809b6e0 2024-03-29T04:08:05.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.787+0000 7f232e24e640 1 --2- 172.21.15.73:0/937986704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23281628e0 0x7f2328154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:08:05.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.787+0000 7f232d24c640 1 --2- 172.21.15.73:0/937986704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f232815e6e0 0x7f23280af1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:08:05.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.787+0000 7f232da4d640 1 --2- 172.21.15.73:0/937986704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f232809b6e0 0x7f23280c94f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f232400c3c0 tx=0x7f232400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:05.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.787+0000 7f231e7fc640 1 -- 172.21.15.73:0/937986704 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23240052d0 con 0x7f232809b6e0 2024-03-29T04:08:05.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.787+0000 7f231e7fc640 1 -- 172.21.15.73:0/937986704 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2324005490 con 0x7f232809b6e0 2024-03-29T04:08:05.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.787+0000 7f232fcb1640 1 -- 172.21.15.73:0/937986704 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23280b0130 con 0x7f232809b6e0 2024-03-29T04:08:05.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.787+0000 7f231e7fc640 1 -- 172.21.15.73:0/937986704 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2324007260 con 0x7f232809b6e0 2024-03-29T04:08:05.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.787+0000 7f232fcb1640 1 -- 172.21.15.73:0/937986704 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23280af890 con 0x7f232809b6e0 2024-03-29T04:08:05.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.788+0000 7f232fcb1640 1 -- 172.21.15.73:0/937986704 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2328068640 con 0x7f232809b6e0 2024-03-29T04:08:05.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.789+0000 7f231e7fc640 1 -- 172.21.15.73:0/937986704 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f2324007400 con 0x7f232809b6e0 2024-03-29T04:08:05.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.789+0000 7f231e7fc640 1 --2- 172.21.15.73:0/937986704 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f230c06c530 0x7f230c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:05.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.789+0000 7f232d24c640 1 --2- 172.21.15.73:0/937986704 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f230c06c530 0x7f230c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:05.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.789+0000 7f231e7fc640 1 -- 172.21.15.73:0/937986704 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f232408a890 con 0x7f232809b6e0 2024-03-29T04:08:05.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.789+0000 7f232d24c640 1 --2- 172.21.15.73:0/937986704 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f230c06c530 0x7f230c06e9f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2318036000 tx=0x7f231803b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:05.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:05.793+0000 7f231e7fc640 1 -- 172.21.15.73:0/937986704 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f2328154e90 con 0x7f232809b6e0 2024-03-29T04:08:05.969 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-29T04:08:05.972 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-29T04:08:05.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:06.004+0000 7f232fcb1640 1 -- 172.21.15.73:0/937986704 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f23280d1e40 con 0x7f232809b6e0 2024-03-29T04:08:05.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:06.005+0000 7f231e7fc640 1 -- 172.21.15.73:0/937986704 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7f2324059200 con 0x7f232809b6e0 2024-03-29T04:08:05.985 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:05.985 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3626787216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":3626787216},{"type":"v1","addr":"172.21.15.73:6837","nonce":3626787216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-03-29T04:08:05.985 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 2 2024-03-29T04:08:05.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:06.007+0000 7f232fcb1640 1 -- 172.21.15.73:0/937986704 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f230c06c530 msgr2=0x7f230c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:05.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:06.007+0000 7f232fcb1640 1 --2- 172.21.15.73:0/937986704 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f230c06c530 0x7f230c06e9f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2318036000 tx=0x7f231803b040 comp rx=0 tx=0).stop 2024-03-29T04:08:05.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:06.007+0000 7f232fcb1640 1 -- 172.21.15.73:0/937986704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f232809b6e0 msgr2=0x7f23280c94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:05.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:06.007+0000 7f232fcb1640 1 --2- 172.21.15.73:0/937986704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f232809b6e0 0x7f23280c94f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f232400c3c0 tx=0x7f232400c880 comp rx=0 tx=0).stop 2024-03-29T04:08:05.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:06.007+0000 7f232fcb1640 1 -- 172.21.15.73:0/937986704 shutdown_connections 2024-03-29T04:08:05.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:06.007+0000 7f232fcb1640 1 --2- 172.21.15.73:0/937986704 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23281628e0 0x7f2328154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:05.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:06.007+0000 7f232fcb1640 1 --2- 172.21.15.73:0/937986704 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f230c06c530 0x7f230c06e9f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:05.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:06.007+0000 7f232fcb1640 1 --2- 172.21.15.73:0/937986704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f232815e6e0 0x7f23280af1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:05.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:06.007+0000 7f232fcb1640 1 --2- 172.21.15.73:0/937986704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f232809b6e0 0x7f23280c94f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:05.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:06.007+0000 7f232fcb1640 1 -- 172.21.15.73:0/937986704 >> 172.21.15.73:0/937986704 conn(0x7f23280b3f10 msgr2=0x7f23280b42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:05.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:06.007+0000 7f232fcb1640 1 -- 172.21.15.73:0/937986704 shutdown_connections 2024-03-29T04:08:05.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:06.007+0000 7f232fcb1640 1 -- 172.21.15.73:0/937986704 wait complete. 2024-03-29T04:08:07.999 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-29T04:08:08.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.131+0000 7f9cfd9f4640 1 Processor -- start 2024-03-29T04:08:08.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.131+0000 7f9cfd9f4640 1 -- start start 2024-03-29T04:08:08.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.132+0000 7f9cfd9f4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9cf815e880 0x7f9cf80cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:08.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.132+0000 7f9cfd9f4640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9cf80b4340 0x7f9cf80d0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:08.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.132+0000 7f9cfd9f4640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cf80cf7f0 con 0x7f9cf815ec60 2024-03-29T04:08:08.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.132+0000 7f9cfd9f4640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f9cf80cfe00 con 0x7f9cf80b4340 2024-03-29T04:08:08.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.132+0000 7f9cfd9f4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9cf80cea70 con 0x7f9cf815e880 2024-03-29T04:08:08.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.132+0000 7f9cf77fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9cf80b4340 0x7f9cf80d0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:08.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.132+0000 7f9cf67fc640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9cf815ec60 0x7f9cf80ce280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58870/0 (socket says 172.21.15.73:58870) 2024-03-29T04:08:08.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.132+0000 7f9cf67fc640 1 -- 172.21.15.73:0/3109862132 learned_addr learned my addr 172.21.15.73:0/3109862132 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:08.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.132+0000 7f9cf77fe640 1 -- 172.21.15.73:0/3109862132 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9cf815e880 msgr2=0x7f9cf80cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:08.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.132+0000 7f9cf77fe640 1 --2- 172.21.15.73:0/3109862132 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9cf815e880 0x7f9cf80cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:08.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.132+0000 7f9cf77fe640 1 -- 172.21.15.73:0/3109862132 >> v1:172.21.15.73:6789/0 conn(0x7f9cf815ec60 legacy=0x7f9cf80ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:08.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.132+0000 7f9cf77fe640 1 -- 172.21.15.73:0/3109862132 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cf80ced50 con 0x7f9cf80b4340 2024-03-29T04:08:08.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.133+0000 7f9cf77fe640 1 --2- 172.21.15.73:0/3109862132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cf80b4340 0x7f9cf80d0290 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9cf00097a0 tx=0x7f9cf002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa41ed50f381c83f server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:08.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.133+0000 7f9cf5ffb640 1 -- 172.21.15.73:0/3109862132 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf0035020 con 0x7f9cf80b4340 2024-03-29T04:08:08.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.133+0000 7f9cf5ffb640 1 -- 172.21.15.73:0/3109862132 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cf0031830 con 0x7f9cf80b4340 2024-03-29T04:08:08.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.133+0000 7f9cf5ffb640 1 -- 172.21.15.73:0/3109862132 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf0031c00 con 0x7f9cf80b4340 2024-03-29T04:08:08.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.134+0000 7f9cfd9f4640 1 -- 172.21.15.73:0/3109862132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cf80b4340 msgr2=0x7f9cf80d0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:08.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.134+0000 7f9cfd9f4640 1 --2- 172.21.15.73:0/3109862132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cf80b4340 0x7f9cf80d0290 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9cf00097a0 tx=0x7f9cf002b8d0 comp rx=0 tx=0).stop 2024-03-29T04:08:08.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.134+0000 7f9cfd9f4640 1 -- 172.21.15.73:0/3109862132 shutdown_connections 2024-03-29T04:08:08.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.134+0000 7f9cfd9f4640 1 --2- 172.21.15.73:0/3109862132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cf80b4340 0x7f9cf80d0290 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:08.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.134+0000 7f9cfd9f4640 1 --2- 172.21.15.73:0/3109862132 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9cf815e880 0x7f9cf80cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:08.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.134+0000 7f9cfd9f4640 1 -- 172.21.15.73:0/3109862132 >> 172.21.15.73:0/3109862132 conn(0x7f9cf80b6860 msgr2=0x7f9cf80b6c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:08.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.134+0000 7f9cfd9f4640 1 -- 172.21.15.73:0/3109862132 shutdown_connections 2024-03-29T04:08:08.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.134+0000 7f9cfd9f4640 1 -- 172.21.15.73:0/3109862132 wait complete. 2024-03-29T04:08:08.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.135+0000 7f9cfd9f4640 1 Processor -- start 2024-03-29T04:08:08.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.135+0000 7f9cfd9f4640 1 -- start start 2024-03-29T04:08:08.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.136+0000 7f9cfd9f4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cf80b4340 0x7f9cf81f4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:08.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.136+0000 7f9cfd9f4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9cf815e880 0x7f9cf8152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:08.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.136+0000 7f9cfd9f4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cf815ec60 0x7f9cf80cc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:08.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.136+0000 7f9cfd9f4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf80d0950 con 0x7f9cf815ec60 2024-03-29T04:08:08.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.136+0000 7f9cfd9f4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf80d07d0 con 0x7f9cf80b4340 2024-03-29T04:08:08.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.136+0000 7f9cfd9f4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9cf80d0ad0 con 0x7f9cf815e880 2024-03-29T04:08:08.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.136+0000 7f9cf77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cf815ec60 0x7f9cf80cc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:08.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.136+0000 7f9cf77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cf815ec60 0x7f9cf80cc4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45526/0 (socket says 172.21.15.73:45526) 2024-03-29T04:08:08.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.136+0000 7f9cf77fe640 1 -- 172.21.15.73:0/2549386018 learned_addr learned my addr 172.21.15.73:0/2549386018 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:08.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.136+0000 7f9cf67fc640 1 --2- 172.21.15.73:0/2549386018 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9cf815e880 0x7f9cf8152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:08.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.136+0000 7f9cf77fe640 1 -- 172.21.15.73:0/2549386018 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9cf815e880 msgr2=0x7f9cf8152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:08.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.136+0000 7f9cf77fe640 1 --2- 172.21.15.73:0/2549386018 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9cf815e880 0x7f9cf8152170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:08.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.137+0000 7f9cf77fe640 1 -- 172.21.15.73:0/2549386018 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cf80b4340 msgr2=0x7f9cf81f4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:08.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.136+0000 7f9cf6ffd640 1 --2- 172.21.15.73:0/2549386018 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cf80b4340 0x7f9cf81f4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:08.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.137+0000 7f9cf77fe640 1 --2- 172.21.15.73:0/2549386018 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cf80b4340 0x7f9cf81f4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:08.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.137+0000 7f9cf77fe640 1 -- 172.21.15.73:0/2549386018 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cf81f54b0 con 0x7f9cf815ec60 2024-03-29T04:08:08.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.137+0000 7f9cf67fc640 1 --2- 172.21.15.73:0/2549386018 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9cf815e880 0x7f9cf8152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:08:08.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.137+0000 7f9cf6ffd640 1 --2- 172.21.15.73:0/2549386018 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cf80b4340 0x7f9cf81f4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:08:08.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.137+0000 7f9cf77fe640 1 --2- 172.21.15.73:0/2549386018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cf815ec60 0x7f9cf80cc4d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9cf002bee0 tx=0x7f9cf00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:08.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.137+0000 7f9cdffff640 1 -- 172.21.15.73:0/2549386018 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf0041070 con 0x7f9cf815ec60 2024-03-29T04:08:08.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.137+0000 7f9cdffff640 1 -- 172.21.15.73:0/2549386018 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cf003a8d0 con 0x7f9cf815ec60 2024-03-29T04:08:08.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.137+0000 7f9cfd9f4640 1 -- 172.21.15.73:0/2549386018 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cf80caa60 con 0x7f9cf815ec60 2024-03-29T04:08:08.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.137+0000 7f9cdffff640 1 -- 172.21.15.73:0/2549386018 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf0035040 con 0x7f9cf815ec60 2024-03-29T04:08:08.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.137+0000 7f9cfd9f4640 1 -- 172.21.15.73:0/2549386018 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cf80cb020 con 0x7f9cf815ec60 2024-03-29T04:08:08.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.138+0000 7f9cfd9f4640 1 -- 172.21.15.73:0/2549386018 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cf8068640 con 0x7f9cf815ec60 2024-03-29T04:08:08.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.138+0000 7f9cdffff640 1 -- 172.21.15.73:0/2549386018 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f9cf0038020 con 0x7f9cf815ec60 2024-03-29T04:08:08.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.139+0000 7f9cdffff640 1 --2- 172.21.15.73:0/2549386018 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9ce406c530 0x7f9ce406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:08.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.139+0000 7f9cdffff640 1 -- 172.21.15.73:0/2549386018 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f9cf00acdf0 con 0x7f9cf815ec60 2024-03-29T04:08:08.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.139+0000 7f9cf6ffd640 1 --2- 172.21.15.73:0/2549386018 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9ce406c530 0x7f9ce406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:08.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.139+0000 7f9cf6ffd640 1 --2- 172.21.15.73:0/2549386018 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9ce406c530 0x7f9ce406e9f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8007eb0 tx=0x7f9ce80073c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:08.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.143+0000 7f9cdffff640 1 -- 172.21.15.73:0/2549386018 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f9cf81f54b0 con 0x7f9cf815ec60 2024-03-29T04:08:08.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.354+0000 7f9cfd9f4640 1 -- 172.21.15.73:0/2549386018 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9cf80d1c40 con 0x7f9cf815ec60 2024-03-29T04:08:08.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.354+0000 7f9cdffff640 1 -- 172.21.15.73:0/2549386018 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3867 (secure 0 0 0) 0x7f9cf007b760 con 0x7f9cf815ec60 2024-03-29T04:08:08.334 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:08.334 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2101608781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2101608781},{"type":"v1","addr":"172.21.15.142:6834","nonce":2101608781}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3626787216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":3626787216},{"type":"v1","addr":"172.21.15.73:6837","nonce":3626787216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1987252283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1987252283},{"type":"v1","addr":"172.21.15.73:6836","nonce":1987252283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/569863112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":569863112},{"type":"v1","addr":"172.21.15.142:6835","nonce":569863112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-03-29T04:08:08.335 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 3 2024-03-29T04:08:08.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.356+0000 7f9cfd9f4640 1 -- 172.21.15.73:0/2549386018 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9ce406c530 msgr2=0x7f9ce406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:08.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.356+0000 7f9cfd9f4640 1 --2- 172.21.15.73:0/2549386018 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9ce406c530 0x7f9ce406e9f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8007eb0 tx=0x7f9ce80073c0 comp rx=0 tx=0).stop 2024-03-29T04:08:08.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.356+0000 7f9cfd9f4640 1 -- 172.21.15.73:0/2549386018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cf815ec60 msgr2=0x7f9cf80cc4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:08.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.356+0000 7f9cfd9f4640 1 --2- 172.21.15.73:0/2549386018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cf815ec60 0x7f9cf80cc4d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9cf002bee0 tx=0x7f9cf00046c0 comp rx=0 tx=0).stop 2024-03-29T04:08:08.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.356+0000 7f9cfd9f4640 1 -- 172.21.15.73:0/2549386018 shutdown_connections 2024-03-29T04:08:08.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.356+0000 7f9cfd9f4640 1 --2- 172.21.15.73:0/2549386018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9cf815ec60 0x7f9cf80cc4d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:08.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.356+0000 7f9cfd9f4640 1 --2- 172.21.15.73:0/2549386018 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9cf815e880 0x7f9cf8152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:08.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.356+0000 7f9cfd9f4640 1 --2- 172.21.15.73:0/2549386018 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9ce406c530 0x7f9ce406e9f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:08.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.356+0000 7f9cfd9f4640 1 --2- 172.21.15.73:0/2549386018 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cf80b4340 0x7f9cf81f4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:08.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.356+0000 7f9cfd9f4640 1 -- 172.21.15.73:0/2549386018 >> 172.21.15.73:0/2549386018 conn(0x7f9cf80b6860 msgr2=0x7f9cf806fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:08.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.356+0000 7f9cfd9f4640 1 -- 172.21.15.73:0/2549386018 shutdown_connections 2024-03-29T04:08:08.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.356+0000 7f9cfd9f4640 1 -- 172.21.15.73:0/2549386018 wait complete. 2024-03-29T04:08:08.347 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-29T04:08:08.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.468+0000 7fd5874c4640 1 Processor -- start 2024-03-29T04:08:08.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.468+0000 7fd5874c4640 1 -- start start 2024-03-29T04:08:08.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.469+0000 7fd5874c4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd58015e860 0x7fd5800d2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:08.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.469+0000 7fd5874c4640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd5800d10d0 0x7fd5800705d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:08.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.469+0000 7fd5874c4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd580070b10 0x7fd5800cca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:08.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.469+0000 7fd5874c4640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fd580070140 con 0x7fd5800d10d0 2024-03-29T04:08:08.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.469+0000 7fd5874c4640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd58015ec40 con 0x7fd58015e860 2024-03-29T04:08:08.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.469+0000 7fd5874c4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd5800d15d0 con 0x7fd580070b10 2024-03-29T04:08:08.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.469+0000 7fd584a5f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd5800d10d0 0x7fd5800705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:08.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.469+0000 7fd584a5f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd5800d10d0 0x7fd5800705d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45534/0 (socket says 172.21.15.73:45534) 2024-03-29T04:08:08.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.469+0000 7fd584a5f640 1 -- 172.21.15.73:0/1007104550 learned_addr learned my addr 172.21.15.73:0/1007104550 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:08.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.469+0000 7fd585260640 1 --2- 172.21.15.73:0/1007104550 >> v2:172.21.15.142:3300/0 conn(0x7fd58015e860 0x7fd5800d2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:08.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.469+0000 7fd585a61640 1 --2- 172.21.15.73:0/1007104550 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd580070b10 0x7fd5800cca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:08.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.469+0000 7fd584a5f640 1 -- 172.21.15.73:0/1007104550 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd580070b10 msgr2=0x7fd5800cca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:08.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.469+0000 7fd584a5f640 1 --2- 172.21.15.73:0/1007104550 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd580070b10 0x7fd5800cca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:08.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.469+0000 7fd584a5f640 1 -- 172.21.15.73:0/1007104550 >> v2:172.21.15.142:3300/0 conn(0x7fd58015e860 msgr2=0x7fd5800d2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:08.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.469+0000 7fd584a5f640 1 --2- 172.21.15.73:0/1007104550 >> v2:172.21.15.142:3300/0 conn(0x7fd58015e860 0x7fd5800d2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:08.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.469+0000 7fd584a5f640 1 -- 172.21.15.73:0/1007104550 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5800d18b0 con 0x7fd5800d10d0 2024-03-29T04:08:08.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.469+0000 7fd585260640 1 --2- 172.21.15.73:0/1007104550 >> v2:172.21.15.142:3300/0 conn(0x7fd58015e860 0x7fd5800d2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:08:08.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.469+0000 7fd585a61640 1 --2- 172.21.15.73:0/1007104550 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd580070b10 0x7fd5800cca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:08:08.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.470+0000 7fd584a5f640 1 --2- 172.21.15.73:0/1007104550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5800d10d0 0x7fd5800705d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd580071d40 tx=0x7fd57002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11b82d05de476990 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:08.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.470+0000 7fd577fff640 1 -- 172.21.15.73:0/1007104550 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd570035020 con 0x7fd5800d10d0 2024-03-29T04:08:08.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.470+0000 7fd577fff640 1 -- 172.21.15.73:0/1007104550 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd570031870 con 0x7fd5800d10d0 2024-03-29T04:08:08.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.470+0000 7fd577fff640 1 -- 172.21.15.73:0/1007104550 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd570031c40 con 0x7fd5800d10d0 2024-03-29T04:08:08.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.470+0000 7fd5874c4640 1 -- 172.21.15.73:0/1007104550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5800d10d0 msgr2=0x7fd5800705d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:08.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.470+0000 7fd5874c4640 1 --2- 172.21.15.73:0/1007104550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5800d10d0 0x7fd5800705d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd580071d40 tx=0x7fd57002b910 comp rx=0 tx=0).stop 2024-03-29T04:08:08.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.470+0000 7fd5874c4640 1 -- 172.21.15.73:0/1007104550 shutdown_connections 2024-03-29T04:08:08.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.470+0000 7fd5874c4640 1 --2- 172.21.15.73:0/1007104550 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd580070b10 0x7fd5800cca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:08.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.470+0000 7fd5874c4640 1 --2- 172.21.15.73:0/1007104550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5800d10d0 0x7fd5800705d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:08.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.470+0000 7fd5874c4640 1 --2- 172.21.15.73:0/1007104550 >> v2:172.21.15.142:3300/0 conn(0x7fd58015e860 0x7fd5800d2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:08.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.470+0000 7fd5874c4640 1 -- 172.21.15.73:0/1007104550 >> 172.21.15.73:0/1007104550 conn(0x7fd5800d2430 msgr2=0x7fd5800d2840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:08.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.471+0000 7fd5874c4640 1 -- 172.21.15.73:0/1007104550 shutdown_connections 2024-03-29T04:08:08.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.471+0000 7fd5874c4640 1 -- 172.21.15.73:0/1007104550 wait complete. 2024-03-29T04:08:08.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.472+0000 7fd5874c4640 1 Processor -- start 2024-03-29T04:08:08.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.472+0000 7fd5874c4640 1 -- start start 2024-03-29T04:08:08.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.472+0000 7fd5874c4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd580070b10 0x7fd5800c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:08.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.472+0000 7fd5874c4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5800d10d0 0x7fd5801f3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:08.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.472+0000 7fd5874c4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd58015e860 0x7fd58006d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:08.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.472+0000 7fd5874c4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd580163090 con 0x7fd58015e860 2024-03-29T04:08:08.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.472+0000 7fd5874c4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd58006fdd0 con 0x7fd580070b10 2024-03-29T04:08:08.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.472+0000 7fd5874c4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd5800ccfc0 con 0x7fd5800d10d0 2024-03-29T04:08:08.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.472+0000 7fd585a61640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd58015e860 0x7fd58006d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:08.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.472+0000 7fd585a61640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd58015e860 0x7fd58006d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45542/0 (socket says 172.21.15.73:45542) 2024-03-29T04:08:08.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.472+0000 7fd585a61640 1 -- 172.21.15.73:0/3168876933 learned_addr learned my addr 172.21.15.73:0/3168876933 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:08.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.473+0000 7fd584a5f640 1 --2- 172.21.15.73:0/3168876933 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5800d10d0 0x7fd5801f3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:08.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.473+0000 7fd585260640 1 --2- 172.21.15.73:0/3168876933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd580070b10 0x7fd5800c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:08.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.473+0000 7fd585a61640 1 -- 172.21.15.73:0/3168876933 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5800d10d0 msgr2=0x7fd5801f3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:08.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.473+0000 7fd585a61640 1 --2- 172.21.15.73:0/3168876933 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5800d10d0 0x7fd5801f3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:08.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.473+0000 7fd585a61640 1 -- 172.21.15.73:0/3168876933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd580070b10 msgr2=0x7fd5800c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:08.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.473+0000 7fd585a61640 1 --2- 172.21.15.73:0/3168876933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd580070b10 0x7fd5800c7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:08.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.473+0000 7fd585a61640 1 -- 172.21.15.73:0/3168876933 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd58015a810 con 0x7fd58015e860 2024-03-29T04:08:08.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.473+0000 7fd584a5f640 1 --2- 172.21.15.73:0/3168876933 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5800d10d0 0x7fd5801f3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:08:08.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.473+0000 7fd585260640 1 --2- 172.21.15.73:0/3168876933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd580070b10 0x7fd5800c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:08:08.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.473+0000 7fd585a61640 1 --2- 172.21.15.73:0/3168876933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd58015e860 0x7fd58006d6a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd57800cef0 tx=0x7fd57800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:08.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.473+0000 7fd575ffb640 1 -- 172.21.15.73:0/3168876933 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57801a070 con 0x7fd58015e860 2024-03-29T04:08:08.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.473+0000 7fd575ffb640 1 -- 172.21.15.73:0/3168876933 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd57800d860 con 0x7fd58015e860 2024-03-29T04:08:08.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.473+0000 7fd5874c4640 1 -- 172.21.15.73:0/3168876933 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd58015aaf0 con 0x7fd58015e860 2024-03-29T04:08:08.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.473+0000 7fd575ffb640 1 -- 172.21.15.73:0/3168876933 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57800dc50 con 0x7fd58015e860 2024-03-29T04:08:08.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.473+0000 7fd5874c4640 1 -- 172.21.15.73:0/3168876933 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd58015b0b0 con 0x7fd58015e860 2024-03-29T04:08:08.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.474+0000 7fd5874c4640 1 -- 172.21.15.73:0/3168876933 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd580068640 con 0x7fd58015e860 2024-03-29T04:08:08.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.475+0000 7fd575ffb640 1 -- 172.21.15.73:0/3168876933 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fd57801d070 con 0x7fd58015e860 2024-03-29T04:08:08.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.475+0000 7fd575ffb640 1 --2- 172.21.15.73:0/3168876933 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd56406c530 0x7fd56406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:08.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.475+0000 7fd575ffb640 1 -- 172.21.15.73:0/3168876933 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fd57808bba0 con 0x7fd58015e860 2024-03-29T04:08:08.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.475+0000 7fd585260640 1 --2- 172.21.15.73:0/3168876933 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd56406c530 0x7fd56406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:08.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.475+0000 7fd585260640 1 --2- 172.21.15.73:0/3168876933 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd56406c530 0x7fd56406e9f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd57c006fd0 tx=0x7fd57c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:08.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.480+0000 7fd575ffb640 1 -- 172.21.15.73:0/3168876933 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fd57805a660 con 0x7fd58015e860 2024-03-29T04:08:08.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.657+0000 7fd5874c4640 1 -- 172.21.15.73:0/3168876933 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd58006ea30 con 0x7fd58015e860 2024-03-29T04:08:08.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.658+0000 7fd575ffb640 1 -- 172.21.15.73:0/3168876933 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12884 (secure 0 0 0) 0x7fd578059f60 con 0x7fd58015e860 2024-03-29T04:08:08.638 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:08.638 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":17,"fsid":"6bff1617-b138-4517-acca-3ecaae3f2bb3","created":"2024-03-29T04:07:47.346864+0000","modified":"2024-03-29T04:08:02.518163+0000","last_up_change":"2024-03-29T04:07:58.507139+0000","last_in_change":"2024-03-29T04:07:49.637816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-29T04:07:59.537301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"925d7de1-14ab-48c0-aebd-7bded108f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6820","nonce":2387335359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6824","nonce":2387335359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6831","nonce":2387335359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6828","nonce":2387335359}]},"public_addr":"172.21.15.73:6820/2387335359","cluster_addr":"172.21.15.73:6824/2387335359","heartbeat_back_addr":"172.21.15.73:6831/2387335359","heartbeat_front_addr":"172.21.15.73:6828/2387335359","state":["exists","up"]},{"osd":1,"uuid":"6b182102-882a-4e0c-99db-0afae5cfb38b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6801","nonce":2431315515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6803","nonce":2431315515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6807","nonce":2431315515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6805","nonce":2431315515}]},"public_addr":"172.21.15.73:6801/2431315515","cluster_addr":"172.21.15.73:6803/2431315515","heartbeat_back_addr":"172.21.15.73:6807/2431315515","heartbeat_front_addr":"172.21.15.73:6805/2431315515","state":["exists","up"]},{"osd":2,"uuid":"8040902e-b0b8-4a21-bf64-ce1c222115ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6809","nonce":407236597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6811","nonce":407236597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6815","nonce":407236597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6813","nonce":407236597}]},"public_addr":"172.21.15.73:6809/407236597","cluster_addr":"172.21.15.73:6811/407236597","heartbeat_back_addr":"172.21.15.73:6815/407236597","heartbeat_front_addr":"172.21.15.73:6813/407236597","state":["exists","up"]},{"osd":3,"uuid":"1bab19ee-3775-4ce1-a4ce-cf7cda3bbbf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6817","nonce":4291100709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6821","nonce":4291100709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6829","nonce":4291100709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6825","nonce":4291100709}]},"public_addr":"172.21.15.73:6817/4291100709","cluster_addr":"172.21.15.73:6821/4291100709","heartbeat_back_addr":"172.21.15.73:6829/4291100709","heartbeat_front_addr":"172.21.15.73:6825/4291100709","state":["exists","up"]},{"osd":4,"uuid":"b0c74337-8fe4-47dc-b3da-2d07591b1f6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6817","nonce":3703256194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6819","nonce":3703256194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6823","nonce":3703256194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6821","nonce":3703256194}]},"public_addr":"172.21.15.142:6817/3703256194","cluster_addr":"172.21.15.142:6819/3703256194","heartbeat_back_addr":"172.21.15.142:6823/3703256194","heartbeat_front_addr":"172.21.15.142:6821/3703256194","state":["exists","up"]},{"osd":5,"uuid":"9ce36410-a29a-42c6-99f4-f95d4afdd7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6825","nonce":4271575803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6827","nonce":4271575803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6831","nonce":4271575803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6829","nonce":4271575803}]},"public_addr":"172.21.15.142:6825/4271575803","cluster_addr":"172.21.15.142:6827/4271575803","heartbeat_back_addr":"172.21.15.142:6831/4271575803","heartbeat_front_addr":"172.21.15.142:6829/4271575803","state":["exists","up"]},{"osd":6,"uuid":"aec4264a-64ac-428e-a860-d2920a304019","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6801","nonce":1772722570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6803","nonce":1772722570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6807","nonce":1772722570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6805","nonce":1772722570}]},"public_addr":"172.21.15.142:6801/1772722570","cluster_addr":"172.21.15.142:6803/1772722570","heartbeat_back_addr":"172.21.15.142:6807/1772722570","heartbeat_front_addr":"172.21.15.142:6805/1772722570","state":["exists","up"]},{"osd":7,"uuid":"fe599052-8e5a-4c7a-91e7-52d1bae24a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6809","nonce":3910589675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6811","nonce":3910589675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6815","nonce":3910589675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6813","nonce":3910589675}]},"public_addr":"172.21.15.142:6809/3910589675","cluster_addr":"172.21.15.142:6811/3910589675","heartbeat_back_addr":"172.21.15.142:6815/3910589675","heartbeat_front_addr":"172.21.15.142:6813/3910589675","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.835096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.587210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.786547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.778004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.843740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.791160+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.837992+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.718722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:08:08.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.660+0000 7fd5874c4640 1 -- 172.21.15.73:0/3168876933 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd56406c530 msgr2=0x7fd56406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:08.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.660+0000 7fd5874c4640 1 --2- 172.21.15.73:0/3168876933 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd56406c530 0x7fd56406e9f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd57c006fd0 tx=0x7fd57c008040 comp rx=0 tx=0).stop 2024-03-29T04:08:08.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.660+0000 7fd5874c4640 1 -- 172.21.15.73:0/3168876933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd58015e860 msgr2=0x7fd58006d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:08.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.660+0000 7fd5874c4640 1 --2- 172.21.15.73:0/3168876933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd58015e860 0x7fd58006d6a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd57800cef0 tx=0x7fd57800a710 comp rx=0 tx=0).stop 2024-03-29T04:08:08.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.660+0000 7fd5874c4640 1 -- 172.21.15.73:0/3168876933 shutdown_connections 2024-03-29T04:08:08.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.660+0000 7fd5874c4640 1 --2- 172.21.15.73:0/3168876933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd58015e860 0x7fd58006d6a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:08.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.660+0000 7fd5874c4640 1 --2- 172.21.15.73:0/3168876933 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5800d10d0 0x7fd5801f3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:08.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.660+0000 7fd5874c4640 1 --2- 172.21.15.73:0/3168876933 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd56406c530 0x7fd56406e9f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:08.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.660+0000 7fd5874c4640 1 --2- 172.21.15.73:0/3168876933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd580070b10 0x7fd5800c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:08.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.660+0000 7fd5874c4640 1 -- 172.21.15.73:0/3168876933 >> 172.21.15.73:0/3168876933 conn(0x7fd5800d2430 msgr2=0x7fd5800b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:08.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.660+0000 7fd5874c4640 1 -- 172.21.15.73:0/3168876933 shutdown_connections 2024-03-29T04:08:08.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.660+0000 7fd5874c4640 1 -- 172.21.15.73:0/3168876933 wait complete. 2024-03-29T04:08:08.651 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-29T04:07:59.537301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-29T04:08:08.651 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-29T04:08:08.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.774+0000 7ff07d91b640 1 Processor -- start 2024-03-29T04:08:08.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.774+0000 7ff07d91b640 1 -- start start 2024-03-29T04:08:08.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.775+0000 7ff07d91b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff07809b140 0x7ff078167870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:08.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.775+0000 7ff07d91b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0780cde40 con 0x7ff0780cea60 2024-03-29T04:08:08.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.775+0000 7ff07d91b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0780d0c80 con 0x7ff0780ce680 2024-03-29T04:08:08.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.775+0000 7ff07d91b640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7ff0780d0a30 con 0x7ff07809b140 2024-03-29T04:08:08.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.775+0000 7ff0777fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff07809b140 0x7ff078167870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:08.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.775+0000 7ff0767fc640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff0780cea60 0x7ff07809aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58874/0 (socket says 172.21.15.73:58874) 2024-03-29T04:08:08.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.775+0000 7ff0767fc640 1 -- 172.21.15.73:0/2154090395 learned_addr learned my addr 172.21.15.73:0/2154090395 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:08.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.776+0000 7ff0777fe640 1 -- 172.21.15.73:0/2154090395 >> v1:172.21.15.142:6789/0 conn(0x7ff0780ce680 legacy=0x7ff07809b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:08.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.776+0000 7ff0777fe640 1 -- 172.21.15.73:0/2154090395 >> v1:172.21.15.73:6789/0 conn(0x7ff0780cea60 legacy=0x7ff07809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:08.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.776+0000 7ff0777fe640 1 -- 172.21.15.73:0/2154090395 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0780d0f60 con 0x7ff07809b140 2024-03-29T04:08:08.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.776+0000 7ff075ffb640 1 -- 172.21.15.73:0/2154090395 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2385815338 0 0) 0x7ff0780cde40 con 0x7ff0780cea60 2024-03-29T04:08:08.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.776+0000 7ff0777fe640 1 --2- 172.21.15.73:0/2154090395 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff07809b140 0x7ff078167870 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff0700097a0 tx=0x7ff07002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2de557bca031845d server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:08.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.776+0000 7ff075ffb640 1 -- 172.21.15.73:0/2154090395 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff070035020 con 0x7ff07809b140 2024-03-29T04:08:08.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.776+0000 7ff075ffb640 1 -- 172.21.15.73:0/2154090395 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff070031830 con 0x7ff07809b140 2024-03-29T04:08:08.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.776+0000 7ff075ffb640 1 -- 172.21.15.73:0/2154090395 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff070031c00 con 0x7ff07809b140 2024-03-29T04:08:08.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.777+0000 7ff07d91b640 1 -- 172.21.15.73:0/2154090395 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff07809b140 msgr2=0x7ff078167870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:08.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.777+0000 7ff07d91b640 1 --2- 172.21.15.73:0/2154090395 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff07809b140 0x7ff078167870 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff0700097a0 tx=0x7ff07002b8d0 comp rx=0 tx=0).stop 2024-03-29T04:08:08.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.777+0000 7ff07d91b640 1 -- 172.21.15.73:0/2154090395 shutdown_connections 2024-03-29T04:08:08.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.777+0000 7ff07d91b640 1 --2- 172.21.15.73:0/2154090395 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff07809b140 0x7ff078167870 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:08.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.777+0000 7ff07d91b640 1 -- 172.21.15.73:0/2154090395 >> 172.21.15.73:0/2154090395 conn(0x7ff0780b3f40 msgr2=0x7ff0780b4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:08.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.777+0000 7ff07d91b640 1 -- 172.21.15.73:0/2154090395 shutdown_connections 2024-03-29T04:08:08.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.777+0000 7ff07d91b640 1 -- 172.21.15.73:0/2154090395 wait complete. 2024-03-29T04:08:08.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.778+0000 7ff07d91b640 1 Processor -- start 2024-03-29T04:08:08.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.778+0000 7ff07d91b640 1 -- start start 2024-03-29T04:08:08.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.779+0000 7ff07d91b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff07809b140 0x7ff07815e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:08.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.779+0000 7ff07d91b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0780ce680 0x7ff0780cbb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:08.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.779+0000 7ff07d91b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0780cea60 0x7ff0780cc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:08.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.779+0000 7ff07d91b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff078070ae0 con 0x7ff07809b140 2024-03-29T04:08:08.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.779+0000 7ff07d91b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff078070650 con 0x7ff0780cea60 2024-03-29T04:08:08.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.779+0000 7ff07d91b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff078070c60 con 0x7ff0780ce680 2024-03-29T04:08:08.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.779+0000 7ff076ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff07809b140 0x7ff07815e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:08.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.779+0000 7ff076ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff07809b140 0x7ff07815e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45566/0 (socket says 172.21.15.73:45566) 2024-03-29T04:08:08.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.779+0000 7ff076ffd640 1 -- 172.21.15.73:0/3044207238 learned_addr learned my addr 172.21.15.73:0/3044207238 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:08.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.779+0000 7ff0777fe640 1 --2- 172.21.15.73:0/3044207238 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0780cea60 0x7ff0780cc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:08.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.779+0000 7ff0767fc640 1 --2- 172.21.15.73:0/3044207238 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0780ce680 0x7ff0780cbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:08.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.779+0000 7ff076ffd640 1 -- 172.21.15.73:0/3044207238 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0780ce680 msgr2=0x7ff0780cbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:08.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.779+0000 7ff076ffd640 1 --2- 172.21.15.73:0/3044207238 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0780ce680 0x7ff0780cbb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:08.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.779+0000 7ff076ffd640 1 -- 172.21.15.73:0/3044207238 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0780cea60 msgr2=0x7ff0780cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:08.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.779+0000 7ff076ffd640 1 --2- 172.21.15.73:0/3044207238 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0780cea60 0x7ff0780cc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:08.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.779+0000 7ff076ffd640 1 -- 172.21.15.73:0/3044207238 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0780ca790 con 0x7ff07809b140 2024-03-29T04:08:08.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.779+0000 7ff0767fc640 1 --2- 172.21.15.73:0/3044207238 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0780ce680 0x7ff0780cbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:08:08.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.779+0000 7ff076ffd640 1 --2- 172.21.15.73:0/3044207238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff07809b140 0x7ff07815e5a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff06800c8a0 tx=0x7ff06800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:08.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.780+0000 7ff05ffff640 1 -- 172.21.15.73:0/3044207238 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff068003b70 con 0x7ff07809b140 2024-03-29T04:08:08.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.780+0000 7ff05ffff640 1 -- 172.21.15.73:0/3044207238 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff068003d30 con 0x7ff07809b140 2024-03-29T04:08:08.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.780+0000 7ff07d91b640 1 -- 172.21.15.73:0/3044207238 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0780caa70 con 0x7ff07809b140 2024-03-29T04:08:08.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.780+0000 7ff05ffff640 1 -- 172.21.15.73:0/3044207238 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06800aa90 con 0x7ff07809b140 2024-03-29T04:08:08.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.780+0000 7ff07d91b640 1 -- 172.21.15.73:0/3044207238 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0780c68c0 con 0x7ff07809b140 2024-03-29T04:08:08.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.781+0000 7ff07d91b640 1 -- 172.21.15.73:0/3044207238 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0780a0520 con 0x7ff07809b140 2024-03-29T04:08:08.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.781+0000 7ff05ffff640 1 -- 172.21.15.73:0/3044207238 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff06800ac30 con 0x7ff07809b140 2024-03-29T04:08:08.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.781+0000 7ff05ffff640 1 --2- 172.21.15.73:0/3044207238 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff06406c530 0x7ff06406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:08.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.782+0000 7ff0767fc640 1 --2- 172.21.15.73:0/3044207238 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff06406c530 0x7ff06406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:08.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.782+0000 7ff05ffff640 1 -- 172.21.15.73:0/3044207238 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7ff06808b360 con 0x7ff07809b140 2024-03-29T04:08:08.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.782+0000 7ff0767fc640 1 --2- 172.21.15.73:0/3044207238 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff06406c530 0x7ff06406e9f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff07806e540 tx=0x7ff06c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:08.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.786+0000 7ff05ffff640 1 -- 172.21.15.73:0/3044207238 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7ff068059cd0 con 0x7ff07809b140 2024-03-29T04:08:08.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.960+0000 7ff07d91b640 1 -- 172.21.15.73:0/3044207238 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff07804f9d0 con 0x7ff07809b140 2024-03-29T04:08:08.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.960+0000 7ff05ffff640 1 -- 172.21.15.73:0/3044207238 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7ff0680595d0 con 0x7ff07809b140 2024-03-29T04:08:08.940 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-03-29T04:08:08.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.962+0000 7ff07d91b640 1 -- 172.21.15.73:0/3044207238 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff06406c530 msgr2=0x7ff06406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:08.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.962+0000 7ff07d91b640 1 --2- 172.21.15.73:0/3044207238 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff06406c530 0x7ff06406e9f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff07806e540 tx=0x7ff06c009040 comp rx=0 tx=0).stop 2024-03-29T04:08:08.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.962+0000 7ff07d91b640 1 -- 172.21.15.73:0/3044207238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff07809b140 msgr2=0x7ff07815e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:08.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.962+0000 7ff07d91b640 1 --2- 172.21.15.73:0/3044207238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff07809b140 0x7ff07815e5a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff06800c8a0 tx=0x7ff06800cd60 comp rx=0 tx=0).stop 2024-03-29T04:08:08.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.962+0000 7ff07d91b640 1 -- 172.21.15.73:0/3044207238 shutdown_connections 2024-03-29T04:08:08.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.962+0000 7ff07d91b640 1 --2- 172.21.15.73:0/3044207238 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff06406c530 0x7ff06406e9f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:08.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.962+0000 7ff07d91b640 1 --2- 172.21.15.73:0/3044207238 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0780cea60 0x7ff0780cc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:08.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.962+0000 7ff07d91b640 1 --2- 172.21.15.73:0/3044207238 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0780ce680 0x7ff0780cbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:08.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.962+0000 7ff07d91b640 1 --2- 172.21.15.73:0/3044207238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff07809b140 0x7ff07815e5a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:08.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.962+0000 7ff07d91b640 1 -- 172.21.15.73:0/3044207238 >> 172.21.15.73:0/3044207238 conn(0x7ff0780b3f40 msgr2=0x7ff0780afc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:08.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.962+0000 7ff07d91b640 1 -- 172.21.15.73:0/3044207238 shutdown_connections 2024-03-29T04:08:08.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:08.962+0000 7ff07d91b640 1 -- 172.21.15.73:0/3044207238 wait complete. 2024-03-29T04:08:08.953 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-29T04:08:09.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.073+0000 7f278eed9640 1 Processor -- start 2024-03-29T04:08:09.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.073+0000 7f278eed9640 1 -- start start 2024-03-29T04:08:09.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.073+0000 7f278eed9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f278806bc20 0x7f2788160cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:09.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.073+0000 7f278eed9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f27880ae240 0x7f278815e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:09.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.073+0000 7f278eed9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f278815ce80 con 0x7f27881460a0 2024-03-29T04:08:09.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.073+0000 7f278eed9640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f278815da90 con 0x7f278806bc20 2024-03-29T04:08:09.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.073+0000 7f278eed9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f278815d160 con 0x7f27880ae240 2024-03-29T04:08:09.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.074+0000 7f2787fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f278806bc20 0x7f2788160cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:09.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.074+0000 7f2787fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f278806bc20 0x7f2788160cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45568/0 (socket says 172.21.15.73:45568) 2024-03-29T04:08:09.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.074+0000 7f2787fff640 1 -- 172.21.15.73:0/1495019962 learned_addr learned my addr 172.21.15.73:0/1495019962 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:09.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.074+0000 7f278d476640 1 --2- 172.21.15.73:0/1495019962 >> v2:172.21.15.142:3300/0 conn(0x7f27880ae240 0x7f278815e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:09.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.074+0000 7f2787fff640 1 -- 172.21.15.73:0/1495019962 >> v2:172.21.15.142:3300/0 conn(0x7f27880ae240 msgr2=0x7f278815e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:09.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.074+0000 7f2787fff640 1 --2- 172.21.15.73:0/1495019962 >> v2:172.21.15.142:3300/0 conn(0x7f27880ae240 0x7f278815e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:09.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.074+0000 7f2787fff640 1 -- 172.21.15.73:0/1495019962 >> v1:172.21.15.142:6789/0 conn(0x7f27881460a0 legacy=0x7f278806b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:09.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.074+0000 7f2787fff640 1 -- 172.21.15.73:0/1495019962 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f278815d440 con 0x7f278806bc20 2024-03-29T04:08:09.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.075+0000 7f2787fff640 1 --2- 172.21.15.73:0/1495019962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f278806bc20 0x7f2788160cf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f27880af500 tx=0x7f277402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=725488c84e6fe0fa server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:09.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.075+0000 7f27877fe640 1 -- 172.21.15.73:0/1495019962 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2774035020 con 0x7f278806bc20 2024-03-29T04:08:09.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.075+0000 7f27877fe640 1 -- 172.21.15.73:0/1495019962 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2774031870 con 0x7f278806bc20 2024-03-29T04:08:09.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.075+0000 7f27877fe640 1 -- 172.21.15.73:0/1495019962 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2774031c40 con 0x7f278806bc20 2024-03-29T04:08:09.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.075+0000 7f278eed9640 1 -- 172.21.15.73:0/1495019962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f278806bc20 msgr2=0x7f2788160cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:09.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.075+0000 7f278eed9640 1 --2- 172.21.15.73:0/1495019962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f278806bc20 0x7f2788160cf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f27880af500 tx=0x7f277402b910 comp rx=0 tx=0).stop 2024-03-29T04:08:09.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.075+0000 7f278eed9640 1 -- 172.21.15.73:0/1495019962 shutdown_connections 2024-03-29T04:08:09.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.075+0000 7f278eed9640 1 --2- 172.21.15.73:0/1495019962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f278806bc20 0x7f2788160cf0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:09.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.075+0000 7f278eed9640 1 --2- 172.21.15.73:0/1495019962 >> v2:172.21.15.142:3300/0 conn(0x7f27880ae240 0x7f278815e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:09.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.075+0000 7f278eed9640 1 -- 172.21.15.73:0/1495019962 >> 172.21.15.73:0/1495019962 conn(0x7f27880b6780 msgr2=0x7f27880b6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:09.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.075+0000 7f278eed9640 1 -- 172.21.15.73:0/1495019962 shutdown_connections 2024-03-29T04:08:09.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.075+0000 7f278eed9640 1 -- 172.21.15.73:0/1495019962 wait complete. 2024-03-29T04:08:09.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.076+0000 7f278eed9640 1 Processor -- start 2024-03-29T04:08:09.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.076+0000 7f278eed9640 1 -- start start 2024-03-29T04:08:09.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.077+0000 7f278eed9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f278806bc20 0x7f27881e67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:09.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.077+0000 7f278eed9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27880ae240 0x7f27881e3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:09.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.077+0000 7f278eed9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27881460a0 0x7f278815be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:09.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.077+0000 7f278eed9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f278815e830 con 0x7f278806bc20 2024-03-29T04:08:09.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.077+0000 7f278eed9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f278815e6b0 con 0x7f27881460a0 2024-03-29T04:08:09.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.077+0000 7f278eed9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f278815e9b0 con 0x7f27880ae240 2024-03-29T04:08:09.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.077+0000 7f278cc75640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f278806bc20 0x7f27881e67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:09.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.077+0000 7f278cc75640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f278806bc20 0x7f27881e67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45570/0 (socket says 172.21.15.73:45570) 2024-03-29T04:08:09.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.077+0000 7f278cc75640 1 -- 172.21.15.73:0/589631229 learned_addr learned my addr 172.21.15.73:0/589631229 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:09.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.078+0000 7f278cc75640 1 -- 172.21.15.73:0/589631229 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27880ae240 msgr2=0x7f27881e3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:09.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.078+0000 7f278cc75640 1 --2- 172.21.15.73:0/589631229 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27880ae240 0x7f27881e3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:09.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.078+0000 7f278cc75640 1 -- 172.21.15.73:0/589631229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27881460a0 msgr2=0x7f278815be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:09.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.078+0000 7f278d476640 1 --2- 172.21.15.73:0/589631229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27881460a0 0x7f278815be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:09.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.078+0000 7f278cc75640 1 --2- 172.21.15.73:0/589631229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27881460a0 0x7f278815be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:09.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.078+0000 7f278cc75640 1 -- 172.21.15.73:0/589631229 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f278813eec0 con 0x7f278806bc20 2024-03-29T04:08:09.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.078+0000 7f278d476640 1 --2- 172.21.15.73:0/589631229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27881460a0 0x7f278815be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:08:09.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.078+0000 7f278cc75640 1 --2- 172.21.15.73:0/589631229 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f278806bc20 0x7f27881e67f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f277c00b3f0 tx=0x7f277c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:09.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.078+0000 7f27857fa640 1 -- 172.21.15.73:0/589631229 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c015020 con 0x7f278806bc20 2024-03-29T04:08:09.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.078+0000 7f27857fa640 1 -- 172.21.15.73:0/589631229 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f277c011830 con 0x7f278806bc20 2024-03-29T04:08:09.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.078+0000 7f278eed9640 1 -- 172.21.15.73:0/589631229 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27881e40a0 con 0x7f278806bc20 2024-03-29T04:08:09.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.078+0000 7f27857fa640 1 -- 172.21.15.73:0/589631229 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c011c20 con 0x7f278806bc20 2024-03-29T04:08:09.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.078+0000 7f278eed9640 1 -- 172.21.15.73:0/589631229 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27881e4660 con 0x7f278806bc20 2024-03-29T04:08:09.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.079+0000 7f278eed9640 1 -- 172.21.15.73:0/589631229 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2788068d50 con 0x7f278806bc20 2024-03-29T04:08:09.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.080+0000 7f27857fa640 1 -- 172.21.15.73:0/589631229 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f277c018020 con 0x7f278806bc20 2024-03-29T04:08:09.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.080+0000 7f27857fa640 1 --2- 172.21.15.73:0/589631229 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f276c06c530 0x7f276c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:09.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.080+0000 7f27857fa640 1 -- 172.21.15.73:0/589631229 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f277c08afd0 con 0x7f278806bc20 2024-03-29T04:08:09.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.080+0000 7f2787fff640 1 --2- 172.21.15.73:0/589631229 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f276c06c530 0x7f276c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:09.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.080+0000 7f2787fff640 1 --2- 172.21.15.73:0/589631229 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f276c06c530 0x7f276c06e9f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2774036000 tx=0x7f2774030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:09.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.084+0000 7f27857fa640 1 -- 172.21.15.73:0/589631229 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f277c01f030 con 0x7f278806bc20 2024-03-29T04:08:09.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.260+0000 7f278eed9640 1 -- 172.21.15.73:0/589631229 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f2788072ba0 con 0x7f278806bc20 2024-03-29T04:08:09.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.260+0000 7f27857fa640 1 -- 172.21.15.73:0/589631229 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f277c0172c0 con 0x7f278806bc20 2024-03-29T04:08:09.240 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:09.240 INFO:teuthology.orchestra.run.smithi073.stdout:[ 2024-03-29T04:08:09.240 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-29T04:08:09.241 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 1, 2024-03-29T04:08:09.241 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": ".mgr" 2024-03-29T04:08:09.241 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-29T04:08:09.241 INFO:teuthology.orchestra.run.smithi073.stdout:] 2024-03-29T04:08:09.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.262+0000 7f278eed9640 1 -- 172.21.15.73:0/589631229 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f276c06c530 msgr2=0x7f276c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:09.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.262+0000 7f278eed9640 1 --2- 172.21.15.73:0/589631229 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f276c06c530 0x7f276c06e9f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2774036000 tx=0x7f2774030000 comp rx=0 tx=0).stop 2024-03-29T04:08:09.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.262+0000 7f278eed9640 1 -- 172.21.15.73:0/589631229 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f278806bc20 msgr2=0x7f27881e67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:09.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.262+0000 7f278eed9640 1 --2- 172.21.15.73:0/589631229 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f278806bc20 0x7f27881e67f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f277c00b3f0 tx=0x7f277c00b8b0 comp rx=0 tx=0).stop 2024-03-29T04:08:09.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.262+0000 7f278eed9640 1 -- 172.21.15.73:0/589631229 shutdown_connections 2024-03-29T04:08:09.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.262+0000 7f278eed9640 1 --2- 172.21.15.73:0/589631229 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f276c06c530 0x7f276c06e9f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:09.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.262+0000 7f278eed9640 1 --2- 172.21.15.73:0/589631229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27881460a0 0x7f278815be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:09.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.262+0000 7f278eed9640 1 --2- 172.21.15.73:0/589631229 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f27880ae240 0x7f27881e3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:09.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.262+0000 7f278eed9640 1 --2- 172.21.15.73:0/589631229 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f278806bc20 0x7f27881e67f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:09.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.262+0000 7f278eed9640 1 -- 172.21.15.73:0/589631229 >> 172.21.15.73:0/589631229 conn(0x7f27880b6780 msgr2=0x7f27880ae620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:09.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.262+0000 7f278eed9640 1 -- 172.21.15.73:0/589631229 shutdown_connections 2024-03-29T04:08:09.243 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.262+0000 7f278eed9640 1 -- 172.21.15.73:0/589631229 wait complete. 2024-03-29T04:08:09.252 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-29T04:08:09.253 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-29T04:08:09.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.377+0000 7f2436fc3640 1 Processor -- start 2024-03-29T04:08:09.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.377+0000 7f2436fc3640 1 -- start start 2024-03-29T04:08:09.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.378+0000 7f2436fc3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f243015e8a0 0x7f24300d32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:09.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.378+0000 7f2436fc3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24300d0f30 0x7f24300d1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:09.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.378+0000 7f2436fc3640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24300d2290 con 0x7f24300cfeb0 2024-03-29T04:08:09.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.378+0000 7f2436fc3640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f243015ec80 con 0x7f243015e8a0 2024-03-29T04:08:09.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.378+0000 7f2436fc3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f24300d3830 con 0x7f24300d0f30 2024-03-29T04:08:09.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.378+0000 7f242ffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24300d0f30 0x7f24300d1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:09.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.378+0000 7f2434d5f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f243015e8a0 0x7f24300d32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:09.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.378+0000 7f242ffff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24300d0f30 0x7f24300d1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:53558/0 (socket says 172.21.15.73:53558) 2024-03-29T04:08:09.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.378+0000 7f242ffff640 1 -- 172.21.15.73:0/2707668867 learned_addr learned my addr 172.21.15.73:0/2707668867 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:09.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.378+0000 7f242ffff640 1 -- 172.21.15.73:0/2707668867 >> v2:172.21.15.142:3300/0 conn(0x7f243015e8a0 msgr2=0x7f24300d32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:09.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.378+0000 7f242ffff640 1 --2- 172.21.15.73:0/2707668867 >> v2:172.21.15.142:3300/0 conn(0x7f243015e8a0 0x7f24300d32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:09.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.378+0000 7f242ffff640 1 -- 172.21.15.73:0/2707668867 >> v1:172.21.15.142:6789/0 conn(0x7f24300cfeb0 legacy=0x7f24300d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:09.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.378+0000 7f242ffff640 1 -- 172.21.15.73:0/2707668867 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24300d2530 con 0x7f24300d0f30 2024-03-29T04:08:09.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.378+0000 7f2434d5f640 1 --2- 172.21.15.73:0/2707668867 >> v2:172.21.15.142:3300/0 conn(0x7f243015e8a0 0x7f24300d32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:08:09.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.379+0000 7f242ffff640 1 --2- 172.21.15.73:0/2707668867 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24300d0f30 0x7f24300d1390 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f241c009870 tx=0x7f241c02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48ee0e4966210f27 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:09.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.379+0000 7f242f7fe640 1 -- 172.21.15.73:0/2707668867 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f241c035020 con 0x7f24300d0f30 2024-03-29T04:08:09.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.379+0000 7f242f7fe640 1 -- 172.21.15.73:0/2707668867 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f241c031640 con 0x7f24300d0f30 2024-03-29T04:08:09.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.379+0000 7f242f7fe640 1 -- 172.21.15.73:0/2707668867 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f241c02d040 con 0x7f24300d0f30 2024-03-29T04:08:09.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.380+0000 7f2436fc3640 1 -- 172.21.15.73:0/2707668867 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24300d0f30 msgr2=0x7f24300d1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:09.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.380+0000 7f2436fc3640 1 --2- 172.21.15.73:0/2707668867 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24300d0f30 0x7f24300d1390 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f241c009870 tx=0x7f241c02b8f0 comp rx=0 tx=0).stop 2024-03-29T04:08:09.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.380+0000 7f2436fc3640 1 -- 172.21.15.73:0/2707668867 shutdown_connections 2024-03-29T04:08:09.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.380+0000 7f2436fc3640 1 --2- 172.21.15.73:0/2707668867 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24300d0f30 0x7f24300d1390 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:09.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.380+0000 7f2436fc3640 1 --2- 172.21.15.73:0/2707668867 >> v2:172.21.15.142:3300/0 conn(0x7f243015e8a0 0x7f24300d32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:09.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.380+0000 7f2436fc3640 1 -- 172.21.15.73:0/2707668867 >> 172.21.15.73:0/2707668867 conn(0x7f243008bfc0 msgr2=0x7f24300d4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:09.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.380+0000 7f2436fc3640 1 -- 172.21.15.73:0/2707668867 shutdown_connections 2024-03-29T04:08:09.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.380+0000 7f2436fc3640 1 -- 172.21.15.73:0/2707668867 wait complete. 2024-03-29T04:08:09.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.381+0000 7f2436fc3640 1 Processor -- start 2024-03-29T04:08:09.362 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.381+0000 7f2436fc3640 1 -- start start 2024-03-29T04:08:09.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.382+0000 7f2436fc3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24300cfeb0 0x7f243015ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:09.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.382+0000 7f2436fc3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24300d0f30 0x7f24300cd240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:09.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.382+0000 7f2436fc3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f243015e8a0 0x7f2430160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:09.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.382+0000 7f2436fc3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f24300d2af0 con 0x7f24300d0f30 2024-03-29T04:08:09.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.382+0000 7f2436fc3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f24300d2dd0 con 0x7f24300cfeb0 2024-03-29T04:08:09.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.382+0000 7f2436fc3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f243006c740 con 0x7f243015e8a0 2024-03-29T04:08:09.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.382+0000 7f242ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24300d0f30 0x7f24300cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:09.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.382+0000 7f242ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24300d0f30 0x7f24300cd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45582/0 (socket says 172.21.15.73:45582) 2024-03-29T04:08:09.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.382+0000 7f242ffff640 1 -- 172.21.15.73:0/2963913137 learned_addr learned my addr 172.21.15.73:0/2963913137 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:09.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.382+0000 7f2434d5f640 1 --2- 172.21.15.73:0/2963913137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24300cfeb0 0x7f243015ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:09.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.382+0000 7f2435560640 1 --2- 172.21.15.73:0/2963913137 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f243015e8a0 0x7f2430160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:09.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.382+0000 7f242ffff640 1 -- 172.21.15.73:0/2963913137 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f243015e8a0 msgr2=0x7f2430160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:09.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.382+0000 7f242ffff640 1 --2- 172.21.15.73:0/2963913137 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f243015e8a0 0x7f2430160ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:09.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.382+0000 7f242ffff640 1 -- 172.21.15.73:0/2963913137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24300cfeb0 msgr2=0x7f243015ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:09.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.382+0000 7f242ffff640 1 --2- 172.21.15.73:0/2963913137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24300cfeb0 0x7f243015ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:09.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.382+0000 7f242ffff640 1 -- 172.21.15.73:0/2963913137 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24300cd780 con 0x7f24300d0f30 2024-03-29T04:08:09.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.382+0000 7f2434d5f640 1 --2- 172.21.15.73:0/2963913137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24300cfeb0 0x7f243015ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:08:09.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.383+0000 7f242ffff640 1 --2- 172.21.15.73:0/2963913137 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24300d0f30 0x7f24300cd240 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f241c000c00 tx=0x7f241c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:09.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.383+0000 7f242d7fa640 1 -- 172.21.15.73:0/2963913137 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f241c040070 con 0x7f24300d0f30 2024-03-29T04:08:09.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.383+0000 7f242d7fa640 1 -- 172.21.15.73:0/2963913137 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f241c0399f0 con 0x7f24300d0f30 2024-03-29T04:08:09.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.383+0000 7f2436fc3640 1 -- 172.21.15.73:0/2963913137 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24300cc1a0 con 0x7f24300d0f30 2024-03-29T04:08:09.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.383+0000 7f242d7fa640 1 -- 172.21.15.73:0/2963913137 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f241c035040 con 0x7f24300d0f30 2024-03-29T04:08:09.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.383+0000 7f2436fc3640 1 -- 172.21.15.73:0/2963913137 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24300cc760 con 0x7f24300d0f30 2024-03-29T04:08:09.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.384+0000 7f2436fc3640 1 -- 172.21.15.73:0/2963913137 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2430068640 con 0x7f24300d0f30 2024-03-29T04:08:09.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.384+0000 7f242d7fa640 1 -- 172.21.15.73:0/2963913137 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f241c04b060 con 0x7f24300d0f30 2024-03-29T04:08:09.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.385+0000 7f242d7fa640 1 --2- 172.21.15.73:0/2963913137 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f241406c560 0x7f241406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:09.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.385+0000 7f242d7fa640 1 -- 172.21.15.73:0/2963913137 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f241c0acbd0 con 0x7f24300d0f30 2024-03-29T04:08:09.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.385+0000 7f2434d5f640 1 --2- 172.21.15.73:0/2963913137 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f241406c560 0x7f241406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:09.367 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.385+0000 7f2434d5f640 1 --2- 172.21.15.73:0/2963913137 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f241406c560 0x7f241406ea20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2424009a20 tx=0x7f2424008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:09.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.389+0000 7f242d7fa640 1 -- 172.21.15.73:0/2963913137 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f241c07b540 con 0x7f24300d0f30 2024-03-29T04:08:09.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:09.566+0000 7f2436fc3640 1 -- 172.21.15.73:0/2963913137 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f24300ba510 con 0x7f24300d0f30 2024-03-29T04:08:10.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.558+0000 7f242d7fa640 1 -- 172.21.15.73:0/2963913137 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7f241c07ae40 con 0x7f24300d0f30 2024-03-29T04:08:10.538 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' created 2024-03-29T04:08:10.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.561+0000 7f2436fc3640 1 -- 172.21.15.73:0/2963913137 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f241406c560 msgr2=0x7f241406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:10.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.561+0000 7f2436fc3640 1 --2- 172.21.15.73:0/2963913137 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f241406c560 0x7f241406ea20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2424009a20 tx=0x7f2424008040 comp rx=0 tx=0).stop 2024-03-29T04:08:10.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.561+0000 7f2436fc3640 1 -- 172.21.15.73:0/2963913137 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24300d0f30 msgr2=0x7f24300cd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:10.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.561+0000 7f2436fc3640 1 --2- 172.21.15.73:0/2963913137 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24300d0f30 0x7f24300cd240 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f241c000c00 tx=0x7f241c0046c0 comp rx=0 tx=0).stop 2024-03-29T04:08:10.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.562+0000 7f2436fc3640 1 -- 172.21.15.73:0/2963913137 shutdown_connections 2024-03-29T04:08:10.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.562+0000 7f2436fc3640 1 --2- 172.21.15.73:0/2963913137 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f243015e8a0 0x7f2430160ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:10.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.562+0000 7f2436fc3640 1 --2- 172.21.15.73:0/2963913137 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24300d0f30 0x7f24300cd240 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:10.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.562+0000 7f2436fc3640 1 --2- 172.21.15.73:0/2963913137 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f241406c560 0x7f241406ea20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:10.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.562+0000 7f2436fc3640 1 --2- 172.21.15.73:0/2963913137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24300cfeb0 0x7f243015ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:10.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.562+0000 7f2436fc3640 1 -- 172.21.15.73:0/2963913137 >> 172.21.15.73:0/2963913137 conn(0x7f243008bfc0 msgr2=0x7f24300d0300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:10.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.563+0000 7f2436fc3640 1 -- 172.21.15.73:0/2963913137 shutdown_connections 2024-03-29T04:08:10.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.563+0000 7f2436fc3640 1 -- 172.21.15.73:0/2963913137 wait complete. 2024-03-29T04:08:10.558 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-29T04:08:10.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.689+0000 7f6a17359640 1 Processor -- start 2024-03-29T04:08:10.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.689+0000 7f6a17359640 1 -- start start 2024-03-29T04:08:10.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.690+0000 7f6a17359640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6a1015e830 0x7f6a1006c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:10.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.690+0000 7f6a17359640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6a1006ca60 0x7f6a1006e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:10.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.690+0000 7f6a17359640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a1006ed90 con 0x7f6a1006e630 2024-03-29T04:08:10.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.690+0000 7f6a17359640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f6a1006cec0 con 0x7f6a1006ca60 2024-03-29T04:08:10.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.690+0000 7f6a17359640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f6a1006f070 con 0x7f6a1015e830 2024-03-29T04:08:10.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.690+0000 7f6a148f4640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6a1006ca60 0x7f6a1006e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:10.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.690+0000 7f6a148f4640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6a1006ca60 0x7f6a1006e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45590/0 (socket says 172.21.15.73:45590) 2024-03-29T04:08:10.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.690+0000 7f6a148f4640 1 -- 172.21.15.73:0/1401697588 learned_addr learned my addr 172.21.15.73:0/1401697588 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:10.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.690+0000 7f6a150f5640 1 --2- 172.21.15.73:0/1401697588 >> v2:172.21.15.142:3300/0 conn(0x7f6a1015e830 0x7f6a1006c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:10.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.690+0000 7f6a148f4640 1 -- 172.21.15.73:0/1401697588 >> v2:172.21.15.142:3300/0 conn(0x7f6a1015e830 msgr2=0x7f6a1006c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:10.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.690+0000 7f6a148f4640 1 --2- 172.21.15.73:0/1401697588 >> v2:172.21.15.142:3300/0 conn(0x7f6a1015e830 0x7f6a1006c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:10.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.690+0000 7f6a148f4640 1 -- 172.21.15.73:0/1401697588 >> v1:172.21.15.142:6789/0 conn(0x7f6a1006e630 legacy=0x7f6a10162490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:10.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.690+0000 7f6a148f4640 1 -- 172.21.15.73:0/1401697588 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a1006f350 con 0x7f6a1006ca60 2024-03-29T04:08:10.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.690+0000 7f6a150f5640 1 --2- 172.21.15.73:0/1401697588 >> v2:172.21.15.142:3300/0 conn(0x7f6a1015e830 0x7f6a1006c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:08:10.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.691+0000 7f6a148f4640 1 --2- 172.21.15.73:0/1401697588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a1006ca60 0x7f6a1006e0f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6a10073d90 tx=0x7f6a0002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61e643b5a1371fa1 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:10.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.691+0000 7f6a07fff640 1 -- 172.21.15.73:0/1401697588 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a00035020 con 0x7f6a1006ca60 2024-03-29T04:08:10.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.691+0000 7f6a07fff640 1 -- 172.21.15.73:0/1401697588 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a00031870 con 0x7f6a1006ca60 2024-03-29T04:08:10.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.691+0000 7f6a07fff640 1 -- 172.21.15.73:0/1401697588 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a00031c40 con 0x7f6a1006ca60 2024-03-29T04:08:10.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.692+0000 7f6a17359640 1 -- 172.21.15.73:0/1401697588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a1006ca60 msgr2=0x7f6a1006e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:10.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.692+0000 7f6a17359640 1 --2- 172.21.15.73:0/1401697588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a1006ca60 0x7f6a1006e0f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6a10073d90 tx=0x7f6a0002b910 comp rx=0 tx=0).stop 2024-03-29T04:08:10.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.692+0000 7f6a17359640 1 -- 172.21.15.73:0/1401697588 shutdown_connections 2024-03-29T04:08:10.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.692+0000 7f6a17359640 1 --2- 172.21.15.73:0/1401697588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a1006ca60 0x7f6a1006e0f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:10.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.692+0000 7f6a17359640 1 --2- 172.21.15.73:0/1401697588 >> v2:172.21.15.142:3300/0 conn(0x7f6a1015e830 0x7f6a1006c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:10.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.692+0000 7f6a17359640 1 -- 172.21.15.73:0/1401697588 >> 172.21.15.73:0/1401697588 conn(0x7f6a10072090 msgr2=0x7f6a100724a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:10.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.692+0000 7f6a17359640 1 -- 172.21.15.73:0/1401697588 shutdown_connections 2024-03-29T04:08:10.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.692+0000 7f6a17359640 1 -- 172.21.15.73:0/1401697588 wait complete. 2024-03-29T04:08:10.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.693+0000 7f6a17359640 1 Processor -- start 2024-03-29T04:08:10.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.693+0000 7f6a17359640 1 -- start start 2024-03-29T04:08:10.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.694+0000 7f6a17359640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a1006ca60 0x7f6a1014efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:10.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.694+0000 7f6a17359640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a1006e630 0x7f6a1015aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:10.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.694+0000 7f6a17359640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a1015e830 0x7f6a10160e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:10.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.694+0000 7f6a17359640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1006eaa0 con 0x7f6a1006e630 2024-03-29T04:08:10.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.694+0000 7f6a17359640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1006f910 con 0x7f6a1006ca60 2024-03-29T04:08:10.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.694+0000 7f6a17359640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f6a100ae9f0 con 0x7f6a1015e830 2024-03-29T04:08:10.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.694+0000 7f6a148f4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a1006e630 0x7f6a1015aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:10.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.694+0000 7f6a148f4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a1006e630 0x7f6a1015aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45604/0 (socket says 172.21.15.73:45604) 2024-03-29T04:08:10.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.694+0000 7f6a148f4640 1 -- 172.21.15.73:0/2243449802 learned_addr learned my addr 172.21.15.73:0/2243449802 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:10.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.694+0000 7f6a158f6640 1 --2- 172.21.15.73:0/2243449802 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a1015e830 0x7f6a10160e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:10.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.694+0000 7f6a150f5640 1 --2- 172.21.15.73:0/2243449802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a1006ca60 0x7f6a1014efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:10.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.694+0000 7f6a148f4640 1 -- 172.21.15.73:0/2243449802 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a1015e830 msgr2=0x7f6a10160e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:10.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.694+0000 7f6a148f4640 1 --2- 172.21.15.73:0/2243449802 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a1015e830 0x7f6a10160e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:10.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.694+0000 7f6a148f4640 1 -- 172.21.15.73:0/2243449802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a1006ca60 msgr2=0x7f6a1014efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:10.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.694+0000 7f6a148f4640 1 --2- 172.21.15.73:0/2243449802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a1006ca60 0x7f6a1014efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:10.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.694+0000 7f6a148f4640 1 -- 172.21.15.73:0/2243449802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a1015fce0 con 0x7f6a1006e630 2024-03-29T04:08:10.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.694+0000 7f6a150f5640 1 --2- 172.21.15.73:0/2243449802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a1006ca60 0x7f6a1014efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:08:10.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.694+0000 7f6a148f4640 1 --2- 172.21.15.73:0/2243449802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a1006e630 0x7f6a1015aec0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6a0002b950 tx=0x7f6a000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:10.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.694+0000 7f6a05ffb640 1 -- 172.21.15.73:0/2243449802 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a00040070 con 0x7f6a1006e630 2024-03-29T04:08:10.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.695+0000 7f6a05ffb640 1 -- 172.21.15.73:0/2243449802 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a0003a420 con 0x7f6a1006e630 2024-03-29T04:08:10.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.695+0000 7f6a05ffb640 1 -- 172.21.15.73:0/2243449802 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a00035040 con 0x7f6a1006e630 2024-03-29T04:08:10.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.695+0000 7f6a17359640 1 -- 172.21.15.73:0/2243449802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a1015ffc0 con 0x7f6a1006e630 2024-03-29T04:08:10.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.695+0000 7f6a17359640 1 -- 172.21.15.73:0/2243449802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a101545b0 con 0x7f6a1006e630 2024-03-29T04:08:10.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.696+0000 7f6a17359640 1 -- 172.21.15.73:0/2243449802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a10162200 con 0x7f6a1006e630 2024-03-29T04:08:10.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.696+0000 7f6a05ffb640 1 -- 172.21.15.73:0/2243449802 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f6a0004b060 con 0x7f6a1006e630 2024-03-29T04:08:10.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.697+0000 7f6a05ffb640 1 --2- 172.21.15.73:0/2243449802 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f69f406c530 0x7f69f406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:10.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.697+0000 7f6a150f5640 1 --2- 172.21.15.73:0/2243449802 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f69f406c530 0x7f69f406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:10.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.697+0000 7f6a05ffb640 1 -- 172.21.15.73:0/2243449802 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f6a000ad370 con 0x7f6a1006e630 2024-03-29T04:08:10.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.697+0000 7f6a150f5640 1 --2- 172.21.15.73:0/2243449802 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f69f406c530 0x7f69f406e9f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c00e3d0 tx=0x7f6a0c007a10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:10.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.701+0000 7f6a05ffb640 1 -- 172.21.15.73:0/2243449802 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f6a0007bc00 con 0x7f6a1006e630 2024-03-29T04:08:10.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:10.878+0000 7f6a17359640 1 -- 172.21.15.73:0/2243449802 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f6a1004f9d0 con 0x7f6a1006e630 2024-03-29T04:08:11.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.563+0000 7f6a05ffb640 1 -- 172.21.15.73:0/2243449802 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) ==== 170+0+0 (secure 0 0 0) 0x7f6a0007b500 con 0x7f6a1006e630 2024-03-29T04:08:11.543 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' created 2024-03-29T04:08:11.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.566+0000 7f6a17359640 1 -- 172.21.15.73:0/2243449802 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f69f406c530 msgr2=0x7f69f406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:11.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.566+0000 7f6a17359640 1 --2- 172.21.15.73:0/2243449802 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f69f406c530 0x7f69f406e9f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c00e3d0 tx=0x7f6a0c007a10 comp rx=0 tx=0).stop 2024-03-29T04:08:11.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.566+0000 7f6a17359640 1 -- 172.21.15.73:0/2243449802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a1006e630 msgr2=0x7f6a1015aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:11.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.566+0000 7f6a17359640 1 --2- 172.21.15.73:0/2243449802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a1006e630 0x7f6a1015aec0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6a0002b950 tx=0x7f6a000046c0 comp rx=0 tx=0).stop 2024-03-29T04:08:11.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.567+0000 7f6a17359640 1 -- 172.21.15.73:0/2243449802 shutdown_connections 2024-03-29T04:08:11.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.567+0000 7f6a17359640 1 --2- 172.21.15.73:0/2243449802 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a1015e830 0x7f6a10160e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:11.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.567+0000 7f6a17359640 1 --2- 172.21.15.73:0/2243449802 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a1006e630 0x7f6a1015aec0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:11.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.567+0000 7f6a17359640 1 --2- 172.21.15.73:0/2243449802 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f69f406c530 0x7f69f406e9f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:11.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.567+0000 7f6a17359640 1 --2- 172.21.15.73:0/2243449802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a1006ca60 0x7f6a1014efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:11.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.567+0000 7f6a17359640 1 -- 172.21.15.73:0/2243449802 >> 172.21.15.73:0/2243449802 conn(0x7f6a10072090 msgr2=0x7f6a1006bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:11.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.567+0000 7f6a17359640 1 -- 172.21.15.73:0/2243449802 shutdown_connections 2024-03-29T04:08:11.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.567+0000 7f6a17359640 1 -- 172.21.15.73:0/2243449802 wait complete. 2024-03-29T04:08:11.570 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-29T04:08:11.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.696+0000 7f33d3a74640 1 Processor -- start 2024-03-29T04:08:11.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.696+0000 7f33d3a74640 1 -- start start 2024-03-29T04:08:11.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.697+0000 7f33d3a74640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f33cc15c760 0x7f33cc06f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:11.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.697+0000 7f33d3a74640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f33cc072dc0 0x7f33cc0cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:11.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.697+0000 7f33d3a74640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33cc0d01e0 con 0x7f33cc06c520 2024-03-29T04:08:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.697+0000 7f33d3a74640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f33cc0b6050 con 0x7f33cc15c760 2024-03-29T04:08:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.697+0000 7f33d3a74640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f33cc0d04c0 con 0x7f33cc072dc0 2024-03-29T04:08:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.697+0000 7f33d1810640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f33cc15c760 0x7f33cc06f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.697+0000 7f33d1810640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f33cc15c760 0x7f33cc06f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45620/0 (socket says 172.21.15.73:45620) 2024-03-29T04:08:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.697+0000 7f33d1810640 1 -- 172.21.15.73:0/210068480 learned_addr learned my addr 172.21.15.73:0/210068480 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.697+0000 7f33d100f640 1 --2- 172.21.15.73:0/210068480 >> v2:172.21.15.142:3300/0 conn(0x7f33cc072dc0 0x7f33cc0cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.698+0000 7f33d1810640 1 -- 172.21.15.73:0/210068480 >> v2:172.21.15.142:3300/0 conn(0x7f33cc072dc0 msgr2=0x7f33cc0cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.698+0000 7f33d1810640 1 --2- 172.21.15.73:0/210068480 >> v2:172.21.15.142:3300/0 conn(0x7f33cc072dc0 0x7f33cc0cf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.698+0000 7f33d1810640 1 -- 172.21.15.73:0/210068480 >> v1:172.21.15.142:6789/0 conn(0x7f33cc06c520 legacy=0x7f33cc06c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:11.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.698+0000 7f33d1810640 1 -- 172.21.15.73:0/210068480 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33cc06f1a0 con 0x7f33cc15c760 2024-03-29T04:08:11.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.698+0000 7f33d1810640 1 --2- 172.21.15.73:0/210068480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33cc15c760 0x7f33cc06f9a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f33cc06d9e0 tx=0x7f33c802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edce214e38a4509c server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:11.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.698+0000 7f33d080e640 1 -- 172.21.15.73:0/210068480 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c802ca80 con 0x7f33cc15c760 2024-03-29T04:08:11.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.698+0000 7f33d080e640 1 -- 172.21.15.73:0/210068480 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33c802cc20 con 0x7f33cc15c760 2024-03-29T04:08:11.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.698+0000 7f33d080e640 1 -- 172.21.15.73:0/210068480 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c80343f0 con 0x7f33cc15c760 2024-03-29T04:08:11.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.699+0000 7f33d3a74640 1 -- 172.21.15.73:0/210068480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33cc15c760 msgr2=0x7f33cc06f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:11.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.699+0000 7f33d3a74640 1 --2- 172.21.15.73:0/210068480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33cc15c760 0x7f33cc06f9a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f33cc06d9e0 tx=0x7f33c802bee0 comp rx=0 tx=0).stop 2024-03-29T04:08:11.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.699+0000 7f33d3a74640 1 -- 172.21.15.73:0/210068480 shutdown_connections 2024-03-29T04:08:11.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.699+0000 7f33d3a74640 1 --2- 172.21.15.73:0/210068480 >> v2:172.21.15.142:3300/0 conn(0x7f33cc072dc0 0x7f33cc0cf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:11.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.699+0000 7f33d3a74640 1 --2- 172.21.15.73:0/210068480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33cc15c760 0x7f33cc06f9a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:11.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.699+0000 7f33d3a74640 1 -- 172.21.15.73:0/210068480 >> 172.21.15.73:0/210068480 conn(0x7f33cc072090 msgr2=0x7f33cc0724a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:11.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.699+0000 7f33d3a74640 1 -- 172.21.15.73:0/210068480 shutdown_connections 2024-03-29T04:08:11.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.699+0000 7f33d3a74640 1 -- 172.21.15.73:0/210068480 wait complete. 2024-03-29T04:08:11.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.700+0000 7f33d3a74640 1 Processor -- start 2024-03-29T04:08:11.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.700+0000 7f33d3a74640 1 -- start start 2024-03-29T04:08:11.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.701+0000 7f33d3a74640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33cc06c520 0x7f33cc14a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:11.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.701+0000 7f33d3a74640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33cc072dc0 0x7f33cc14c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:11.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.701+0000 7f33d3a74640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33cc15c760 0x7f33cc14cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:11.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.701+0000 7f33d3a74640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f33cc0cfeb0 con 0x7f33cc06c520 2024-03-29T04:08:11.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.701+0000 7f33d3a74640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f33cc06fee0 con 0x7f33cc072dc0 2024-03-29T04:08:11.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.701+0000 7f33d3a74640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f33cc0d07a0 con 0x7f33cc15c760 2024-03-29T04:08:11.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.701+0000 7f33d1810640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33cc06c520 0x7f33cc14a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:11.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.701+0000 7f33d1810640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33cc06c520 0x7f33cc14a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45636/0 (socket says 172.21.15.73:45636) 2024-03-29T04:08:11.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.701+0000 7f33d1810640 1 -- 172.21.15.73:0/2007782071 learned_addr learned my addr 172.21.15.73:0/2007782071 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:11.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.701+0000 7f33d100f640 1 --2- 172.21.15.73:0/2007782071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33cc072dc0 0x7f33cc14c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:11.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.701+0000 7f33d2011640 1 --2- 172.21.15.73:0/2007782071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33cc15c760 0x7f33cc14cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:11.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.701+0000 7f33d1810640 1 -- 172.21.15.73:0/2007782071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33cc15c760 msgr2=0x7f33cc14cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:11.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.701+0000 7f33d1810640 1 --2- 172.21.15.73:0/2007782071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33cc15c760 0x7f33cc14cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:11.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.701+0000 7f33d1810640 1 -- 172.21.15.73:0/2007782071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33cc072dc0 msgr2=0x7f33cc14c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:11.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.701+0000 7f33d1810640 1 --2- 172.21.15.73:0/2007782071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33cc072dc0 0x7f33cc14c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:11.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.701+0000 7f33d1810640 1 -- 172.21.15.73:0/2007782071 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33cc14e3b0 con 0x7f33cc06c520 2024-03-29T04:08:11.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.701+0000 7f33d2011640 1 --2- 172.21.15.73:0/2007782071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33cc15c760 0x7f33cc14cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:08:11.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.701+0000 7f33d1810640 1 --2- 172.21.15.73:0/2007782071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33cc06c520 0x7f33cc14a810 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f33c8000f80 tx=0x7f33c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:11.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.702+0000 7f33c27fc640 1 -- 172.21.15.73:0/2007782071 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c8043020 con 0x7f33cc06c520 2024-03-29T04:08:11.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.702+0000 7f33c27fc640 1 -- 172.21.15.73:0/2007782071 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33c803e450 con 0x7f33cc06c520 2024-03-29T04:08:11.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.702+0000 7f33d3a74640 1 -- 172.21.15.73:0/2007782071 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33cc14bbf0 con 0x7f33cc06c520 2024-03-29T04:08:11.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.702+0000 7f33c27fc640 1 -- 172.21.15.73:0/2007782071 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c8009510 con 0x7f33cc06c520 2024-03-29T04:08:11.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.702+0000 7f33d3a74640 1 -- 172.21.15.73:0/2007782071 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33cc14c1b0 con 0x7f33cc06c520 2024-03-29T04:08:11.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.703+0000 7f33d3a74640 1 -- 172.21.15.73:0/2007782071 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33cc04f9d0 con 0x7f33cc06c520 2024-03-29T04:08:11.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.703+0000 7f33c27fc640 1 -- 172.21.15.73:0/2007782071 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f33c8046020 con 0x7f33cc06c520 2024-03-29T04:08:11.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.703+0000 7f33c27fc640 1 --2- 172.21.15.73:0/2007782071 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f33b006c530 0x7f33b006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:11.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.703+0000 7f33c27fc640 1 -- 172.21.15.73:0/2007782071 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7f33c80ade10 con 0x7f33cc06c520 2024-03-29T04:08:11.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.703+0000 7f33d100f640 1 --2- 172.21.15.73:0/2007782071 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f33b006c530 0x7f33b006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:11.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.704+0000 7f33d100f640 1 --2- 172.21.15.73:0/2007782071 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f33b006c530 0x7f33b006e9f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f33cc06c1f0 tx=0x7f33bc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:11.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.708+0000 7f33c27fc640 1 -- 172.21.15.73:0/2007782071 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f33c804d030 con 0x7f33cc06c520 2024-03-29T04:08:11.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:11.920+0000 7f33d3a74640 1 -- 172.21.15.73:0/2007782071 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f33cc06ed50 con 0x7f33cc06c520 2024-03-29T04:08:12.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.565+0000 7f33c27fc640 1 -- 172.21.15.73:0/2007782071 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f33c807c520 con 0x7f33cc06c520 2024-03-29T04:08:12.545 INFO:teuthology.orchestra.run.smithi073.stderr:new fs with metadata pool 2 and data pool 3 2024-03-29T04:08:12.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.570+0000 7f33d3a74640 1 -- 172.21.15.73:0/2007782071 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f33b006c530 msgr2=0x7f33b006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:12.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.570+0000 7f33d3a74640 1 --2- 172.21.15.73:0/2007782071 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f33b006c530 0x7f33b006e9f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f33cc06c1f0 tx=0x7f33bc008040 comp rx=0 tx=0).stop 2024-03-29T04:08:12.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.570+0000 7f33d3a74640 1 -- 172.21.15.73:0/2007782071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33cc06c520 msgr2=0x7f33cc14a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:12.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.570+0000 7f33d3a74640 1 --2- 172.21.15.73:0/2007782071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33cc06c520 0x7f33cc14a810 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f33c8000f80 tx=0x7f33c8004a40 comp rx=0 tx=0).stop 2024-03-29T04:08:12.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.570+0000 7f33d3a74640 1 -- 172.21.15.73:0/2007782071 shutdown_connections 2024-03-29T04:08:12.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.570+0000 7f33d3a74640 1 --2- 172.21.15.73:0/2007782071 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f33cc15c760 0x7f33cc14cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:12.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.570+0000 7f33d3a74640 1 --2- 172.21.15.73:0/2007782071 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f33b006c530 0x7f33b006e9f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:12.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.570+0000 7f33d3a74640 1 --2- 172.21.15.73:0/2007782071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f33cc072dc0 0x7f33cc14c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:12.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.570+0000 7f33d3a74640 1 --2- 172.21.15.73:0/2007782071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33cc06c520 0x7f33cc14a810 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:12.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.570+0000 7f33d3a74640 1 -- 172.21.15.73:0/2007782071 >> 172.21.15.73:0/2007782071 conn(0x7f33cc072090 msgr2=0x7f33cc06e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:12.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.570+0000 7f33d3a74640 1 -- 172.21.15.73:0/2007782071 shutdown_connections 2024-03-29T04:08:12.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.570+0000 7f33d3a74640 1 -- 172.21.15.73:0/2007782071 wait complete. 2024-03-29T04:08:12.572 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-29T04:08:12.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.694+0000 7f6149524640 1 Processor -- start 2024-03-29T04:08:12.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.694+0000 7f6149524640 1 -- start start 2024-03-29T04:08:12.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.695+0000 7f6149524640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f614415b400 0x7f61440b6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:12.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.695+0000 7f6149524640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61440b43e0 con 0x7f61440d1a30 2024-03-29T04:08:12.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.695+0000 7f6149524640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61440af7a0 con 0x7f614415b7e0 2024-03-29T04:08:12.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.695+0000 7f6149524640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f61440afd60 con 0x7f614415b400 2024-03-29T04:08:12.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.695+0000 7f6142ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f614415b400 0x7f61440b6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:12.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.695+0000 7f61437fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f61440d1a30 0x7f61440b4ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58882/0 (socket says 172.21.15.73:58882) 2024-03-29T04:08:12.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.695+0000 7f6142ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f614415b400 0x7f61440b6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45652/0 (socket says 172.21.15.73:45652) 2024-03-29T04:08:12.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.695+0000 7f61437fe640 1 -- 172.21.15.73:0/1951917791 learned_addr learned my addr 172.21.15.73:0/1951917791 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:12.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.695+0000 7f6142ffd640 1 -- 172.21.15.73:0/1951917791 >> v1:172.21.15.142:6789/0 conn(0x7f614415b7e0 legacy=0x7f61440d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:12.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.695+0000 7f6142ffd640 1 -- 172.21.15.73:0/1951917791 >> v1:172.21.15.73:6789/0 conn(0x7f61440d1a30 legacy=0x7f61440b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:12.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.695+0000 7f6142ffd640 1 -- 172.21.15.73:0/1951917791 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61440afa80 con 0x7f614415b400 2024-03-29T04:08:12.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.695+0000 7f6141ffb640 1 -- 172.21.15.73:0/1951917791 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3807378166 0 0) 0x7f61440b43e0 con 0x7f61440d1a30 2024-03-29T04:08:12.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.696+0000 7f6142ffd640 1 --2- 172.21.15.73:0/1951917791 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f614415b400 0x7f61440b6e70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f613c0097a0 tx=0x7f613c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a35c74118848729 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:12.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.696+0000 7f6141ffb640 1 -- 172.21.15.73:0/1951917791 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f613c035020 con 0x7f614415b400 2024-03-29T04:08:12.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.696+0000 7f6141ffb640 1 -- 172.21.15.73:0/1951917791 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f613c031640 con 0x7f614415b400 2024-03-29T04:08:12.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.696+0000 7f6141ffb640 1 -- 172.21.15.73:0/1951917791 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f613c02d040 con 0x7f614415b400 2024-03-29T04:08:12.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.696+0000 7f6149524640 1 -- 172.21.15.73:0/1951917791 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f614415b400 msgr2=0x7f61440b6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:12.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.696+0000 7f6149524640 1 --2- 172.21.15.73:0/1951917791 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f614415b400 0x7f61440b6e70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f613c0097a0 tx=0x7f613c02b8f0 comp rx=0 tx=0).stop 2024-03-29T04:08:12.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.696+0000 7f6149524640 1 -- 172.21.15.73:0/1951917791 shutdown_connections 2024-03-29T04:08:12.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.696+0000 7f6149524640 1 --2- 172.21.15.73:0/1951917791 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f614415b400 0x7f61440b6e70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:12.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.696+0000 7f6149524640 1 -- 172.21.15.73:0/1951917791 >> 172.21.15.73:0/1951917791 conn(0x7f614409aa30 msgr2=0x7f61440b6760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:12.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.696+0000 7f6149524640 1 -- 172.21.15.73:0/1951917791 shutdown_connections 2024-03-29T04:08:12.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.696+0000 7f6149524640 1 -- 172.21.15.73:0/1951917791 wait complete. 2024-03-29T04:08:12.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.698+0000 7f6149524640 1 Processor -- start 2024-03-29T04:08:12.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.698+0000 7f6149524640 1 -- start start 2024-03-29T04:08:12.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.698+0000 7f6149524640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61440d1a30 0x7f6144140d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:12.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.698+0000 7f6149524640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f614415b400 0x7f6144157c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:12.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.698+0000 7f6149524640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f614415b7e0 0x7f61441530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:12.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.698+0000 7f6149524640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f61440b4710 con 0x7f614415b400 2024-03-29T04:08:12.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.698+0000 7f6149524640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f61440b73b0 con 0x7f61440d1a30 2024-03-29T04:08:12.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.698+0000 7f6149524640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f61440af420 con 0x7f614415b7e0 2024-03-29T04:08:12.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.698+0000 7f61427fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f614415b400 0x7f6144157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:12.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.699+0000 7f61427fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f614415b400 0x7f6144157c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45662/0 (socket says 172.21.15.73:45662) 2024-03-29T04:08:12.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.699+0000 7f61427fc640 1 -- 172.21.15.73:0/214655083 learned_addr learned my addr 172.21.15.73:0/214655083 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:12.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.699+0000 7f6142ffd640 1 --2- 172.21.15.73:0/214655083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61440d1a30 0x7f6144140d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:12.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.699+0000 7f61437fe640 1 --2- 172.21.15.73:0/214655083 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f614415b7e0 0x7f61441530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:12.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.699+0000 7f61427fc640 1 -- 172.21.15.73:0/214655083 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f614415b7e0 msgr2=0x7f61441530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:12.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.699+0000 7f61427fc640 1 --2- 172.21.15.73:0/214655083 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f614415b7e0 0x7f61441530a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:12.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.699+0000 7f61427fc640 1 -- 172.21.15.73:0/214655083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61440d1a30 msgr2=0x7f6144140d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:12.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.699+0000 7f61427fc640 1 --2- 172.21.15.73:0/214655083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61440d1a30 0x7f6144140d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:12.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.699+0000 7f61427fc640 1 -- 172.21.15.73:0/214655083 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61441586a0 con 0x7f614415b400 2024-03-29T04:08:12.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.699+0000 7f61427fc640 1 --2- 172.21.15.73:0/214655083 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f614415b400 0x7f6144157c50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f613800c820 tx=0x7f613800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:12.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.699+0000 7f612b7fe640 1 -- 172.21.15.73:0/214655083 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6138017070 con 0x7f614415b400 2024-03-29T04:08:12.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.699+0000 7f612b7fe640 1 -- 172.21.15.73:0/214655083 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6138003da0 con 0x7f614415b400 2024-03-29T04:08:12.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.699+0000 7f6149524640 1 -- 172.21.15.73:0/214655083 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6144158980 con 0x7f614415b400 2024-03-29T04:08:12.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.699+0000 7f612b7fe640 1 -- 172.21.15.73:0/214655083 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61380052b0 con 0x7f614415b400 2024-03-29T04:08:12.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.699+0000 7f6149524640 1 -- 172.21.15.73:0/214655083 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6144141270 con 0x7f614415b400 2024-03-29T04:08:12.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.700+0000 7f6149524640 1 -- 172.21.15.73:0/214655083 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6144068010 con 0x7f614415b400 2024-03-29T04:08:12.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.701+0000 7f612b7fe640 1 -- 172.21.15.73:0/214655083 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f613801a070 con 0x7f614415b400 2024-03-29T04:08:12.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.701+0000 7f612b7fe640 1 --2- 172.21.15.73:0/214655083 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f613006c560 0x7f613006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:12.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.701+0000 7f612b7fe640 1 -- 172.21.15.73:0/214655083 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f613808ac60 con 0x7f614415b400 2024-03-29T04:08:12.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.701+0000 7f6142ffd640 1 --2- 172.21.15.73:0/214655083 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f613006c560 0x7f613006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:12.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.701+0000 7f6142ffd640 1 --2- 172.21.15.73:0/214655083 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f613006c560 0x7f613006ea20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f613c036000 tx=0x7f613c03c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:12.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.705+0000 7f612b7fe640 1 -- 172.21.15.73:0/214655083 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f6138058cc0 con 0x7f614415b400 2024-03-29T04:08:12.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.880+0000 7f6149524640 1 -- 172.21.15.73:0/214655083 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f61440d20e0 con 0x7f614415b400 2024-03-29T04:08:12.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.881+0000 7f612b7fe640 1 -- 172.21.15.73:0/214655083 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16618 (secure 0 0 0) 0x7f613805cfc0 con 0x7f614415b400 2024-03-29T04:08:12.861 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:12.861 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":20,"fsid":"6bff1617-b138-4517-acca-3ecaae3f2bb3","created":"2024-03-29T04:07:47.346864+0000","modified":"2024-03-29T04:08:11.921731+0000","last_up_change":"2024-03-29T04:07:58.507139+0000","last_in_change":"2024-03-29T04:07:49.637816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-29T04:07:59.537301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-29T04:08:09.570906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-29T04:08:10.882349+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"925d7de1-14ab-48c0-aebd-7bded108f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6820","nonce":2387335359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6824","nonce":2387335359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6831","nonce":2387335359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6828","nonce":2387335359}]},"public_addr":"172.21.15.73:6820/2387335359","cluster_addr":"172.21.15.73:6824/2387335359","heartbeat_back_addr":"172.21.15.73:6831/2387335359","heartbeat_front_addr":"172.21.15.73:6828/2387335359","state":["exists","up"]},{"osd":1,"uuid":"6b182102-882a-4e0c-99db-0afae5cfb38b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6801","nonce":2431315515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6803","nonce":2431315515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6807","nonce":2431315515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6805","nonce":2431315515}]},"public_addr":"172.21.15.73:6801/2431315515","cluster_addr":"172.21.15.73:6803/2431315515","heartbeat_back_addr":"172.21.15.73:6807/2431315515","heartbeat_front_addr":"172.21.15.73:6805/2431315515","state":["exists","up"]},{"osd":2,"uuid":"8040902e-b0b8-4a21-bf64-ce1c222115ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6809","nonce":407236597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6811","nonce":407236597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6815","nonce":407236597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6813","nonce":407236597}]},"public_addr":"172.21.15.73:6809/407236597","cluster_addr":"172.21.15.73:6811/407236597","heartbeat_back_addr":"172.21.15.73:6815/407236597","heartbeat_front_addr":"172.21.15.73:6813/407236597","state":["exists","up"]},{"osd":3,"uuid":"1bab19ee-3775-4ce1-a4ce-cf7cda3bbbf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6817","nonce":4291100709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6821","nonce":4291100709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6829","nonce":4291100709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6825","nonce":4291100709}]},"public_addr":"172.21.15.73:6817/4291100709","cluster_addr":"172.21.15.73:6821/4291100709","heartbeat_back_addr":"172.21.15.73:6829/4291100709","heartbeat_front_addr":"172.21.15.73:6825/4291100709","state":["exists","up"]},{"osd":4,"uuid":"b0c74337-8fe4-47dc-b3da-2d07591b1f6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6817","nonce":3703256194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6819","nonce":3703256194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6823","nonce":3703256194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6821","nonce":3703256194}]},"public_addr":"172.21.15.142:6817/3703256194","cluster_addr":"172.21.15.142:6819/3703256194","heartbeat_back_addr":"172.21.15.142:6823/3703256194","heartbeat_front_addr":"172.21.15.142:6821/3703256194","state":["exists","up"]},{"osd":5,"uuid":"9ce36410-a29a-42c6-99f4-f95d4afdd7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6825","nonce":4271575803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6827","nonce":4271575803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6831","nonce":4271575803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6829","nonce":4271575803}]},"public_addr":"172.21.15.142:6825/4271575803","cluster_addr":"172.21.15.142:6827/4271575803","heartbeat_back_addr":"172.21.15.142:6831/4271575803","heartbeat_front_addr":"172.21.15.142:6829/4271575803","state":["exists","up"]},{"osd":6,"uuid":"aec4264a-64ac-428e-a860-d2920a304019","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6801","nonce":1772722570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6803","nonce":1772722570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6807","nonce":1772722570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6805","nonce":1772722570}]},"public_addr":"172.21.15.142:6801/1772722570","cluster_addr":"172.21.15.142:6803/1772722570","heartbeat_back_addr":"172.21.15.142:6807/1772722570","heartbeat_front_addr":"172.21.15.142:6805/1772722570","state":["exists","up"]},{"osd":7,"uuid":"fe599052-8e5a-4c7a-91e7-52d1bae24a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6809","nonce":3910589675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6811","nonce":3910589675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6815","nonce":3910589675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6813","nonce":3910589675}]},"public_addr":"172.21.15.142:6809/3910589675","cluster_addr":"172.21.15.142:6811/3910589675","heartbeat_back_addr":"172.21.15.142:6815/3910589675","heartbeat_front_addr":"172.21.15.142:6813/3910589675","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.835096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.587210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.786547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.778004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.843740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.791160+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.837992+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.718722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:08:12.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.883+0000 7f6149524640 1 -- 172.21.15.73:0/214655083 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f613006c560 msgr2=0x7f613006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:12.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.883+0000 7f6149524640 1 --2- 172.21.15.73:0/214655083 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f613006c560 0x7f613006ea20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f613c036000 tx=0x7f613c03c040 comp rx=0 tx=0).stop 2024-03-29T04:08:12.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.883+0000 7f6149524640 1 -- 172.21.15.73:0/214655083 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f614415b400 msgr2=0x7f6144157c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:12.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.883+0000 7f6149524640 1 --2- 172.21.15.73:0/214655083 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f614415b400 0x7f6144157c50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f613800c820 tx=0x7f613800cce0 comp rx=0 tx=0).stop 2024-03-29T04:08:12.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.883+0000 7f6149524640 1 -- 172.21.15.73:0/214655083 shutdown_connections 2024-03-29T04:08:12.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.883+0000 7f6149524640 1 --2- 172.21.15.73:0/214655083 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f614415b7e0 0x7f61441530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:12.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.883+0000 7f6149524640 1 --2- 172.21.15.73:0/214655083 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f614415b400 0x7f6144157c50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:12.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.883+0000 7f6149524640 1 --2- 172.21.15.73:0/214655083 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f613006c560 0x7f613006ea20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:12.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.883+0000 7f6149524640 1 --2- 172.21.15.73:0/214655083 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61440d1a30 0x7f6144140d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:12.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.883+0000 7f6149524640 1 -- 172.21.15.73:0/214655083 >> 172.21.15.73:0/214655083 conn(0x7f614409aa30 msgr2=0x7f614415a510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:12.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.883+0000 7f6149524640 1 -- 172.21.15.73:0/214655083 shutdown_connections 2024-03-29T04:08:12.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.883+0000 7f6149524640 1 -- 172.21.15.73:0/214655083 wait complete. 2024-03-29T04:08:12.874 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-29T04:08:12.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.996+0000 7fdcb6990640 1 Processor -- start 2024-03-29T04:08:12.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.997+0000 7fdcb6990640 1 -- start start 2024-03-29T04:08:12.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.997+0000 7fdcb6990640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fdcb006d030 0x7fdcb009b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:12.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.997+0000 7fdcb6990640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdcb00ccd00 0x7fdcb00cd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:12.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.997+0000 7fdcb6990640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcb00d0f20 con 0x7fdcb006d410 2024-03-29T04:08:12.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.997+0000 7fdcb6990640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fdcb0162250 con 0x7fdcb00ccd00 2024-03-29T04:08:12.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.997+0000 7fdcb6990640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fdcb00d1200 con 0x7fdcb006d030 2024-03-29T04:08:12.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.997+0000 7fdcb4f2d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdcb00ccd00 0x7fdcb00cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:12.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.997+0000 7fdcb4f2d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdcb00ccd00 0x7fdcb00cd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45664/0 (socket says 172.21.15.73:45664) 2024-03-29T04:08:12.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.997+0000 7fdcb4f2d640 1 -- 172.21.15.73:0/2920691800 learned_addr learned my addr 172.21.15.73:0/2920691800 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:12.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.998+0000 7fdcaffff640 1 --2- 172.21.15.73:0/2920691800 >> v2:172.21.15.142:3300/0 conn(0x7fdcb006d030 0x7fdcb009b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:12.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.998+0000 7fdcb4f2d640 1 -- 172.21.15.73:0/2920691800 >> v2:172.21.15.142:3300/0 conn(0x7fdcb006d030 msgr2=0x7fdcb009b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:12.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.998+0000 7fdcb4f2d640 1 --2- 172.21.15.73:0/2920691800 >> v2:172.21.15.142:3300/0 conn(0x7fdcb006d030 0x7fdcb009b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:12.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.998+0000 7fdcb4f2d640 1 -- 172.21.15.73:0/2920691800 >> v1:172.21.15.142:6789/0 conn(0x7fdcb006d410 legacy=0x7fdcb00d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:12.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.998+0000 7fdcb4f2d640 1 -- 172.21.15.73:0/2920691800 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcb00d14e0 con 0x7fdcb00ccd00 2024-03-29T04:08:12.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.998+0000 7fdcb4f2d640 1 --2- 172.21.15.73:0/2920691800 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcb00ccd00 0x7fdcb00cd130 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0073320 tx=0x7fdca802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af2ad37d8ca0712 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:12.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.999+0000 7fdcaeffd640 1 -- 172.21.15.73:0/2920691800 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca802cb20 con 0x7fdcb00ccd00 2024-03-29T04:08:12.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.999+0000 7fdcaeffd640 1 -- 172.21.15.73:0/2920691800 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdca802ccc0 con 0x7fdcb00ccd00 2024-03-29T04:08:12.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.999+0000 7fdcaeffd640 1 -- 172.21.15.73:0/2920691800 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca8034610 con 0x7fdcb00ccd00 2024-03-29T04:08:12.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.999+0000 7fdcb6990640 1 -- 172.21.15.73:0/2920691800 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcb00ccd00 msgr2=0x7fdcb00cd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:12.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.999+0000 7fdcb6990640 1 --2- 172.21.15.73:0/2920691800 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcb00ccd00 0x7fdcb00cd130 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0073320 tx=0x7fdca802bf80 comp rx=0 tx=0).stop 2024-03-29T04:08:12.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.999+0000 7fdcb6990640 1 -- 172.21.15.73:0/2920691800 shutdown_connections 2024-03-29T04:08:12.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.999+0000 7fdcb6990640 1 --2- 172.21.15.73:0/2920691800 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcb00ccd00 0x7fdcb00cd130 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:12.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.999+0000 7fdcb6990640 1 --2- 172.21.15.73:0/2920691800 >> v2:172.21.15.142:3300/0 conn(0x7fdcb006d030 0x7fdcb009b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:12.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.999+0000 7fdcb6990640 1 -- 172.21.15.73:0/2920691800 >> 172.21.15.73:0/2920691800 conn(0x7fdcb00b3f00 msgr2=0x7fdcb00b4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:12.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.999+0000 7fdcb6990640 1 -- 172.21.15.73:0/2920691800 shutdown_connections 2024-03-29T04:08:12.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:12.999+0000 7fdcb6990640 1 -- 172.21.15.73:0/2920691800 wait complete. 2024-03-29T04:08:12.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.000+0000 7fdcb6990640 1 Processor -- start 2024-03-29T04:08:12.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.000+0000 7fdcb6990640 1 -- start start 2024-03-29T04:08:12.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.001+0000 7fdcb6990640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcb006d030 0x7fdcb0152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:12.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.001+0000 7fdcb6990640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcb006d410 0x7fdcb00ca450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:12.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.001+0000 7fdcb6990640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdcb00ccd00 0x7fdcb00ca990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:12.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.001+0000 7fdcb6990640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fdcb006d8a0 con 0x7fdcb006d410 2024-03-29T04:08:12.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.001+0000 7fdcb6990640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fdcb00d1aa0 con 0x7fdcb006d030 2024-03-29T04:08:12.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.001+0000 7fdcb6990640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fdcb006da20 con 0x7fdcb00ccd00 2024-03-29T04:08:12.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.001+0000 7fdcaf7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcb006d410 0x7fdcb00ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:12.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.001+0000 7fdcaf7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcb006d410 0x7fdcb00ca450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45678/0 (socket says 172.21.15.73:45678) 2024-03-29T04:08:12.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.001+0000 7fdcaf7fe640 1 -- 172.21.15.73:0/81088159 learned_addr learned my addr 172.21.15.73:0/81088159 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:12.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.001+0000 7fdcaffff640 1 --2- 172.21.15.73:0/81088159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcb006d030 0x7fdcb0152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:12.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.001+0000 7fdcb4f2d640 1 --2- 172.21.15.73:0/81088159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdcb00ccd00 0x7fdcb00ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:12.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.001+0000 7fdcaf7fe640 1 -- 172.21.15.73:0/81088159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdcb00ccd00 msgr2=0x7fdcb00ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:12.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.001+0000 7fdcaf7fe640 1 --2- 172.21.15.73:0/81088159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdcb00ccd00 0x7fdcb00ca990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:12.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.001+0000 7fdcaf7fe640 1 -- 172.21.15.73:0/81088159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcb006d030 msgr2=0x7fdcb0152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:12.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.001+0000 7fdcaf7fe640 1 --2- 172.21.15.73:0/81088159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcb006d030 0x7fdcb0152820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:12.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.001+0000 7fdcaf7fe640 1 -- 172.21.15.73:0/81088159 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcb00cc680 con 0x7fdcb006d410 2024-03-29T04:08:12.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.001+0000 7fdcaffff640 1 --2- 172.21.15.73:0/81088159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcb006d030 0x7fdcb0152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:08:12.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.002+0000 7fdcaf7fe640 1 --2- 172.21.15.73:0/81088159 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcb006d410 0x7fdcb00ca450 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdca400c400 tx=0x7fdca400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:12.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.002+0000 7fdcacff9640 1 -- 172.21.15.73:0/81088159 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca40052d0 con 0x7fdcb006d410 2024-03-29T04:08:12.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.002+0000 7fdcacff9640 1 -- 172.21.15.73:0/81088159 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdca4005490 con 0x7fdcb006d410 2024-03-29T04:08:12.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.002+0000 7fdcacff9640 1 -- 172.21.15.73:0/81088159 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca4007260 con 0x7fdcb006d410 2024-03-29T04:08:12.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.002+0000 7fdcb6990640 1 -- 172.21.15.73:0/81088159 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcb00cb080 con 0x7fdcb006d410 2024-03-29T04:08:12.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.002+0000 7fdcb6990640 1 -- 172.21.15.73:0/81088159 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcb00cb640 con 0x7fdcb006d410 2024-03-29T04:08:12.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.003+0000 7fdcb6990640 1 -- 172.21.15.73:0/81088159 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcb0068d50 con 0x7fdcb006d410 2024-03-29T04:08:12.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.003+0000 7fdcacff9640 1 -- 172.21.15.73:0/81088159 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fdca4007400 con 0x7fdcb006d410 2024-03-29T04:08:12.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.003+0000 7fdcacff9640 1 --2- 172.21.15.73:0/81088159 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fdc9c06c530 0x7fdc9c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:12.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.004+0000 7fdcacff9640 1 -- 172.21.15.73:0/81088159 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fdca408ac50 con 0x7fdcb006d410 2024-03-29T04:08:12.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.004+0000 7fdcaffff640 1 --2- 172.21.15.73:0/81088159 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fdc9c06c530 0x7fdc9c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:12.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.004+0000 7fdcaffff640 1 --2- 172.21.15.73:0/81088159 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fdc9c06c530 0x7fdc9c06e9f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdca0009af0 tx=0x7fdca0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:12.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.008+0000 7fdcacff9640 1 -- 172.21.15.73:0/81088159 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fdca4090020 con 0x7fdcb006d410 2024-03-29T04:08:13.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.185+0000 7fdcb6990640 1 -- 172.21.15.73:0/81088159 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdcb00cec70 con 0x7fdcb006d410 2024-03-29T04:08:13.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.186+0000 7fdcacff9640 1 -- 172.21.15.73:0/81088159 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16618 (secure 0 0 0) 0x7fdca4059270 con 0x7fdcb006d410 2024-03-29T04:08:13.166 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:13.166 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":20,"fsid":"6bff1617-b138-4517-acca-3ecaae3f2bb3","created":"2024-03-29T04:07:47.346864+0000","modified":"2024-03-29T04:08:11.921731+0000","last_up_change":"2024-03-29T04:07:58.507139+0000","last_in_change":"2024-03-29T04:07:49.637816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-29T04:07:59.537301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-29T04:08:09.570906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-29T04:08:10.882349+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"925d7de1-14ab-48c0-aebd-7bded108f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6820","nonce":2387335359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6824","nonce":2387335359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6831","nonce":2387335359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6828","nonce":2387335359}]},"public_addr":"172.21.15.73:6820/2387335359","cluster_addr":"172.21.15.73:6824/2387335359","heartbeat_back_addr":"172.21.15.73:6831/2387335359","heartbeat_front_addr":"172.21.15.73:6828/2387335359","state":["exists","up"]},{"osd":1,"uuid":"6b182102-882a-4e0c-99db-0afae5cfb38b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6801","nonce":2431315515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6803","nonce":2431315515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6807","nonce":2431315515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6805","nonce":2431315515}]},"public_addr":"172.21.15.73:6801/2431315515","cluster_addr":"172.21.15.73:6803/2431315515","heartbeat_back_addr":"172.21.15.73:6807/2431315515","heartbeat_front_addr":"172.21.15.73:6805/2431315515","state":["exists","up"]},{"osd":2,"uuid":"8040902e-b0b8-4a21-bf64-ce1c222115ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6809","nonce":407236597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6811","nonce":407236597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6815","nonce":407236597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6813","nonce":407236597}]},"public_addr":"172.21.15.73:6809/407236597","cluster_addr":"172.21.15.73:6811/407236597","heartbeat_back_addr":"172.21.15.73:6815/407236597","heartbeat_front_addr":"172.21.15.73:6813/407236597","state":["exists","up"]},{"osd":3,"uuid":"1bab19ee-3775-4ce1-a4ce-cf7cda3bbbf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6817","nonce":4291100709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6821","nonce":4291100709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6829","nonce":4291100709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6825","nonce":4291100709}]},"public_addr":"172.21.15.73:6817/4291100709","cluster_addr":"172.21.15.73:6821/4291100709","heartbeat_back_addr":"172.21.15.73:6829/4291100709","heartbeat_front_addr":"172.21.15.73:6825/4291100709","state":["exists","up"]},{"osd":4,"uuid":"b0c74337-8fe4-47dc-b3da-2d07591b1f6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6817","nonce":3703256194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6819","nonce":3703256194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6823","nonce":3703256194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6821","nonce":3703256194}]},"public_addr":"172.21.15.142:6817/3703256194","cluster_addr":"172.21.15.142:6819/3703256194","heartbeat_back_addr":"172.21.15.142:6823/3703256194","heartbeat_front_addr":"172.21.15.142:6821/3703256194","state":["exists","up"]},{"osd":5,"uuid":"9ce36410-a29a-42c6-99f4-f95d4afdd7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6825","nonce":4271575803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6827","nonce":4271575803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6831","nonce":4271575803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6829","nonce":4271575803}]},"public_addr":"172.21.15.142:6825/4271575803","cluster_addr":"172.21.15.142:6827/4271575803","heartbeat_back_addr":"172.21.15.142:6831/4271575803","heartbeat_front_addr":"172.21.15.142:6829/4271575803","state":["exists","up"]},{"osd":6,"uuid":"aec4264a-64ac-428e-a860-d2920a304019","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6801","nonce":1772722570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6803","nonce":1772722570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6807","nonce":1772722570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6805","nonce":1772722570}]},"public_addr":"172.21.15.142:6801/1772722570","cluster_addr":"172.21.15.142:6803/1772722570","heartbeat_back_addr":"172.21.15.142:6807/1772722570","heartbeat_front_addr":"172.21.15.142:6805/1772722570","state":["exists","up"]},{"osd":7,"uuid":"fe599052-8e5a-4c7a-91e7-52d1bae24a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6809","nonce":3910589675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6811","nonce":3910589675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6815","nonce":3910589675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6813","nonce":3910589675}]},"public_addr":"172.21.15.142:6809/3910589675","cluster_addr":"172.21.15.142:6811/3910589675","heartbeat_back_addr":"172.21.15.142:6815/3910589675","heartbeat_front_addr":"172.21.15.142:6813/3910589675","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.835096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.587210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.786547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.778004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.843740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.791160+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.837992+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.718722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:08:13.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.188+0000 7fdcb6990640 1 -- 172.21.15.73:0/81088159 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fdc9c06c530 msgr2=0x7fdc9c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:13.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.188+0000 7fdcb6990640 1 --2- 172.21.15.73:0/81088159 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fdc9c06c530 0x7fdc9c06e9f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdca0009af0 tx=0x7fdca0008040 comp rx=0 tx=0).stop 2024-03-29T04:08:13.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.188+0000 7fdcb6990640 1 -- 172.21.15.73:0/81088159 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcb006d410 msgr2=0x7fdcb00ca450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:13.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.188+0000 7fdcb6990640 1 --2- 172.21.15.73:0/81088159 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcb006d410 0x7fdcb00ca450 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdca400c400 tx=0x7fdca400c8c0 comp rx=0 tx=0).stop 2024-03-29T04:08:13.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.188+0000 7fdcb6990640 1 -- 172.21.15.73:0/81088159 shutdown_connections 2024-03-29T04:08:13.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.188+0000 7fdcb6990640 1 --2- 172.21.15.73:0/81088159 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fdcb00ccd00 0x7fdcb00ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:13.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.188+0000 7fdcb6990640 1 --2- 172.21.15.73:0/81088159 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdcb006d410 0x7fdcb00ca450 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:13.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.188+0000 7fdcb6990640 1 --2- 172.21.15.73:0/81088159 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fdc9c06c530 0x7fdc9c06e9f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:13.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.188+0000 7fdcb6990640 1 --2- 172.21.15.73:0/81088159 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdcb006d030 0x7fdcb0152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:13.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.188+0000 7fdcb6990640 1 -- 172.21.15.73:0/81088159 >> 172.21.15.73:0/81088159 conn(0x7fdcb00b3f00 msgr2=0x7fdcb00cd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:13.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.188+0000 7fdcb6990640 1 -- 172.21.15.73:0/81088159 shutdown_connections 2024-03-29T04:08:13.169 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.188+0000 7fdcb6990640 1 -- 172.21.15.73:0/81088159 wait complete. 2024-03-29T04:08:13.179 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-29T04:08:13.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.302+0000 7f4f7131c640 1 Processor -- start 2024-03-29T04:08:13.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.302+0000 7f4f7131c640 1 -- start start 2024-03-29T04:08:13.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.303+0000 7f4f7131c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4f6c09aa30 0x7f4f6c09aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:13.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.303+0000 7f4f7131c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f6c0d0bd0 0x7f4f6c0d0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:13.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.303+0000 7f4f7131c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f6c0d06f0 con 0x7f4f6c161f50 2024-03-29T04:08:13.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.303+0000 7f4f7131c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f4f6c070250 con 0x7f4f6c09aa30 2024-03-29T04:08:13.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.303+0000 7f4f7131c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f4f6c15f300 con 0x7f4f6c0d0bd0 2024-03-29T04:08:13.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.303+0000 7f4f6a7fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4f6c09aa30 0x7f4f6c09aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:13.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.303+0000 7f4f6a7fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4f6c09aa30 0x7f4f6c09aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45684/0 (socket says 172.21.15.73:45684) 2024-03-29T04:08:13.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.303+0000 7f4f6affd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f4f6c161f50 0x7f4f6c06fb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58888/0 (socket says 172.21.15.73:58888) 2024-03-29T04:08:13.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.303+0000 7f4f6a7fc640 1 -- 172.21.15.73:0/2777508508 learned_addr learned my addr 172.21.15.73:0/2777508508 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:13.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.303+0000 7f4f6a7fc640 1 -- 172.21.15.73:0/2777508508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f6c0d0bd0 msgr2=0x7f4f6c0d0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:13.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.303+0000 7f4f6a7fc640 1 --2- 172.21.15.73:0/2777508508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f6c0d0bd0 0x7f4f6c0d0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:13.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.303+0000 7f4f6a7fc640 1 -- 172.21.15.73:0/2777508508 >> v1:172.21.15.73:6789/0 conn(0x7f4f6c161f50 legacy=0x7f4f6c06fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:13.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.303+0000 7f4f6a7fc640 1 -- 172.21.15.73:0/2777508508 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f6c15f5e0 con 0x7f4f6c09aa30 2024-03-29T04:08:13.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.303+0000 7f4f69ffb640 1 -- 172.21.15.73:0/2777508508 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3236493369 0 0) 0x7f4f6c0d06f0 con 0x7f4f6c161f50 2024-03-29T04:08:13.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.304+0000 7f4f6a7fc640 1 --2- 172.21.15.73:0/2777508508 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f6c09aa30 0x7f4f6c09aec0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4f54009870 tx=0x7f4f5402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7da552c0eb2477ea server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:13.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.304+0000 7f4f69ffb640 1 -- 172.21.15.73:0/2777508508 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f54035020 con 0x7f4f6c09aa30 2024-03-29T04:08:13.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.304+0000 7f4f69ffb640 1 -- 172.21.15.73:0/2777508508 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f54031640 con 0x7f4f6c09aa30 2024-03-29T04:08:13.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.304+0000 7f4f69ffb640 1 -- 172.21.15.73:0/2777508508 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f5402d040 con 0x7f4f6c09aa30 2024-03-29T04:08:13.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.305+0000 7f4f7131c640 1 -- 172.21.15.73:0/2777508508 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f6c09aa30 msgr2=0x7f4f6c09aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:13.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.305+0000 7f4f7131c640 1 --2- 172.21.15.73:0/2777508508 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f6c09aa30 0x7f4f6c09aec0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4f54009870 tx=0x7f4f5402b8f0 comp rx=0 tx=0).stop 2024-03-29T04:08:13.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.305+0000 7f4f7131c640 1 -- 172.21.15.73:0/2777508508 shutdown_connections 2024-03-29T04:08:13.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.305+0000 7f4f7131c640 1 --2- 172.21.15.73:0/2777508508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f6c0d0bd0 0x7f4f6c0d0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:13.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.305+0000 7f4f7131c640 1 --2- 172.21.15.73:0/2777508508 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f6c09aa30 0x7f4f6c09aec0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:13.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.305+0000 7f4f7131c640 1 -- 172.21.15.73:0/2777508508 >> 172.21.15.73:0/2777508508 conn(0x7f4f6c0b3fa0 msgr2=0x7f4f6c0b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:13.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.305+0000 7f4f7131c640 1 -- 172.21.15.73:0/2777508508 shutdown_connections 2024-03-29T04:08:13.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.305+0000 7f4f7131c640 1 -- 172.21.15.73:0/2777508508 wait complete. 2024-03-29T04:08:13.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.306+0000 7f4f7131c640 1 Processor -- start 2024-03-29T04:08:13.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.306+0000 7f4f7131c640 1 -- start start 2024-03-29T04:08:13.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.307+0000 7f4f7131c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f6c09aa30 0x7f4f6c1f5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:13.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.307+0000 7f4f7131c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f6c0d0bd0 0x7f4f6c157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:13.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.307+0000 7f4f7131c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f6c161f50 0x7f4f6c157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:13.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.307+0000 7f4f7131c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6c160220 con 0x7f4f6c0d0bd0 2024-03-29T04:08:13.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.307+0000 7f4f7131c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6c15fba0 con 0x7f4f6c09aa30 2024-03-29T04:08:13.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.307+0000 7f4f7131c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f4f6c1603a0 con 0x7f4f6c161f50 2024-03-29T04:08:13.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.307+0000 7f4f6a7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f6c0d0bd0 0x7f4f6c157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:13.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.307+0000 7f4f6a7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f6c0d0bd0 0x7f4f6c157a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45686/0 (socket says 172.21.15.73:45686) 2024-03-29T04:08:13.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.307+0000 7f4f6a7fc640 1 -- 172.21.15.73:0/1712722940 learned_addr learned my addr 172.21.15.73:0/1712722940 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:13.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.307+0000 7f4f6a7fc640 1 -- 172.21.15.73:0/1712722940 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f6c161f50 msgr2=0x7f4f6c157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:13.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.307+0000 7f4f6a7fc640 1 --2- 172.21.15.73:0/1712722940 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f6c161f50 0x7f4f6c157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:13.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.307+0000 7f4f6a7fc640 1 -- 172.21.15.73:0/1712722940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f6c09aa30 msgr2=0x7f4f6c1f5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:13.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.307+0000 7f4f6a7fc640 1 --2- 172.21.15.73:0/1712722940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f6c09aa30 0x7f4f6c1f5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:13.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.307+0000 7f4f6a7fc640 1 -- 172.21.15.73:0/1712722940 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f6c15afd0 con 0x7f4f6c0d0bd0 2024-03-29T04:08:13.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.307+0000 7f4f6a7fc640 1 --2- 172.21.15.73:0/1712722940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f6c0d0bd0 0x7f4f6c157a00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4f54000c00 tx=0x7f4f540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:13.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.307+0000 7f4f637fe640 1 -- 172.21.15.73:0/1712722940 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f5403ac60 con 0x7f4f6c0d0bd0 2024-03-29T04:08:13.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.307+0000 7f4f637fe640 1 -- 172.21.15.73:0/1712722940 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f5403ae20 con 0x7f4f6c0d0bd0 2024-03-29T04:08:13.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.307+0000 7f4f7131c640 1 -- 172.21.15.73:0/1712722940 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f6c15a6d0 con 0x7f4f6c0d0bd0 2024-03-29T04:08:13.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.307+0000 7f4f637fe640 1 -- 172.21.15.73:0/1712722940 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f54044630 con 0x7f4f6c0d0bd0 2024-03-29T04:08:13.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.307+0000 7f4f7131c640 1 -- 172.21.15.73:0/1712722940 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f6c15b270 con 0x7f4f6c0d0bd0 2024-03-29T04:08:13.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.309+0000 7f4f7131c640 1 -- 172.21.15.73:0/1712722940 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f6c0a05c0 con 0x7f4f6c0d0bd0 2024-03-29T04:08:13.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.309+0000 7f4f637fe640 1 -- 172.21.15.73:0/1712722940 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f4f54038020 con 0x7f4f6c0d0bd0 2024-03-29T04:08:13.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.309+0000 7f4f637fe640 1 --2- 172.21.15.73:0/1712722940 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f4f4c06c530 0x7f4f4c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:13.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.309+0000 7f4f637fe640 1 -- 172.21.15.73:0/1712722940 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4f540ad470 con 0x7f4f6c0d0bd0 2024-03-29T04:08:13.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.309+0000 7f4f6affd640 1 --2- 172.21.15.73:0/1712722940 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f4f4c06c530 0x7f4f4c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:13.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.310+0000 7f4f6affd640 1 --2- 172.21.15.73:0/1712722940 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f4f4c06c530 0x7f4f4c06e9f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c007fd0 tx=0x7f4f5c007ce0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:13.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.313+0000 7f4f637fe640 1 -- 172.21.15.73:0/1712722940 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f4f5403f070 con 0x7f4f6c0d0bd0 2024-03-29T04:08:13.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.545+0000 7f4f7131c640 1 -- 172.21.15.73:0/1712722940 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f4f6c15abf0 con 0x7f4f6c0d0bd0 2024-03-29T04:08:13.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.580+0000 7f4f637fe640 1 -- 172.21.15.73:0/1712722940 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 118+0+0 (secure 0 0 0) 0x7f4f5407bbb0 con 0x7f4f6c0d0bd0 2024-03-29T04:08:13.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.582+0000 7f4f7131c640 1 -- 172.21.15.73:0/1712722940 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f4f4c06c530 msgr2=0x7f4f4c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:13.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.582+0000 7f4f7131c640 1 --2- 172.21.15.73:0/1712722940 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f4f4c06c530 0x7f4f4c06e9f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c007fd0 tx=0x7f4f5c007ce0 comp rx=0 tx=0).stop 2024-03-29T04:08:13.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.582+0000 7f4f7131c640 1 -- 172.21.15.73:0/1712722940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f6c0d0bd0 msgr2=0x7f4f6c157a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:13.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.582+0000 7f4f7131c640 1 --2- 172.21.15.73:0/1712722940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f6c0d0bd0 0x7f4f6c157a00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4f54000c00 tx=0x7f4f540046c0 comp rx=0 tx=0).stop 2024-03-29T04:08:13.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.583+0000 7f4f7131c640 1 -- 172.21.15.73:0/1712722940 shutdown_connections 2024-03-29T04:08:13.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.583+0000 7f4f7131c640 1 --2- 172.21.15.73:0/1712722940 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f6c161f50 0x7f4f6c157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:13.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.583+0000 7f4f7131c640 1 --2- 172.21.15.73:0/1712722940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f6c0d0bd0 0x7f4f6c157a00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:13.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.583+0000 7f4f7131c640 1 --2- 172.21.15.73:0/1712722940 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f4f4c06c530 0x7f4f4c06e9f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:13.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.583+0000 7f4f7131c640 1 --2- 172.21.15.73:0/1712722940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f6c09aa30 0x7f4f6c1f5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:13.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.583+0000 7f4f7131c640 1 -- 172.21.15.73:0/1712722940 >> 172.21.15.73:0/1712722940 conn(0x7f4f6c0b3fa0 msgr2=0x7f4f6c15e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:13.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.583+0000 7f4f7131c640 1 -- 172.21.15.73:0/1712722940 shutdown_connections 2024-03-29T04:08:13.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.583+0000 7f4f7131c640 1 -- 172.21.15.73:0/1712722940 wait complete. 2024-03-29T04:08:13.573 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-29T04:08:13.573 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-29T04:08:13.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.696+0000 7f2b6d332640 1 Processor -- start 2024-03-29T04:08:13.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.697+0000 7f2b6d332640 1 -- start start 2024-03-29T04:08:13.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.697+0000 7f2b6d332640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2b680cfde0 0x7f2b680d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:13.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.697+0000 7f2b6d332640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2b680d0f90 0x7f2b680d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:13.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.697+0000 7f2b6d332640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b6815ed00 con 0x7f2b6815e920 2024-03-29T04:08:13.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.697+0000 7f2b6d332640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f2b680d21e0 con 0x7f2b680d0f90 2024-03-29T04:08:13.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.697+0000 7f2b6d332640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f2b680d2480 con 0x7f2b680cfde0 2024-03-29T04:08:13.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.697+0000 7f2b677fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2b680d0f90 0x7f2b680d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:13.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.697+0000 7f2b677fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2b680d0f90 0x7f2b680d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45696/0 (socket says 172.21.15.73:45696) 2024-03-29T04:08:13.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.697+0000 7f2b677fe640 1 -- 172.21.15.73:0/3410419970 learned_addr learned my addr 172.21.15.73:0/3410419970 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:13.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.697+0000 7f2b667fc640 1 --2- 172.21.15.73:0/3410419970 >> v2:172.21.15.142:3300/0 conn(0x7f2b680cfde0 0x7f2b680d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:13.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.698+0000 7f2b677fe640 1 -- 172.21.15.73:0/3410419970 >> v2:172.21.15.142:3300/0 conn(0x7f2b680cfde0 msgr2=0x7f2b680d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:13.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.698+0000 7f2b677fe640 1 --2- 172.21.15.73:0/3410419970 >> v2:172.21.15.142:3300/0 conn(0x7f2b680cfde0 0x7f2b680d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:13.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.698+0000 7f2b677fe640 1 -- 172.21.15.73:0/3410419970 >> v1:172.21.15.142:6789/0 conn(0x7f2b6815e920 legacy=0x7f2b680d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:13.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.698+0000 7f2b677fe640 1 -- 172.21.15.73:0/3410419970 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b680d2760 con 0x7f2b680d0f90 2024-03-29T04:08:13.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.698+0000 7f2b677fe640 1 --2- 172.21.15.73:0/3410419970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b680d0f90 0x7f2b680d1420 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2b6808ccb0 tx=0x7f2b6002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edcdf79b2341a9de server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:13.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.699+0000 7f2b65ffb640 1 -- 172.21.15.73:0/3410419970 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b60034070 con 0x7f2b680d0f90 2024-03-29T04:08:13.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.699+0000 7f2b65ffb640 1 -- 172.21.15.73:0/3410419970 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b60030860 con 0x7f2b680d0f90 2024-03-29T04:08:13.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.699+0000 7f2b65ffb640 1 -- 172.21.15.73:0/3410419970 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b60030c30 con 0x7f2b680d0f90 2024-03-29T04:08:13.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.699+0000 7f2b6d332640 1 -- 172.21.15.73:0/3410419970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b680d0f90 msgr2=0x7f2b680d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:13.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.699+0000 7f2b6d332640 1 --2- 172.21.15.73:0/3410419970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b680d0f90 0x7f2b680d1420 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2b6808ccb0 tx=0x7f2b6002b9a0 comp rx=0 tx=0).stop 2024-03-29T04:08:13.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.699+0000 7f2b6d332640 1 -- 172.21.15.73:0/3410419970 shutdown_connections 2024-03-29T04:08:13.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.699+0000 7f2b6d332640 1 --2- 172.21.15.73:0/3410419970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b680d0f90 0x7f2b680d1420 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:13.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.699+0000 7f2b6d332640 1 --2- 172.21.15.73:0/3410419970 >> v2:172.21.15.142:3300/0 conn(0x7f2b680cfde0 0x7f2b680d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:13.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.699+0000 7f2b6d332640 1 -- 172.21.15.73:0/3410419970 >> 172.21.15.73:0/3410419970 conn(0x7f2b6808bfc0 msgr2=0x7f2b680d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:13.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.699+0000 7f2b6d332640 1 -- 172.21.15.73:0/3410419970 shutdown_connections 2024-03-29T04:08:13.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.699+0000 7f2b6d332640 1 -- 172.21.15.73:0/3410419970 wait complete. 2024-03-29T04:08:13.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.700+0000 7f2b6d332640 1 Processor -- start 2024-03-29T04:08:13.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.700+0000 7f2b6d332640 1 -- start start 2024-03-29T04:08:13.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.701+0000 7f2b6d332640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b680cfde0 0x7f2b680c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:13.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.701+0000 7f2b6d332640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b680d0f90 0x7f2b68160380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:13.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.701+0000 7f2b6d332640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b6815e920 0x7f2b681608c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:13.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.701+0000 7f2b6d332640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2b680d4ef0 con 0x7f2b680d0f90 2024-03-29T04:08:13.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.701+0000 7f2b6d332640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2b680d2d20 con 0x7f2b6815e920 2024-03-29T04:08:13.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.701+0000 7f2b6d332640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2b680d5070 con 0x7f2b680cfde0 2024-03-29T04:08:13.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.701+0000 7f2b667fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b680d0f90 0x7f2b68160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:13.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.701+0000 7f2b667fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b680d0f90 0x7f2b68160380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45706/0 (socket says 172.21.15.73:45706) 2024-03-29T04:08:13.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.701+0000 7f2b667fc640 1 -- 172.21.15.73:0/2949465095 learned_addr learned my addr 172.21.15.73:0/2949465095 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:13.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.701+0000 7f2b677fe640 1 --2- 172.21.15.73:0/2949465095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b6815e920 0x7f2b681608c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:13.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.701+0000 7f2b66ffd640 1 --2- 172.21.15.73:0/2949465095 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b680cfde0 0x7f2b680c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:13.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.701+0000 7f2b667fc640 1 -- 172.21.15.73:0/2949465095 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b680cfde0 msgr2=0x7f2b680c97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:13.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.701+0000 7f2b667fc640 1 --2- 172.21.15.73:0/2949465095 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b680cfde0 0x7f2b680c97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:13.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.701+0000 7f2b667fc640 1 -- 172.21.15.73:0/2949465095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b6815e920 msgr2=0x7f2b681608c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:13.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.701+0000 7f2b667fc640 1 --2- 172.21.15.73:0/2949465095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b6815e920 0x7f2b681608c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:13.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.702+0000 7f2b667fc640 1 -- 172.21.15.73:0/2949465095 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b680ce080 con 0x7f2b680d0f90 2024-03-29T04:08:13.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.702+0000 7f2b66ffd640 1 --2- 172.21.15.73:0/2949465095 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b680cfde0 0x7f2b680c97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:08:13.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.702+0000 7f2b667fc640 1 --2- 172.21.15.73:0/2949465095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b680d0f90 0x7f2b68160380 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c00e870 tx=0x7f2b5c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:13.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.702+0000 7f2b4f7fe640 1 -- 172.21.15.73:0/2949465095 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c017070 con 0x7f2b680d0f90 2024-03-29T04:08:13.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.702+0000 7f2b4f7fe640 1 -- 172.21.15.73:0/2949465095 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b5c00c940 con 0x7f2b680d0f90 2024-03-29T04:08:13.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.702+0000 7f2b6d332640 1 -- 172.21.15.73:0/2949465095 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b680c8280 con 0x7f2b680d0f90 2024-03-29T04:08:13.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.702+0000 7f2b4f7fe640 1 -- 172.21.15.73:0/2949465095 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c00cd30 con 0x7f2b680d0f90 2024-03-29T04:08:13.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.702+0000 7f2b6d332640 1 -- 172.21.15.73:0/2949465095 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b680c8840 con 0x7f2b680d0f90 2024-03-29T04:08:13.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.703+0000 7f2b6d332640 1 -- 172.21.15.73:0/2949465095 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b680a2560 con 0x7f2b680d0f90 2024-03-29T04:08:13.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.703+0000 7f2b4f7fe640 1 -- 172.21.15.73:0/2949465095 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f2b5c01a070 con 0x7f2b680d0f90 2024-03-29T04:08:13.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.704+0000 7f2b4f7fe640 1 --2- 172.21.15.73:0/2949465095 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2b5406c530 0x7f2b5406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:13.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.704+0000 7f2b4f7fe640 1 -- 172.21.15.73:0/2949465095 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2b5c08b4c0 con 0x7f2b680d0f90 2024-03-29T04:08:13.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.704+0000 7f2b66ffd640 1 --2- 172.21.15.73:0/2949465095 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2b5406c530 0x7f2b5406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:13.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.704+0000 7f2b66ffd640 1 --2- 172.21.15.73:0/2949465095 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2b5406c530 0x7f2b5406e9f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2b58001e00 tx=0x7f2b58009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:13.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.708+0000 7f2b4f7fe640 1 -- 172.21.15.73:0/2949465095 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f2b5c059490 con 0x7f2b680d0f90 2024-03-29T04:08:13.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:13.917+0000 7f2b6d332640 1 -- 172.21.15.73:0/2949465095 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f2b6804f9d0 con 0x7f2b680d0f90 2024-03-29T04:08:14.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.586+0000 7f2b4f7fe640 1 -- 172.21.15.73:0/2949465095 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7f2b5c05d790 con 0x7f2b680d0f90 2024-03-29T04:08:14.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.589+0000 7f2b6d332640 1 -- 172.21.15.73:0/2949465095 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2b5406c530 msgr2=0x7f2b5406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:14.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.589+0000 7f2b6d332640 1 --2- 172.21.15.73:0/2949465095 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2b5406c530 0x7f2b5406e9f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2b58001e00 tx=0x7f2b58009040 comp rx=0 tx=0).stop 2024-03-29T04:08:14.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.589+0000 7f2b6d332640 1 -- 172.21.15.73:0/2949465095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b680d0f90 msgr2=0x7f2b68160380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:14.569 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.589+0000 7f2b6d332640 1 --2- 172.21.15.73:0/2949465095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b680d0f90 0x7f2b68160380 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c00e870 tx=0x7f2b5c00ed30 comp rx=0 tx=0).stop 2024-03-29T04:08:14.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.589+0000 7f2b6d332640 1 -- 172.21.15.73:0/2949465095 shutdown_connections 2024-03-29T04:08:14.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.589+0000 7f2b6d332640 1 --2- 172.21.15.73:0/2949465095 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2b5406c530 0x7f2b5406e9f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:14.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.589+0000 7f2b6d332640 1 --2- 172.21.15.73:0/2949465095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2b6815e920 0x7f2b681608c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:14.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.589+0000 7f2b6d332640 1 --2- 172.21.15.73:0/2949465095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b680d0f90 0x7f2b68160380 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:14.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.589+0000 7f2b6d332640 1 --2- 172.21.15.73:0/2949465095 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2b680cfde0 0x7f2b680c97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:14.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.589+0000 7f2b6d332640 1 -- 172.21.15.73:0/2949465095 >> 172.21.15.73:0/2949465095 conn(0x7f2b6808bfc0 msgr2=0x7f2b680b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:14.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.589+0000 7f2b6d332640 1 -- 172.21.15.73:0/2949465095 shutdown_connections 2024-03-29T04:08:14.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.590+0000 7f2b6d332640 1 -- 172.21.15.73:0/2949465095 wait complete. 2024-03-29T04:08:14.582 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-29T04:08:14.582 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-29T04:08:14.686 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.707+0000 7f02b80f8640 1 Processor -- start 2024-03-29T04:08:14.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.707+0000 7f02b80f8640 1 -- start start 2024-03-29T04:08:14.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.708+0000 7f02b80f8640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f02b00cfff0 0x7f02b009aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:14.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.708+0000 7f02b80f8640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02b015db70 con 0x7f02b00d0a00 2024-03-29T04:08:14.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.708+0000 7f02b80f8640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02b00cd380 con 0x7f02b00d0470 2024-03-29T04:08:14.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.708+0000 7f02b80f8640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f02b00cdf90 con 0x7f02b00cfff0 2024-03-29T04:08:14.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.708+0000 7f02b5693640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f02b00cfff0 0x7f02b009aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:14.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.708+0000 7f02b5e94640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f02b00d0a00 0x7f02b00d0de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58892/0 (socket says 172.21.15.73:58892) 2024-03-29T04:08:14.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.708+0000 7f02b5e94640 1 -- 172.21.15.73:0/1209887649 learned_addr learned my addr 172.21.15.73:0/1209887649 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:14.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.708+0000 7f02b5693640 1 -- 172.21.15.73:0/1209887649 >> v1:172.21.15.142:6789/0 conn(0x7f02b00d0470 legacy=0x7f02b009af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:14.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.708+0000 7f02b5693640 1 -- 172.21.15.73:0/1209887649 >> v1:172.21.15.73:6789/0 conn(0x7f02b00d0a00 legacy=0x7f02b00d0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:14.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.708+0000 7f02b5693640 1 -- 172.21.15.73:0/1209887649 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02b00cd660 con 0x7f02b00cfff0 2024-03-29T04:08:14.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.708+0000 7f02b4e92640 1 -- 172.21.15.73:0/1209887649 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2453880356 0 0) 0x7f02b015db70 con 0x7f02b00d0a00 2024-03-29T04:08:14.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.709+0000 7f02b5693640 1 --2- 172.21.15.73:0/1209887649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02b00cfff0 0x7f02b009aa30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f02a00097a0 tx=0x7f02a002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=534048f3f5eb4e86 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:14.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.709+0000 7f02b4e92640 1 -- 172.21.15.73:0/1209887649 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a0034070 con 0x7f02b00cfff0 2024-03-29T04:08:14.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.709+0000 7f02b4e92640 1 -- 172.21.15.73:0/1209887649 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02a0030610 con 0x7f02b00cfff0 2024-03-29T04:08:14.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.709+0000 7f02b4e92640 1 -- 172.21.15.73:0/1209887649 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a00309e0 con 0x7f02b00cfff0 2024-03-29T04:08:14.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.710+0000 7f02b80f8640 1 -- 172.21.15.73:0/1209887649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02b00cfff0 msgr2=0x7f02b009aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:14.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.710+0000 7f02b80f8640 1 --2- 172.21.15.73:0/1209887649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02b00cfff0 0x7f02b009aa30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f02a00097a0 tx=0x7f02a002b960 comp rx=0 tx=0).stop 2024-03-29T04:08:14.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.710+0000 7f02b80f8640 1 -- 172.21.15.73:0/1209887649 shutdown_connections 2024-03-29T04:08:14.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.710+0000 7f02b80f8640 1 --2- 172.21.15.73:0/1209887649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02b00cfff0 0x7f02b009aa30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:14.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.710+0000 7f02b80f8640 1 -- 172.21.15.73:0/1209887649 >> 172.21.15.73:0/1209887649 conn(0x7f02b00b3f10 msgr2=0x7f02b00b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:14.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.710+0000 7f02b80f8640 1 -- 172.21.15.73:0/1209887649 shutdown_connections 2024-03-29T04:08:14.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.710+0000 7f02b80f8640 1 -- 172.21.15.73:0/1209887649 wait complete. 2024-03-29T04:08:14.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.711+0000 7f02b80f8640 1 Processor -- start 2024-03-29T04:08:14.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.711+0000 7f02b80f8640 1 -- start start 2024-03-29T04:08:14.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.711+0000 7f02b80f8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02b00cfff0 0x7f02b01f2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:14.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.711+0000 7f02b80f8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02b00d0470 0x7f02b01f3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:14.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.711+0000 7f02b80f8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02b00d0a00 0x7f02b00b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:14.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.711+0000 7f02b80f8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f02b015c960 con 0x7f02b00d0a00 2024-03-29T04:08:14.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.711+0000 7f02b80f8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f02b00cdc20 con 0x7f02b00cfff0 2024-03-29T04:08:14.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.711+0000 7f02b80f8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f02b00ccf30 con 0x7f02b00d0470 2024-03-29T04:08:14.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.712+0000 7f02b6695640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02b00d0a00 0x7f02b00b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:14.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.712+0000 7f02b6695640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02b00d0a00 0x7f02b00b7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45730/0 (socket says 172.21.15.73:45730) 2024-03-29T04:08:14.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.712+0000 7f02b6695640 1 -- 172.21.15.73:0/2858785275 learned_addr learned my addr 172.21.15.73:0/2858785275 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:14.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.712+0000 7f02b5e94640 1 --2- 172.21.15.73:0/2858785275 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02b00cfff0 0x7f02b01f2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:14.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.712+0000 7f02b5693640 1 --2- 172.21.15.73:0/2858785275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02b00d0470 0x7f02b01f3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:14.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.712+0000 7f02b6695640 1 -- 172.21.15.73:0/2858785275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02b00d0470 msgr2=0x7f02b01f3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:14.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.712+0000 7f02b6695640 1 --2- 172.21.15.73:0/2858785275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02b00d0470 0x7f02b01f3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:14.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.712+0000 7f02b6695640 1 -- 172.21.15.73:0/2858785275 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02b00cfff0 msgr2=0x7f02b01f2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:14.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.712+0000 7f02b6695640 1 --2- 172.21.15.73:0/2858785275 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02b00cfff0 0x7f02b01f2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:14.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.712+0000 7f02b6695640 1 -- 172.21.15.73:0/2858785275 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02b00b53a0 con 0x7f02b00d0a00 2024-03-29T04:08:14.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.712+0000 7f02b6695640 1 --2- 172.21.15.73:0/2858785275 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02b00d0a00 0x7f02b00b7710 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f02a800c760 tx=0x7f02a800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:14.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.712+0000 7f02a67fc640 1 -- 172.21.15.73:0/2858785275 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a8003b70 con 0x7f02b00d0a00 2024-03-29T04:08:14.694 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.712+0000 7f02a67fc640 1 -- 172.21.15.73:0/2858785275 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02a8003d10 con 0x7f02b00d0a00 2024-03-29T04:08:14.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.712+0000 7f02b80f8640 1 -- 172.21.15.73:0/2858785275 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02b00b5680 con 0x7f02b00d0a00 2024-03-29T04:08:14.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.712+0000 7f02a67fc640 1 -- 172.21.15.73:0/2858785275 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a800aa90 con 0x7f02b00d0a00 2024-03-29T04:08:14.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.712+0000 7f02b80f8640 1 -- 172.21.15.73:0/2858785275 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02b00b5c40 con 0x7f02b00d0a00 2024-03-29T04:08:14.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.713+0000 7f02b80f8640 1 -- 172.21.15.73:0/2858785275 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02b0068640 con 0x7f02b00d0a00 2024-03-29T04:08:14.695 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.714+0000 7f02a67fc640 1 -- 172.21.15.73:0/2858785275 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f02a800ac30 con 0x7f02b00d0a00 2024-03-29T04:08:14.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.714+0000 7f02a67fc640 1 --2- 172.21.15.73:0/2858785275 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f029406c530 0x7f029406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:14.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.714+0000 7f02a67fc640 1 -- 172.21.15.73:0/2858785275 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f02a808b400 con 0x7f02b00d0a00 2024-03-29T04:08:14.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.714+0000 7f02b5e94640 1 --2- 172.21.15.73:0/2858785275 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f029406c530 0x7f029406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:14.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.714+0000 7f02b5e94640 1 --2- 172.21.15.73:0/2858785275 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f029406c530 0x7f029406e9f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f02ac000f60 tx=0x7f02ac007e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:14.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.719+0000 7f02a67fc640 1 -- 172.21.15.73:0/2858785275 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f02a8059460 con 0x7f02b00d0a00 2024-03-29T04:08:14.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.931+0000 7f02b80f8640 1 -- 172.21.15.73:0/2858785275 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f02b00b4b00 con 0x7f02b00d0a00 2024-03-29T04:08:14.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.931+0000 7f02a67fc640 1 -- 172.21.15.73:0/2858785275 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5178 (secure 0 0 0) 0x7f02a805d760 con 0x7f02b00d0a00 2024-03-29T04:08:14.911 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:14.912 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2101608781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2101608781},{"type":"v1","addr":"172.21.15.142:6834","nonce":2101608781}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3626787216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":3626787216},{"type":"v1","addr":"172.21.15.73:6837","nonce":3626787216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1987252283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1987252283},{"type":"v1","addr":"172.21.15.73:6836","nonce":1987252283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-29T04:08:11.922090+0000","modified":"2024-03-29T04:08:13.918938+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6835/569863112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":569863112},{"type":"v1","addr":"172.21.15.142:6835","nonce":569863112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-03-29T04:08:14.912 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 6 2024-03-29T04:08:14.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.933+0000 7f02b80f8640 1 -- 172.21.15.73:0/2858785275 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f029406c530 msgr2=0x7f029406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:14.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.933+0000 7f02b80f8640 1 --2- 172.21.15.73:0/2858785275 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f029406c530 0x7f029406e9f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f02ac000f60 tx=0x7f02ac007e40 comp rx=0 tx=0).stop 2024-03-29T04:08:14.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.933+0000 7f02b80f8640 1 -- 172.21.15.73:0/2858785275 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02b00d0a00 msgr2=0x7f02b00b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:14.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.933+0000 7f02b80f8640 1 --2- 172.21.15.73:0/2858785275 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02b00d0a00 0x7f02b00b7710 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f02a800c760 tx=0x7f02a800cc20 comp rx=0 tx=0).stop 2024-03-29T04:08:14.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.933+0000 7f02b80f8640 1 -- 172.21.15.73:0/2858785275 shutdown_connections 2024-03-29T04:08:14.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.933+0000 7f02b80f8640 1 --2- 172.21.15.73:0/2858785275 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02b00d0a00 0x7f02b00b7710 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:14.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.933+0000 7f02b80f8640 1 --2- 172.21.15.73:0/2858785275 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f02b00d0470 0x7f02b01f3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:14.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.933+0000 7f02b80f8640 1 --2- 172.21.15.73:0/2858785275 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f029406c530 0x7f029406e9f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:14.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.933+0000 7f02b80f8640 1 --2- 172.21.15.73:0/2858785275 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02b00cfff0 0x7f02b01f2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:14.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.933+0000 7f02b80f8640 1 -- 172.21.15.73:0/2858785275 >> 172.21.15.73:0/2858785275 conn(0x7f02b00b3f10 msgr2=0x7f02b015da80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:14.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.934+0000 7f02b80f8640 1 -- 172.21.15.73:0/2858785275 shutdown_connections 2024-03-29T04:08:14.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:14.934+0000 7f02b80f8640 1 -- 172.21.15.73:0/2858785275 wait complete. 2024-03-29T04:08:14.924 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-29T04:08:15.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.044+0000 7f032753d640 1 Processor -- start 2024-03-29T04:08:15.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.044+0000 7f032753d640 1 -- start start 2024-03-29T04:08:15.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.045+0000 7f032753d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f03200b1430 0x7f03200b1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:15.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.045+0000 7f032753d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f032015d4b0 0x7f03200cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:15.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.045+0000 7f032753d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f032006b880 con 0x7f0320160300 2024-03-29T04:08:15.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.045+0000 7f032753d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f032006c490 con 0x7f032015d4b0 2024-03-29T04:08:15.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.045+0000 7f032753d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f032006bb60 con 0x7f03200b1430 2024-03-29T04:08:15.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.045+0000 7f0325ada640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f032015d4b0 0x7f03200cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:15.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.045+0000 7f0324ad8640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0320160300 0x7f032015cda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58908/0 (socket says 172.21.15.73:58908) 2024-03-29T04:08:15.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.045+0000 7f0324ad8640 1 -- 172.21.15.73:0/2122415855 learned_addr learned my addr 172.21.15.73:0/2122415855 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:15.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.045+0000 7f03252d9640 1 --2- 172.21.15.73:0/2122415855 >> v2:172.21.15.142:3300/0 conn(0x7f03200b1430 0x7f03200b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:15.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.045+0000 7f0325ada640 1 -- 172.21.15.73:0/2122415855 >> v2:172.21.15.142:3300/0 conn(0x7f03200b1430 msgr2=0x7f03200b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:15.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.045+0000 7f0325ada640 1 --2- 172.21.15.73:0/2122415855 >> v2:172.21.15.142:3300/0 conn(0x7f03200b1430 0x7f03200b1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:15.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.045+0000 7f0325ada640 1 -- 172.21.15.73:0/2122415855 >> v1:172.21.15.73:6789/0 conn(0x7f0320160300 legacy=0x7f032015cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:15.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.045+0000 7f0325ada640 1 -- 172.21.15.73:0/2122415855 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f032006be40 con 0x7f032015d4b0 2024-03-29T04:08:15.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.045+0000 7f0317fff640 1 -- 172.21.15.73:0/2122415855 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2236796021 0 0) 0x7f032006b880 con 0x7f0320160300 2024-03-29T04:08:15.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.046+0000 7f0325ada640 1 --2- 172.21.15.73:0/2122415855 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f032015d4b0 0x7f03200cdff0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f03200692b0 tx=0x7f031802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80015877b0ab07e3 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:15.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.046+0000 7f0317fff640 1 -- 172.21.15.73:0/2122415855 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0318039070 con 0x7f032015d4b0 2024-03-29T04:08:15.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.046+0000 7f0317fff640 1 -- 172.21.15.73:0/2122415855 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f031802cc80 con 0x7f032015d4b0 2024-03-29T04:08:15.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.046+0000 7f0317fff640 1 -- 172.21.15.73:0/2122415855 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0318034660 con 0x7f032015d4b0 2024-03-29T04:08:15.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.047+0000 7f032753d640 1 -- 172.21.15.73:0/2122415855 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f032015d4b0 msgr2=0x7f03200cdff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:15.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.047+0000 7f032753d640 1 --2- 172.21.15.73:0/2122415855 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f032015d4b0 0x7f03200cdff0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f03200692b0 tx=0x7f031802bed0 comp rx=0 tx=0).stop 2024-03-29T04:08:15.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.047+0000 7f032753d640 1 -- 172.21.15.73:0/2122415855 shutdown_connections 2024-03-29T04:08:15.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.047+0000 7f032753d640 1 --2- 172.21.15.73:0/2122415855 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f032015d4b0 0x7f03200cdff0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:15.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.047+0000 7f032753d640 1 --2- 172.21.15.73:0/2122415855 >> v2:172.21.15.142:3300/0 conn(0x7f03200b1430 0x7f03200b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:15.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.047+0000 7f032753d640 1 -- 172.21.15.73:0/2122415855 >> 172.21.15.73:0/2122415855 conn(0x7f03200b6860 msgr2=0x7f03200b6c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:15.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.047+0000 7f032753d640 1 -- 172.21.15.73:0/2122415855 shutdown_connections 2024-03-29T04:08:15.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.047+0000 7f032753d640 1 -- 172.21.15.73:0/2122415855 wait complete. 2024-03-29T04:08:15.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.048+0000 7f032753d640 1 Processor -- start 2024-03-29T04:08:15.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.048+0000 7f032753d640 1 -- start start 2024-03-29T04:08:15.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.049+0000 7f032753d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03200b1430 0x7f0320142dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:15.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.049+0000 7f032753d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f032015d4b0 0x7f0320158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:15.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.049+0000 7f032753d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0320160300 0x7f0320158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:15.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.049+0000 7f032753d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f032006b510 con 0x7f032015d4b0 2024-03-29T04:08:15.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.049+0000 7f032753d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f03200734f0 con 0x7f0320160300 2024-03-29T04:08:15.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.049+0000 7f032753d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f03200b1d50 con 0x7f03200b1430 2024-03-29T04:08:15.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.049+0000 7f0324ad8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f032015d4b0 0x7f0320158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:15.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.049+0000 7f0324ad8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f032015d4b0 0x7f0320158590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45748/0 (socket says 172.21.15.73:45748) 2024-03-29T04:08:15.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.049+0000 7f0324ad8640 1 -- 172.21.15.73:0/3508016349 learned_addr learned my addr 172.21.15.73:0/3508016349 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:15.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.049+0000 7f03252d9640 1 --2- 172.21.15.73:0/3508016349 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03200b1430 0x7f0320142dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:15.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.049+0000 7f0325ada640 1 --2- 172.21.15.73:0/3508016349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0320160300 0x7f0320158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:15.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.049+0000 7f0324ad8640 1 -- 172.21.15.73:0/3508016349 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03200b1430 msgr2=0x7f0320142dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:15.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.049+0000 7f0324ad8640 1 --2- 172.21.15.73:0/3508016349 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03200b1430 0x7f0320142dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:15.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.049+0000 7f0324ad8640 1 -- 172.21.15.73:0/3508016349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0320160300 msgr2=0x7f0320158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:15.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.049+0000 7f0324ad8640 1 --2- 172.21.15.73:0/3508016349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0320160300 0x7f0320158ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:15.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.049+0000 7f0324ad8640 1 -- 172.21.15.73:0/3508016349 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f032015ddf0 con 0x7f032015d4b0 2024-03-29T04:08:15.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.049+0000 7f0324ad8640 1 --2- 172.21.15.73:0/3508016349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f032015d4b0 0x7f0320158590 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f031000c4d0 tx=0x7f031000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:15.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.049+0000 7f0315ffb640 1 -- 172.21.15.73:0/3508016349 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0310018070 con 0x7f032015d4b0 2024-03-29T04:08:15.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.049+0000 7f0315ffb640 1 -- 172.21.15.73:0/3508016349 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0310007500 con 0x7f032015d4b0 2024-03-29T04:08:15.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.049+0000 7f032753d640 1 -- 172.21.15.73:0/3508016349 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f032015e0d0 con 0x7f032015d4b0 2024-03-29T04:08:15.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.049+0000 7f0315ffb640 1 -- 172.21.15.73:0/3508016349 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0310004a20 con 0x7f032015d4b0 2024-03-29T04:08:15.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.050+0000 7f032753d640 1 -- 172.21.15.73:0/3508016349 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0320151640 con 0x7f032015d4b0 2024-03-29T04:08:15.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.051+0000 7f032753d640 1 -- 172.21.15.73:0/3508016349 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0320068640 con 0x7f032015d4b0 2024-03-29T04:08:15.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.051+0000 7f0315ffb640 1 -- 172.21.15.73:0/3508016349 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f031001b070 con 0x7f032015d4b0 2024-03-29T04:08:15.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.051+0000 7f0315ffb640 1 --2- 172.21.15.73:0/3508016349 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f030406c530 0x7f030406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:15.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.051+0000 7f0315ffb640 1 -- 172.21.15.73:0/3508016349 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f031008a900 con 0x7f032015d4b0 2024-03-29T04:08:15.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.051+0000 7f03252d9640 1 --2- 172.21.15.73:0/3508016349 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f030406c530 0x7f030406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:15.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.052+0000 7f03252d9640 1 --2- 172.21.15.73:0/3508016349 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f030406c530 0x7f030406e9f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f031c009aa0 tx=0x7f031c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:15.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.056+0000 7f0315ffb640 1 -- 172.21.15.73:0/3508016349 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f0310058960 con 0x7f032015d4b0 2024-03-29T04:08:15.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.232+0000 7f032753d640 1 -- 172.21.15.73:0/3508016349 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f032006eb60 con 0x7f032015d4b0 2024-03-29T04:08:15.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.233+0000 7f0315ffb640 1 -- 172.21.15.73:0/3508016349 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16605 (secure 0 0 0) 0x7f031005cc60 con 0x7f032015d4b0 2024-03-29T04:08:15.213 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:15.213 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"6bff1617-b138-4517-acca-3ecaae3f2bb3","created":"2024-03-29T04:07:47.346864+0000","modified":"2024-03-29T04:08:13.577603+0000","last_up_change":"2024-03-29T04:07:58.507139+0000","last_in_change":"2024-03-29T04:07:49.637816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-29T04:07:59.537301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-29T04:08:09.570906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-29T04:08:10.882349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"925d7de1-14ab-48c0-aebd-7bded108f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6820","nonce":2387335359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6824","nonce":2387335359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6831","nonce":2387335359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6828","nonce":2387335359}]},"public_addr":"172.21.15.73:6820/2387335359","cluster_addr":"172.21.15.73:6824/2387335359","heartbeat_back_addr":"172.21.15.73:6831/2387335359","heartbeat_front_addr":"172.21.15.73:6828/2387335359","state":["exists","up"]},{"osd":1,"uuid":"6b182102-882a-4e0c-99db-0afae5cfb38b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6801","nonce":2431315515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6803","nonce":2431315515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6807","nonce":2431315515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6805","nonce":2431315515}]},"public_addr":"172.21.15.73:6801/2431315515","cluster_addr":"172.21.15.73:6803/2431315515","heartbeat_back_addr":"172.21.15.73:6807/2431315515","heartbeat_front_addr":"172.21.15.73:6805/2431315515","state":["exists","up"]},{"osd":2,"uuid":"8040902e-b0b8-4a21-bf64-ce1c222115ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6809","nonce":407236597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6811","nonce":407236597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6815","nonce":407236597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6813","nonce":407236597}]},"public_addr":"172.21.15.73:6809/407236597","cluster_addr":"172.21.15.73:6811/407236597","heartbeat_back_addr":"172.21.15.73:6815/407236597","heartbeat_front_addr":"172.21.15.73:6813/407236597","state":["exists","up"]},{"osd":3,"uuid":"1bab19ee-3775-4ce1-a4ce-cf7cda3bbbf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6817","nonce":4291100709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6821","nonce":4291100709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6829","nonce":4291100709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6825","nonce":4291100709}]},"public_addr":"172.21.15.73:6817/4291100709","cluster_addr":"172.21.15.73:6821/4291100709","heartbeat_back_addr":"172.21.15.73:6829/4291100709","heartbeat_front_addr":"172.21.15.73:6825/4291100709","state":["exists","up"]},{"osd":4,"uuid":"b0c74337-8fe4-47dc-b3da-2d07591b1f6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6817","nonce":3703256194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6819","nonce":3703256194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6823","nonce":3703256194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6821","nonce":3703256194}]},"public_addr":"172.21.15.142:6817/3703256194","cluster_addr":"172.21.15.142:6819/3703256194","heartbeat_back_addr":"172.21.15.142:6823/3703256194","heartbeat_front_addr":"172.21.15.142:6821/3703256194","state":["exists","up"]},{"osd":5,"uuid":"9ce36410-a29a-42c6-99f4-f95d4afdd7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6825","nonce":4271575803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6827","nonce":4271575803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6831","nonce":4271575803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6829","nonce":4271575803}]},"public_addr":"172.21.15.142:6825/4271575803","cluster_addr":"172.21.15.142:6827/4271575803","heartbeat_back_addr":"172.21.15.142:6831/4271575803","heartbeat_front_addr":"172.21.15.142:6829/4271575803","state":["exists","up"]},{"osd":6,"uuid":"aec4264a-64ac-428e-a860-d2920a304019","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6801","nonce":1772722570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6803","nonce":1772722570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6807","nonce":1772722570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6805","nonce":1772722570}]},"public_addr":"172.21.15.142:6801/1772722570","cluster_addr":"172.21.15.142:6803/1772722570","heartbeat_back_addr":"172.21.15.142:6807/1772722570","heartbeat_front_addr":"172.21.15.142:6805/1772722570","state":["exists","up"]},{"osd":7,"uuid":"fe599052-8e5a-4c7a-91e7-52d1bae24a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6809","nonce":3910589675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6811","nonce":3910589675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6815","nonce":3910589675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6813","nonce":3910589675}]},"public_addr":"172.21.15.142:6809/3910589675","cluster_addr":"172.21.15.142:6811/3910589675","heartbeat_back_addr":"172.21.15.142:6815/3910589675","heartbeat_front_addr":"172.21.15.142:6813/3910589675","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.835096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.587210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.786547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.778004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.843740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.791160+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.837992+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.718722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:08:15.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.235+0000 7f032753d640 1 -- 172.21.15.73:0/3508016349 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f030406c530 msgr2=0x7f030406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:15.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.235+0000 7f032753d640 1 --2- 172.21.15.73:0/3508016349 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f030406c530 0x7f030406e9f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f031c009aa0 tx=0x7f031c009190 comp rx=0 tx=0).stop 2024-03-29T04:08:15.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.235+0000 7f032753d640 1 -- 172.21.15.73:0/3508016349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f032015d4b0 msgr2=0x7f0320158590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:15.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.235+0000 7f032753d640 1 --2- 172.21.15.73:0/3508016349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f032015d4b0 0x7f0320158590 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f031000c4d0 tx=0x7f031000c990 comp rx=0 tx=0).stop 2024-03-29T04:08:15.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.235+0000 7f032753d640 1 -- 172.21.15.73:0/3508016349 shutdown_connections 2024-03-29T04:08:15.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.235+0000 7f032753d640 1 --2- 172.21.15.73:0/3508016349 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f030406c530 0x7f030406e9f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:15.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.235+0000 7f032753d640 1 --2- 172.21.15.73:0/3508016349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0320160300 0x7f0320158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:15.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.235+0000 7f032753d640 1 --2- 172.21.15.73:0/3508016349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f032015d4b0 0x7f0320158590 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:15.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.235+0000 7f032753d640 1 --2- 172.21.15.73:0/3508016349 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f03200b1430 0x7f0320142dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:15.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.235+0000 7f032753d640 1 -- 172.21.15.73:0/3508016349 >> 172.21.15.73:0/3508016349 conn(0x7f03200b6860 msgr2=0x7f03200ae810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:15.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.235+0000 7f032753d640 1 -- 172.21.15.73:0/3508016349 shutdown_connections 2024-03-29T04:08:15.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.235+0000 7f032753d640 1 -- 172.21.15.73:0/3508016349 wait complete. 2024-03-29T04:08:15.226 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-29T04:08:15.226 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-29T04:08:15.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.348+0000 7f01e0560640 1 Processor -- start 2024-03-29T04:08:15.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.348+0000 7f01e0560640 1 -- start start 2024-03-29T04:08:15.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.349+0000 7f01e0560640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f01d81592b0 0x7f01d8159750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:15.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.349+0000 7f01e0560640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01d815d220 con 0x7f01d815cd30 2024-03-29T04:08:15.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.349+0000 7f01e0560640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01d815d500 con 0x7f01d80b4fe0 2024-03-29T04:08:15.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.349+0000 7f01e0560640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f01d80b45d0 con 0x7f01d81592b0 2024-03-29T04:08:15.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.349+0000 7f01deafd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f01d81592b0 0x7f01d8159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:15.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.349+0000 7f01ddafb640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f01d815cd30 0x7f01d8158ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58924/0 (socket says 172.21.15.73:58924) 2024-03-29T04:08:15.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.349+0000 7f01ddafb640 1 -- 172.21.15.73:0/2061414159 learned_addr learned my addr 172.21.15.73:0/2061414159 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:15.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.349+0000 7f01deafd640 1 --2- 172.21.15.73:0/2061414159 >> v2:172.21.15.73:3300/0 conn(0x7f01d81592b0 0x7f01d8159750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45760/0 (socket says 172.21.15.73:45760) 2024-03-29T04:08:15.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.349+0000 7f01deafd640 1 -- 172.21.15.73:0/2061414159 >> v1:172.21.15.142:6789/0 conn(0x7f01d80b4fe0 legacy=0x7f01d815c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:15.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.349+0000 7f01deafd640 1 -- 172.21.15.73:0/2061414159 >> v1:172.21.15.73:6789/0 conn(0x7f01d815cd30 legacy=0x7f01d8158ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:15.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.349+0000 7f01deafd640 1 -- 172.21.15.73:0/2061414159 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01d815d7e0 con 0x7f01d81592b0 2024-03-29T04:08:15.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.349+0000 7f01dd2fa640 1 -- 172.21.15.73:0/2061414159 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 195481387 0 0) 0x7f01d815d220 con 0x7f01d815cd30 2024-03-29T04:08:15.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.350+0000 7f01deafd640 1 --2- 172.21.15.73:0/2061414159 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01d81592b0 0x7f01d8159750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f01d0009dc0 tx=0x7f01d002bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27875ba3b105d39b server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:15.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.350+0000 7f01dd2fa640 1 -- 172.21.15.73:0/2061414159 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d0039070 con 0x7f01d81592b0 2024-03-29T04:08:15.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.350+0000 7f01dd2fa640 1 -- 172.21.15.73:0/2061414159 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01d002ccd0 con 0x7f01d81592b0 2024-03-29T04:08:15.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.350+0000 7f01dd2fa640 1 -- 172.21.15.73:0/2061414159 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d0034660 con 0x7f01d81592b0 2024-03-29T04:08:15.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.350+0000 7f01e0560640 1 -- 172.21.15.73:0/2061414159 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01d81592b0 msgr2=0x7f01d8159750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:15.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.350+0000 7f01e0560640 1 --2- 172.21.15.73:0/2061414159 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01d81592b0 0x7f01d8159750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f01d0009dc0 tx=0x7f01d002bf20 comp rx=0 tx=0).stop 2024-03-29T04:08:15.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.351+0000 7f01e0560640 1 -- 172.21.15.73:0/2061414159 shutdown_connections 2024-03-29T04:08:15.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.351+0000 7f01e0560640 1 --2- 172.21.15.73:0/2061414159 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01d81592b0 0x7f01d8159750 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:15.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.351+0000 7f01e0560640 1 -- 172.21.15.73:0/2061414159 >> 172.21.15.73:0/2061414159 conn(0x7f01d80b6780 msgr2=0x7f01d80b6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:15.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.351+0000 7f01e0560640 1 -- 172.21.15.73:0/2061414159 shutdown_connections 2024-03-29T04:08:15.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.351+0000 7f01e0560640 1 -- 172.21.15.73:0/2061414159 wait complete. 2024-03-29T04:08:15.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.352+0000 7f01e0560640 1 Processor -- start 2024-03-29T04:08:15.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.352+0000 7f01e0560640 1 -- start start 2024-03-29T04:08:15.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.352+0000 7f01e0560640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01d80b4fe0 0x7f01d80b3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:15.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.352+0000 7f01e0560640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01d81592b0 0x7f01d8151b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:15.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.352+0000 7f01e0560640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01d815cd30 0x7f01d8154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:15.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.352+0000 7f01e0560640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f01d80b53c0 con 0x7f01d815cd30 2024-03-29T04:08:15.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.352+0000 7f01e0560640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f01d815dda0 con 0x7f01d81592b0 2024-03-29T04:08:15.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.352+0000 7f01e0560640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f01d80b5540 con 0x7f01d80b4fe0 2024-03-29T04:08:15.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.353+0000 7f01deafd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01d815cd30 0x7f01d8154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:15.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.353+0000 7f01deafd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01d815cd30 0x7f01d8154e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45770/0 (socket says 172.21.15.73:45770) 2024-03-29T04:08:15.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.353+0000 7f01deafd640 1 -- 172.21.15.73:0/4130447480 learned_addr learned my addr 172.21.15.73:0/4130447480 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:15.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.353+0000 7f01ddafb640 1 --2- 172.21.15.73:0/4130447480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01d81592b0 0x7f01d8151b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:15.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.353+0000 7f01de2fc640 1 --2- 172.21.15.73:0/4130447480 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01d80b4fe0 0x7f01d80b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:15.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.353+0000 7f01deafd640 1 -- 172.21.15.73:0/4130447480 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01d80b4fe0 msgr2=0x7f01d80b3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:15.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.353+0000 7f01deafd640 1 --2- 172.21.15.73:0/4130447480 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01d80b4fe0 0x7f01d80b3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:15.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.353+0000 7f01deafd640 1 -- 172.21.15.73:0/4130447480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01d81592b0 msgr2=0x7f01d8151b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:15.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.353+0000 7f01deafd640 1 --2- 172.21.15.73:0/4130447480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01d81592b0 0x7f01d8151b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:15.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.353+0000 7f01deafd640 1 -- 172.21.15.73:0/4130447480 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01d80b3760 con 0x7f01d815cd30 2024-03-29T04:08:15.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.353+0000 7f01deafd640 1 --2- 172.21.15.73:0/4130447480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01d815cd30 0x7f01d8154e10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f01d0009dc0 tx=0x7f01d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:15.335 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.353+0000 7f01ceffd640 1 -- 172.21.15.73:0/4130447480 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d0039050 con 0x7f01d815cd30 2024-03-29T04:08:15.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.353+0000 7f01ceffd640 1 -- 172.21.15.73:0/4130447480 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01d003a040 con 0x7f01d815cd30 2024-03-29T04:08:15.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.353+0000 7f01e0560640 1 -- 172.21.15.73:0/4130447480 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01d8154330 con 0x7f01d815cd30 2024-03-29T04:08:15.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.353+0000 7f01ceffd640 1 -- 172.21.15.73:0/4130447480 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d003e610 con 0x7f01d815cd30 2024-03-29T04:08:15.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.353+0000 7f01e0560640 1 -- 172.21.15.73:0/4130447480 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01d8155350 con 0x7f01d815cd30 2024-03-29T04:08:15.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.354+0000 7f01e0560640 1 -- 172.21.15.73:0/4130447480 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01d8068d50 con 0x7f01d815cd30 2024-03-29T04:08:15.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.355+0000 7f01ceffd640 1 -- 172.21.15.73:0/4130447480 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f01d0047020 con 0x7f01d815cd30 2024-03-29T04:08:15.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.355+0000 7f01ceffd640 1 --2- 172.21.15.73:0/4130447480 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f01bc06c530 0x7f01bc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:15.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.355+0000 7f01de2fc640 1 --2- 172.21.15.73:0/4130447480 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f01bc06c530 0x7f01bc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:15.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.355+0000 7f01ceffd640 1 -- 172.21.15.73:0/4130447480 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f01d00ad970 con 0x7f01d815cd30 2024-03-29T04:08:15.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.356+0000 7f01de2fc640 1 --2- 172.21.15.73:0/4130447480 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f01bc06c530 0x7f01bc06e9f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f01d4000f60 tx=0x7f01d4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:15.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.360+0000 7f01ceffd640 1 -- 172.21.15.73:0/4130447480 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f01d004e020 con 0x7f01d815cd30 2024-03-29T04:08:15.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.532+0000 7f01e0560640 1 -- 172.21.15.73:0/4130447480 --> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f01d80b3a40 con 0x7f01bc06c530 2024-03-29T04:08:15.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.538+0000 7f01ceffd640 1 -- 172.21.15.73:0/4130447480 <== mgr.4104 v2:172.21.15.73:6832/1640471941 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251878 (secure 0 0 0) 0x7f01d80b3a40 con 0x7f01bc06c530 2024-03-29T04:08:15.521 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:15.523 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-29T04:08:15.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.541+0000 7f01e0560640 1 -- 172.21.15.73:0/4130447480 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f01bc06c530 msgr2=0x7f01bc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:15.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.541+0000 7f01e0560640 1 --2- 172.21.15.73:0/4130447480 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f01bc06c530 0x7f01bc06e9f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f01d4000f60 tx=0x7f01d4009040 comp rx=0 tx=0).stop 2024-03-29T04:08:15.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.541+0000 7f01e0560640 1 -- 172.21.15.73:0/4130447480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01d815cd30 msgr2=0x7f01d8154e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:15.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.541+0000 7f01e0560640 1 --2- 172.21.15.73:0/4130447480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01d815cd30 0x7f01d8154e10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f01d0009dc0 tx=0x7f01d0004a40 comp rx=0 tx=0).stop 2024-03-29T04:08:15.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.541+0000 7f01e0560640 1 -- 172.21.15.73:0/4130447480 shutdown_connections 2024-03-29T04:08:15.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.541+0000 7f01e0560640 1 --2- 172.21.15.73:0/4130447480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01d815cd30 0x7f01d8154e10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:15.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.541+0000 7f01e0560640 1 --2- 172.21.15.73:0/4130447480 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f01bc06c530 0x7f01bc06e9f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:15.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.541+0000 7f01e0560640 1 --2- 172.21.15.73:0/4130447480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01d81592b0 0x7f01d8151b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:15.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.541+0000 7f01e0560640 1 --2- 172.21.15.73:0/4130447480 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f01d80b4fe0 0x7f01d80b3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:15.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.541+0000 7f01e0560640 1 -- 172.21.15.73:0/4130447480 >> 172.21.15.73:0/4130447480 conn(0x7f01d80b6780 msgr2=0x7f01d809b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:15.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.541+0000 7f01e0560640 1 -- 172.21.15.73:0/4130447480 shutdown_connections 2024-03-29T04:08:15.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.541+0000 7f01e0560640 1 -- 172.21.15.73:0/4130447480 wait complete. 2024-03-29T04:08:15.531 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-03-29T04:08:15.523414+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218984,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755736,"statfs":{"total":773094113280,"available":772869873664,"internally_reserved":0,"allocated":2891776,"data_stored":1739996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.963649"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.590396+0000","last_change":"2024-03-29T04:08:12.587912+0000","last_active":"2024-03-29T04:08:12.590396+0000","last_peered":"2024-03-29T04:08:12.590396+0000","last_clean":"2024-03-29T04:08:12.590396+0000","last_became_active":"2024-03-29T04:08:12.587593+0000","last_became_peered":"2024-03-29T04:08:12.587593+0000","last_unstale":"2024-03-29T04:08:12.590396+0000","last_undegraded":"2024-03-29T04:08:12.590396+0000","last_fullsized":"2024-03-29T04:08:12.590396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:15:10.072949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.583861+0000","last_change":"2024-03-29T04:08:12.582178+0000","last_active":"2024-03-29T04:08:12.583861+0000","last_peered":"2024-03-29T04:08:12.583861+0000","last_clean":"2024-03-29T04:08:12.583861+0000","last_became_active":"2024-03-29T04:08:12.581920+0000","last_became_peered":"2024-03-29T04:08:12.581920+0000","last_unstale":"2024-03-29T04:08:12.583861+0000","last_undegraded":"2024-03-29T04:08:12.583861+0000","last_fullsized":"2024-03-29T04:08:12.583861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:52:01.877649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.594003+0000","last_change":"2024-03-29T04:08:12.584079+0000","last_active":"2024-03-29T04:08:12.594003+0000","last_peered":"2024-03-29T04:08:12.594003+0000","last_clean":"2024-03-29T04:08:12.594003+0000","last_became_active":"2024-03-29T04:08:12.583240+0000","last_became_peered":"2024-03-29T04:08:12.583240+0000","last_unstale":"2024-03-29T04:08:12.594003+0000","last_undegraded":"2024-03-29T04:08:12.594003+0000","last_fullsized":"2024-03-29T04:08:12.594003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T13:31:03.806930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.603331+0000","last_change":"2024-03-29T04:08:12.595090+0000","last_active":"2024-03-29T04:08:12.603331+0000","last_peered":"2024-03-29T04:08:12.603331+0000","last_clean":"2024-03-29T04:08:12.603331+0000","last_became_active":"2024-03-29T04:08:12.594477+0000","last_became_peered":"2024-03-29T04:08:12.594477+0000","last_unstale":"2024-03-29T04:08:12.603331+0000","last_undegraded":"2024-03-29T04:08:12.603331+0000","last_fullsized":"2024-03-29T04:08:12.603331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:52:01.877649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.598184+0000","last_change":"2024-03-29T04:08:12.595546+0000","last_active":"2024-03-29T04:08:12.598184+0000","last_peered":"2024-03-29T04:08:12.598184+0000","last_clean":"2024-03-29T04:08:12.598184+0000","last_became_active":"2024-03-29T04:08:12.595270+0000","last_became_peered":"2024-03-29T04:08:12.595270+0000","last_unstale":"2024-03-29T04:08:12.598184+0000","last_undegraded":"2024-03-29T04:08:12.598184+0000","last_fullsized":"2024-03-29T04:08:12.598184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:24:45.816098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.603588+0000","last_change":"2024-03-29T04:08:12.598973+0000","last_active":"2024-03-29T04:08:12.603588+0000","last_peered":"2024-03-29T04:08:12.603588+0000","last_clean":"2024-03-29T04:08:12.603588+0000","last_became_active":"2024-03-29T04:08:12.598463+0000","last_became_peered":"2024-03-29T04:08:12.598463+0000","last_unstale":"2024-03-29T04:08:12.603588+0000","last_undegraded":"2024-03-29T04:08:12.603588+0000","last_fullsized":"2024-03-29T04:08:12.603588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:43:58.842293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.596260+0000","last_change":"2024-03-29T04:08:12.590636+0000","last_active":"2024-03-29T04:08:12.596260+0000","last_peered":"2024-03-29T04:08:12.596260+0000","last_clean":"2024-03-29T04:08:12.596260+0000","last_became_active":"2024-03-29T04:08:12.590365+0000","last_became_peered":"2024-03-29T04:08:12.590365+0000","last_unstale":"2024-03-29T04:08:12.596260+0000","last_undegraded":"2024-03-29T04:08:12.596260+0000","last_fullsized":"2024-03-29T04:08:12.596260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:47:13.560160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.597029+0000","last_change":"2024-03-29T04:08:12.594929+0000","last_active":"2024-03-29T04:08:12.597029+0000","last_peered":"2024-03-29T04:08:12.597029+0000","last_clean":"2024-03-29T04:08:12.597029+0000","last_became_active":"2024-03-29T04:08:12.594646+0000","last_became_peered":"2024-03-29T04:08:12.594646+0000","last_unstale":"2024-03-29T04:08:12.597029+0000","last_undegraded":"2024-03-29T04:08:12.597029+0000","last_fullsized":"2024-03-29T04:08:12.597029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:44:46.187079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.599330+0000","last_change":"2024-03-29T04:08:12.597651+0000","last_active":"2024-03-29T04:08:12.599330+0000","last_peered":"2024-03-29T04:08:12.599330+0000","last_clean":"2024-03-29T04:08:12.599330+0000","last_became_active":"2024-03-29T04:08:12.597389+0000","last_became_peered":"2024-03-29T04:08:12.597389+0000","last_unstale":"2024-03-29T04:08:12.599330+0000","last_undegraded":"2024-03-29T04:08:12.599330+0000","last_fullsized":"2024-03-29T04:08:12.599330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T13:00:12.842920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.598028+0000","last_change":"2024-03-29T04:08:12.588278+0000","last_active":"2024-03-29T04:08:12.598028+0000","last_peered":"2024-03-29T04:08:12.598028+0000","last_clean":"2024-03-29T04:08:12.598028+0000","last_became_active":"2024-03-29T04:08:12.587891+0000","last_became_peered":"2024-03-29T04:08:12.587891+0000","last_unstale":"2024-03-29T04:08:12.598028+0000","last_undegraded":"2024-03-29T04:08:12.598028+0000","last_fullsized":"2024-03-29T04:08:12.598028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:46:43.492166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.597048+0000","last_change":"2024-03-29T04:08:12.590703+0000","last_active":"2024-03-29T04:08:12.597048+0000","last_peered":"2024-03-29T04:08:12.597048+0000","last_clean":"2024-03-29T04:08:12.597048+0000","last_became_active":"2024-03-29T04:08:12.590420+0000","last_became_peered":"2024-03-29T04:08:12.590420+0000","last_unstale":"2024-03-29T04:08:12.597048+0000","last_undegraded":"2024-03-29T04:08:12.597048+0000","last_fullsized":"2024-03-29T04:08:12.597048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:15:10.072949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.593217+0000","last_change":"2024-03-29T04:08:12.587297+0000","last_active":"2024-03-29T04:08:12.593217+0000","last_peered":"2024-03-29T04:08:12.593217+0000","last_clean":"2024-03-29T04:08:12.593217+0000","last_became_active":"2024-03-29T04:08:12.587036+0000","last_became_peered":"2024-03-29T04:08:12.587036+0000","last_unstale":"2024-03-29T04:08:12.593217+0000","last_undegraded":"2024-03-29T04:08:12.593217+0000","last_fullsized":"2024-03-29T04:08:12.593217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T13:31:03.806930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.583164+0000","last_change":"2024-03-29T04:08:12.580578+0000","last_active":"2024-03-29T04:08:12.583164+0000","last_peered":"2024-03-29T04:08:12.583164+0000","last_clean":"2024-03-29T04:08:12.583164+0000","last_became_active":"2024-03-29T04:08:12.580335+0000","last_became_peered":"2024-03-29T04:08:12.580335+0000","last_unstale":"2024-03-29T04:08:12.583164+0000","last_undegraded":"2024-03-29T04:08:12.583164+0000","last_fullsized":"2024-03-29T04:08:12.583164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:43:46.637919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.594030+0000","last_change":"2024-03-29T04:08:12.584573+0000","last_active":"2024-03-29T04:08:12.594030+0000","last_peered":"2024-03-29T04:08:12.594030+0000","last_clean":"2024-03-29T04:08:12.594030+0000","last_became_active":"2024-03-29T04:08:12.584294+0000","last_became_peered":"2024-03-29T04:08:12.584294+0000","last_unstale":"2024-03-29T04:08:12.594030+0000","last_undegraded":"2024-03-29T04:08:12.594030+0000","last_fullsized":"2024-03-29T04:08:12.594030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:22:24.224965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.594281+0000","last_change":"2024-03-29T04:08:12.588885+0000","last_active":"2024-03-29T04:08:12.594281+0000","last_peered":"2024-03-29T04:08:12.594281+0000","last_clean":"2024-03-29T04:08:12.594281+0000","last_became_active":"2024-03-29T04:08:12.588581+0000","last_became_peered":"2024-03-29T04:08:12.588581+0000","last_unstale":"2024-03-29T04:08:12.594281+0000","last_undegraded":"2024-03-29T04:08:12.594281+0000","last_fullsized":"2024-03-29T04:08:12.594281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:23:55.560819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.603387+0000","last_change":"2024-03-29T04:08:12.595787+0000","last_active":"2024-03-29T04:08:12.603387+0000","last_peered":"2024-03-29T04:08:12.603387+0000","last_clean":"2024-03-29T04:08:12.603387+0000","last_became_active":"2024-03-29T04:08:12.595403+0000","last_became_peered":"2024-03-29T04:08:12.595403+0000","last_unstale":"2024-03-29T04:08:12.603387+0000","last_undegraded":"2024-03-29T04:08:12.603387+0000","last_fullsized":"2024-03-29T04:08:12.603387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:44:46.187079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.603347+0000","last_change":"2024-03-29T04:08:12.598647+0000","last_active":"2024-03-29T04:08:12.603347+0000","last_peered":"2024-03-29T04:08:12.603347+0000","last_clean":"2024-03-29T04:08:12.603347+0000","last_became_active":"2024-03-29T04:08:12.597742+0000","last_became_peered":"2024-03-29T04:08:12.597742+0000","last_unstale":"2024-03-29T04:08:12.603347+0000","last_undegraded":"2024-03-29T04:08:12.603347+0000","last_fullsized":"2024-03-29T04:08:12.603347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:24:45.816098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.590251+0000","last_change":"2024-03-29T04:08:12.583931+0000","last_active":"2024-03-29T04:08:12.590251+0000","last_peered":"2024-03-29T04:08:12.590251+0000","last_clean":"2024-03-29T04:08:12.590251+0000","last_became_active":"2024-03-29T04:08:12.583644+0000","last_became_peered":"2024-03-29T04:08:12.583644+0000","last_unstale":"2024-03-29T04:08:12.590251+0000","last_undegraded":"2024-03-29T04:08:12.590251+0000","last_fullsized":"2024-03-29T04:08:12.590251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:29:58.161169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.598390+0000","last_change":"2024-03-29T04:08:12.596215+0000","last_active":"2024-03-29T04:08:12.598390+0000","last_peered":"2024-03-29T04:08:12.598390+0000","last_clean":"2024-03-29T04:08:12.598390+0000","last_became_active":"2024-03-29T04:08:12.595946+0000","last_became_peered":"2024-03-29T04:08:12.595946+0000","last_unstale":"2024-03-29T04:08:12.598390+0000","last_undegraded":"2024-03-29T04:08:12.598390+0000","last_fullsized":"2024-03-29T04:08:12.598390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:43:58.842293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.596951+0000","last_change":"2024-03-29T04:08:12.591240+0000","last_active":"2024-03-29T04:08:12.596951+0000","last_peered":"2024-03-29T04:08:12.596951+0000","last_clean":"2024-03-29T04:08:12.596951+0000","last_became_active":"2024-03-29T04:08:12.590916+0000","last_became_peered":"2024-03-29T04:08:12.590916+0000","last_unstale":"2024-03-29T04:08:12.596951+0000","last_undegraded":"2024-03-29T04:08:12.596951+0000","last_fullsized":"2024-03-29T04:08:12.596951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:44:46.187079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.594937+0000","last_change":"2024-03-29T04:08:12.591775+0000","last_active":"2024-03-29T04:08:12.594937+0000","last_peered":"2024-03-29T04:08:12.594937+0000","last_clean":"2024-03-29T04:08:12.594937+0000","last_became_active":"2024-03-29T04:08:12.591502+0000","last_became_peered":"2024-03-29T04:08:12.591502+0000","last_unstale":"2024-03-29T04:08:12.594937+0000","last_undegraded":"2024-03-29T04:08:12.594937+0000","last_fullsized":"2024-03-29T04:08:12.594937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:52:01.877649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.603325+0000","last_change":"2024-03-29T04:08:12.598535+0000","last_active":"2024-03-29T04:08:12.603325+0000","last_peered":"2024-03-29T04:08:12.603325+0000","last_clean":"2024-03-29T04:08:12.603325+0000","last_became_active":"2024-03-29T04:08:12.594745+0000","last_became_peered":"2024-03-29T04:08:12.594745+0000","last_unstale":"2024-03-29T04:08:12.603325+0000","last_undegraded":"2024-03-29T04:08:12.603325+0000","last_fullsized":"2024-03-29T04:08:12.603325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T10:10:20.492063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.589974+0000","last_change":"2024-03-29T04:08:12.588823+0000","last_active":"2024-03-29T04:08:12.589974+0000","last_peered":"2024-03-29T04:08:12.589974+0000","last_clean":"2024-03-29T04:08:12.589974+0000","last_became_active":"2024-03-29T04:08:12.588560+0000","last_became_peered":"2024-03-29T04:08:12.588560+0000","last_unstale":"2024-03-29T04:08:12.589974+0000","last_undegraded":"2024-03-29T04:08:12.589974+0000","last_fullsized":"2024-03-29T04:08:12.589974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:46:43.492166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.603288+0000","last_change":"2024-03-29T04:08:12.598196+0000","last_active":"2024-03-29T04:08:12.603288+0000","last_peered":"2024-03-29T04:08:12.603288+0000","last_clean":"2024-03-29T04:08:12.603288+0000","last_became_active":"2024-03-29T04:08:12.594199+0000","last_became_peered":"2024-03-29T04:08:12.594199+0000","last_unstale":"2024-03-29T04:08:12.603288+0000","last_undegraded":"2024-03-29T04:08:12.603288+0000","last_fullsized":"2024-03-29T04:08:12.603288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:23:55.560819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.590118+0000","last_change":"2024-03-29T04:08:12.588950+0000","last_active":"2024-03-29T04:08:12.590118+0000","last_peered":"2024-03-29T04:08:12.590118+0000","last_clean":"2024-03-29T04:08:12.590118+0000","last_became_active":"2024-03-29T04:08:12.588659+0000","last_became_peered":"2024-03-29T04:08:12.588659+0000","last_unstale":"2024-03-29T04:08:12.590118+0000","last_undegraded":"2024-03-29T04:08:12.590118+0000","last_fullsized":"2024-03-29T04:08:12.590118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:25:50.715560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.598055+0000","last_change":"2024-03-29T04:08:12.589789+0000","last_active":"2024-03-29T04:08:12.598055+0000","last_peered":"2024-03-29T04:08:12.598055+0000","last_clean":"2024-03-29T04:08:12.598055+0000","last_became_active":"2024-03-29T04:08:12.587505+0000","last_became_peered":"2024-03-29T04:08:12.587505+0000","last_unstale":"2024-03-29T04:08:12.598055+0000","last_undegraded":"2024-03-29T04:08:12.598055+0000","last_fullsized":"2024-03-29T04:08:12.598055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:52:01.877649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.583893+0000","last_change":"2024-03-29T04:08:12.582545+0000","last_active":"2024-03-29T04:08:12.583893+0000","last_peered":"2024-03-29T04:08:12.583893+0000","last_clean":"2024-03-29T04:08:12.583893+0000","last_became_active":"2024-03-29T04:08:12.582268+0000","last_became_peered":"2024-03-29T04:08:12.582268+0000","last_unstale":"2024-03-29T04:08:12.583893+0000","last_undegraded":"2024-03-29T04:08:12.583893+0000","last_fullsized":"2024-03-29T04:08:12.583893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:15:10.072949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.590198+0000","last_change":"2024-03-29T04:08:12.589186+0000","last_active":"2024-03-29T04:08:12.590198+0000","last_peered":"2024-03-29T04:08:12.590198+0000","last_clean":"2024-03-29T04:08:12.590198+0000","last_became_active":"2024-03-29T04:08:12.588882+0000","last_became_peered":"2024-03-29T04:08:12.588882+0000","last_unstale":"2024-03-29T04:08:12.590198+0000","last_undegraded":"2024-03-29T04:08:12.590198+0000","last_fullsized":"2024-03-29T04:08:12.590198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:52:01.877649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.594078+0000","last_change":"2024-03-29T04:08:12.584300+0000","last_active":"2024-03-29T04:08:12.594078+0000","last_peered":"2024-03-29T04:08:12.594078+0000","last_clean":"2024-03-29T04:08:12.594078+0000","last_became_active":"2024-03-29T04:08:12.583925+0000","last_became_peered":"2024-03-29T04:08:12.583925+0000","last_unstale":"2024-03-29T04:08:12.594078+0000","last_undegraded":"2024-03-29T04:08:12.594078+0000","last_fullsized":"2024-03-29T04:08:12.594078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:43:46.637919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.598929+0000","last_change":"2024-03-29T04:08:12.593957+0000","last_active":"2024-03-29T04:08:12.598929+0000","last_peered":"2024-03-29T04:08:12.598929+0000","last_clean":"2024-03-29T04:08:12.598929+0000","last_became_active":"2024-03-29T04:08:12.593694+0000","last_became_peered":"2024-03-29T04:08:12.593694+0000","last_unstale":"2024-03-29T04:08:12.598929+0000","last_undegraded":"2024-03-29T04:08:12.598929+0000","last_fullsized":"2024-03-29T04:08:12.598929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:39:27.893573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.594378+0000","last_change":"2024-03-29T04:08:12.587534+0000","last_active":"2024-03-29T04:08:12.594378+0000","last_peered":"2024-03-29T04:08:12.594378+0000","last_clean":"2024-03-29T04:08:12.594378+0000","last_became_active":"2024-03-29T04:08:12.587244+0000","last_became_peered":"2024-03-29T04:08:12.587244+0000","last_unstale":"2024-03-29T04:08:12.594378+0000","last_undegraded":"2024-03-29T04:08:12.594378+0000","last_fullsized":"2024-03-29T04:08:12.594378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:04:47.466811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.596965+0000","last_change":"2024-03-29T04:08:12.588798+0000","last_active":"2024-03-29T04:08:12.596965+0000","last_peered":"2024-03-29T04:08:12.596965+0000","last_clean":"2024-03-29T04:08:12.596965+0000","last_became_active":"2024-03-29T04:08:12.588526+0000","last_became_peered":"2024-03-29T04:08:12.588526+0000","last_unstale":"2024-03-29T04:08:12.596965+0000","last_undegraded":"2024-03-29T04:08:12.596965+0000","last_fullsized":"2024-03-29T04:08:12.596965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:25:50.715560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.593186+0000","last_change":"2024-03-29T04:08:12.586895+0000","last_active":"2024-03-29T04:08:12.593186+0000","last_peered":"2024-03-29T04:08:12.593186+0000","last_clean":"2024-03-29T04:08:12.593186+0000","last_became_active":"2024-03-29T04:08:12.586616+0000","last_became_peered":"2024-03-29T04:08:12.586616+0000","last_unstale":"2024-03-29T04:08:12.593186+0000","last_undegraded":"2024-03-29T04:08:12.593186+0000","last_fullsized":"2024-03-29T04:08:12.593186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T16:04:15.396729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.586096+0000","last_change":"2024-03-29T04:08:11.581036+0000","last_active":"2024-03-29T04:08:12.586096+0000","last_peered":"2024-03-29T04:08:12.586096+0000","last_clean":"2024-03-29T04:08:12.586096+0000","last_became_active":"2024-03-29T04:08:11.580771+0000","last_became_peered":"2024-03-29T04:08:11.580771+0000","last_unstale":"2024-03-29T04:08:12.586096+0000","last_undegraded":"2024-03-29T04:08:12.586096+0000","last_fullsized":"2024-03-29T04:08:12.586096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T13:31:02.796965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.594919+0000","last_change":"2024-03-29T04:08:12.591216+0000","last_active":"2024-03-29T04:08:12.594919+0000","last_peered":"2024-03-29T04:08:12.594919+0000","last_clean":"2024-03-29T04:08:12.594919+0000","last_became_active":"2024-03-29T04:08:12.590900+0000","last_became_peered":"2024-03-29T04:08:12.590900+0000","last_unstale":"2024-03-29T04:08:12.594919+0000","last_undegraded":"2024-03-29T04:08:12.594919+0000","last_fullsized":"2024-03-29T04:08:12.594919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:46:43.492166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.590220+0000","last_change":"2024-03-29T04:08:11.578220+0000","last_active":"2024-03-29T04:08:12.590220+0000","last_peered":"2024-03-29T04:08:12.590220+0000","last_clean":"2024-03-29T04:08:12.590220+0000","last_became_active":"2024-03-29T04:08:11.577710+0000","last_became_peered":"2024-03-29T04:08:11.577710+0000","last_unstale":"2024-03-29T04:08:12.590220+0000","last_undegraded":"2024-03-29T04:08:12.590220+0000","last_fullsized":"2024-03-29T04:08:12.590220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:04:46.456846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.569215+0000","last_change":"2024-03-29T04:08:11.579579+0000","last_active":"2024-03-29T04:08:12.569215+0000","last_peered":"2024-03-29T04:08:12.569215+0000","last_clean":"2024-03-29T04:08:12.569215+0000","last_became_active":"2024-03-29T04:08:11.578445+0000","last_became_peered":"2024-03-29T04:08:11.578445+0000","last_unstale":"2024-03-29T04:08:12.569215+0000","last_undegraded":"2024-03-29T04:08:12.569215+0000","last_fullsized":"2024-03-29T04:08:12.569215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T10:32:34.230140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.589569+0000","last_change":"2024-03-29T04:08:12.587465+0000","last_active":"2024-03-29T04:08:12.589569+0000","last_peered":"2024-03-29T04:08:12.589569+0000","last_clean":"2024-03-29T04:08:12.589569+0000","last_became_active":"2024-03-29T04:08:12.587202+0000","last_became_peered":"2024-03-29T04:08:12.587202+0000","last_unstale":"2024-03-29T04:08:12.589569+0000","last_undegraded":"2024-03-29T04:08:12.589569+0000","last_fullsized":"2024-03-29T04:08:12.589569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:39:27.893573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.581862+0000","last_change":"2024-03-29T04:08:11.584446+0000","last_active":"2024-03-29T04:08:12.581862+0000","last_peered":"2024-03-29T04:08:12.581862+0000","last_clean":"2024-03-29T04:08:12.581862+0000","last_became_active":"2024-03-29T04:08:11.584105+0000","last_became_peered":"2024-03-29T04:08:11.584105+0000","last_unstale":"2024-03-29T04:08:12.581862+0000","last_undegraded":"2024-03-29T04:08:12.581862+0000","last_fullsized":"2024-03-29T04:08:12.581862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:22:23.215000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.583369+0000","last_change":"2024-03-29T04:08:12.580898+0000","last_active":"2024-03-29T04:08:12.583369+0000","last_peered":"2024-03-29T04:08:12.583369+0000","last_clean":"2024-03-29T04:08:12.583369+0000","last_became_active":"2024-03-29T04:08:12.580579+0000","last_became_peered":"2024-03-29T04:08:12.580579+0000","last_unstale":"2024-03-29T04:08:12.583369+0000","last_undegraded":"2024-03-29T04:08:12.583369+0000","last_fullsized":"2024-03-29T04:08:12.583369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:25:50.715560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.575128+0000","last_change":"2024-03-29T04:08:11.584262+0000","last_active":"2024-03-29T04:08:12.575128+0000","last_peered":"2024-03-29T04:08:12.575128+0000","last_clean":"2024-03-29T04:08:12.575128+0000","last_became_active":"2024-03-29T04:08:11.583668+0000","last_became_peered":"2024-03-29T04:08:11.583668+0000","last_unstale":"2024-03-29T04:08:12.575128+0000","last_undegraded":"2024-03-29T04:08:12.575128+0000","last_fullsized":"2024-03-29T04:08:12.575128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:43:45.627953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.599287+0000","last_change":"2024-03-29T04:08:12.595602+0000","last_active":"2024-03-29T04:08:12.599287+0000","last_peered":"2024-03-29T04:08:12.599287+0000","last_clean":"2024-03-29T04:08:12.599287+0000","last_became_active":"2024-03-29T04:08:12.595332+0000","last_became_peered":"2024-03-29T04:08:12.595332+0000","last_unstale":"2024-03-29T04:08:12.599287+0000","last_undegraded":"2024-03-29T04:08:12.599287+0000","last_fullsized":"2024-03-29T04:08:12.599287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:47:13.560160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.579243+0000","last_change":"2024-03-29T04:08:11.586122+0000","last_active":"2024-03-29T04:08:12.579243+0000","last_peered":"2024-03-29T04:08:12.579243+0000","last_clean":"2024-03-29T04:08:12.579243+0000","last_became_active":"2024-03-29T04:08:11.585845+0000","last_became_peered":"2024-03-29T04:08:11.585845+0000","last_unstale":"2024-03-29T04:08:12.579243+0000","last_undegraded":"2024-03-29T04:08:12.579243+0000","last_fullsized":"2024-03-29T04:08:12.579243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:43:45.627953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.594974+0000","last_change":"2024-03-29T04:08:12.591051+0000","last_active":"2024-03-29T04:08:12.594974+0000","last_peered":"2024-03-29T04:08:12.594974+0000","last_clean":"2024-03-29T04:08:12.594974+0000","last_became_active":"2024-03-29T04:08:12.590728+0000","last_became_peered":"2024-03-29T04:08:12.590728+0000","last_unstale":"2024-03-29T04:08:12.594974+0000","last_undegraded":"2024-03-29T04:08:12.594974+0000","last_fullsized":"2024-03-29T04:08:12.594974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:39:27.893573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.590397+0000","last_change":"2024-03-29T04:08:11.583944+0000","last_active":"2024-03-29T04:08:12.590397+0000","last_peered":"2024-03-29T04:08:12.590397+0000","last_clean":"2024-03-29T04:08:12.590397+0000","last_became_active":"2024-03-29T04:08:11.583666+0000","last_became_peered":"2024-03-29T04:08:11.583666+0000","last_unstale":"2024-03-29T04:08:12.590397+0000","last_undegraded":"2024-03-29T04:08:12.590397+0000","last_fullsized":"2024-03-29T04:08:12.590397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:04:46.456846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.593273+0000","last_change":"2024-03-29T04:08:12.590849+0000","last_active":"2024-03-29T04:08:12.593273+0000","last_peered":"2024-03-29T04:08:12.593273+0000","last_clean":"2024-03-29T04:08:12.593273+0000","last_became_active":"2024-03-29T04:08:12.590510+0000","last_became_peered":"2024-03-29T04:08:12.590510+0000","last_unstale":"2024-03-29T04:08:12.593273+0000","last_undegraded":"2024-03-29T04:08:12.593273+0000","last_fullsized":"2024-03-29T04:08:12.593273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:43:46.637919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.596890+0000","last_change":"2024-03-29T04:08:11.579283+0000","last_active":"2024-03-29T04:08:12.596890+0000","last_peered":"2024-03-29T04:08:12.596890+0000","last_clean":"2024-03-29T04:08:12.596890+0000","last_became_active":"2024-03-29T04:08:11.578990+0000","last_became_peered":"2024-03-29T04:08:11.578990+0000","last_unstale":"2024-03-29T04:08:12.596890+0000","last_undegraded":"2024-03-29T04:08:12.596890+0000","last_fullsized":"2024-03-29T04:08:12.596890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T13:31:02.796965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.591534+0000","last_change":"2024-03-29T04:08:12.586665+0000","last_active":"2024-03-29T04:08:12.591534+0000","last_peered":"2024-03-29T04:08:12.591534+0000","last_clean":"2024-03-29T04:08:12.591534+0000","last_became_active":"2024-03-29T04:08:12.586394+0000","last_became_peered":"2024-03-29T04:08:12.586394+0000","last_unstale":"2024-03-29T04:08:12.591534+0000","last_undegraded":"2024-03-29T04:08:12.591534+0000","last_fullsized":"2024-03-29T04:08:12.591534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:52:01.877649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.594023+0000","last_change":"2024-03-29T04:08:11.581071+0000","last_active":"2024-03-29T04:08:12.594023+0000","last_peered":"2024-03-29T04:08:12.594023+0000","last_clean":"2024-03-29T04:08:12.594023+0000","last_became_active":"2024-03-29T04:08:11.580803+0000","last_became_peered":"2024-03-29T04:08:11.580803+0000","last_unstale":"2024-03-29T04:08:12.594023+0000","last_undegraded":"2024-03-29T04:08:12.594023+0000","last_fullsized":"2024-03-29T04:08:12.594023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T10:32:34.230140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.594884+0000","last_change":"2024-03-29T04:08:12.591431+0000","last_active":"2024-03-29T04:08:12.594884+0000","last_peered":"2024-03-29T04:08:12.594884+0000","last_clean":"2024-03-29T04:08:12.594884+0000","last_became_active":"2024-03-29T04:08:12.591158+0000","last_became_peered":"2024-03-29T04:08:12.591158+0000","last_unstale":"2024-03-29T04:08:12.594884+0000","last_undegraded":"2024-03-29T04:08:12.594884+0000","last_fullsized":"2024-03-29T04:08:12.594884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:25:50.715560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.585194+0000","last_change":"2024-03-29T04:08:11.585963+0000","last_active":"2024-03-29T04:08:12.585194+0000","last_peered":"2024-03-29T04:08:12.585194+0000","last_clean":"2024-03-29T04:08:12.585194+0000","last_became_active":"2024-03-29T04:08:11.585663+0000","last_became_peered":"2024-03-29T04:08:11.585663+0000","last_unstale":"2024-03-29T04:08:12.585194+0000","last_undegraded":"2024-03-29T04:08:12.585194+0000","last_fullsized":"2024-03-29T04:08:12.585194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:29:57.151204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.598104+0000","last_change":"2024-03-29T04:08:12.593510+0000","last_active":"2024-03-29T04:08:12.598104+0000","last_peered":"2024-03-29T04:08:12.598104+0000","last_clean":"2024-03-29T04:08:12.598104+0000","last_became_active":"2024-03-29T04:08:12.593129+0000","last_became_peered":"2024-03-29T04:08:12.593129+0000","last_unstale":"2024-03-29T04:08:12.598104+0000","last_undegraded":"2024-03-29T04:08:12.598104+0000","last_fullsized":"2024-03-29T04:08:12.598104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T10:10:20.492063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.575398+0000","last_change":"2024-03-29T04:08:11.578269+0000","last_active":"2024-03-29T04:08:12.575398+0000","last_peered":"2024-03-29T04:08:12.575398+0000","last_clean":"2024-03-29T04:08:12.575398+0000","last_became_active":"2024-03-29T04:08:11.578014+0000","last_became_peered":"2024-03-29T04:08:11.578014+0000","last_unstale":"2024-03-29T04:08:12.575398+0000","last_undegraded":"2024-03-29T04:08:12.575398+0000","last_fullsized":"2024-03-29T04:08:12.575398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:29:57.151204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.596941+0000","last_change":"2024-03-29T04:08:12.587831+0000","last_active":"2024-03-29T04:08:12.596941+0000","last_peered":"2024-03-29T04:08:12.596941+0000","last_clean":"2024-03-29T04:08:12.596941+0000","last_became_active":"2024-03-29T04:08:12.587537+0000","last_became_peered":"2024-03-29T04:08:12.587537+0000","last_unstale":"2024-03-29T04:08:12.596941+0000","last_undegraded":"2024-03-29T04:08:12.596941+0000","last_fullsized":"2024-03-29T04:08:12.596941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:39:27.893573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.585401+0000","last_change":"2024-03-29T04:08:11.579486+0000","last_active":"2024-03-29T04:08:12.585401+0000","last_peered":"2024-03-29T04:08:12.585401+0000","last_clean":"2024-03-29T04:08:12.585401+0000","last_became_active":"2024-03-29T04:08:11.579186+0000","last_became_peered":"2024-03-29T04:08:11.579186+0000","last_unstale":"2024-03-29T04:08:12.585401+0000","last_undegraded":"2024-03-29T04:08:12.585401+0000","last_fullsized":"2024-03-29T04:08:12.585401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T16:04:14.386764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.597995+0000","last_change":"2024-03-29T04:08:12.593018+0000","last_active":"2024-03-29T04:08:12.597995+0000","last_peered":"2024-03-29T04:08:12.597995+0000","last_clean":"2024-03-29T04:08:12.597995+0000","last_became_active":"2024-03-29T04:08:12.592716+0000","last_became_peered":"2024-03-29T04:08:12.592716+0000","last_unstale":"2024-03-29T04:08:12.597995+0000","last_undegraded":"2024-03-29T04:08:12.597995+0000","last_fullsized":"2024-03-29T04:08:12.597995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:51:30.023734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.589570+0000","last_change":"2024-03-29T04:08:11.579702+0000","last_active":"2024-03-29T04:08:12.589570+0000","last_peered":"2024-03-29T04:08:12.589570+0000","last_clean":"2024-03-29T04:08:12.589570+0000","last_became_active":"2024-03-29T04:08:11.579407+0000","last_became_peered":"2024-03-29T04:08:11.579407+0000","last_unstale":"2024-03-29T04:08:12.589570+0000","last_undegraded":"2024-03-29T04:08:12.589570+0000","last_fullsized":"2024-03-29T04:08:12.589570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:58:15.647153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.597816+0000","last_change":"2024-03-29T04:08:12.592883+0000","last_active":"2024-03-29T04:08:12.597816+0000","last_peered":"2024-03-29T04:08:12.597816+0000","last_clean":"2024-03-29T04:08:12.597816+0000","last_became_active":"2024-03-29T04:08:12.592611+0000","last_became_peered":"2024-03-29T04:08:12.592611+0000","last_unstale":"2024-03-29T04:08:12.597816+0000","last_undegraded":"2024-03-29T04:08:12.597816+0000","last_fullsized":"2024-03-29T04:08:12.597816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:23:55.560819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.584906+0000","last_change":"2024-03-29T04:08:11.581905+0000","last_active":"2024-03-29T04:08:12.584906+0000","last_peered":"2024-03-29T04:08:12.584906+0000","last_clean":"2024-03-29T04:08:12.584906+0000","last_became_active":"2024-03-29T04:08:11.581367+0000","last_became_peered":"2024-03-29T04:08:11.581367+0000","last_unstale":"2024-03-29T04:08:12.584906+0000","last_undegraded":"2024-03-29T04:08:12.584906+0000","last_fullsized":"2024-03-29T04:08:12.584906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:43:45.627953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.597955+0000","last_change":"2024-03-29T04:08:12.592388+0000","last_active":"2024-03-29T04:08:12.597955+0000","last_peered":"2024-03-29T04:08:12.597955+0000","last_clean":"2024-03-29T04:08:12.597955+0000","last_became_active":"2024-03-29T04:08:12.592126+0000","last_became_peered":"2024-03-29T04:08:12.592126+0000","last_unstale":"2024-03-29T04:08:12.597955+0000","last_undegraded":"2024-03-29T04:08:12.597955+0000","last_fullsized":"2024-03-29T04:08:12.597955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:44:46.187079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.597089+0000","last_change":"2024-03-29T04:08:11.574823+0000","last_active":"2024-03-29T04:08:12.597089+0000","last_peered":"2024-03-29T04:08:12.597089+0000","last_clean":"2024-03-29T04:08:12.597089+0000","last_became_active":"2024-03-29T04:08:11.574536+0000","last_became_peered":"2024-03-29T04:08:11.574536+0000","last_unstale":"2024-03-29T04:08:12.597089+0000","last_undegraded":"2024-03-29T04:08:12.597089+0000","last_fullsized":"2024-03-29T04:08:12.597089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:39:26.883608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.599124+0000","last_change":"2024-03-29T04:08:12.595008+0000","last_active":"2024-03-29T04:08:12.599124+0000","last_peered":"2024-03-29T04:08:12.599124+0000","last_clean":"2024-03-29T04:08:12.599124+0000","last_became_active":"2024-03-29T04:08:12.594429+0000","last_became_peered":"2024-03-29T04:08:12.594429+0000","last_unstale":"2024-03-29T04:08:12.599124+0000","last_undegraded":"2024-03-29T04:08:12.599124+0000","last_fullsized":"2024-03-29T04:08:12.599124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:46:43.492166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.574443+0000","last_change":"2024-03-29T04:08:11.584568+0000","last_active":"2024-03-29T04:08:12.574443+0000","last_peered":"2024-03-29T04:08:12.574443+0000","last_clean":"2024-03-29T04:08:12.574443+0000","last_became_active":"2024-03-29T04:08:11.584246+0000","last_became_peered":"2024-03-29T04:08:11.584246+0000","last_unstale":"2024-03-29T04:08:12.574443+0000","last_undegraded":"2024-03-29T04:08:12.574443+0000","last_fullsized":"2024-03-29T04:08:12.574443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T13:31:02.796965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.599209+0000","last_change":"2024-03-29T04:08:12.597064+0000","last_active":"2024-03-29T04:08:12.599209+0000","last_peered":"2024-03-29T04:08:12.599209+0000","last_clean":"2024-03-29T04:08:12.599209+0000","last_became_active":"2024-03-29T04:08:12.596790+0000","last_became_peered":"2024-03-29T04:08:12.596790+0000","last_unstale":"2024-03-29T04:08:12.599209+0000","last_undegraded":"2024-03-29T04:08:12.599209+0000","last_fullsized":"2024-03-29T04:08:12.599209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:50:17.616748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.575629+0000","last_change":"2024-03-29T04:08:01.885311+0000","last_active":"2024-03-29T04:08:12.575629+0000","last_peered":"2024-03-29T04:08:12.575629+0000","last_clean":"2024-03-29T04:08:12.575629+0000","last_became_active":"2024-03-29T04:08:01.884340+0000","last_became_peered":"2024-03-29T04:08:01.884340+0000","last_unstale":"2024-03-29T04:08:12.575629+0000","last_undegraded":"2024-03-29T04:08:12.575629+0000","last_fullsized":"2024-03-29T04:08:12.575629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:00.511520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:00.511520+0000","last_clean_scrub_stamp":"2024-03-29T04:08:00.511520+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:40:25.245419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.576962+0000","last_change":"2024-03-29T04:08:11.585258+0000","last_active":"2024-03-29T04:08:12.576962+0000","last_peered":"2024-03-29T04:08:12.576962+0000","last_clean":"2024-03-29T04:08:12.576962+0000","last_became_active":"2024-03-29T04:08:11.584935+0000","last_became_peered":"2024-03-29T04:08:11.584935+0000","last_unstale":"2024-03-29T04:08:12.576962+0000","last_undegraded":"2024-03-29T04:08:12.576962+0000","last_fullsized":"2024-03-29T04:08:12.576962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T13:31:02.796965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.597037+0000","last_change":"2024-03-29T04:08:12.594912+0000","last_active":"2024-03-29T04:08:12.597037+0000","last_peered":"2024-03-29T04:08:12.597037+0000","last_clean":"2024-03-29T04:08:12.597037+0000","last_became_active":"2024-03-29T04:08:12.594603+0000","last_became_peered":"2024-03-29T04:08:12.594603+0000","last_unstale":"2024-03-29T04:08:12.597037+0000","last_undegraded":"2024-03-29T04:08:12.597037+0000","last_fullsized":"2024-03-29T04:08:12.597037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:47:13.560160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.575567+0000","last_change":"2024-03-29T04:08:11.586269+0000","last_active":"2024-03-29T04:08:12.575567+0000","last_peered":"2024-03-29T04:08:12.575567+0000","last_clean":"2024-03-29T04:08:12.575567+0000","last_became_active":"2024-03-29T04:08:11.585746+0000","last_became_peered":"2024-03-29T04:08:11.585746+0000","last_unstale":"2024-03-29T04:08:12.575567+0000","last_undegraded":"2024-03-29T04:08:12.575567+0000","last_fullsized":"2024-03-29T04:08:12.575567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:29:57.151204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.594760+0000","last_change":"2024-03-29T04:08:12.590744+0000","last_active":"2024-03-29T04:08:12.594760+0000","last_peered":"2024-03-29T04:08:12.594760+0000","last_clean":"2024-03-29T04:08:12.594760+0000","last_became_active":"2024-03-29T04:08:12.590441+0000","last_became_peered":"2024-03-29T04:08:12.590441+0000","last_unstale":"2024-03-29T04:08:12.594760+0000","last_undegraded":"2024-03-29T04:08:12.594760+0000","last_fullsized":"2024-03-29T04:08:12.594760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:04:47.466811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.581459+0000","last_change":"2024-03-29T04:08:11.581639+0000","last_active":"2024-03-29T04:08:12.581459+0000","last_peered":"2024-03-29T04:08:12.581459+0000","last_clean":"2024-03-29T04:08:12.581459+0000","last_became_active":"2024-03-29T04:08:11.581291+0000","last_became_peered":"2024-03-29T04:08:11.581291+0000","last_unstale":"2024-03-29T04:08:12.581459+0000","last_undegraded":"2024-03-29T04:08:12.581459+0000","last_fullsized":"2024-03-29T04:08:12.581459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:22:23.215000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.594202+0000","last_change":"2024-03-29T04:08:12.584723+0000","last_active":"2024-03-29T04:08:12.594202+0000","last_peered":"2024-03-29T04:08:12.594202+0000","last_clean":"2024-03-29T04:08:12.594202+0000","last_became_active":"2024-03-29T04:08:12.584466+0000","last_became_peered":"2024-03-29T04:08:12.584466+0000","last_unstale":"2024-03-29T04:08:12.594202+0000","last_undegraded":"2024-03-29T04:08:12.594202+0000","last_fullsized":"2024-03-29T04:08:12.594202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:44:46.187079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.585338+0000","last_change":"2024-03-29T04:08:11.587034+0000","last_active":"2024-03-29T04:08:12.585338+0000","last_peered":"2024-03-29T04:08:12.585338+0000","last_clean":"2024-03-29T04:08:12.585338+0000","last_became_active":"2024-03-29T04:08:11.586720+0000","last_became_peered":"2024-03-29T04:08:11.586720+0000","last_unstale":"2024-03-29T04:08:12.585338+0000","last_undegraded":"2024-03-29T04:08:12.585338+0000","last_fullsized":"2024-03-29T04:08:12.585338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:04:46.456846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.593447+0000","last_change":"2024-03-29T04:08:12.591148+0000","last_active":"2024-03-29T04:08:12.593447+0000","last_peered":"2024-03-29T04:08:12.593447+0000","last_clean":"2024-03-29T04:08:12.593447+0000","last_became_active":"2024-03-29T04:08:12.590076+0000","last_became_peered":"2024-03-29T04:08:12.590076+0000","last_unstale":"2024-03-29T04:08:12.593447+0000","last_undegraded":"2024-03-29T04:08:12.593447+0000","last_fullsized":"2024-03-29T04:08:12.593447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:22:24.224965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.568984+0000","last_change":"2024-03-29T04:08:11.582158+0000","last_active":"2024-03-29T04:08:12.568984+0000","last_peered":"2024-03-29T04:08:12.568984+0000","last_clean":"2024-03-29T04:08:12.568984+0000","last_became_active":"2024-03-29T04:08:11.581893+0000","last_became_peered":"2024-03-29T04:08:11.581893+0000","last_unstale":"2024-03-29T04:08:12.568984+0000","last_undegraded":"2024-03-29T04:08:12.568984+0000","last_fullsized":"2024-03-29T04:08:12.568984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:22:23.215000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.599108+0000","last_change":"2024-03-29T04:08:12.595023+0000","last_active":"2024-03-29T04:08:12.599108+0000","last_peered":"2024-03-29T04:08:12.599108+0000","last_clean":"2024-03-29T04:08:12.599108+0000","last_became_active":"2024-03-29T04:08:12.594277+0000","last_became_peered":"2024-03-29T04:08:12.594277+0000","last_unstale":"2024-03-29T04:08:12.599108+0000","last_undegraded":"2024-03-29T04:08:12.599108+0000","last_fullsized":"2024-03-29T04:08:12.599108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:25:50.715560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.578471+0000","last_change":"2024-03-29T04:08:11.586951+0000","last_active":"2024-03-29T04:08:12.578471+0000","last_peered":"2024-03-29T04:08:12.578471+0000","last_clean":"2024-03-29T04:08:12.578471+0000","last_became_active":"2024-03-29T04:08:11.586654+0000","last_became_peered":"2024-03-29T04:08:11.586654+0000","last_unstale":"2024-03-29T04:08:12.578471+0000","last_undegraded":"2024-03-29T04:08:12.578471+0000","last_fullsized":"2024-03-29T04:08:12.578471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:46:42.482201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.590095+0000","last_change":"2024-03-29T04:08:12.584288+0000","last_active":"2024-03-29T04:08:12.590095+0000","last_peered":"2024-03-29T04:08:12.590095+0000","last_clean":"2024-03-29T04:08:12.590095+0000","last_became_active":"2024-03-29T04:08:12.584022+0000","last_became_peered":"2024-03-29T04:08:12.584022+0000","last_unstale":"2024-03-29T04:08:12.590095+0000","last_undegraded":"2024-03-29T04:08:12.590095+0000","last_fullsized":"2024-03-29T04:08:12.590095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:47:13.560160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.569003+0000","last_change":"2024-03-29T04:08:11.575033+0000","last_active":"2024-03-29T04:08:12.569003+0000","last_peered":"2024-03-29T04:08:12.569003+0000","last_clean":"2024-03-29T04:08:12.569003+0000","last_became_active":"2024-03-29T04:08:11.574736+0000","last_became_peered":"2024-03-29T04:08:11.574736+0000","last_unstale":"2024-03-29T04:08:12.569003+0000","last_undegraded":"2024-03-29T04:08:12.569003+0000","last_fullsized":"2024-03-29T04:08:12.569003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:29:57.151204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.593188+0000","last_change":"2024-03-29T04:08:12.592175+0000","last_active":"2024-03-29T04:08:12.593188+0000","last_peered":"2024-03-29T04:08:12.593188+0000","last_clean":"2024-03-29T04:08:12.593188+0000","last_became_active":"2024-03-29T04:08:12.591851+0000","last_became_peered":"2024-03-29T04:08:12.591851+0000","last_unstale":"2024-03-29T04:08:12.593188+0000","last_undegraded":"2024-03-29T04:08:12.593188+0000","last_fullsized":"2024-03-29T04:08:12.593188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:15:10.072949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.593838+0000","last_change":"2024-03-29T04:08:11.581692+0000","last_active":"2024-03-29T04:08:12.593838+0000","last_peered":"2024-03-29T04:08:12.593838+0000","last_clean":"2024-03-29T04:08:12.593838+0000","last_became_active":"2024-03-29T04:08:11.580542+0000","last_became_peered":"2024-03-29T04:08:11.580542+0000","last_unstale":"2024-03-29T04:08:12.593838+0000","last_undegraded":"2024-03-29T04:08:12.593838+0000","last_fullsized":"2024-03-29T04:08:12.593838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:22:23.215000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.594056+0000","last_change":"2024-03-29T04:08:12.584745+0000","last_active":"2024-03-29T04:08:12.594056+0000","last_peered":"2024-03-29T04:08:12.594056+0000","last_clean":"2024-03-29T04:08:12.594056+0000","last_became_active":"2024-03-29T04:08:12.584417+0000","last_became_peered":"2024-03-29T04:08:12.584417+0000","last_unstale":"2024-03-29T04:08:12.594056+0000","last_undegraded":"2024-03-29T04:08:12.594056+0000","last_fullsized":"2024-03-29T04:08:12.594056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:29:58.161169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.575625+0000","last_change":"2024-03-29T04:08:11.587081+0000","last_active":"2024-03-29T04:08:12.575625+0000","last_peered":"2024-03-29T04:08:12.575625+0000","last_clean":"2024-03-29T04:08:12.575625+0000","last_became_active":"2024-03-29T04:08:11.586729+0000","last_became_peered":"2024-03-29T04:08:11.586729+0000","last_unstale":"2024-03-29T04:08:12.575625+0000","last_undegraded":"2024-03-29T04:08:12.575625+0000","last_fullsized":"2024-03-29T04:08:12.575625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:04:46.456846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.593118+0000","last_change":"2024-03-29T04:08:12.586216+0000","last_active":"2024-03-29T04:08:12.593118+0000","last_peered":"2024-03-29T04:08:12.593118+0000","last_clean":"2024-03-29T04:08:12.593118+0000","last_became_active":"2024-03-29T04:08:12.585834+0000","last_became_peered":"2024-03-29T04:08:12.585834+0000","last_unstale":"2024-03-29T04:08:12.593118+0000","last_undegraded":"2024-03-29T04:08:12.593118+0000","last_fullsized":"2024-03-29T04:08:12.593118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T10:32:35.240105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.569795+0000","last_change":"2024-03-29T04:08:11.580924+0000","last_active":"2024-03-29T04:08:12.569795+0000","last_peered":"2024-03-29T04:08:12.569795+0000","last_clean":"2024-03-29T04:08:12.569795+0000","last_became_active":"2024-03-29T04:08:11.580668+0000","last_became_peered":"2024-03-29T04:08:11.580668+0000","last_unstale":"2024-03-29T04:08:12.569795+0000","last_undegraded":"2024-03-29T04:08:12.569795+0000","last_fullsized":"2024-03-29T04:08:12.569795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:46:42.482201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.584397+0000","last_change":"2024-03-29T04:08:12.582417+0000","last_active":"2024-03-29T04:08:12.584397+0000","last_peered":"2024-03-29T04:08:12.584397+0000","last_clean":"2024-03-29T04:08:12.584397+0000","last_became_active":"2024-03-29T04:08:12.582157+0000","last_became_peered":"2024-03-29T04:08:12.582157+0000","last_unstale":"2024-03-29T04:08:12.584397+0000","last_undegraded":"2024-03-29T04:08:12.584397+0000","last_fullsized":"2024-03-29T04:08:12.584397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:22:24.224965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.568671+0000","last_change":"2024-03-29T04:08:11.579852+0000","last_active":"2024-03-29T04:08:12.568671+0000","last_peered":"2024-03-29T04:08:12.568671+0000","last_clean":"2024-03-29T04:08:12.568671+0000","last_became_active":"2024-03-29T04:08:11.579507+0000","last_became_peered":"2024-03-29T04:08:11.579507+0000","last_unstale":"2024-03-29T04:08:12.568671+0000","last_undegraded":"2024-03-29T04:08:12.568671+0000","last_fullsized":"2024-03-29T04:08:12.568671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:43:45.627953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.589548+0000","last_change":"2024-03-29T04:08:12.586892+0000","last_active":"2024-03-29T04:08:12.589548+0000","last_peered":"2024-03-29T04:08:12.589548+0000","last_clean":"2024-03-29T04:08:12.589548+0000","last_became_active":"2024-03-29T04:08:12.586624+0000","last_became_peered":"2024-03-29T04:08:12.586624+0000","last_unstale":"2024-03-29T04:08:12.589548+0000","last_undegraded":"2024-03-29T04:08:12.589548+0000","last_fullsized":"2024-03-29T04:08:12.589548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:04:47.466811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.592723+0000","last_change":"2024-03-29T04:08:11.583745+0000","last_active":"2024-03-29T04:08:12.592723+0000","last_peered":"2024-03-29T04:08:12.592723+0000","last_clean":"2024-03-29T04:08:12.592723+0000","last_became_active":"2024-03-29T04:08:11.583507+0000","last_became_peered":"2024-03-29T04:08:11.583507+0000","last_unstale":"2024-03-29T04:08:12.592723+0000","last_undegraded":"2024-03-29T04:08:12.592723+0000","last_fullsized":"2024-03-29T04:08:12.592723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:39:26.883608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.596887+0000","last_change":"2024-03-29T04:08:12.590902+0000","last_active":"2024-03-29T04:08:12.596887+0000","last_peered":"2024-03-29T04:08:12.596887+0000","last_clean":"2024-03-29T04:08:12.596887+0000","last_became_active":"2024-03-29T04:08:12.590480+0000","last_became_peered":"2024-03-29T04:08:12.590480+0000","last_unstale":"2024-03-29T04:08:12.596887+0000","last_undegraded":"2024-03-29T04:08:12.596887+0000","last_fullsized":"2024-03-29T04:08:12.596887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:47:13.560160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.599128+0000","last_change":"2024-03-29T04:08:12.595229+0000","last_active":"2024-03-29T04:08:12.599128+0000","last_peered":"2024-03-29T04:08:12.599128+0000","last_clean":"2024-03-29T04:08:12.599128+0000","last_became_active":"2024-03-29T04:08:12.594665+0000","last_became_peered":"2024-03-29T04:08:12.594665+0000","last_unstale":"2024-03-29T04:08:12.599128+0000","last_undegraded":"2024-03-29T04:08:12.599128+0000","last_fullsized":"2024-03-29T04:08:12.599128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:15:10.072949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.596515+0000","last_change":"2024-03-29T04:08:11.587908+0000","last_active":"2024-03-29T04:08:12.596515+0000","last_peered":"2024-03-29T04:08:12.596515+0000","last_clean":"2024-03-29T04:08:12.596515+0000","last_became_active":"2024-03-29T04:08:11.587602+0000","last_became_peered":"2024-03-29T04:08:11.587602+0000","last_unstale":"2024-03-29T04:08:12.596515+0000","last_undegraded":"2024-03-29T04:08:12.596515+0000","last_fullsized":"2024-03-29T04:08:12.596515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:22:23.215000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.603297+0000","last_change":"2024-03-29T04:08:12.598292+0000","last_active":"2024-03-29T04:08:12.603297+0000","last_peered":"2024-03-29T04:08:12.603297+0000","last_clean":"2024-03-29T04:08:12.603297+0000","last_became_active":"2024-03-29T04:08:12.594781+0000","last_became_peered":"2024-03-29T04:08:12.594781+0000","last_unstale":"2024-03-29T04:08:12.603297+0000","last_undegraded":"2024-03-29T04:08:12.603297+0000","last_fullsized":"2024-03-29T04:08:12.603297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:51:30.023734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.591481+0000","last_change":"2024-03-29T04:08:11.583436+0000","last_active":"2024-03-29T04:08:12.591481+0000","last_peered":"2024-03-29T04:08:12.591481+0000","last_clean":"2024-03-29T04:08:12.591481+0000","last_became_active":"2024-03-29T04:08:11.583187+0000","last_became_peered":"2024-03-29T04:08:11.583187+0000","last_unstale":"2024-03-29T04:08:12.591481+0000","last_undegraded":"2024-03-29T04:08:12.591481+0000","last_fullsized":"2024-03-29T04:08:12.591481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:25:49.705595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.594991+0000","last_change":"2024-03-29T04:08:12.591815+0000","last_active":"2024-03-29T04:08:12.594991+0000","last_peered":"2024-03-29T04:08:12.594991+0000","last_clean":"2024-03-29T04:08:12.594991+0000","last_became_active":"2024-03-29T04:08:12.590845+0000","last_became_peered":"2024-03-29T04:08:12.590845+0000","last_unstale":"2024-03-29T04:08:12.594991+0000","last_undegraded":"2024-03-29T04:08:12.594991+0000","last_fullsized":"2024-03-29T04:08:12.594991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:15:10.072949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.581199+0000","last_change":"2024-03-29T04:08:11.583808+0000","last_active":"2024-03-29T04:08:12.581199+0000","last_peered":"2024-03-29T04:08:12.581199+0000","last_clean":"2024-03-29T04:08:12.581199+0000","last_became_active":"2024-03-29T04:08:11.583401+0000","last_became_peered":"2024-03-29T04:08:11.583401+0000","last_unstale":"2024-03-29T04:08:12.581199+0000","last_undegraded":"2024-03-29T04:08:12.581199+0000","last_fullsized":"2024-03-29T04:08:12.581199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T16:04:14.386764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.585869+0000","last_change":"2024-03-29T04:08:12.583667+0000","last_active":"2024-03-29T04:08:12.585869+0000","last_peered":"2024-03-29T04:08:12.585869+0000","last_clean":"2024-03-29T04:08:12.585869+0000","last_became_active":"2024-03-29T04:08:12.583396+0000","last_became_peered":"2024-03-29T04:08:12.583396+0000","last_unstale":"2024-03-29T04:08:12.585869+0000","last_undegraded":"2024-03-29T04:08:12.585869+0000","last_fullsized":"2024-03-29T04:08:12.585869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:29:58.161169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.594012+0000","last_change":"2024-03-29T04:08:11.583448+0000","last_active":"2024-03-29T04:08:12.594012+0000","last_peered":"2024-03-29T04:08:12.594012+0000","last_clean":"2024-03-29T04:08:12.594012+0000","last_became_active":"2024-03-29T04:08:11.583190+0000","last_became_peered":"2024-03-29T04:08:11.583190+0000","last_unstale":"2024-03-29T04:08:12.594012+0000","last_undegraded":"2024-03-29T04:08:12.594012+0000","last_fullsized":"2024-03-29T04:08:12.594012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T16:04:14.386764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":660255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":70917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":69395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":69431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":70917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":69305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":69465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":660311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-29T04:08:15.536 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-29T04:08:15.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.691+0000 7fd344088640 1 Processor -- start 2024-03-29T04:08:15.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.692+0000 7fd344088640 1 -- start start 2024-03-29T04:08:15.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.692+0000 7fd344088640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd33c0b3c50 0x7fd33c0d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:15.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.692+0000 7fd344088640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd33c0cfb30 con 0x7fd33c0d3140 2024-03-29T04:08:15.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.692+0000 7fd344088640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd33c0cfe10 con 0x7fd33c15e930 2024-03-29T04:08:15.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.692+0000 7fd344088640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd33c0d3590 con 0x7fd33c0b3c50 2024-03-29T04:08:15.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.693+0000 7fd342625640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd33c0d3140 0x7fd33c06cc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58934/0 (socket says 172.21.15.73:58934) 2024-03-29T04:08:15.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.693+0000 7fd342625640 1 -- 172.21.15.73:0/487899777 learned_addr learned my addr 172.21.15.73:0/487899777 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:15.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.693+0000 7fd341623640 1 --2- 172.21.15.73:0/487899777 >> v2:172.21.15.142:3300/0 conn(0x7fd33c0b3c50 0x7fd33c0d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:15.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.693+0000 7fd340e22640 1 -- 172.21.15.73:0/487899777 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1636510746 0 0) 0x7fd33c0cfb30 con 0x7fd33c0d3140 2024-03-29T04:08:15.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.693+0000 7fd340e22640 1 -- 172.21.15.73:0/487899777 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd328003520 con 0x7fd33c0d3140 2024-03-29T04:08:15.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.693+0000 7fd341623640 1 -- 172.21.15.73:0/487899777 >> v1:172.21.15.142:6789/0 conn(0x7fd33c15e930 legacy=0x7fd33c0cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:15.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.693+0000 7fd341623640 1 -- 172.21.15.73:0/487899777 >> v1:172.21.15.73:6789/0 conn(0x7fd33c0d3140 legacy=0x7fd33c06cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:15.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.693+0000 7fd341623640 1 -- 172.21.15.73:0/487899777 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd33c0d00f0 con 0x7fd33c0b3c50 2024-03-29T04:08:15.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.694+0000 7fd341623640 1 --2- 172.21.15.73:0/487899777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd33c0b3c50 0x7fd33c0d2c00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd3380097a0 tx=0x7fd33802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34cd9ade79af5947 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:15.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.694+0000 7fd340e22640 1 -- 172.21.15.73:0/487899777 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd338035020 con 0x7fd33c0b3c50 2024-03-29T04:08:15.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.694+0000 7fd340e22640 1 -- 172.21.15.73:0/487899777 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd338031830 con 0x7fd33c0b3c50 2024-03-29T04:08:15.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.694+0000 7fd340e22640 1 -- 172.21.15.73:0/487899777 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd338031be0 con 0x7fd33c0b3c50 2024-03-29T04:08:15.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.694+0000 7fd344088640 1 -- 172.21.15.73:0/487899777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd33c0b3c50 msgr2=0x7fd33c0d2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:15.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.694+0000 7fd344088640 1 --2- 172.21.15.73:0/487899777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd33c0b3c50 0x7fd33c0d2c00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd3380097a0 tx=0x7fd33802b8d0 comp rx=0 tx=0).stop 2024-03-29T04:08:15.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.694+0000 7fd344088640 1 -- 172.21.15.73:0/487899777 shutdown_connections 2024-03-29T04:08:15.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.694+0000 7fd344088640 1 --2- 172.21.15.73:0/487899777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd33c0b3c50 0x7fd33c0d2c00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:15.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.694+0000 7fd344088640 1 -- 172.21.15.73:0/487899777 >> 172.21.15.73:0/487899777 conn(0x7fd33c08bfc0 msgr2=0x7fd33c0d4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:15.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.694+0000 7fd344088640 1 -- 172.21.15.73:0/487899777 shutdown_connections 2024-03-29T04:08:15.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.694+0000 7fd344088640 1 -- 172.21.15.73:0/487899777 wait complete. 2024-03-29T04:08:15.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.696+0000 7fd344088640 1 Processor -- start 2024-03-29T04:08:15.676 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.696+0000 7fd344088640 1 -- start start 2024-03-29T04:08:15.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.696+0000 7fd344088640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd33c0b3c50 0x7fd33c160b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:15.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.696+0000 7fd344088640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd33c0d3140 0x7fd33c14ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:15.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.696+0000 7fd344088640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd33c15e930 0x7fd33c15f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:15.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.696+0000 7fd344088640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd33c0cf840 con 0x7fd33c0d3140 2024-03-29T04:08:15.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.696+0000 7fd344088640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd33c06c780 con 0x7fd33c0b3c50 2024-03-29T04:08:15.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.696+0000 7fd344088640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd33c15ed10 con 0x7fd33c15e930 2024-03-29T04:08:15.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.696+0000 7fd341623640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd33c0d3140 0x7fd33c14ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:15.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.696+0000 7fd341623640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd33c0d3140 0x7fd33c14ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45778/0 (socket says 172.21.15.73:45778) 2024-03-29T04:08:15.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.696+0000 7fd341623640 1 -- 172.21.15.73:0/3099601752 learned_addr learned my addr 172.21.15.73:0/3099601752 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:15.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.696+0000 7fd342625640 1 --2- 172.21.15.73:0/3099601752 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd33c15e930 0x7fd33c15f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:15.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.696+0000 7fd341e24640 1 --2- 172.21.15.73:0/3099601752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd33c0b3c50 0x7fd33c160b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:15.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.697+0000 7fd341623640 1 -- 172.21.15.73:0/3099601752 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd33c15e930 msgr2=0x7fd33c15f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:15.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.697+0000 7fd341623640 1 --2- 172.21.15.73:0/3099601752 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd33c15e930 0x7fd33c15f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:15.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.697+0000 7fd341623640 1 -- 172.21.15.73:0/3099601752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd33c0b3c50 msgr2=0x7fd33c160b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:15.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.697+0000 7fd341623640 1 --2- 172.21.15.73:0/3099601752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd33c0b3c50 0x7fd33c160b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:15.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.697+0000 7fd341623640 1 -- 172.21.15.73:0/3099601752 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd33c15fac0 con 0x7fd33c0d3140 2024-03-29T04:08:15.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.697+0000 7fd341623640 1 --2- 172.21.15.73:0/3099601752 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd33c0d3140 0x7fd33c14ecf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd3380097a0 tx=0x7fd3380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:15.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.697+0000 7fd3327fc640 1 -- 172.21.15.73:0/3099601752 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd338035070 con 0x7fd33c0d3140 2024-03-29T04:08:15.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.697+0000 7fd3327fc640 1 -- 172.21.15.73:0/3099601752 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd338004230 con 0x7fd33c0d3140 2024-03-29T04:08:15.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.697+0000 7fd344088640 1 -- 172.21.15.73:0/3099601752 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd33c15fda0 con 0x7fd33c0d3140 2024-03-29T04:08:15.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.697+0000 7fd3327fc640 1 -- 172.21.15.73:0/3099601752 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33803a630 con 0x7fd33c0d3140 2024-03-29T04:08:15.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.697+0000 7fd344088640 1 -- 172.21.15.73:0/3099601752 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd33c160360 con 0x7fd33c0d3140 2024-03-29T04:08:15.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.698+0000 7fd344088640 1 -- 172.21.15.73:0/3099601752 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd33c068640 con 0x7fd33c0d3140 2024-03-29T04:08:15.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.698+0000 7fd3327fc640 1 -- 172.21.15.73:0/3099601752 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fd338038020 con 0x7fd33c0d3140 2024-03-29T04:08:15.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.699+0000 7fd3327fc640 1 --2- 172.21.15.73:0/3099601752 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd32006c560 0x7fd32006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:15.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.699+0000 7fd3327fc640 1 -- 172.21.15.73:0/3099601752 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd3380ad120 con 0x7fd33c0d3140 2024-03-29T04:08:15.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.699+0000 7fd341e24640 1 --2- 172.21.15.73:0/3099601752 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd32006c560 0x7fd32006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:15.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.699+0000 7fd341e24640 1 --2- 172.21.15.73:0/3099601752 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd32006c560 0x7fd32006ea20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd32c0016e0 tx=0x7fd32c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:15.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.703+0000 7fd3327fc640 1 -- 172.21.15.73:0/3099601752 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fd338040070 con 0x7fd33c0d3140 2024-03-29T04:08:15.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.878+0000 7fd344088640 1 -- 172.21.15.73:0/3099601752 --> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd33c0b2b80 con 0x7fd32006c560 2024-03-29T04:08:15.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.883+0000 7fd3327fc640 1 -- 172.21.15.73:0/3099601752 <== mgr.4104 v2:172.21.15.73:6832/1640471941 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251878 (secure 0 0 0) 0x7fd33c0b2b80 con 0x7fd32006c560 2024-03-29T04:08:15.866 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:15.867 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-29T04:08:15.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.886+0000 7fd344088640 1 -- 172.21.15.73:0/3099601752 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd32006c560 msgr2=0x7fd32006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:15.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.886+0000 7fd344088640 1 --2- 172.21.15.73:0/3099601752 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd32006c560 0x7fd32006ea20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd32c0016e0 tx=0x7fd32c009040 comp rx=0 tx=0).stop 2024-03-29T04:08:15.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.886+0000 7fd344088640 1 -- 172.21.15.73:0/3099601752 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd33c0d3140 msgr2=0x7fd33c14ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:15.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.886+0000 7fd344088640 1 --2- 172.21.15.73:0/3099601752 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd33c0d3140 0x7fd33c14ecf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd3380097a0 tx=0x7fd3380046c0 comp rx=0 tx=0).stop 2024-03-29T04:08:15.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.886+0000 7fd344088640 1 -- 172.21.15.73:0/3099601752 shutdown_connections 2024-03-29T04:08:15.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.886+0000 7fd344088640 1 --2- 172.21.15.73:0/3099601752 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd33c15e930 0x7fd33c15f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:15.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.886+0000 7fd344088640 1 --2- 172.21.15.73:0/3099601752 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd33c0d3140 0x7fd33c14ecf0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:15.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.886+0000 7fd344088640 1 --2- 172.21.15.73:0/3099601752 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd32006c560 0x7fd32006ea20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:15.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.886+0000 7fd344088640 1 --2- 172.21.15.73:0/3099601752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd33c0b3c50 0x7fd33c160b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:15.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.886+0000 7fd344088640 1 -- 172.21.15.73:0/3099601752 >> 172.21.15.73:0/3099601752 conn(0x7fd33c08bfc0 msgr2=0x7fd33c0b5270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:15.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.886+0000 7fd344088640 1 -- 172.21.15.73:0/3099601752 shutdown_connections 2024-03-29T04:08:15.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:15.886+0000 7fd344088640 1 -- 172.21.15.73:0/3099601752 wait complete. 2024-03-29T04:08:15.876 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-03-29T04:08:15.523414+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218984,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755736,"statfs":{"total":773094113280,"available":772869873664,"internally_reserved":0,"allocated":2891776,"data_stored":1739996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.963649"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.590396+0000","last_change":"2024-03-29T04:08:12.587912+0000","last_active":"2024-03-29T04:08:12.590396+0000","last_peered":"2024-03-29T04:08:12.590396+0000","last_clean":"2024-03-29T04:08:12.590396+0000","last_became_active":"2024-03-29T04:08:12.587593+0000","last_became_peered":"2024-03-29T04:08:12.587593+0000","last_unstale":"2024-03-29T04:08:12.590396+0000","last_undegraded":"2024-03-29T04:08:12.590396+0000","last_fullsized":"2024-03-29T04:08:12.590396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:15:10.072949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.583861+0000","last_change":"2024-03-29T04:08:12.582178+0000","last_active":"2024-03-29T04:08:12.583861+0000","last_peered":"2024-03-29T04:08:12.583861+0000","last_clean":"2024-03-29T04:08:12.583861+0000","last_became_active":"2024-03-29T04:08:12.581920+0000","last_became_peered":"2024-03-29T04:08:12.581920+0000","last_unstale":"2024-03-29T04:08:12.583861+0000","last_undegraded":"2024-03-29T04:08:12.583861+0000","last_fullsized":"2024-03-29T04:08:12.583861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:52:01.877649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.594003+0000","last_change":"2024-03-29T04:08:12.584079+0000","last_active":"2024-03-29T04:08:12.594003+0000","last_peered":"2024-03-29T04:08:12.594003+0000","last_clean":"2024-03-29T04:08:12.594003+0000","last_became_active":"2024-03-29T04:08:12.583240+0000","last_became_peered":"2024-03-29T04:08:12.583240+0000","last_unstale":"2024-03-29T04:08:12.594003+0000","last_undegraded":"2024-03-29T04:08:12.594003+0000","last_fullsized":"2024-03-29T04:08:12.594003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T13:31:03.806930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.603331+0000","last_change":"2024-03-29T04:08:12.595090+0000","last_active":"2024-03-29T04:08:12.603331+0000","last_peered":"2024-03-29T04:08:12.603331+0000","last_clean":"2024-03-29T04:08:12.603331+0000","last_became_active":"2024-03-29T04:08:12.594477+0000","last_became_peered":"2024-03-29T04:08:12.594477+0000","last_unstale":"2024-03-29T04:08:12.603331+0000","last_undegraded":"2024-03-29T04:08:12.603331+0000","last_fullsized":"2024-03-29T04:08:12.603331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:52:01.877649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.598184+0000","last_change":"2024-03-29T04:08:12.595546+0000","last_active":"2024-03-29T04:08:12.598184+0000","last_peered":"2024-03-29T04:08:12.598184+0000","last_clean":"2024-03-29T04:08:12.598184+0000","last_became_active":"2024-03-29T04:08:12.595270+0000","last_became_peered":"2024-03-29T04:08:12.595270+0000","last_unstale":"2024-03-29T04:08:12.598184+0000","last_undegraded":"2024-03-29T04:08:12.598184+0000","last_fullsized":"2024-03-29T04:08:12.598184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:24:45.816098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.603588+0000","last_change":"2024-03-29T04:08:12.598973+0000","last_active":"2024-03-29T04:08:12.603588+0000","last_peered":"2024-03-29T04:08:12.603588+0000","last_clean":"2024-03-29T04:08:12.603588+0000","last_became_active":"2024-03-29T04:08:12.598463+0000","last_became_peered":"2024-03-29T04:08:12.598463+0000","last_unstale":"2024-03-29T04:08:12.603588+0000","last_undegraded":"2024-03-29T04:08:12.603588+0000","last_fullsized":"2024-03-29T04:08:12.603588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:43:58.842293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.596260+0000","last_change":"2024-03-29T04:08:12.590636+0000","last_active":"2024-03-29T04:08:12.596260+0000","last_peered":"2024-03-29T04:08:12.596260+0000","last_clean":"2024-03-29T04:08:12.596260+0000","last_became_active":"2024-03-29T04:08:12.590365+0000","last_became_peered":"2024-03-29T04:08:12.590365+0000","last_unstale":"2024-03-29T04:08:12.596260+0000","last_undegraded":"2024-03-29T04:08:12.596260+0000","last_fullsized":"2024-03-29T04:08:12.596260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:47:13.560160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.597029+0000","last_change":"2024-03-29T04:08:12.594929+0000","last_active":"2024-03-29T04:08:12.597029+0000","last_peered":"2024-03-29T04:08:12.597029+0000","last_clean":"2024-03-29T04:08:12.597029+0000","last_became_active":"2024-03-29T04:08:12.594646+0000","last_became_peered":"2024-03-29T04:08:12.594646+0000","last_unstale":"2024-03-29T04:08:12.597029+0000","last_undegraded":"2024-03-29T04:08:12.597029+0000","last_fullsized":"2024-03-29T04:08:12.597029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:44:46.187079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.599330+0000","last_change":"2024-03-29T04:08:12.597651+0000","last_active":"2024-03-29T04:08:12.599330+0000","last_peered":"2024-03-29T04:08:12.599330+0000","last_clean":"2024-03-29T04:08:12.599330+0000","last_became_active":"2024-03-29T04:08:12.597389+0000","last_became_peered":"2024-03-29T04:08:12.597389+0000","last_unstale":"2024-03-29T04:08:12.599330+0000","last_undegraded":"2024-03-29T04:08:12.599330+0000","last_fullsized":"2024-03-29T04:08:12.599330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T13:00:12.842920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.598028+0000","last_change":"2024-03-29T04:08:12.588278+0000","last_active":"2024-03-29T04:08:12.598028+0000","last_peered":"2024-03-29T04:08:12.598028+0000","last_clean":"2024-03-29T04:08:12.598028+0000","last_became_active":"2024-03-29T04:08:12.587891+0000","last_became_peered":"2024-03-29T04:08:12.587891+0000","last_unstale":"2024-03-29T04:08:12.598028+0000","last_undegraded":"2024-03-29T04:08:12.598028+0000","last_fullsized":"2024-03-29T04:08:12.598028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:46:43.492166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.597048+0000","last_change":"2024-03-29T04:08:12.590703+0000","last_active":"2024-03-29T04:08:12.597048+0000","last_peered":"2024-03-29T04:08:12.597048+0000","last_clean":"2024-03-29T04:08:12.597048+0000","last_became_active":"2024-03-29T04:08:12.590420+0000","last_became_peered":"2024-03-29T04:08:12.590420+0000","last_unstale":"2024-03-29T04:08:12.597048+0000","last_undegraded":"2024-03-29T04:08:12.597048+0000","last_fullsized":"2024-03-29T04:08:12.597048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:15:10.072949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.593217+0000","last_change":"2024-03-29T04:08:12.587297+0000","last_active":"2024-03-29T04:08:12.593217+0000","last_peered":"2024-03-29T04:08:12.593217+0000","last_clean":"2024-03-29T04:08:12.593217+0000","last_became_active":"2024-03-29T04:08:12.587036+0000","last_became_peered":"2024-03-29T04:08:12.587036+0000","last_unstale":"2024-03-29T04:08:12.593217+0000","last_undegraded":"2024-03-29T04:08:12.593217+0000","last_fullsized":"2024-03-29T04:08:12.593217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T13:31:03.806930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.583164+0000","last_change":"2024-03-29T04:08:12.580578+0000","last_active":"2024-03-29T04:08:12.583164+0000","last_peered":"2024-03-29T04:08:12.583164+0000","last_clean":"2024-03-29T04:08:12.583164+0000","last_became_active":"2024-03-29T04:08:12.580335+0000","last_became_peered":"2024-03-29T04:08:12.580335+0000","last_unstale":"2024-03-29T04:08:12.583164+0000","last_undegraded":"2024-03-29T04:08:12.583164+0000","last_fullsized":"2024-03-29T04:08:12.583164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:43:46.637919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.594030+0000","last_change":"2024-03-29T04:08:12.584573+0000","last_active":"2024-03-29T04:08:12.594030+0000","last_peered":"2024-03-29T04:08:12.594030+0000","last_clean":"2024-03-29T04:08:12.594030+0000","last_became_active":"2024-03-29T04:08:12.584294+0000","last_became_peered":"2024-03-29T04:08:12.584294+0000","last_unstale":"2024-03-29T04:08:12.594030+0000","last_undegraded":"2024-03-29T04:08:12.594030+0000","last_fullsized":"2024-03-29T04:08:12.594030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:22:24.224965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.594281+0000","last_change":"2024-03-29T04:08:12.588885+0000","last_active":"2024-03-29T04:08:12.594281+0000","last_peered":"2024-03-29T04:08:12.594281+0000","last_clean":"2024-03-29T04:08:12.594281+0000","last_became_active":"2024-03-29T04:08:12.588581+0000","last_became_peered":"2024-03-29T04:08:12.588581+0000","last_unstale":"2024-03-29T04:08:12.594281+0000","last_undegraded":"2024-03-29T04:08:12.594281+0000","last_fullsized":"2024-03-29T04:08:12.594281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:23:55.560819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.603387+0000","last_change":"2024-03-29T04:08:12.595787+0000","last_active":"2024-03-29T04:08:12.603387+0000","last_peered":"2024-03-29T04:08:12.603387+0000","last_clean":"2024-03-29T04:08:12.603387+0000","last_became_active":"2024-03-29T04:08:12.595403+0000","last_became_peered":"2024-03-29T04:08:12.595403+0000","last_unstale":"2024-03-29T04:08:12.603387+0000","last_undegraded":"2024-03-29T04:08:12.603387+0000","last_fullsized":"2024-03-29T04:08:12.603387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:44:46.187079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.603347+0000","last_change":"2024-03-29T04:08:12.598647+0000","last_active":"2024-03-29T04:08:12.603347+0000","last_peered":"2024-03-29T04:08:12.603347+0000","last_clean":"2024-03-29T04:08:12.603347+0000","last_became_active":"2024-03-29T04:08:12.597742+0000","last_became_peered":"2024-03-29T04:08:12.597742+0000","last_unstale":"2024-03-29T04:08:12.603347+0000","last_undegraded":"2024-03-29T04:08:12.603347+0000","last_fullsized":"2024-03-29T04:08:12.603347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:24:45.816098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.590251+0000","last_change":"2024-03-29T04:08:12.583931+0000","last_active":"2024-03-29T04:08:12.590251+0000","last_peered":"2024-03-29T04:08:12.590251+0000","last_clean":"2024-03-29T04:08:12.590251+0000","last_became_active":"2024-03-29T04:08:12.583644+0000","last_became_peered":"2024-03-29T04:08:12.583644+0000","last_unstale":"2024-03-29T04:08:12.590251+0000","last_undegraded":"2024-03-29T04:08:12.590251+0000","last_fullsized":"2024-03-29T04:08:12.590251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:29:58.161169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.598390+0000","last_change":"2024-03-29T04:08:12.596215+0000","last_active":"2024-03-29T04:08:12.598390+0000","last_peered":"2024-03-29T04:08:12.598390+0000","last_clean":"2024-03-29T04:08:12.598390+0000","last_became_active":"2024-03-29T04:08:12.595946+0000","last_became_peered":"2024-03-29T04:08:12.595946+0000","last_unstale":"2024-03-29T04:08:12.598390+0000","last_undegraded":"2024-03-29T04:08:12.598390+0000","last_fullsized":"2024-03-29T04:08:12.598390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:43:58.842293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.596951+0000","last_change":"2024-03-29T04:08:12.591240+0000","last_active":"2024-03-29T04:08:12.596951+0000","last_peered":"2024-03-29T04:08:12.596951+0000","last_clean":"2024-03-29T04:08:12.596951+0000","last_became_active":"2024-03-29T04:08:12.590916+0000","last_became_peered":"2024-03-29T04:08:12.590916+0000","last_unstale":"2024-03-29T04:08:12.596951+0000","last_undegraded":"2024-03-29T04:08:12.596951+0000","last_fullsized":"2024-03-29T04:08:12.596951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:44:46.187079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.594937+0000","last_change":"2024-03-29T04:08:12.591775+0000","last_active":"2024-03-29T04:08:12.594937+0000","last_peered":"2024-03-29T04:08:12.594937+0000","last_clean":"2024-03-29T04:08:12.594937+0000","last_became_active":"2024-03-29T04:08:12.591502+0000","last_became_peered":"2024-03-29T04:08:12.591502+0000","last_unstale":"2024-03-29T04:08:12.594937+0000","last_undegraded":"2024-03-29T04:08:12.594937+0000","last_fullsized":"2024-03-29T04:08:12.594937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:52:01.877649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.603325+0000","last_change":"2024-03-29T04:08:12.598535+0000","last_active":"2024-03-29T04:08:12.603325+0000","last_peered":"2024-03-29T04:08:12.603325+0000","last_clean":"2024-03-29T04:08:12.603325+0000","last_became_active":"2024-03-29T04:08:12.594745+0000","last_became_peered":"2024-03-29T04:08:12.594745+0000","last_unstale":"2024-03-29T04:08:12.603325+0000","last_undegraded":"2024-03-29T04:08:12.603325+0000","last_fullsized":"2024-03-29T04:08:12.603325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T10:10:20.492063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.589974+0000","last_change":"2024-03-29T04:08:12.588823+0000","last_active":"2024-03-29T04:08:12.589974+0000","last_peered":"2024-03-29T04:08:12.589974+0000","last_clean":"2024-03-29T04:08:12.589974+0000","last_became_active":"2024-03-29T04:08:12.588560+0000","last_became_peered":"2024-03-29T04:08:12.588560+0000","last_unstale":"2024-03-29T04:08:12.589974+0000","last_undegraded":"2024-03-29T04:08:12.589974+0000","last_fullsized":"2024-03-29T04:08:12.589974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:46:43.492166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.603288+0000","last_change":"2024-03-29T04:08:12.598196+0000","last_active":"2024-03-29T04:08:12.603288+0000","last_peered":"2024-03-29T04:08:12.603288+0000","last_clean":"2024-03-29T04:08:12.603288+0000","last_became_active":"2024-03-29T04:08:12.594199+0000","last_became_peered":"2024-03-29T04:08:12.594199+0000","last_unstale":"2024-03-29T04:08:12.603288+0000","last_undegraded":"2024-03-29T04:08:12.603288+0000","last_fullsized":"2024-03-29T04:08:12.603288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:23:55.560819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.590118+0000","last_change":"2024-03-29T04:08:12.588950+0000","last_active":"2024-03-29T04:08:12.590118+0000","last_peered":"2024-03-29T04:08:12.590118+0000","last_clean":"2024-03-29T04:08:12.590118+0000","last_became_active":"2024-03-29T04:08:12.588659+0000","last_became_peered":"2024-03-29T04:08:12.588659+0000","last_unstale":"2024-03-29T04:08:12.590118+0000","last_undegraded":"2024-03-29T04:08:12.590118+0000","last_fullsized":"2024-03-29T04:08:12.590118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:25:50.715560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.598055+0000","last_change":"2024-03-29T04:08:12.589789+0000","last_active":"2024-03-29T04:08:12.598055+0000","last_peered":"2024-03-29T04:08:12.598055+0000","last_clean":"2024-03-29T04:08:12.598055+0000","last_became_active":"2024-03-29T04:08:12.587505+0000","last_became_peered":"2024-03-29T04:08:12.587505+0000","last_unstale":"2024-03-29T04:08:12.598055+0000","last_undegraded":"2024-03-29T04:08:12.598055+0000","last_fullsized":"2024-03-29T04:08:12.598055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:52:01.877649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.583893+0000","last_change":"2024-03-29T04:08:12.582545+0000","last_active":"2024-03-29T04:08:12.583893+0000","last_peered":"2024-03-29T04:08:12.583893+0000","last_clean":"2024-03-29T04:08:12.583893+0000","last_became_active":"2024-03-29T04:08:12.582268+0000","last_became_peered":"2024-03-29T04:08:12.582268+0000","last_unstale":"2024-03-29T04:08:12.583893+0000","last_undegraded":"2024-03-29T04:08:12.583893+0000","last_fullsized":"2024-03-29T04:08:12.583893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:15:10.072949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.590198+0000","last_change":"2024-03-29T04:08:12.589186+0000","last_active":"2024-03-29T04:08:12.590198+0000","last_peered":"2024-03-29T04:08:12.590198+0000","last_clean":"2024-03-29T04:08:12.590198+0000","last_became_active":"2024-03-29T04:08:12.588882+0000","last_became_peered":"2024-03-29T04:08:12.588882+0000","last_unstale":"2024-03-29T04:08:12.590198+0000","last_undegraded":"2024-03-29T04:08:12.590198+0000","last_fullsized":"2024-03-29T04:08:12.590198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:52:01.877649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.594078+0000","last_change":"2024-03-29T04:08:12.584300+0000","last_active":"2024-03-29T04:08:12.594078+0000","last_peered":"2024-03-29T04:08:12.594078+0000","last_clean":"2024-03-29T04:08:12.594078+0000","last_became_active":"2024-03-29T04:08:12.583925+0000","last_became_peered":"2024-03-29T04:08:12.583925+0000","last_unstale":"2024-03-29T04:08:12.594078+0000","last_undegraded":"2024-03-29T04:08:12.594078+0000","last_fullsized":"2024-03-29T04:08:12.594078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:43:46.637919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.598929+0000","last_change":"2024-03-29T04:08:12.593957+0000","last_active":"2024-03-29T04:08:12.598929+0000","last_peered":"2024-03-29T04:08:12.598929+0000","last_clean":"2024-03-29T04:08:12.598929+0000","last_became_active":"2024-03-29T04:08:12.593694+0000","last_became_peered":"2024-03-29T04:08:12.593694+0000","last_unstale":"2024-03-29T04:08:12.598929+0000","last_undegraded":"2024-03-29T04:08:12.598929+0000","last_fullsized":"2024-03-29T04:08:12.598929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:39:27.893573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.594378+0000","last_change":"2024-03-29T04:08:12.587534+0000","last_active":"2024-03-29T04:08:12.594378+0000","last_peered":"2024-03-29T04:08:12.594378+0000","last_clean":"2024-03-29T04:08:12.594378+0000","last_became_active":"2024-03-29T04:08:12.587244+0000","last_became_peered":"2024-03-29T04:08:12.587244+0000","last_unstale":"2024-03-29T04:08:12.594378+0000","last_undegraded":"2024-03-29T04:08:12.594378+0000","last_fullsized":"2024-03-29T04:08:12.594378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:04:47.466811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.596965+0000","last_change":"2024-03-29T04:08:12.588798+0000","last_active":"2024-03-29T04:08:12.596965+0000","last_peered":"2024-03-29T04:08:12.596965+0000","last_clean":"2024-03-29T04:08:12.596965+0000","last_became_active":"2024-03-29T04:08:12.588526+0000","last_became_peered":"2024-03-29T04:08:12.588526+0000","last_unstale":"2024-03-29T04:08:12.596965+0000","last_undegraded":"2024-03-29T04:08:12.596965+0000","last_fullsized":"2024-03-29T04:08:12.596965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:25:50.715560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.593186+0000","last_change":"2024-03-29T04:08:12.586895+0000","last_active":"2024-03-29T04:08:12.593186+0000","last_peered":"2024-03-29T04:08:12.593186+0000","last_clean":"2024-03-29T04:08:12.593186+0000","last_became_active":"2024-03-29T04:08:12.586616+0000","last_became_peered":"2024-03-29T04:08:12.586616+0000","last_unstale":"2024-03-29T04:08:12.593186+0000","last_undegraded":"2024-03-29T04:08:12.593186+0000","last_fullsized":"2024-03-29T04:08:12.593186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T16:04:15.396729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.586096+0000","last_change":"2024-03-29T04:08:11.581036+0000","last_active":"2024-03-29T04:08:12.586096+0000","last_peered":"2024-03-29T04:08:12.586096+0000","last_clean":"2024-03-29T04:08:12.586096+0000","last_became_active":"2024-03-29T04:08:11.580771+0000","last_became_peered":"2024-03-29T04:08:11.580771+0000","last_unstale":"2024-03-29T04:08:12.586096+0000","last_undegraded":"2024-03-29T04:08:12.586096+0000","last_fullsized":"2024-03-29T04:08:12.586096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T13:31:02.796965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.594919+0000","last_change":"2024-03-29T04:08:12.591216+0000","last_active":"2024-03-29T04:08:12.594919+0000","last_peered":"2024-03-29T04:08:12.594919+0000","last_clean":"2024-03-29T04:08:12.594919+0000","last_became_active":"2024-03-29T04:08:12.590900+0000","last_became_peered":"2024-03-29T04:08:12.590900+0000","last_unstale":"2024-03-29T04:08:12.594919+0000","last_undegraded":"2024-03-29T04:08:12.594919+0000","last_fullsized":"2024-03-29T04:08:12.594919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:46:43.492166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.590220+0000","last_change":"2024-03-29T04:08:11.578220+0000","last_active":"2024-03-29T04:08:12.590220+0000","last_peered":"2024-03-29T04:08:12.590220+0000","last_clean":"2024-03-29T04:08:12.590220+0000","last_became_active":"2024-03-29T04:08:11.577710+0000","last_became_peered":"2024-03-29T04:08:11.577710+0000","last_unstale":"2024-03-29T04:08:12.590220+0000","last_undegraded":"2024-03-29T04:08:12.590220+0000","last_fullsized":"2024-03-29T04:08:12.590220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:04:46.456846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.569215+0000","last_change":"2024-03-29T04:08:11.579579+0000","last_active":"2024-03-29T04:08:12.569215+0000","last_peered":"2024-03-29T04:08:12.569215+0000","last_clean":"2024-03-29T04:08:12.569215+0000","last_became_active":"2024-03-29T04:08:11.578445+0000","last_became_peered":"2024-03-29T04:08:11.578445+0000","last_unstale":"2024-03-29T04:08:12.569215+0000","last_undegraded":"2024-03-29T04:08:12.569215+0000","last_fullsized":"2024-03-29T04:08:12.569215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T10:32:34.230140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.589569+0000","last_change":"2024-03-29T04:08:12.587465+0000","last_active":"2024-03-29T04:08:12.589569+0000","last_peered":"2024-03-29T04:08:12.589569+0000","last_clean":"2024-03-29T04:08:12.589569+0000","last_became_active":"2024-03-29T04:08:12.587202+0000","last_became_peered":"2024-03-29T04:08:12.587202+0000","last_unstale":"2024-03-29T04:08:12.589569+0000","last_undegraded":"2024-03-29T04:08:12.589569+0000","last_fullsized":"2024-03-29T04:08:12.589569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:39:27.893573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.581862+0000","last_change":"2024-03-29T04:08:11.584446+0000","last_active":"2024-03-29T04:08:12.581862+0000","last_peered":"2024-03-29T04:08:12.581862+0000","last_clean":"2024-03-29T04:08:12.581862+0000","last_became_active":"2024-03-29T04:08:11.584105+0000","last_became_peered":"2024-03-29T04:08:11.584105+0000","last_unstale":"2024-03-29T04:08:12.581862+0000","last_undegraded":"2024-03-29T04:08:12.581862+0000","last_fullsized":"2024-03-29T04:08:12.581862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:22:23.215000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.583369+0000","last_change":"2024-03-29T04:08:12.580898+0000","last_active":"2024-03-29T04:08:12.583369+0000","last_peered":"2024-03-29T04:08:12.583369+0000","last_clean":"2024-03-29T04:08:12.583369+0000","last_became_active":"2024-03-29T04:08:12.580579+0000","last_became_peered":"2024-03-29T04:08:12.580579+0000","last_unstale":"2024-03-29T04:08:12.583369+0000","last_undegraded":"2024-03-29T04:08:12.583369+0000","last_fullsized":"2024-03-29T04:08:12.583369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:25:50.715560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.575128+0000","last_change":"2024-03-29T04:08:11.584262+0000","last_active":"2024-03-29T04:08:12.575128+0000","last_peered":"2024-03-29T04:08:12.575128+0000","last_clean":"2024-03-29T04:08:12.575128+0000","last_became_active":"2024-03-29T04:08:11.583668+0000","last_became_peered":"2024-03-29T04:08:11.583668+0000","last_unstale":"2024-03-29T04:08:12.575128+0000","last_undegraded":"2024-03-29T04:08:12.575128+0000","last_fullsized":"2024-03-29T04:08:12.575128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:43:45.627953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.599287+0000","last_change":"2024-03-29T04:08:12.595602+0000","last_active":"2024-03-29T04:08:12.599287+0000","last_peered":"2024-03-29T04:08:12.599287+0000","last_clean":"2024-03-29T04:08:12.599287+0000","last_became_active":"2024-03-29T04:08:12.595332+0000","last_became_peered":"2024-03-29T04:08:12.595332+0000","last_unstale":"2024-03-29T04:08:12.599287+0000","last_undegraded":"2024-03-29T04:08:12.599287+0000","last_fullsized":"2024-03-29T04:08:12.599287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:47:13.560160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.579243+0000","last_change":"2024-03-29T04:08:11.586122+0000","last_active":"2024-03-29T04:08:12.579243+0000","last_peered":"2024-03-29T04:08:12.579243+0000","last_clean":"2024-03-29T04:08:12.579243+0000","last_became_active":"2024-03-29T04:08:11.585845+0000","last_became_peered":"2024-03-29T04:08:11.585845+0000","last_unstale":"2024-03-29T04:08:12.579243+0000","last_undegraded":"2024-03-29T04:08:12.579243+0000","last_fullsized":"2024-03-29T04:08:12.579243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:43:45.627953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.594974+0000","last_change":"2024-03-29T04:08:12.591051+0000","last_active":"2024-03-29T04:08:12.594974+0000","last_peered":"2024-03-29T04:08:12.594974+0000","last_clean":"2024-03-29T04:08:12.594974+0000","last_became_active":"2024-03-29T04:08:12.590728+0000","last_became_peered":"2024-03-29T04:08:12.590728+0000","last_unstale":"2024-03-29T04:08:12.594974+0000","last_undegraded":"2024-03-29T04:08:12.594974+0000","last_fullsized":"2024-03-29T04:08:12.594974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:39:27.893573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.590397+0000","last_change":"2024-03-29T04:08:11.583944+0000","last_active":"2024-03-29T04:08:12.590397+0000","last_peered":"2024-03-29T04:08:12.590397+0000","last_clean":"2024-03-29T04:08:12.590397+0000","last_became_active":"2024-03-29T04:08:11.583666+0000","last_became_peered":"2024-03-29T04:08:11.583666+0000","last_unstale":"2024-03-29T04:08:12.590397+0000","last_undegraded":"2024-03-29T04:08:12.590397+0000","last_fullsized":"2024-03-29T04:08:12.590397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:04:46.456846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.593273+0000","last_change":"2024-03-29T04:08:12.590849+0000","last_active":"2024-03-29T04:08:12.593273+0000","last_peered":"2024-03-29T04:08:12.593273+0000","last_clean":"2024-03-29T04:08:12.593273+0000","last_became_active":"2024-03-29T04:08:12.590510+0000","last_became_peered":"2024-03-29T04:08:12.590510+0000","last_unstale":"2024-03-29T04:08:12.593273+0000","last_undegraded":"2024-03-29T04:08:12.593273+0000","last_fullsized":"2024-03-29T04:08:12.593273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:43:46.637919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.596890+0000","last_change":"2024-03-29T04:08:11.579283+0000","last_active":"2024-03-29T04:08:12.596890+0000","last_peered":"2024-03-29T04:08:12.596890+0000","last_clean":"2024-03-29T04:08:12.596890+0000","last_became_active":"2024-03-29T04:08:11.578990+0000","last_became_peered":"2024-03-29T04:08:11.578990+0000","last_unstale":"2024-03-29T04:08:12.596890+0000","last_undegraded":"2024-03-29T04:08:12.596890+0000","last_fullsized":"2024-03-29T04:08:12.596890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T13:31:02.796965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.591534+0000","last_change":"2024-03-29T04:08:12.586665+0000","last_active":"2024-03-29T04:08:12.591534+0000","last_peered":"2024-03-29T04:08:12.591534+0000","last_clean":"2024-03-29T04:08:12.591534+0000","last_became_active":"2024-03-29T04:08:12.586394+0000","last_became_peered":"2024-03-29T04:08:12.586394+0000","last_unstale":"2024-03-29T04:08:12.591534+0000","last_undegraded":"2024-03-29T04:08:12.591534+0000","last_fullsized":"2024-03-29T04:08:12.591534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:52:01.877649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.594023+0000","last_change":"2024-03-29T04:08:11.581071+0000","last_active":"2024-03-29T04:08:12.594023+0000","last_peered":"2024-03-29T04:08:12.594023+0000","last_clean":"2024-03-29T04:08:12.594023+0000","last_became_active":"2024-03-29T04:08:11.580803+0000","last_became_peered":"2024-03-29T04:08:11.580803+0000","last_unstale":"2024-03-29T04:08:12.594023+0000","last_undegraded":"2024-03-29T04:08:12.594023+0000","last_fullsized":"2024-03-29T04:08:12.594023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T10:32:34.230140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.594884+0000","last_change":"2024-03-29T04:08:12.591431+0000","last_active":"2024-03-29T04:08:12.594884+0000","last_peered":"2024-03-29T04:08:12.594884+0000","last_clean":"2024-03-29T04:08:12.594884+0000","last_became_active":"2024-03-29T04:08:12.591158+0000","last_became_peered":"2024-03-29T04:08:12.591158+0000","last_unstale":"2024-03-29T04:08:12.594884+0000","last_undegraded":"2024-03-29T04:08:12.594884+0000","last_fullsized":"2024-03-29T04:08:12.594884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:25:50.715560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.585194+0000","last_change":"2024-03-29T04:08:11.585963+0000","last_active":"2024-03-29T04:08:12.585194+0000","last_peered":"2024-03-29T04:08:12.585194+0000","last_clean":"2024-03-29T04:08:12.585194+0000","last_became_active":"2024-03-29T04:08:11.585663+0000","last_became_peered":"2024-03-29T04:08:11.585663+0000","last_unstale":"2024-03-29T04:08:12.585194+0000","last_undegraded":"2024-03-29T04:08:12.585194+0000","last_fullsized":"2024-03-29T04:08:12.585194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:29:57.151204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.598104+0000","last_change":"2024-03-29T04:08:12.593510+0000","last_active":"2024-03-29T04:08:12.598104+0000","last_peered":"2024-03-29T04:08:12.598104+0000","last_clean":"2024-03-29T04:08:12.598104+0000","last_became_active":"2024-03-29T04:08:12.593129+0000","last_became_peered":"2024-03-29T04:08:12.593129+0000","last_unstale":"2024-03-29T04:08:12.598104+0000","last_undegraded":"2024-03-29T04:08:12.598104+0000","last_fullsized":"2024-03-29T04:08:12.598104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T10:10:20.492063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.575398+0000","last_change":"2024-03-29T04:08:11.578269+0000","last_active":"2024-03-29T04:08:12.575398+0000","last_peered":"2024-03-29T04:08:12.575398+0000","last_clean":"2024-03-29T04:08:12.575398+0000","last_became_active":"2024-03-29T04:08:11.578014+0000","last_became_peered":"2024-03-29T04:08:11.578014+0000","last_unstale":"2024-03-29T04:08:12.575398+0000","last_undegraded":"2024-03-29T04:08:12.575398+0000","last_fullsized":"2024-03-29T04:08:12.575398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:29:57.151204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.596941+0000","last_change":"2024-03-29T04:08:12.587831+0000","last_active":"2024-03-29T04:08:12.596941+0000","last_peered":"2024-03-29T04:08:12.596941+0000","last_clean":"2024-03-29T04:08:12.596941+0000","last_became_active":"2024-03-29T04:08:12.587537+0000","last_became_peered":"2024-03-29T04:08:12.587537+0000","last_unstale":"2024-03-29T04:08:12.596941+0000","last_undegraded":"2024-03-29T04:08:12.596941+0000","last_fullsized":"2024-03-29T04:08:12.596941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:39:27.893573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.585401+0000","last_change":"2024-03-29T04:08:11.579486+0000","last_active":"2024-03-29T04:08:12.585401+0000","last_peered":"2024-03-29T04:08:12.585401+0000","last_clean":"2024-03-29T04:08:12.585401+0000","last_became_active":"2024-03-29T04:08:11.579186+0000","last_became_peered":"2024-03-29T04:08:11.579186+0000","last_unstale":"2024-03-29T04:08:12.585401+0000","last_undegraded":"2024-03-29T04:08:12.585401+0000","last_fullsized":"2024-03-29T04:08:12.585401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T16:04:14.386764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.597995+0000","last_change":"2024-03-29T04:08:12.593018+0000","last_active":"2024-03-29T04:08:12.597995+0000","last_peered":"2024-03-29T04:08:12.597995+0000","last_clean":"2024-03-29T04:08:12.597995+0000","last_became_active":"2024-03-29T04:08:12.592716+0000","last_became_peered":"2024-03-29T04:08:12.592716+0000","last_unstale":"2024-03-29T04:08:12.597995+0000","last_undegraded":"2024-03-29T04:08:12.597995+0000","last_fullsized":"2024-03-29T04:08:12.597995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:51:30.023734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.589570+0000","last_change":"2024-03-29T04:08:11.579702+0000","last_active":"2024-03-29T04:08:12.589570+0000","last_peered":"2024-03-29T04:08:12.589570+0000","last_clean":"2024-03-29T04:08:12.589570+0000","last_became_active":"2024-03-29T04:08:11.579407+0000","last_became_peered":"2024-03-29T04:08:11.579407+0000","last_unstale":"2024-03-29T04:08:12.589570+0000","last_undegraded":"2024-03-29T04:08:12.589570+0000","last_fullsized":"2024-03-29T04:08:12.589570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:58:15.647153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.597816+0000","last_change":"2024-03-29T04:08:12.592883+0000","last_active":"2024-03-29T04:08:12.597816+0000","last_peered":"2024-03-29T04:08:12.597816+0000","last_clean":"2024-03-29T04:08:12.597816+0000","last_became_active":"2024-03-29T04:08:12.592611+0000","last_became_peered":"2024-03-29T04:08:12.592611+0000","last_unstale":"2024-03-29T04:08:12.597816+0000","last_undegraded":"2024-03-29T04:08:12.597816+0000","last_fullsized":"2024-03-29T04:08:12.597816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:23:55.560819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.584906+0000","last_change":"2024-03-29T04:08:11.581905+0000","last_active":"2024-03-29T04:08:12.584906+0000","last_peered":"2024-03-29T04:08:12.584906+0000","last_clean":"2024-03-29T04:08:12.584906+0000","last_became_active":"2024-03-29T04:08:11.581367+0000","last_became_peered":"2024-03-29T04:08:11.581367+0000","last_unstale":"2024-03-29T04:08:12.584906+0000","last_undegraded":"2024-03-29T04:08:12.584906+0000","last_fullsized":"2024-03-29T04:08:12.584906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:43:45.627953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.597955+0000","last_change":"2024-03-29T04:08:12.592388+0000","last_active":"2024-03-29T04:08:12.597955+0000","last_peered":"2024-03-29T04:08:12.597955+0000","last_clean":"2024-03-29T04:08:12.597955+0000","last_became_active":"2024-03-29T04:08:12.592126+0000","last_became_peered":"2024-03-29T04:08:12.592126+0000","last_unstale":"2024-03-29T04:08:12.597955+0000","last_undegraded":"2024-03-29T04:08:12.597955+0000","last_fullsized":"2024-03-29T04:08:12.597955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:44:46.187079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.597089+0000","last_change":"2024-03-29T04:08:11.574823+0000","last_active":"2024-03-29T04:08:12.597089+0000","last_peered":"2024-03-29T04:08:12.597089+0000","last_clean":"2024-03-29T04:08:12.597089+0000","last_became_active":"2024-03-29T04:08:11.574536+0000","last_became_peered":"2024-03-29T04:08:11.574536+0000","last_unstale":"2024-03-29T04:08:12.597089+0000","last_undegraded":"2024-03-29T04:08:12.597089+0000","last_fullsized":"2024-03-29T04:08:12.597089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:39:26.883608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.599124+0000","last_change":"2024-03-29T04:08:12.595008+0000","last_active":"2024-03-29T04:08:12.599124+0000","last_peered":"2024-03-29T04:08:12.599124+0000","last_clean":"2024-03-29T04:08:12.599124+0000","last_became_active":"2024-03-29T04:08:12.594429+0000","last_became_peered":"2024-03-29T04:08:12.594429+0000","last_unstale":"2024-03-29T04:08:12.599124+0000","last_undegraded":"2024-03-29T04:08:12.599124+0000","last_fullsized":"2024-03-29T04:08:12.599124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:46:43.492166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.574443+0000","last_change":"2024-03-29T04:08:11.584568+0000","last_active":"2024-03-29T04:08:12.574443+0000","last_peered":"2024-03-29T04:08:12.574443+0000","last_clean":"2024-03-29T04:08:12.574443+0000","last_became_active":"2024-03-29T04:08:11.584246+0000","last_became_peered":"2024-03-29T04:08:11.584246+0000","last_unstale":"2024-03-29T04:08:12.574443+0000","last_undegraded":"2024-03-29T04:08:12.574443+0000","last_fullsized":"2024-03-29T04:08:12.574443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T13:31:02.796965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.599209+0000","last_change":"2024-03-29T04:08:12.597064+0000","last_active":"2024-03-29T04:08:12.599209+0000","last_peered":"2024-03-29T04:08:12.599209+0000","last_clean":"2024-03-29T04:08:12.599209+0000","last_became_active":"2024-03-29T04:08:12.596790+0000","last_became_peered":"2024-03-29T04:08:12.596790+0000","last_unstale":"2024-03-29T04:08:12.599209+0000","last_undegraded":"2024-03-29T04:08:12.599209+0000","last_fullsized":"2024-03-29T04:08:12.599209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:50:17.616748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.575629+0000","last_change":"2024-03-29T04:08:01.885311+0000","last_active":"2024-03-29T04:08:12.575629+0000","last_peered":"2024-03-29T04:08:12.575629+0000","last_clean":"2024-03-29T04:08:12.575629+0000","last_became_active":"2024-03-29T04:08:01.884340+0000","last_became_peered":"2024-03-29T04:08:01.884340+0000","last_unstale":"2024-03-29T04:08:12.575629+0000","last_undegraded":"2024-03-29T04:08:12.575629+0000","last_fullsized":"2024-03-29T04:08:12.575629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:00.511520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:00.511520+0000","last_clean_scrub_stamp":"2024-03-29T04:08:00.511520+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:40:25.245419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.576962+0000","last_change":"2024-03-29T04:08:11.585258+0000","last_active":"2024-03-29T04:08:12.576962+0000","last_peered":"2024-03-29T04:08:12.576962+0000","last_clean":"2024-03-29T04:08:12.576962+0000","last_became_active":"2024-03-29T04:08:11.584935+0000","last_became_peered":"2024-03-29T04:08:11.584935+0000","last_unstale":"2024-03-29T04:08:12.576962+0000","last_undegraded":"2024-03-29T04:08:12.576962+0000","last_fullsized":"2024-03-29T04:08:12.576962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T13:31:02.796965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.597037+0000","last_change":"2024-03-29T04:08:12.594912+0000","last_active":"2024-03-29T04:08:12.597037+0000","last_peered":"2024-03-29T04:08:12.597037+0000","last_clean":"2024-03-29T04:08:12.597037+0000","last_became_active":"2024-03-29T04:08:12.594603+0000","last_became_peered":"2024-03-29T04:08:12.594603+0000","last_unstale":"2024-03-29T04:08:12.597037+0000","last_undegraded":"2024-03-29T04:08:12.597037+0000","last_fullsized":"2024-03-29T04:08:12.597037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:47:13.560160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.575567+0000","last_change":"2024-03-29T04:08:11.586269+0000","last_active":"2024-03-29T04:08:12.575567+0000","last_peered":"2024-03-29T04:08:12.575567+0000","last_clean":"2024-03-29T04:08:12.575567+0000","last_became_active":"2024-03-29T04:08:11.585746+0000","last_became_peered":"2024-03-29T04:08:11.585746+0000","last_unstale":"2024-03-29T04:08:12.575567+0000","last_undegraded":"2024-03-29T04:08:12.575567+0000","last_fullsized":"2024-03-29T04:08:12.575567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:29:57.151204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.594760+0000","last_change":"2024-03-29T04:08:12.590744+0000","last_active":"2024-03-29T04:08:12.594760+0000","last_peered":"2024-03-29T04:08:12.594760+0000","last_clean":"2024-03-29T04:08:12.594760+0000","last_became_active":"2024-03-29T04:08:12.590441+0000","last_became_peered":"2024-03-29T04:08:12.590441+0000","last_unstale":"2024-03-29T04:08:12.594760+0000","last_undegraded":"2024-03-29T04:08:12.594760+0000","last_fullsized":"2024-03-29T04:08:12.594760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:04:47.466811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.581459+0000","last_change":"2024-03-29T04:08:11.581639+0000","last_active":"2024-03-29T04:08:12.581459+0000","last_peered":"2024-03-29T04:08:12.581459+0000","last_clean":"2024-03-29T04:08:12.581459+0000","last_became_active":"2024-03-29T04:08:11.581291+0000","last_became_peered":"2024-03-29T04:08:11.581291+0000","last_unstale":"2024-03-29T04:08:12.581459+0000","last_undegraded":"2024-03-29T04:08:12.581459+0000","last_fullsized":"2024-03-29T04:08:12.581459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:22:23.215000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.594202+0000","last_change":"2024-03-29T04:08:12.584723+0000","last_active":"2024-03-29T04:08:12.594202+0000","last_peered":"2024-03-29T04:08:12.594202+0000","last_clean":"2024-03-29T04:08:12.594202+0000","last_became_active":"2024-03-29T04:08:12.584466+0000","last_became_peered":"2024-03-29T04:08:12.584466+0000","last_unstale":"2024-03-29T04:08:12.594202+0000","last_undegraded":"2024-03-29T04:08:12.594202+0000","last_fullsized":"2024-03-29T04:08:12.594202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:44:46.187079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.585338+0000","last_change":"2024-03-29T04:08:11.587034+0000","last_active":"2024-03-29T04:08:12.585338+0000","last_peered":"2024-03-29T04:08:12.585338+0000","last_clean":"2024-03-29T04:08:12.585338+0000","last_became_active":"2024-03-29T04:08:11.586720+0000","last_became_peered":"2024-03-29T04:08:11.586720+0000","last_unstale":"2024-03-29T04:08:12.585338+0000","last_undegraded":"2024-03-29T04:08:12.585338+0000","last_fullsized":"2024-03-29T04:08:12.585338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:04:46.456846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.593447+0000","last_change":"2024-03-29T04:08:12.591148+0000","last_active":"2024-03-29T04:08:12.593447+0000","last_peered":"2024-03-29T04:08:12.593447+0000","last_clean":"2024-03-29T04:08:12.593447+0000","last_became_active":"2024-03-29T04:08:12.590076+0000","last_became_peered":"2024-03-29T04:08:12.590076+0000","last_unstale":"2024-03-29T04:08:12.593447+0000","last_undegraded":"2024-03-29T04:08:12.593447+0000","last_fullsized":"2024-03-29T04:08:12.593447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:22:24.224965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.568984+0000","last_change":"2024-03-29T04:08:11.582158+0000","last_active":"2024-03-29T04:08:12.568984+0000","last_peered":"2024-03-29T04:08:12.568984+0000","last_clean":"2024-03-29T04:08:12.568984+0000","last_became_active":"2024-03-29T04:08:11.581893+0000","last_became_peered":"2024-03-29T04:08:11.581893+0000","last_unstale":"2024-03-29T04:08:12.568984+0000","last_undegraded":"2024-03-29T04:08:12.568984+0000","last_fullsized":"2024-03-29T04:08:12.568984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:22:23.215000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.599108+0000","last_change":"2024-03-29T04:08:12.595023+0000","last_active":"2024-03-29T04:08:12.599108+0000","last_peered":"2024-03-29T04:08:12.599108+0000","last_clean":"2024-03-29T04:08:12.599108+0000","last_became_active":"2024-03-29T04:08:12.594277+0000","last_became_peered":"2024-03-29T04:08:12.594277+0000","last_unstale":"2024-03-29T04:08:12.599108+0000","last_undegraded":"2024-03-29T04:08:12.599108+0000","last_fullsized":"2024-03-29T04:08:12.599108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:25:50.715560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.578471+0000","last_change":"2024-03-29T04:08:11.586951+0000","last_active":"2024-03-29T04:08:12.578471+0000","last_peered":"2024-03-29T04:08:12.578471+0000","last_clean":"2024-03-29T04:08:12.578471+0000","last_became_active":"2024-03-29T04:08:11.586654+0000","last_became_peered":"2024-03-29T04:08:11.586654+0000","last_unstale":"2024-03-29T04:08:12.578471+0000","last_undegraded":"2024-03-29T04:08:12.578471+0000","last_fullsized":"2024-03-29T04:08:12.578471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:46:42.482201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.590095+0000","last_change":"2024-03-29T04:08:12.584288+0000","last_active":"2024-03-29T04:08:12.590095+0000","last_peered":"2024-03-29T04:08:12.590095+0000","last_clean":"2024-03-29T04:08:12.590095+0000","last_became_active":"2024-03-29T04:08:12.584022+0000","last_became_peered":"2024-03-29T04:08:12.584022+0000","last_unstale":"2024-03-29T04:08:12.590095+0000","last_undegraded":"2024-03-29T04:08:12.590095+0000","last_fullsized":"2024-03-29T04:08:12.590095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:47:13.560160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.569003+0000","last_change":"2024-03-29T04:08:11.575033+0000","last_active":"2024-03-29T04:08:12.569003+0000","last_peered":"2024-03-29T04:08:12.569003+0000","last_clean":"2024-03-29T04:08:12.569003+0000","last_became_active":"2024-03-29T04:08:11.574736+0000","last_became_peered":"2024-03-29T04:08:11.574736+0000","last_unstale":"2024-03-29T04:08:12.569003+0000","last_undegraded":"2024-03-29T04:08:12.569003+0000","last_fullsized":"2024-03-29T04:08:12.569003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:29:57.151204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.593188+0000","last_change":"2024-03-29T04:08:12.592175+0000","last_active":"2024-03-29T04:08:12.593188+0000","last_peered":"2024-03-29T04:08:12.593188+0000","last_clean":"2024-03-29T04:08:12.593188+0000","last_became_active":"2024-03-29T04:08:12.591851+0000","last_became_peered":"2024-03-29T04:08:12.591851+0000","last_unstale":"2024-03-29T04:08:12.593188+0000","last_undegraded":"2024-03-29T04:08:12.593188+0000","last_fullsized":"2024-03-29T04:08:12.593188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:15:10.072949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.593838+0000","last_change":"2024-03-29T04:08:11.581692+0000","last_active":"2024-03-29T04:08:12.593838+0000","last_peered":"2024-03-29T04:08:12.593838+0000","last_clean":"2024-03-29T04:08:12.593838+0000","last_became_active":"2024-03-29T04:08:11.580542+0000","last_became_peered":"2024-03-29T04:08:11.580542+0000","last_unstale":"2024-03-29T04:08:12.593838+0000","last_undegraded":"2024-03-29T04:08:12.593838+0000","last_fullsized":"2024-03-29T04:08:12.593838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:22:23.215000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.594056+0000","last_change":"2024-03-29T04:08:12.584745+0000","last_active":"2024-03-29T04:08:12.594056+0000","last_peered":"2024-03-29T04:08:12.594056+0000","last_clean":"2024-03-29T04:08:12.594056+0000","last_became_active":"2024-03-29T04:08:12.584417+0000","last_became_peered":"2024-03-29T04:08:12.584417+0000","last_unstale":"2024-03-29T04:08:12.594056+0000","last_undegraded":"2024-03-29T04:08:12.594056+0000","last_fullsized":"2024-03-29T04:08:12.594056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:29:58.161169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.575625+0000","last_change":"2024-03-29T04:08:11.587081+0000","last_active":"2024-03-29T04:08:12.575625+0000","last_peered":"2024-03-29T04:08:12.575625+0000","last_clean":"2024-03-29T04:08:12.575625+0000","last_became_active":"2024-03-29T04:08:11.586729+0000","last_became_peered":"2024-03-29T04:08:11.586729+0000","last_unstale":"2024-03-29T04:08:12.575625+0000","last_undegraded":"2024-03-29T04:08:12.575625+0000","last_fullsized":"2024-03-29T04:08:12.575625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:04:46.456846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.593118+0000","last_change":"2024-03-29T04:08:12.586216+0000","last_active":"2024-03-29T04:08:12.593118+0000","last_peered":"2024-03-29T04:08:12.593118+0000","last_clean":"2024-03-29T04:08:12.593118+0000","last_became_active":"2024-03-29T04:08:12.585834+0000","last_became_peered":"2024-03-29T04:08:12.585834+0000","last_unstale":"2024-03-29T04:08:12.593118+0000","last_undegraded":"2024-03-29T04:08:12.593118+0000","last_fullsized":"2024-03-29T04:08:12.593118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T10:32:35.240105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.569795+0000","last_change":"2024-03-29T04:08:11.580924+0000","last_active":"2024-03-29T04:08:12.569795+0000","last_peered":"2024-03-29T04:08:12.569795+0000","last_clean":"2024-03-29T04:08:12.569795+0000","last_became_active":"2024-03-29T04:08:11.580668+0000","last_became_peered":"2024-03-29T04:08:11.580668+0000","last_unstale":"2024-03-29T04:08:12.569795+0000","last_undegraded":"2024-03-29T04:08:12.569795+0000","last_fullsized":"2024-03-29T04:08:12.569795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:46:42.482201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.584397+0000","last_change":"2024-03-29T04:08:12.582417+0000","last_active":"2024-03-29T04:08:12.584397+0000","last_peered":"2024-03-29T04:08:12.584397+0000","last_clean":"2024-03-29T04:08:12.584397+0000","last_became_active":"2024-03-29T04:08:12.582157+0000","last_became_peered":"2024-03-29T04:08:12.582157+0000","last_unstale":"2024-03-29T04:08:12.584397+0000","last_undegraded":"2024-03-29T04:08:12.584397+0000","last_fullsized":"2024-03-29T04:08:12.584397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:22:24.224965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.568671+0000","last_change":"2024-03-29T04:08:11.579852+0000","last_active":"2024-03-29T04:08:12.568671+0000","last_peered":"2024-03-29T04:08:12.568671+0000","last_clean":"2024-03-29T04:08:12.568671+0000","last_became_active":"2024-03-29T04:08:11.579507+0000","last_became_peered":"2024-03-29T04:08:11.579507+0000","last_unstale":"2024-03-29T04:08:12.568671+0000","last_undegraded":"2024-03-29T04:08:12.568671+0000","last_fullsized":"2024-03-29T04:08:12.568671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:43:45.627953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.589548+0000","last_change":"2024-03-29T04:08:12.586892+0000","last_active":"2024-03-29T04:08:12.589548+0000","last_peered":"2024-03-29T04:08:12.589548+0000","last_clean":"2024-03-29T04:08:12.589548+0000","last_became_active":"2024-03-29T04:08:12.586624+0000","last_became_peered":"2024-03-29T04:08:12.586624+0000","last_unstale":"2024-03-29T04:08:12.589548+0000","last_undegraded":"2024-03-29T04:08:12.589548+0000","last_fullsized":"2024-03-29T04:08:12.589548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:04:47.466811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.592723+0000","last_change":"2024-03-29T04:08:11.583745+0000","last_active":"2024-03-29T04:08:12.592723+0000","last_peered":"2024-03-29T04:08:12.592723+0000","last_clean":"2024-03-29T04:08:12.592723+0000","last_became_active":"2024-03-29T04:08:11.583507+0000","last_became_peered":"2024-03-29T04:08:11.583507+0000","last_unstale":"2024-03-29T04:08:12.592723+0000","last_undegraded":"2024-03-29T04:08:12.592723+0000","last_fullsized":"2024-03-29T04:08:12.592723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:39:26.883608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.596887+0000","last_change":"2024-03-29T04:08:12.590902+0000","last_active":"2024-03-29T04:08:12.596887+0000","last_peered":"2024-03-29T04:08:12.596887+0000","last_clean":"2024-03-29T04:08:12.596887+0000","last_became_active":"2024-03-29T04:08:12.590480+0000","last_became_peered":"2024-03-29T04:08:12.590480+0000","last_unstale":"2024-03-29T04:08:12.596887+0000","last_undegraded":"2024-03-29T04:08:12.596887+0000","last_fullsized":"2024-03-29T04:08:12.596887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:47:13.560160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.599128+0000","last_change":"2024-03-29T04:08:12.595229+0000","last_active":"2024-03-29T04:08:12.599128+0000","last_peered":"2024-03-29T04:08:12.599128+0000","last_clean":"2024-03-29T04:08:12.599128+0000","last_became_active":"2024-03-29T04:08:12.594665+0000","last_became_peered":"2024-03-29T04:08:12.594665+0000","last_unstale":"2024-03-29T04:08:12.599128+0000","last_undegraded":"2024-03-29T04:08:12.599128+0000","last_fullsized":"2024-03-29T04:08:12.599128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:15:10.072949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.596515+0000","last_change":"2024-03-29T04:08:11.587908+0000","last_active":"2024-03-29T04:08:12.596515+0000","last_peered":"2024-03-29T04:08:12.596515+0000","last_clean":"2024-03-29T04:08:12.596515+0000","last_became_active":"2024-03-29T04:08:11.587602+0000","last_became_peered":"2024-03-29T04:08:11.587602+0000","last_unstale":"2024-03-29T04:08:12.596515+0000","last_undegraded":"2024-03-29T04:08:12.596515+0000","last_fullsized":"2024-03-29T04:08:12.596515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:22:23.215000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.603297+0000","last_change":"2024-03-29T04:08:12.598292+0000","last_active":"2024-03-29T04:08:12.603297+0000","last_peered":"2024-03-29T04:08:12.603297+0000","last_clean":"2024-03-29T04:08:12.603297+0000","last_became_active":"2024-03-29T04:08:12.594781+0000","last_became_peered":"2024-03-29T04:08:12.594781+0000","last_unstale":"2024-03-29T04:08:12.603297+0000","last_undegraded":"2024-03-29T04:08:12.603297+0000","last_fullsized":"2024-03-29T04:08:12.603297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:51:30.023734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.591481+0000","last_change":"2024-03-29T04:08:11.583436+0000","last_active":"2024-03-29T04:08:12.591481+0000","last_peered":"2024-03-29T04:08:12.591481+0000","last_clean":"2024-03-29T04:08:12.591481+0000","last_became_active":"2024-03-29T04:08:11.583187+0000","last_became_peered":"2024-03-29T04:08:11.583187+0000","last_unstale":"2024-03-29T04:08:12.591481+0000","last_undegraded":"2024-03-29T04:08:12.591481+0000","last_fullsized":"2024-03-29T04:08:12.591481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:25:49.705595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.594991+0000","last_change":"2024-03-29T04:08:12.591815+0000","last_active":"2024-03-29T04:08:12.594991+0000","last_peered":"2024-03-29T04:08:12.594991+0000","last_clean":"2024-03-29T04:08:12.594991+0000","last_became_active":"2024-03-29T04:08:12.590845+0000","last_became_peered":"2024-03-29T04:08:12.590845+0000","last_unstale":"2024-03-29T04:08:12.594991+0000","last_undegraded":"2024-03-29T04:08:12.594991+0000","last_fullsized":"2024-03-29T04:08:12.594991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:15:10.072949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.581199+0000","last_change":"2024-03-29T04:08:11.583808+0000","last_active":"2024-03-29T04:08:12.581199+0000","last_peered":"2024-03-29T04:08:12.581199+0000","last_clean":"2024-03-29T04:08:12.581199+0000","last_became_active":"2024-03-29T04:08:11.583401+0000","last_became_peered":"2024-03-29T04:08:11.583401+0000","last_unstale":"2024-03-29T04:08:12.581199+0000","last_undegraded":"2024-03-29T04:08:12.581199+0000","last_fullsized":"2024-03-29T04:08:12.581199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T16:04:14.386764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.585869+0000","last_change":"2024-03-29T04:08:12.583667+0000","last_active":"2024-03-29T04:08:12.585869+0000","last_peered":"2024-03-29T04:08:12.585869+0000","last_clean":"2024-03-29T04:08:12.585869+0000","last_became_active":"2024-03-29T04:08:12.583396+0000","last_became_peered":"2024-03-29T04:08:12.583396+0000","last_unstale":"2024-03-29T04:08:12.585869+0000","last_undegraded":"2024-03-29T04:08:12.585869+0000","last_fullsized":"2024-03-29T04:08:12.585869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:29:58.161169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-29T04:08:12.594012+0000","last_change":"2024-03-29T04:08:11.583448+0000","last_active":"2024-03-29T04:08:12.594012+0000","last_peered":"2024-03-29T04:08:12.594012+0000","last_clean":"2024-03-29T04:08:12.594012+0000","last_became_active":"2024-03-29T04:08:11.583190+0000","last_became_peered":"2024-03-29T04:08:11.583190+0000","last_unstale":"2024-03-29T04:08:12.594012+0000","last_undegraded":"2024-03-29T04:08:12.594012+0000","last_fullsized":"2024-03-29T04:08:12.594012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T16:04:14.386764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":660255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":70917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":69395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":69431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":70917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":69305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":69465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":660311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-29T04:08:15.880 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-29T04:08:15.881 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-29T04:08:15.881 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-29T04:08:15.881 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-29T04:08:15.881 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-29T04:08:16.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.037+0000 7f79ece88640 1 Processor -- start 2024-03-29T04:08:16.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.037+0000 7f79ece88640 1 -- start start 2024-03-29T04:08:16.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.038+0000 7f79ece88640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f79e80d3310 0x7f79e81695b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:16.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.038+0000 7f79ece88640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79e80cfb30 con 0x7f79e80b3c50 2024-03-29T04:08:16.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.038+0000 7f79ece88640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79e80cfe10 con 0x7f79e815e930 2024-03-29T04:08:16.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.038+0000 7f79ece88640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f79e806c780 con 0x7f79e80d3310 2024-03-29T04:08:16.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.038+0000 7f79e6d9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f79e80d3310 0x7f79e81695b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:16.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.038+0000 7f79e5d9b640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f79e80b3c50 0x7f79e80d2c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58936/0 (socket says 172.21.15.73:58936) 2024-03-29T04:08:16.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.038+0000 7f79e6d9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f79e80d3310 0x7f79e81695b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45782/0 (socket says 172.21.15.73:45782) 2024-03-29T04:08:16.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.038+0000 7f79e5d9b640 1 -- 172.21.15.73:0/488827102 learned_addr learned my addr 172.21.15.73:0/488827102 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:16.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.039+0000 7f79e6d9d640 1 -- 172.21.15.73:0/488827102 >> v1:172.21.15.142:6789/0 conn(0x7f79e815e930 legacy=0x7f79e80cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:16.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.039+0000 7f79e6d9d640 1 -- 172.21.15.73:0/488827102 >> v1:172.21.15.73:6789/0 conn(0x7f79e80b3c50 legacy=0x7f79e80d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:16.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.039+0000 7f79e559a640 1 -- 172.21.15.73:0/488827102 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 629760918 0 0) 0x7f79e80cfe10 con 0x7f79e815e930 2024-03-29T04:08:16.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.039+0000 7f79e6d9d640 1 -- 172.21.15.73:0/488827102 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e80d00f0 con 0x7f79e80d3310 2024-03-29T04:08:16.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.039+0000 7f79e6d9d640 1 --2- 172.21.15.73:0/488827102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e80d3310 0x7f79e81695b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f79e00097a0 tx=0x7f79e002b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c455cdc9291eb0fb server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:16.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.039+0000 7f79e559a640 1 -- 172.21.15.73:0/488827102 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e0037070 con 0x7f79e80d3310 2024-03-29T04:08:16.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.039+0000 7f79e559a640 1 -- 172.21.15.73:0/488827102 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79e0030710 con 0x7f79e80d3310 2024-03-29T04:08:16.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.039+0000 7f79e559a640 1 -- 172.21.15.73:0/488827102 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e0030ae0 con 0x7f79e80d3310 2024-03-29T04:08:16.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.040+0000 7f79ece88640 1 -- 172.21.15.73:0/488827102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e80d3310 msgr2=0x7f79e81695b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:16.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.040+0000 7f79ece88640 1 --2- 172.21.15.73:0/488827102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e80d3310 0x7f79e81695b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f79e00097a0 tx=0x7f79e002b710 comp rx=0 tx=0).stop 2024-03-29T04:08:16.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.040+0000 7f79ece88640 1 -- 172.21.15.73:0/488827102 shutdown_connections 2024-03-29T04:08:16.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.040+0000 7f79ece88640 1 --2- 172.21.15.73:0/488827102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e80d3310 0x7f79e81695b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:16.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.040+0000 7f79ece88640 1 -- 172.21.15.73:0/488827102 >> 172.21.15.73:0/488827102 conn(0x7f79e808bfc0 msgr2=0x7f79e80d4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:16.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.040+0000 7f79ece88640 1 -- 172.21.15.73:0/488827102 shutdown_connections 2024-03-29T04:08:16.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.040+0000 7f79ece88640 1 -- 172.21.15.73:0/488827102 wait complete. 2024-03-29T04:08:16.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.041+0000 7f79ece88640 1 Processor -- start 2024-03-29T04:08:16.024 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.041+0000 7f79ece88640 1 -- start start 2024-03-29T04:08:16.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.042+0000 7f79ece88640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79e80b3c50 0x7f79e8153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:16.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.042+0000 7f79ece88640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79e80d3310 0x7f79e81614c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:16.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.042+0000 7f79ece88640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e815e930 0x7f79e8161a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:16.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.042+0000 7f79ece88640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f79e815ed10 con 0x7f79e815e930 2024-03-29T04:08:16.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.042+0000 7f79ece88640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f79e80cf840 con 0x7f79e80b3c50 2024-03-29T04:08:16.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.042+0000 7f79ece88640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f79e815ee90 con 0x7f79e80d3310 2024-03-29T04:08:16.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.042+0000 7f79e6d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e815e930 0x7f79e8161a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:16.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.042+0000 7f79e6d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e815e930 0x7f79e8161a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45788/0 (socket says 172.21.15.73:45788) 2024-03-29T04:08:16.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.042+0000 7f79e6d9d640 1 -- 172.21.15.73:0/2943646973 learned_addr learned my addr 172.21.15.73:0/2943646973 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:16.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.042+0000 7f79e659c640 1 --2- 172.21.15.73:0/2943646973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79e80b3c50 0x7f79e8153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:16.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.042+0000 7f79e5d9b640 1 --2- 172.21.15.73:0/2943646973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79e80d3310 0x7f79e81614c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:16.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.042+0000 7f79e6d9d640 1 -- 172.21.15.73:0/2943646973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79e80d3310 msgr2=0x7f79e81614c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:16.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.042+0000 7f79e6d9d640 1 --2- 172.21.15.73:0/2943646973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79e80d3310 0x7f79e81614c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:16.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.042+0000 7f79e6d9d640 1 -- 172.21.15.73:0/2943646973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79e80b3c50 msgr2=0x7f79e8153660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:16.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.042+0000 7f79e6d9d640 1 --2- 172.21.15.73:0/2943646973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79e80b3c50 0x7f79e8153660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:16.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.042+0000 7f79e6d9d640 1 -- 172.21.15.73:0/2943646973 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e81f5270 con 0x7f79e815e930 2024-03-29T04:08:16.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.043+0000 7f79e6d9d640 1 --2- 172.21.15.73:0/2943646973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e815e930 0x7f79e8161a00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f79e00097a0 tx=0x7f79e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:16.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.043+0000 7f79d6ffd640 1 -- 172.21.15.73:0/2943646973 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e0042070 con 0x7f79e815e930 2024-03-29T04:08:16.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.043+0000 7f79d6ffd640 1 -- 172.21.15.73:0/2943646973 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79e00329c0 con 0x7f79e815e930 2024-03-29T04:08:16.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.043+0000 7f79ece88640 1 -- 172.21.15.73:0/2943646973 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79e81f46f0 con 0x7f79e815e930 2024-03-29T04:08:16.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.043+0000 7f79d6ffd640 1 -- 172.21.15.73:0/2943646973 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e0037040 con 0x7f79e815e930 2024-03-29T04:08:16.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.043+0000 7f79ece88640 1 -- 172.21.15.73:0/2943646973 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79e81f4f90 con 0x7f79e815e930 2024-03-29T04:08:16.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.044+0000 7f79ece88640 1 -- 172.21.15.73:0/2943646973 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79e81f4ae0 con 0x7f79e815e930 2024-03-29T04:08:16.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.044+0000 7f79d6ffd640 1 -- 172.21.15.73:0/2943646973 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f79e0045070 con 0x7f79e815e930 2024-03-29T04:08:16.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.045+0000 7f79d6ffd640 1 --2- 172.21.15.73:0/2943646973 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f79c806c530 0x7f79c806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:16.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.045+0000 7f79d6ffd640 1 -- 172.21.15.73:0/2943646973 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f79e00ad450 con 0x7f79e815e930 2024-03-29T04:08:16.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.045+0000 7f79e659c640 1 --2- 172.21.15.73:0/2943646973 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f79c806c530 0x7f79c806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:16.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.045+0000 7f79e659c640 1 --2- 172.21.15.73:0/2943646973 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f79c806c530 0x7f79c806e9f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f79d80012e0 tx=0x7f79d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:16.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.049+0000 7f79d6ffd640 1 -- 172.21.15.73:0/2943646973 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f79e007b5d0 con 0x7f79e815e930 2024-03-29T04:08:16.136 INFO:tasks.ceph.mds.b.smithi142.stderr:2024-03-29T04:08:16.157+0000 7ff3a2a82640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-29T04:08:16.249 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.270+0000 7f79ece88640 1 -- 172.21.15.73:0/2943646973 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f79e8068640 con 0x7f79e815e930 2024-03-29T04:08:16.252 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.273+0000 7f79d6ffd640 1 -- 172.21.15.73:0/2943646973 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+173734 (secure 0 0 0) 0x7f79e007f8d0 con 0x7f79e815e930 2024-03-29T04:08:16.254 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:16.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.275+0000 7f79ece88640 1 -- 172.21.15.73:0/2943646973 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f79c806c530 msgr2=0x7f79c806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:16.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.275+0000 7f79ece88640 1 --2- 172.21.15.73:0/2943646973 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f79c806c530 0x7f79c806e9f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f79d80012e0 tx=0x7f79d8009040 comp rx=0 tx=0).stop 2024-03-29T04:08:16.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.275+0000 7f79ece88640 1 -- 172.21.15.73:0/2943646973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e815e930 msgr2=0x7f79e8161a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:16.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.275+0000 7f79ece88640 1 --2- 172.21.15.73:0/2943646973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e815e930 0x7f79e8161a00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f79e00097a0 tx=0x7f79e00046c0 comp rx=0 tx=0).stop 2024-03-29T04:08:16.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.275+0000 7f79ece88640 1 -- 172.21.15.73:0/2943646973 shutdown_connections 2024-03-29T04:08:16.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.275+0000 7f79ece88640 1 --2- 172.21.15.73:0/2943646973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79e815e930 0x7f79e8161a00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:16.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.275+0000 7f79ece88640 1 --2- 172.21.15.73:0/2943646973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f79e80d3310 0x7f79e81614c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:16.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.275+0000 7f79ece88640 1 --2- 172.21.15.73:0/2943646973 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f79c806c530 0x7f79c806e9f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:16.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.275+0000 7f79ece88640 1 --2- 172.21.15.73:0/2943646973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79e80b3c50 0x7f79e8153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:16.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.275+0000 7f79ece88640 1 -- 172.21.15.73:0/2943646973 >> 172.21.15.73:0/2943646973 conn(0x7f79e808bfc0 msgr2=0x7f79e80d21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:16.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.275+0000 7f79ece88640 1 -- 172.21.15.73:0/2943646973 shutdown_connections 2024-03-29T04:08:16.259 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.275+0000 7f79ece88640 1 -- 172.21.15.73:0/2943646973 wait complete. 2024-03-29T04:08:16.265 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1640471941},{"type":"v1","addr":"172.21.15.73:6833","nonce":1640471941}]},"active_addr":"172.21.15.73:6833/1640471941","active_change":"2024-03-29T04:07:51.514744+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":1381795220}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":4266775109}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":772912691}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":2987794894}]}]} 2024-03-29T04:08:16.269 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-29T04:08:16.269 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-29T04:08:16.269 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-29T04:08:16.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.390+0000 7f419e99d640 1 Processor -- start 2024-03-29T04:08:16.370 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.391+0000 7f419e99d640 1 -- start start 2024-03-29T04:08:16.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.391+0000 7f419e99d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4198161e40 0x7f41980b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:16.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.391+0000 7f419e99d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f41980b3690 0x7f41980d28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:16.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.391+0000 7f419e99d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f419808c560 con 0x7f41980d2e30 2024-03-29T04:08:16.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.391+0000 7f419e99d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f41980d3260 con 0x7f41980b3690 2024-03-29T04:08:16.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.391+0000 7f419e99d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f41980d2330 con 0x7f4198161e40 2024-03-29T04:08:16.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.391+0000 7f419d19a640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f41980b3690 0x7f41980d28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:16.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.391+0000 7f419e19c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f41980d2e30 0x7f41980cef40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58944/0 (socket says 172.21.15.73:58944) 2024-03-29T04:08:16.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.391+0000 7f419e19c640 1 -- 172.21.15.73:0/4267887733 learned_addr learned my addr 172.21.15.73:0/4267887733 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:16.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.392+0000 7f419d99b640 1 --2- 172.21.15.73:0/4267887733 >> v2:172.21.15.142:3300/0 conn(0x7f4198161e40 0x7f41980b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:16.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.392+0000 7f419d19a640 1 -- 172.21.15.73:0/4267887733 >> v2:172.21.15.142:3300/0 conn(0x7f4198161e40 msgr2=0x7f41980b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:16.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.392+0000 7f419d19a640 1 --2- 172.21.15.73:0/4267887733 >> v2:172.21.15.142:3300/0 conn(0x7f4198161e40 0x7f41980b30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:16.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.392+0000 7f419d19a640 1 -- 172.21.15.73:0/4267887733 >> v1:172.21.15.73:6789/0 conn(0x7f41980d2e30 legacy=0x7f41980cef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:16.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.392+0000 7f419d19a640 1 -- 172.21.15.73:0/4267887733 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41980d25f0 con 0x7f41980b3690 2024-03-29T04:08:16.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.392+0000 7f419c999640 1 -- 172.21.15.73:0/4267887733 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3785073073 0 0) 0x7f419808c560 con 0x7f41980d2e30 2024-03-29T04:08:16.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.392+0000 7f419d19a640 1 --2- 172.21.15.73:0/4267887733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41980b3690 0x7f41980d28f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f419808cbc0 tx=0x7f418802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48a6583b1f3d032c server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:16.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.393+0000 7f419c999640 1 -- 172.21.15.73:0/4267887733 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4188035020 con 0x7f41980b3690 2024-03-29T04:08:16.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.393+0000 7f419c999640 1 -- 172.21.15.73:0/4267887733 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4188031830 con 0x7f41980b3690 2024-03-29T04:08:16.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.393+0000 7f419c999640 1 -- 172.21.15.73:0/4267887733 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4188031c00 con 0x7f41980b3690 2024-03-29T04:08:16.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.393+0000 7f419e99d640 1 -- 172.21.15.73:0/4267887733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41980b3690 msgr2=0x7f41980d28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:16.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.393+0000 7f419e99d640 1 --2- 172.21.15.73:0/4267887733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41980b3690 0x7f41980d28f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f419808cbc0 tx=0x7f418802b8d0 comp rx=0 tx=0).stop 2024-03-29T04:08:16.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.393+0000 7f419e99d640 1 -- 172.21.15.73:0/4267887733 shutdown_connections 2024-03-29T04:08:16.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.393+0000 7f419e99d640 1 --2- 172.21.15.73:0/4267887733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41980b3690 0x7f41980d28f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:16.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.393+0000 7f419e99d640 1 --2- 172.21.15.73:0/4267887733 >> v2:172.21.15.142:3300/0 conn(0x7f4198161e40 0x7f41980b30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:16.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.393+0000 7f419e99d640 1 -- 172.21.15.73:0/4267887733 >> 172.21.15.73:0/4267887733 conn(0x7f419808bfc0 msgr2=0x7f41980d4430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:16.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.393+0000 7f419e99d640 1 -- 172.21.15.73:0/4267887733 shutdown_connections 2024-03-29T04:08:16.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.393+0000 7f419e99d640 1 -- 172.21.15.73:0/4267887733 wait complete. 2024-03-29T04:08:16.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.394+0000 7f419e99d640 1 Processor -- start 2024-03-29T04:08:16.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.394+0000 7f419e99d640 1 -- start start 2024-03-29T04:08:16.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.395+0000 7f419e99d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41980b3690 0x7f41980ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:16.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.395+0000 7f419e99d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41980d2e30 0x7f41980cd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:16.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.395+0000 7f419e99d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4198161e40 0x7f41981f47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:16.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.395+0000 7f419e99d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f41980d01d0 con 0x7f41980b3690 2024-03-29T04:08:16.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.395+0000 7f419e99d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f41980d50c0 con 0x7f4198161e40 2024-03-29T04:08:16.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.395+0000 7f419e99d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f4198162220 con 0x7f41980d2e30 2024-03-29T04:08:16.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.395+0000 7f419d99b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41980b3690 0x7f41980ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:16.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.395+0000 7f419d99b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41980b3690 0x7f41980ce0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45804/0 (socket says 172.21.15.73:45804) 2024-03-29T04:08:16.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.395+0000 7f419d99b640 1 -- 172.21.15.73:0/1209620977 learned_addr learned my addr 172.21.15.73:0/1209620977 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:16.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.395+0000 7f419e19c640 1 --2- 172.21.15.73:0/1209620977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4198161e40 0x7f41981f47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:16.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.395+0000 7f419d19a640 1 --2- 172.21.15.73:0/1209620977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41980d2e30 0x7f41980cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:16.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.395+0000 7f419d99b640 1 -- 172.21.15.73:0/1209620977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41980d2e30 msgr2=0x7f41980cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:16.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.395+0000 7f419d99b640 1 --2- 172.21.15.73:0/1209620977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41980d2e30 0x7f41980cd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:16.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.395+0000 7f419d99b640 1 -- 172.21.15.73:0/1209620977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4198161e40 msgr2=0x7f41981f47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:16.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.395+0000 7f419d99b640 1 --2- 172.21.15.73:0/1209620977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4198161e40 0x7f41981f47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:16.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.395+0000 7f419d99b640 1 -- 172.21.15.73:0/1209620977 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41981f7dd0 con 0x7f41980b3690 2024-03-29T04:08:16.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.396+0000 7f419d99b640 1 --2- 172.21.15.73:0/1209620977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41980b3690 0x7f41980ce0d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f419000efc0 tx=0x7f419000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:16.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.396+0000 7f418e7fc640 1 -- 172.21.15.73:0/1209620977 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4190018020 con 0x7f41980b3690 2024-03-29T04:08:16.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.396+0000 7f418e7fc640 1 -- 172.21.15.73:0/1209620977 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4190014480 con 0x7f41980b3690 2024-03-29T04:08:16.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.396+0000 7f418e7fc640 1 -- 172.21.15.73:0/1209620977 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4190014850 con 0x7f41980b3690 2024-03-29T04:08:16.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.396+0000 7f419e99d640 1 -- 172.21.15.73:0/1209620977 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41981f80b0 con 0x7f41980b3690 2024-03-29T04:08:16.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.396+0000 7f419e99d640 1 -- 172.21.15.73:0/1209620977 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41981f3730 con 0x7f41980b3690 2024-03-29T04:08:16.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.397+0000 7f419e99d640 1 -- 172.21.15.73:0/1209620977 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f419804f8f0 con 0x7f41980b3690 2024-03-29T04:08:16.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.397+0000 7f418e7fc640 1 -- 172.21.15.73:0/1209620977 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f4190005d10 con 0x7f41980b3690 2024-03-29T04:08:16.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.398+0000 7f418e7fc640 1 --2- 172.21.15.73:0/1209620977 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f417c06c530 0x7f417c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:16.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.398+0000 7f419d19a640 1 --2- 172.21.15.73:0/1209620977 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f417c06c530 0x7f417c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:16.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.398+0000 7f418e7fc640 1 -- 172.21.15.73:0/1209620977 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f419008bf70 con 0x7f41980b3690 2024-03-29T04:08:16.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.398+0000 7f419d19a640 1 --2- 172.21.15.73:0/1209620977 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f417c06c530 0x7f417c06e9f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4188036000 tx=0x7f4188008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:16.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.402+0000 7f418e7fc640 1 -- 172.21.15.73:0/1209620977 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f4190022070 con 0x7f41980b3690 2024-03-29T04:08:16.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.577+0000 7f419e99d640 1 -- 172.21.15.73:0/1209620977 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f41980cde40 con 0x7f41980b3690 2024-03-29T04:08:16.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.578+0000 7f418e7fc640 1 -- 172.21.15.73:0/1209620977 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16605 (secure 0 0 0) 0x7f4190010040 con 0x7f41980b3690 2024-03-29T04:08:16.558 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:16.558 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"6bff1617-b138-4517-acca-3ecaae3f2bb3","created":"2024-03-29T04:07:47.346864+0000","modified":"2024-03-29T04:08:13.577603+0000","last_up_change":"2024-03-29T04:07:58.507139+0000","last_in_change":"2024-03-29T04:07:49.637816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-29T04:07:59.537301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-29T04:08:09.570906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-29T04:08:10.882349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"925d7de1-14ab-48c0-aebd-7bded108f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6820","nonce":2387335359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6824","nonce":2387335359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6831","nonce":2387335359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6828","nonce":2387335359}]},"public_addr":"172.21.15.73:6820/2387335359","cluster_addr":"172.21.15.73:6824/2387335359","heartbeat_back_addr":"172.21.15.73:6831/2387335359","heartbeat_front_addr":"172.21.15.73:6828/2387335359","state":["exists","up"]},{"osd":1,"uuid":"6b182102-882a-4e0c-99db-0afae5cfb38b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6801","nonce":2431315515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6803","nonce":2431315515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6807","nonce":2431315515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6805","nonce":2431315515}]},"public_addr":"172.21.15.73:6801/2431315515","cluster_addr":"172.21.15.73:6803/2431315515","heartbeat_back_addr":"172.21.15.73:6807/2431315515","heartbeat_front_addr":"172.21.15.73:6805/2431315515","state":["exists","up"]},{"osd":2,"uuid":"8040902e-b0b8-4a21-bf64-ce1c222115ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6809","nonce":407236597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6811","nonce":407236597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6815","nonce":407236597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6813","nonce":407236597}]},"public_addr":"172.21.15.73:6809/407236597","cluster_addr":"172.21.15.73:6811/407236597","heartbeat_back_addr":"172.21.15.73:6815/407236597","heartbeat_front_addr":"172.21.15.73:6813/407236597","state":["exists","up"]},{"osd":3,"uuid":"1bab19ee-3775-4ce1-a4ce-cf7cda3bbbf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6817","nonce":4291100709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6821","nonce":4291100709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6829","nonce":4291100709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6825","nonce":4291100709}]},"public_addr":"172.21.15.73:6817/4291100709","cluster_addr":"172.21.15.73:6821/4291100709","heartbeat_back_addr":"172.21.15.73:6829/4291100709","heartbeat_front_addr":"172.21.15.73:6825/4291100709","state":["exists","up"]},{"osd":4,"uuid":"b0c74337-8fe4-47dc-b3da-2d07591b1f6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6817","nonce":3703256194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6819","nonce":3703256194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6823","nonce":3703256194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6821","nonce":3703256194}]},"public_addr":"172.21.15.142:6817/3703256194","cluster_addr":"172.21.15.142:6819/3703256194","heartbeat_back_addr":"172.21.15.142:6823/3703256194","heartbeat_front_addr":"172.21.15.142:6821/3703256194","state":["exists","up"]},{"osd":5,"uuid":"9ce36410-a29a-42c6-99f4-f95d4afdd7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6825","nonce":4271575803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6827","nonce":4271575803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6831","nonce":4271575803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6829","nonce":4271575803}]},"public_addr":"172.21.15.142:6825/4271575803","cluster_addr":"172.21.15.142:6827/4271575803","heartbeat_back_addr":"172.21.15.142:6831/4271575803","heartbeat_front_addr":"172.21.15.142:6829/4271575803","state":["exists","up"]},{"osd":6,"uuid":"aec4264a-64ac-428e-a860-d2920a304019","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6801","nonce":1772722570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6803","nonce":1772722570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6807","nonce":1772722570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6805","nonce":1772722570}]},"public_addr":"172.21.15.142:6801/1772722570","cluster_addr":"172.21.15.142:6803/1772722570","heartbeat_back_addr":"172.21.15.142:6807/1772722570","heartbeat_front_addr":"172.21.15.142:6805/1772722570","state":["exists","up"]},{"osd":7,"uuid":"fe599052-8e5a-4c7a-91e7-52d1bae24a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6809","nonce":3910589675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6811","nonce":3910589675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6815","nonce":3910589675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6813","nonce":3910589675}]},"public_addr":"172.21.15.142:6809/3910589675","cluster_addr":"172.21.15.142:6811/3910589675","heartbeat_back_addr":"172.21.15.142:6815/3910589675","heartbeat_front_addr":"172.21.15.142:6813/3910589675","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.835096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.587210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.786547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.778004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.843740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.791160+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.837992+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.718722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:08:16.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.580+0000 7f419e99d640 1 -- 172.21.15.73:0/1209620977 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f417c06c530 msgr2=0x7f417c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:16.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.580+0000 7f419e99d640 1 --2- 172.21.15.73:0/1209620977 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f417c06c530 0x7f417c06e9f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4188036000 tx=0x7f4188008030 comp rx=0 tx=0).stop 2024-03-29T04:08:16.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.580+0000 7f419e99d640 1 -- 172.21.15.73:0/1209620977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41980b3690 msgr2=0x7f41980ce0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:16.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.580+0000 7f419e99d640 1 --2- 172.21.15.73:0/1209620977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41980b3690 0x7f41980ce0d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f419000efc0 tx=0x7f419000c490 comp rx=0 tx=0).stop 2024-03-29T04:08:16.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.580+0000 7f419e99d640 1 -- 172.21.15.73:0/1209620977 shutdown_connections 2024-03-29T04:08:16.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.580+0000 7f419e99d640 1 --2- 172.21.15.73:0/1209620977 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f417c06c530 0x7f417c06e9f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:16.560 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.580+0000 7f419e99d640 1 --2- 172.21.15.73:0/1209620977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4198161e40 0x7f41981f47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:16.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.580+0000 7f419e99d640 1 --2- 172.21.15.73:0/1209620977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41980d2e30 0x7f41980cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:16.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.580+0000 7f419e99d640 1 --2- 172.21.15.73:0/1209620977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41980b3690 0x7f41980ce0d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:16.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.580+0000 7f419e99d640 1 -- 172.21.15.73:0/1209620977 >> 172.21.15.73:0/1209620977 conn(0x7f419808bfc0 msgr2=0x7f419806c870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:16.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.580+0000 7f419e99d640 1 -- 172.21.15.73:0/1209620977 shutdown_connections 2024-03-29T04:08:16.561 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.580+0000 7f419e99d640 1 -- 172.21.15.73:0/1209620977 wait complete. 2024-03-29T04:08:16.571 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-29T04:08:16.571 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-29T04:08:16.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.692+0000 7f6f2cf59640 1 Processor -- start 2024-03-29T04:08:16.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.692+0000 7f6f2cf59640 1 -- start start 2024-03-29T04:08:16.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.693+0000 7f6f2cf59640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6f2815e860 0x7f6f280d2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:16.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.693+0000 7f6f2cf59640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6f280cca80 0x7f6f280ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:16.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.693+0000 7f6f2cf59640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f2815ec40 con 0x7f6f280d10d0 2024-03-29T04:08:16.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.693+0000 7f6f2cf59640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f6f28070140 con 0x7f6f280cca80 2024-03-29T04:08:16.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.693+0000 7f6f2cf59640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f6f280d15d0 con 0x7f6f2815e860 2024-03-29T04:08:16.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.693+0000 7f6f26d9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6f280cca80 0x7f6f280ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:16.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.693+0000 7f6f26d9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6f280cca80 0x7f6f280ccf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45818/0 (socket says 172.21.15.73:45818) 2024-03-29T04:08:16.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.693+0000 7f6f26d9d640 1 -- 172.21.15.73:0/1761119035 learned_addr learned my addr 172.21.15.73:0/1761119035 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:16.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.693+0000 7f6f2659c640 1 --2- 172.21.15.73:0/1761119035 >> v2:172.21.15.142:3300/0 conn(0x7f6f2815e860 0x7f6f280d2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:16.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.693+0000 7f6f26d9d640 1 -- 172.21.15.73:0/1761119035 >> v2:172.21.15.142:3300/0 conn(0x7f6f2815e860 msgr2=0x7f6f280d2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:16.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.693+0000 7f6f26d9d640 1 --2- 172.21.15.73:0/1761119035 >> v2:172.21.15.142:3300/0 conn(0x7f6f2815e860 0x7f6f280d2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:16.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.693+0000 7f6f26d9d640 1 -- 172.21.15.73:0/1761119035 >> v1:172.21.15.142:6789/0 conn(0x7f6f280d10d0 legacy=0x7f6f280705d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:16.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.693+0000 7f6f26d9d640 1 -- 172.21.15.73:0/1761119035 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f280d18b0 con 0x7f6f280cca80 2024-03-29T04:08:16.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.694+0000 7f6f26d9d640 1 --2- 172.21.15.73:0/1761119035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f280cca80 0x7f6f280ccf10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6f28071d40 tx=0x7f6f2002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27b6c73602c6e3a5 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:16.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.694+0000 7f6f25d9b640 1 -- 172.21.15.73:0/1761119035 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f2002cb20 con 0x7f6f280cca80 2024-03-29T04:08:16.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.694+0000 7f6f25d9b640 1 -- 172.21.15.73:0/1761119035 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f2002ccc0 con 0x7f6f280cca80 2024-03-29T04:08:16.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.694+0000 7f6f25d9b640 1 -- 172.21.15.73:0/1761119035 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f20034610 con 0x7f6f280cca80 2024-03-29T04:08:16.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.694+0000 7f6f2cf59640 1 -- 172.21.15.73:0/1761119035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f280cca80 msgr2=0x7f6f280ccf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:16.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.694+0000 7f6f2cf59640 1 --2- 172.21.15.73:0/1761119035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f280cca80 0x7f6f280ccf10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6f28071d40 tx=0x7f6f2002bf80 comp rx=0 tx=0).stop 2024-03-29T04:08:16.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.694+0000 7f6f2cf59640 1 -- 172.21.15.73:0/1761119035 shutdown_connections 2024-03-29T04:08:16.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.694+0000 7f6f2cf59640 1 --2- 172.21.15.73:0/1761119035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f280cca80 0x7f6f280ccf10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:16.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.694+0000 7f6f2cf59640 1 --2- 172.21.15.73:0/1761119035 >> v2:172.21.15.142:3300/0 conn(0x7f6f2815e860 0x7f6f280d2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:16.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.694+0000 7f6f2cf59640 1 -- 172.21.15.73:0/1761119035 >> 172.21.15.73:0/1761119035 conn(0x7f6f280d2430 msgr2=0x7f6f280d2840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:16.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.694+0000 7f6f2cf59640 1 -- 172.21.15.73:0/1761119035 shutdown_connections 2024-03-29T04:08:16.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.694+0000 7f6f2cf59640 1 -- 172.21.15.73:0/1761119035 wait complete. 2024-03-29T04:08:16.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.696+0000 7f6f2cf59640 1 Processor -- start 2024-03-29T04:08:16.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.696+0000 7f6f2cf59640 1 -- start start 2024-03-29T04:08:16.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.696+0000 7f6f2cf59640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f280cca80 0x7f6f28153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:16.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.696+0000 7f6f2cf59640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f280d10d0 0x7f6f280c7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:16.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.696+0000 7f6f2cf59640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f2815e860 0x7f6f280c7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:16.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.696+0000 7f6f2cf59640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6f28163090 con 0x7f6f280d10d0 2024-03-29T04:08:16.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.696+0000 7f6f2cf59640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6f2806fdd0 con 0x7f6f2815e860 2024-03-29T04:08:16.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.696+0000 7f6f2cf59640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f6f28070ce0 con 0x7f6f280cca80 2024-03-29T04:08:16.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.696+0000 7f6f1ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f280d10d0 0x7f6f280c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:16.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.696+0000 7f6f1ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f280d10d0 0x7f6f280c7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45830/0 (socket says 172.21.15.73:45830) 2024-03-29T04:08:16.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.696+0000 7f6f1ffff640 1 -- 172.21.15.73:0/3287585223 learned_addr learned my addr 172.21.15.73:0/3287585223 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:16.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.696+0000 7f6f26d9d640 1 --2- 172.21.15.73:0/3287585223 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f2815e860 0x7f6f280c7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:16.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.697+0000 7f6f2659c640 1 --2- 172.21.15.73:0/3287585223 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f280cca80 0x7f6f28153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:16.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.697+0000 7f6f1ffff640 1 -- 172.21.15.73:0/3287585223 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f280cca80 msgr2=0x7f6f28153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:16.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.697+0000 7f6f1ffff640 1 --2- 172.21.15.73:0/3287585223 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f280cca80 0x7f6f28153d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:16.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.697+0000 7f6f1ffff640 1 -- 172.21.15.73:0/3287585223 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f2815e860 msgr2=0x7f6f280c7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:16.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.697+0000 7f6f1ffff640 1 --2- 172.21.15.73:0/3287585223 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f2815e860 0x7f6f280c7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:16.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.697+0000 7f6f1ffff640 1 -- 172.21.15.73:0/3287585223 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f280b5850 con 0x7f6f280d10d0 2024-03-29T04:08:16.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.697+0000 7f6f1ffff640 1 --2- 172.21.15.73:0/3287585223 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f280d10d0 0x7f6f280c7890 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6f1000c430 tx=0x7f6f1000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:16.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.697+0000 7f6f1effd640 1 -- 172.21.15.73:0/3287585223 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f100052d0 con 0x7f6f280d10d0 2024-03-29T04:08:16.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.697+0000 7f6f1effd640 1 -- 172.21.15.73:0/3287585223 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f10005490 con 0x7f6f280d10d0 2024-03-29T04:08:16.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.697+0000 7f6f2cf59640 1 -- 172.21.15.73:0/3287585223 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f280ca480 con 0x7f6f280d10d0 2024-03-29T04:08:16.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.697+0000 7f6f1effd640 1 -- 172.21.15.73:0/3287585223 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f10007260 con 0x7f6f280d10d0 2024-03-29T04:08:16.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.697+0000 7f6f2cf59640 1 -- 172.21.15.73:0/3287585223 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f280caa40 con 0x7f6f280d10d0 2024-03-29T04:08:16.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.698+0000 7f6f2cf59640 1 -- 172.21.15.73:0/3287585223 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f28068640 con 0x7f6f280d10d0 2024-03-29T04:08:16.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.698+0000 7f6f1effd640 1 -- 172.21.15.73:0/3287585223 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f6f10007400 con 0x7f6f280d10d0 2024-03-29T04:08:16.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.699+0000 7f6f1effd640 1 --2- 172.21.15.73:0/3287585223 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f6f0806c530 0x7f6f0806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:16.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.699+0000 7f6f1effd640 1 -- 172.21.15.73:0/3287585223 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6f1008ab60 con 0x7f6f280d10d0 2024-03-29T04:08:16.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.699+0000 7f6f2659c640 1 --2- 172.21.15.73:0/3287585223 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f6f0806c530 0x7f6f0806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:16.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.699+0000 7f6f2659c640 1 --2- 172.21.15.73:0/3287585223 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f6f0806c530 0x7f6f0806e9f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6f18009b40 tx=0x7f6f18009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:16.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.703+0000 7f6f1effd640 1 -- 172.21.15.73:0/3287585223 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f6f10058b30 con 0x7f6f280d10d0 2024-03-29T04:08:16.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.877+0000 7f6f2cf59640 1 -- 172.21.15.73:0/3287585223 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6f280b83b0 con 0x7f6f280d10d0 2024-03-29T04:08:16.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.879+0000 7f6f1effd640 1 -- 172.21.15.73:0/3287585223 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16605 (secure 0 0 0) 0x7f6f1005ce30 con 0x7f6f280d10d0 2024-03-29T04:08:16.858 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:16.859 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"6bff1617-b138-4517-acca-3ecaae3f2bb3","created":"2024-03-29T04:07:47.346864+0000","modified":"2024-03-29T04:08:13.577603+0000","last_up_change":"2024-03-29T04:07:58.507139+0000","last_in_change":"2024-03-29T04:07:49.637816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-29T04:07:59.537301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-29T04:08:09.570906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-29T04:08:10.882349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"925d7de1-14ab-48c0-aebd-7bded108f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6820","nonce":2387335359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6824","nonce":2387335359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6831","nonce":2387335359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6828","nonce":2387335359}]},"public_addr":"172.21.15.73:6820/2387335359","cluster_addr":"172.21.15.73:6824/2387335359","heartbeat_back_addr":"172.21.15.73:6831/2387335359","heartbeat_front_addr":"172.21.15.73:6828/2387335359","state":["exists","up"]},{"osd":1,"uuid":"6b182102-882a-4e0c-99db-0afae5cfb38b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6801","nonce":2431315515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6803","nonce":2431315515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6807","nonce":2431315515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6805","nonce":2431315515}]},"public_addr":"172.21.15.73:6801/2431315515","cluster_addr":"172.21.15.73:6803/2431315515","heartbeat_back_addr":"172.21.15.73:6807/2431315515","heartbeat_front_addr":"172.21.15.73:6805/2431315515","state":["exists","up"]},{"osd":2,"uuid":"8040902e-b0b8-4a21-bf64-ce1c222115ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6809","nonce":407236597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6811","nonce":407236597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6815","nonce":407236597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6813","nonce":407236597}]},"public_addr":"172.21.15.73:6809/407236597","cluster_addr":"172.21.15.73:6811/407236597","heartbeat_back_addr":"172.21.15.73:6815/407236597","heartbeat_front_addr":"172.21.15.73:6813/407236597","state":["exists","up"]},{"osd":3,"uuid":"1bab19ee-3775-4ce1-a4ce-cf7cda3bbbf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6817","nonce":4291100709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6821","nonce":4291100709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6829","nonce":4291100709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6825","nonce":4291100709}]},"public_addr":"172.21.15.73:6817/4291100709","cluster_addr":"172.21.15.73:6821/4291100709","heartbeat_back_addr":"172.21.15.73:6829/4291100709","heartbeat_front_addr":"172.21.15.73:6825/4291100709","state":["exists","up"]},{"osd":4,"uuid":"b0c74337-8fe4-47dc-b3da-2d07591b1f6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6817","nonce":3703256194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6819","nonce":3703256194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6823","nonce":3703256194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6821","nonce":3703256194}]},"public_addr":"172.21.15.142:6817/3703256194","cluster_addr":"172.21.15.142:6819/3703256194","heartbeat_back_addr":"172.21.15.142:6823/3703256194","heartbeat_front_addr":"172.21.15.142:6821/3703256194","state":["exists","up"]},{"osd":5,"uuid":"9ce36410-a29a-42c6-99f4-f95d4afdd7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6825","nonce":4271575803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6827","nonce":4271575803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6831","nonce":4271575803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6829","nonce":4271575803}]},"public_addr":"172.21.15.142:6825/4271575803","cluster_addr":"172.21.15.142:6827/4271575803","heartbeat_back_addr":"172.21.15.142:6831/4271575803","heartbeat_front_addr":"172.21.15.142:6829/4271575803","state":["exists","up"]},{"osd":6,"uuid":"aec4264a-64ac-428e-a860-d2920a304019","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6801","nonce":1772722570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6803","nonce":1772722570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6807","nonce":1772722570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6805","nonce":1772722570}]},"public_addr":"172.21.15.142:6801/1772722570","cluster_addr":"172.21.15.142:6803/1772722570","heartbeat_back_addr":"172.21.15.142:6807/1772722570","heartbeat_front_addr":"172.21.15.142:6805/1772722570","state":["exists","up"]},{"osd":7,"uuid":"fe599052-8e5a-4c7a-91e7-52d1bae24a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6809","nonce":3910589675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6811","nonce":3910589675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6815","nonce":3910589675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6813","nonce":3910589675}]},"public_addr":"172.21.15.142:6809/3910589675","cluster_addr":"172.21.15.142:6811/3910589675","heartbeat_back_addr":"172.21.15.142:6815/3910589675","heartbeat_front_addr":"172.21.15.142:6813/3910589675","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.835096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.587210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.786547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.778004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.843740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.791160+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.837992+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.718722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:08:16.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.880+0000 7f6f2cf59640 1 -- 172.21.15.73:0/3287585223 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f6f0806c530 msgr2=0x7f6f0806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:16.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.880+0000 7f6f2cf59640 1 --2- 172.21.15.73:0/3287585223 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f6f0806c530 0x7f6f0806e9f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6f18009b40 tx=0x7f6f18009190 comp rx=0 tx=0).stop 2024-03-29T04:08:16.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.880+0000 7f6f2cf59640 1 -- 172.21.15.73:0/3287585223 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f280d10d0 msgr2=0x7f6f280c7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:16.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.880+0000 7f6f2cf59640 1 --2- 172.21.15.73:0/3287585223 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f280d10d0 0x7f6f280c7890 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6f1000c430 tx=0x7f6f1000c8f0 comp rx=0 tx=0).stop 2024-03-29T04:08:16.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.881+0000 7f6f2cf59640 1 -- 172.21.15.73:0/3287585223 shutdown_connections 2024-03-29T04:08:16.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.881+0000 7f6f2cf59640 1 --2- 172.21.15.73:0/3287585223 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f6f0806c530 0x7f6f0806e9f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:16.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.881+0000 7f6f2cf59640 1 --2- 172.21.15.73:0/3287585223 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f2815e860 0x7f6f280c7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:16.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.881+0000 7f6f2cf59640 1 --2- 172.21.15.73:0/3287585223 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f280d10d0 0x7f6f280c7890 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:16.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.881+0000 7f6f2cf59640 1 --2- 172.21.15.73:0/3287585223 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6f280cca80 0x7f6f28153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:16.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.881+0000 7f6f2cf59640 1 -- 172.21.15.73:0/3287585223 >> 172.21.15.73:0/3287585223 conn(0x7f6f280d2430 msgr2=0x7f6f280b2350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:16.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.881+0000 7f6f2cf59640 1 -- 172.21.15.73:0/3287585223 shutdown_connections 2024-03-29T04:08:16.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:16.881+0000 7f6f2cf59640 1 -- 172.21.15.73:0/3287585223 wait complete. 2024-03-29T04:08:16.875 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-29T04:08:16.875 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-29T04:08:16.876 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-29T04:08:16.876 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-29T04:08:16.876 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-03-29T04:08:16.877 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-03-29T04:08:16.877 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-03-29T04:08:16.877 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-03-29T04:08:17.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.067+0000 7f9e2544e640 1 Processor -- start 2024-03-29T04:08:17.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.067+0000 7fafba6a5640 1 Processor -- start 2024-03-29T04:08:17.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.067+0000 7fb613d66640 1 Processor -- start 2024-03-29T04:08:17.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.067+0000 7fb613d66640 1 -- start start 2024-03-29T04:08:17.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.067+0000 7f9e2544e640 1 -- start start 2024-03-29T04:08:17.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.068+0000 7fa1452d0640 1 Processor -- start 2024-03-29T04:08:17.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.068+0000 7fa1452d0640 1 -- start start 2024-03-29T04:08:17.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.068+0000 7f7d0e32b640 1 Processor -- start 2024-03-29T04:08:17.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.068+0000 7f7d0e32b640 1 -- start start 2024-03-29T04:08:17.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.068+0000 7f9e2544e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e201447a0 0x7f9e20067330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.068+0000 7f9e2544e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9e2006cc30 0x7f9e200b4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.068+0000 7f9e2544e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e2006e150 con 0x7f9e200b4720 2024-03-29T04:08:17.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.068+0000 7f9e2544e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f9e200cd9e0 con 0x7f9e2006cc30 2024-03-29T04:08:17.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.068+0000 7f9e2544e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9e2006e730 con 0x7f9e201447a0 2024-03-29T04:08:17.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.069+0000 7f9e1f7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9e2006cc30 0x7f9e200b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.067+0000 7fafba6a5640 1 -- start start 2024-03-29T04:08:17.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.069+0000 7f9e1effd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e201447a0 0x7f9e20067330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.069+0000 7f9e1e7fc640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9e200b4720 0x7f9e2006c520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58958/0 (socket says 172.21.15.73:58958) 2024-03-29T04:08:17.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.069+0000 7f9e1e7fc640 1 -- 172.21.15.73:0/963631775 learned_addr learned my addr 172.21.15.73:0/963631775 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:17.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.069+0000 7fafba6a5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fafb4159b20 0x7fafb40d0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.069+0000 7fafba6a5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafb40d0670 0x7fafb406c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.069+0000 7fafba6a5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fafb406ca60 0x7fafb406ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.069+0000 7fafba6a5640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fafb4163fa0 con 0x7fafb4159b20 2024-03-29T04:08:17.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.068+0000 7fab02c88640 1 Processor -- start 2024-03-29T04:08:17.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.068+0000 7fab02c88640 1 -- start start 2024-03-29T04:08:17.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.069+0000 7fafba6a5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fafb406e3e0 con 0x7fafb406ca60 2024-03-29T04:08:17.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.069+0000 7fafba6a5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fafb4163390 con 0x7fafb40d0670 2024-03-29T04:08:17.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.069+0000 7fa1452d0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1380348f0 0x7fa138006220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.069+0000 7fafb8c42640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fafb406ca60 0x7fafb406ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.069+0000 7fa1452d0640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa138006760 0x7fa138031fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.069+0000 7fa1452d0640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa13803a3d0 con 0x7fa1380e35b0 2024-03-29T04:08:17.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.069+0000 7fa1452d0640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fa138006e00 con 0x7fa138006760 2024-03-29T04:08:17.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.069+0000 7fa1452d0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa1380070e0 con 0x7fa1380348f0 2024-03-29T04:08:17.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.069+0000 7fafb8c42640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fafb406ca60 0x7fafb406ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:34486/0 (socket says 172.21.15.73:34486) 2024-03-29T04:08:17.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.069+0000 7f9e1f7fe640 1 -- 172.21.15.73:0/963631775 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e201447a0 msgr2=0x7f9e20067330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:17.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.069+0000 7f9e1f7fe640 1 --2- 172.21.15.73:0/963631775 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e201447a0 0x7f9e20067330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.069+0000 7f9e1f7fe640 1 -- 172.21.15.73:0/963631775 >> v1:172.21.15.73:6789/0 conn(0x7f9e200b4720 legacy=0x7f9e2006c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.069+0000 7f9e1f7fe640 1 -- 172.21.15.73:0/963631775 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e200b3da0 con 0x7f9e2006cc30 2024-03-29T04:08:17.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.069+0000 7f9e1effd640 1 --2- 172.21.15.73:0/963631775 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e201447a0 0x7f9e20067330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:08:17.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.069+0000 7fafb8c42640 1 -- 172.21.15.73:0/1098660690 learned_addr learned my addr 172.21.15.73:0/1098660690 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:17.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.069+0000 7fafb3fff640 1 --2- 172.21.15.73:0/1098660690 >> v2:172.21.15.73:3300/0 conn(0x7fafb4159b20 0x7fafb40d0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.069+0000 7fb613d66640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb6040546c0 0x7fb604038170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.069+0000 7fa13ffff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa1380e35b0 0x7fa1380341e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58968/0 (socket says 172.21.15.73:58968) 2024-03-29T04:08:17.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.069+0000 7fafb37fe640 1 --2- 172.21.15.73:0/1098660690 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafb40d0670 0x7fafb406c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.070+0000 7fa13ffff640 1 -- 172.21.15.73:0/2289918049 learned_addr learned my addr 172.21.15.73:0/2289918049 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:17.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.069+0000 7fb613d66640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb60404f0b0 0x7fb60404fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.069+0000 7fb613d66640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb604005f60 con 0x7fb60400c0d0 2024-03-29T04:08:17.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.069+0000 7fb613d66640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fb6040e38e0 con 0x7fb6040546c0 2024-03-29T04:08:17.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.069+0000 7fb613d66640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fb604006200 con 0x7fb60404f0b0 2024-03-29T04:08:17.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.070+0000 7fb612303640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb60404f0b0 0x7fb60404fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.070+0000 7fb612303640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb60404f0b0 0x7fb60404fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:34494/0 (socket says 172.21.15.73:34494) 2024-03-29T04:08:17.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.070+0000 7fb612303640 1 -- 172.21.15.73:0/3469192731 learned_addr learned my addr 172.21.15.73:0/3469192731 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:17.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.070+0000 7fa13effd640 1 -- 172.21.15.73:0/2289918049 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 908451865 0 0) 0x7fa134001110 con 0x7fa1380e35b0 2024-03-29T04:08:17.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.070+0000 7fb611b02640 1 --2- 172.21.15.73:0/3469192731 >> v2:172.21.15.73:3300/0 conn(0x7fb6040546c0 0x7fb604038170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.070+0000 7fa13effd640 1 -- 172.21.15.73:0/2289918049 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa130003520 con 0x7fa1380e35b0 2024-03-29T04:08:17.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.070+0000 7fb611b02640 1 -- 172.21.15.73:0/3469192731 >> v2:172.21.15.142:3300/0 conn(0x7fb60404f0b0 msgr2=0x7fb60404fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:17.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.070+0000 7fb611b02640 1 --2- 172.21.15.73:0/3469192731 >> v2:172.21.15.142:3300/0 conn(0x7fb60404f0b0 0x7fb60404fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.070+0000 7f7d0e32b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d000e32d0 0x7f7d00052c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.070+0000 7f7d0e32b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7d0004ff80 0x7f7d00037bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.070+0000 7f7d0e32b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d000536a0 con 0x7f7d00053190 2024-03-29T04:08:17.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.070+0000 7f7d0e32b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f7d000e36b0 con 0x7f7d0004ff80 2024-03-29T04:08:17.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.070+0000 7f7d0e32b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7d00053980 con 0x7f7d000e32d0 2024-03-29T04:08:17.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.070+0000 7f7d0cb28640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f7d00053190 0x7f7d0004f870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.73:44250/0 (socket says 172.21.15.73:44250) 2024-03-29T04:08:17.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.070+0000 7f7d0cb28640 1 -- 172.21.15.73:0/1134484686 learned_addr learned my addr 172.21.15.73:0/1134484686 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:17.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.070+0000 7fab02c88640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7faaf4054970 0x7faaf4050290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.070+0000 7fab02c88640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faaf4009270 0x7faaf4039480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.070+0000 7fab02c88640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faaf4050d40 con 0x7faaf4008de0 2024-03-29T04:08:17.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.070+0000 7fab02c88640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7faaf4050fe0 con 0x7faaf4054970 2024-03-29T04:08:17.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.070+0000 7fab02c88640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7faaf40085e0 con 0x7faaf4009270 2024-03-29T04:08:17.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.070+0000 7fafb8c42640 1 -- 172.21.15.73:0/1098660690 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafb40d0670 msgr2=0x7fafb406c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:17.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.070+0000 7fafb8c42640 1 --2- 172.21.15.73:0/1098660690 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafb40d0670 0x7fafb406c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.070+0000 7fafb8c42640 1 -- 172.21.15.73:0/1098660690 >> v2:172.21.15.73:3300/0 conn(0x7fafb4159b20 msgr2=0x7fafb40d0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:17.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.070+0000 7fafb8c42640 1 --2- 172.21.15.73:0/1098660690 >> v2:172.21.15.73:3300/0 conn(0x7fafb4159b20 0x7fafb40d0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.070+0000 7fafb8c42640 1 -- 172.21.15.73:0/1098660690 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb4163670 con 0x7fafb406ca60 2024-03-29T04:08:17.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.071+0000 7f9e1f7fe640 1 --2- 172.21.15.73:0/963631775 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e2006cc30 0x7f9e200b4b80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9e18009d90 tx=0x7f9e1802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=652e1fbb59938d15 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.071+0000 7fa13effd640 1 -- 172.21.15.73:0/2289918049 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 726989359 0 0) 0x7fa130003520 con 0x7fa1380e35b0 2024-03-29T04:08:17.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.071+0000 7fa13effd640 1 -- 172.21.15.73:0/2289918049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1380348f0 msgr2=0x7fa138006220 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-29T04:08:17.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.071+0000 7fa13effd640 1 --2- 172.21.15.73:0/2289918049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1380348f0 0x7fa138006220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.071+0000 7fa13effd640 1 -- 172.21.15.73:0/2289918049 >> v2:172.21.15.73:3300/0 conn(0x7fa138006760 msgr2=0x7fa138031fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:17.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.071+0000 7fa13effd640 1 --2- 172.21.15.73:0/2289918049 >> v2:172.21.15.73:3300/0 conn(0x7fa138006760 0x7fa138031fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.071+0000 7fa13effd640 1 -- 172.21.15.73:0/2289918049 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1380073c0 con 0x7fa1380e35b0 2024-03-29T04:08:17.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.071+0000 7fa13effd640 1 -- 172.21.15.73:0/2289918049 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1290421750 0 0) 0x7fa134001840 con 0x7fa1380e35b0 2024-03-29T04:08:17.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.071+0000 7fa13effd640 1 -- 172.21.15.73:0/2289918049 >> v1:172.21.15.73:6789/0 conn(0x7fa1380e35b0 legacy=0x7fa1380341e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.071+0000 7f7cfffff640 1 -- 172.21.15.73:0/1134484686 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2206040567 0 0) 0x7f7d000536a0 con 0x7f7d00053190 2024-03-29T04:08:17.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.071+0000 7f7cfffff640 1 -- 172.21.15.73:0/1134484686 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cf4003520 con 0x7f7d00053190 2024-03-29T04:08:17.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.071+0000 7f7d0d329640 1 --2- 172.21.15.73:0/1134484686 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d000e32d0 0x7f7d00052c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.071+0000 7ff5f128f640 1 Processor -- start 2024-03-29T04:08:17.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.071+0000 7f7d0db2a640 1 --2- 172.21.15.73:0/1134484686 >> v2:172.21.15.142:3300/0 conn(0x7f7d0004ff80 0x7f7d00037bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.071+0000 7f1f89cdb640 1 Processor -- start 2024-03-29T04:08:17.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.071+0000 7fa13effd640 1 --2- 172.21.15.73:0/2289918049 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1300039b0 0x7fa130003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.071+0000 7fa13effd640 1 --2- 172.21.15.73:0/2289918049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa130004800 0x7fa130004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.071+0000 7fa13effd640 1 --2- 172.21.15.73:0/2289918049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1300052e0 0x7fa13000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.071+0000 7fa13effd640 1 -- 172.21.15.73:0/2289918049 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa138006e00 con 0x7fa130004800 2024-03-29T04:08:17.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.071+0000 7fa13effd640 1 -- 172.21.15.73:0/2289918049 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa1380070e0 con 0x7fa1300039b0 2024-03-29T04:08:17.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.071+0000 7fa13effd640 1 -- 172.21.15.73:0/2289918049 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa13000c1c0 con 0x7fa1300052e0 2024-03-29T04:08:17.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.071+0000 7fa13ffff640 1 --2- 172.21.15.73:0/2289918049 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1300039b0 0x7fa130003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.071+0000 7fa144acf640 1 --2- 172.21.15.73:0/2289918049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1300052e0 0x7fa13000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.071+0000 7f1f89cdb640 1 -- start start 2024-03-29T04:08:17.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.070+0000 7fb611b02640 1 -- 172.21.15.73:0/3469192731 >> v1:172.21.15.142:6789/0 conn(0x7fb60400c0d0 legacy=0x7fb6040df030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.070+0000 7fb611b02640 1 -- 172.21.15.73:0/3469192731 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6040064e0 con 0x7fb6040546c0 2024-03-29T04:08:17.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.070+0000 7fb612303640 1 --2- 172.21.15.73:0/3469192731 >> v2:172.21.15.142:3300/0 conn(0x7fb60404f0b0 0x7fb60404fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:08:17.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.071+0000 7f9e1dffb640 1 -- 172.21.15.73:0/963631775 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e18039070 con 0x7f9e2006cc30 2024-03-29T04:08:17.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.071+0000 7f9e1dffb640 1 -- 172.21.15.73:0/963631775 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e1802cc50 con 0x7f9e2006cc30 2024-03-29T04:08:17.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.071+0000 7f9e1dffb640 1 -- 172.21.15.73:0/963631775 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e18034440 con 0x7f9e2006cc30 2024-03-29T04:08:17.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.071+0000 7ff5f128f640 1 -- start start 2024-03-29T04:08:17.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.071+0000 7fafb8c42640 1 --2- 172.21.15.73:0/1098660690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafb406ca60 0x7fafb406ebf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fafb40b3820 tx=0x7fafa402b990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab4510fc59aadb5c server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.071+0000 7f7d0db2a640 1 -- 172.21.15.73:0/1134484686 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d000e32d0 msgr2=0x7f7d00052c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:17.066 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.071+0000 7f7d0db2a640 1 --2- 172.21.15.73:0/1134484686 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d000e32d0 0x7f7d00052c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.071+0000 7f7d0db2a640 1 -- 172.21.15.73:0/1134484686 >> v1:172.21.15.142:6789/0 conn(0x7f7d00053190 legacy=0x7f7d0004f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.071+0000 7f7d0db2a640 1 -- 172.21.15.73:0/1134484686 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d00053c60 con 0x7f7d0004ff80 2024-03-29T04:08:17.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.071+0000 7fab01225640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faaf4009270 0x7faaf4039480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.071+0000 7fab01225640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faaf4009270 0x7faaf4039480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:34520/0 (socket says 172.21.15.73:34520) 2024-03-29T04:08:17.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.071+0000 7fab01225640 1 -- 172.21.15.73:0/1088860051 learned_addr learned my addr 172.21.15.73:0/1088860051 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:17.067 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.071+0000 7fab00a24640 1 --2- 172.21.15.73:0/1088860051 >> v2:172.21.15.73:3300/0 conn(0x7faaf4054970 0x7faaf4050290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.071+0000 7fafb2ffd640 1 -- 172.21.15.73:0/1098660690 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa4034070 con 0x7fafb406ca60 2024-03-29T04:08:17.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.072+0000 7fafb2ffd640 1 -- 172.21.15.73:0/1098660690 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafa4030850 con 0x7fafb406ca60 2024-03-29T04:08:17.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.072+0000 7fb611b02640 1 --2- 172.21.15.73:0/3469192731 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6040546c0 0x7fb604038170 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb604034500 tx=0x7fb60802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce2ed5a890e26030 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.071+0000 7fa13f7fe640 1 --2- 172.21.15.73:0/2289918049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa130004800 0x7fa130004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.072+0000 7fafb2ffd640 1 -- 172.21.15.73:0/1098660690 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa4030c20 con 0x7fafb406ca60 2024-03-29T04:08:17.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.072+0000 7fab01225640 1 -- 172.21.15.73:0/1088860051 >> v2:172.21.15.73:3300/0 conn(0x7faaf4054970 msgr2=0x7faaf4050290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:17.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.072+0000 7fab01225640 1 --2- 172.21.15.73:0/1088860051 >> v2:172.21.15.73:3300/0 conn(0x7faaf4054970 0x7faaf4050290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.072+0000 7fab01225640 1 -- 172.21.15.73:0/1088860051 >> v1:172.21.15.73:6789/0 conn(0x7faaf4008de0 legacy=0x7faaf4038d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:17.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.072+0000 7fb610b00640 1 -- 172.21.15.73:0/3469192731 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb608035020 con 0x7fb6040546c0 2024-03-29T04:08:17.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.072+0000 7fb610b00640 1 -- 172.21.15.73:0/3469192731 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb608031830 con 0x7fb6040546c0 2024-03-29T04:08:17.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.072+0000 7fb610b00640 1 -- 172.21.15.73:0/3469192731 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb608031c00 con 0x7fb6040546c0 2024-03-29T04:08:17.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.072+0000 7f9e2544e640 1 -- 172.21.15.73:0/963631775 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e2006cc30 msgr2=0x7f9e200b4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.072+0000 7f9e2544e640 1 --2- 172.21.15.73:0/963631775 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e2006cc30 0x7f9e200b4b80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9e18009d90 tx=0x7f9e1802bea0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.072+0000 7fab01225640 1 -- 172.21.15.73:0/1088860051 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf40088c0 con 0x7faaf4009270 2024-03-29T04:08:17.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.072+0000 7f9e2544e640 1 -- 172.21.15.73:0/963631775 shutdown_connections 2024-03-29T04:08:17.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.072+0000 7f9e2544e640 1 --2- 172.21.15.73:0/963631775 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e2006cc30 0x7f9e200b4b80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.072+0000 7f9e2544e640 1 --2- 172.21.15.73:0/963631775 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e201447a0 0x7f9e20067330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.072+0000 7f9e2544e640 1 -- 172.21.15.73:0/963631775 >> 172.21.15.73:0/963631775 conn(0x7f9e20072050 msgr2=0x7f9e20072460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:17.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.072+0000 7ff5f128f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff5ec0b3c40 0x7ff5ec15c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.072+0000 7f1f89cdb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1f84166ea0 0x7f1f84162f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.072+0000 7f1f89cdb640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1f840acf20 0x7f1f840ad3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.072+0000 7f1f89cdb640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f84163ee0 con 0x7f1f840cca20 2024-03-29T04:08:17.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.072+0000 7f1f89cdb640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f1f840ce680 con 0x7f1f840acf20 2024-03-29T04:08:17.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.072+0000 7f1f89cdb640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f1f84163920 con 0x7f1f84166ea0 2024-03-29T04:08:17.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.072+0000 7f9e2544e640 1 -- 172.21.15.73:0/963631775 shutdown_connections 2024-03-29T04:08:17.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.072+0000 7ff5f128f640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5ec0b4170 con 0x7ff5ec15a800 2024-03-29T04:08:17.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7f1f83fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1f84166ea0 0x7f1f84162f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7f1f83fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1f84166ea0 0x7f1f84162f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:34530/0 (socket says 172.21.15.73:34530) 2024-03-29T04:08:17.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7f1f83fff640 1 -- 172.21.15.73:0/985639822 learned_addr learned my addr 172.21.15.73:0/985639822 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:17.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7ff5f128f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5ec0b31c0 con 0x7ff5ec0b2310 2024-03-29T04:08:17.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7ff5f128f640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7ff5ec0b0300 con 0x7ff5ec0b3c40 2024-03-29T04:08:17.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7ff5eaffd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff5ec15a800 0x7ff5ec15b9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:58984/0 (socket says 172.21.15.73:58984) 2024-03-29T04:08:17.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7ff5eaffd640 1 -- 172.21.15.73:0/1174175922 learned_addr learned my addr 172.21.15.73:0/1174175922 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:17.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.072+0000 7fab00a24640 1 --2- 172.21.15.73:0/1088860051 >> v2:172.21.15.73:3300/0 conn(0x7faaf4054970 0x7faaf4050290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:08:17.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.072+0000 7fa13f7fe640 1 -- 172.21.15.73:0/2289918049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1300052e0 msgr2=0x7fa13000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:17.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.072+0000 7fa13f7fe640 1 --2- 172.21.15.73:0/2289918049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa1300052e0 0x7fa13000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.072+0000 7fa13f7fe640 1 -- 172.21.15.73:0/2289918049 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1300039b0 msgr2=0x7fa130003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:17.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.072+0000 7fa13f7fe640 1 --2- 172.21.15.73:0/2289918049 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1300039b0 0x7fa130003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.072+0000 7fa13f7fe640 1 -- 172.21.15.73:0/2289918049 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1380073c0 con 0x7fa130004800 2024-03-29T04:08:17.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7fb613d66640 1 -- 172.21.15.73:0/3469192731 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6040546c0 msgr2=0x7fb604038170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7f9e2544e640 1 -- 172.21.15.73:0/963631775 wait complete. 2024-03-29T04:08:17.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7fb613d66640 1 --2- 172.21.15.73:0/3469192731 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6040546c0 0x7fb604038170 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb604034500 tx=0x7fb60802b8d0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7f1f894da640 1 --2- 172.21.15.73:0/985639822 >> v2:172.21.15.73:3300/0 conn(0x7f1f840acf20 0x7f1f840ad3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7ff5ea7fc640 1 --2- 172.21.15.73:0/1174175922 >> v2:172.21.15.73:3300/0 conn(0x7ff5ec0b3c40 0x7ff5ec15c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7f7d0db2a640 1 --2- 172.21.15.73:0/1134484686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d0004ff80 0x7f7d00037bb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7d080506a0 tx=0x7f7d080a71b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6748c74a193a3a4 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7f1f83fff640 1 -- 172.21.15.73:0/985639822 >> v2:172.21.15.73:3300/0 conn(0x7f1f840acf20 msgr2=0x7f1f840ad3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:17.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7fab01225640 1 --2- 172.21.15.73:0/1088860051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faaf4009270 0x7faaf4039480 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7faafc02d940 tx=0x7faafc0a7210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e3bee6628522044 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7f1f83fff640 1 --2- 172.21.15.73:0/985639822 >> v2:172.21.15.73:3300/0 conn(0x7f1f840acf20 0x7f1f840ad3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7f1f83fff640 1 -- 172.21.15.73:0/985639822 >> v1:172.21.15.73:6789/0 conn(0x7f1f840cca20 legacy=0x7f1f840cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7f1f83fff640 1 -- 172.21.15.73:0/985639822 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f84163c00 con 0x7f1f84166ea0 2024-03-29T04:08:17.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7fb613d66640 1 -- 172.21.15.73:0/3469192731 shutdown_connections 2024-03-29T04:08:17.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7fb613d66640 1 --2- 172.21.15.73:0/3469192731 >> v2:172.21.15.142:3300/0 conn(0x7fb60404f0b0 0x7fb60404fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7f7cfffff640 1 -- 172.21.15.73:0/1134484686 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d080b4070 con 0x7f7d0004ff80 2024-03-29T04:08:17.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7f7cfffff640 1 -- 172.21.15.73:0/1134484686 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d080af640 con 0x7f7d0004ff80 2024-03-29T04:08:17.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7f7cfffff640 1 -- 172.21.15.73:0/1134484686 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d080afab0 con 0x7f7d0004ff80 2024-03-29T04:08:17.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7fb613d66640 1 --2- 172.21.15.73:0/3469192731 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6040546c0 0x7fb604038170 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7fb613d66640 1 -- 172.21.15.73:0/3469192731 >> 172.21.15.73:0/3469192731 conn(0x7fb604009fe0 msgr2=0x7fb60400a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:17.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7fb613d66640 1 -- 172.21.15.73:0/3469192731 shutdown_connections 2024-03-29T04:08:17.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7fb613d66640 1 -- 172.21.15.73:0/3469192731 wait complete. 2024-03-29T04:08:17.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7ff5ea7fc640 1 -- 172.21.15.73:0/1174175922 >> v1:172.21.15.142:6789/0 conn(0x7ff5ec0b2310 legacy=0x7ff5ec0b0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7ff5ea7fc640 1 -- 172.21.15.73:0/1174175922 >> v1:172.21.15.73:6789/0 conn(0x7ff5ec15a800 legacy=0x7ff5ec15b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7ff5e9ffb640 1 -- 172.21.15.73:0/1174175922 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 766349412 0 0) 0x7ff5ec0b4170 con 0x7ff5ec15a800 2024-03-29T04:08:17.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7ff5ea7fc640 1 -- 172.21.15.73:0/1174175922 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5ec0b34a0 con 0x7ff5ec0b3c40 2024-03-29T04:08:17.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7faafb7fe640 1 -- 172.21.15.73:0/1088860051 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faafc0b4070 con 0x7faaf4009270 2024-03-29T04:08:17.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7faafb7fe640 1 -- 172.21.15.73:0/1088860051 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faafc0af680 con 0x7faaf4009270 2024-03-29T04:08:17.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.074+0000 7faafb7fe640 1 -- 172.21.15.73:0/1088860051 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faafc0afaf0 con 0x7faaf4009270 2024-03-29T04:08:17.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7fafba6a5640 1 -- 172.21.15.73:0/1098660690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafb406ca60 msgr2=0x7fafb406ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7fafba6a5640 1 --2- 172.21.15.73:0/1098660690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafb406ca60 0x7fafb406ebf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fafb40b3820 tx=0x7fafa402b990 comp rx=0 tx=0).stop 2024-03-29T04:08:17.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7fafba6a5640 1 -- 172.21.15.73:0/1098660690 shutdown_connections 2024-03-29T04:08:17.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7fafba6a5640 1 --2- 172.21.15.73:0/1098660690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafb406ca60 0x7fafb406ebf0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7fafba6a5640 1 --2- 172.21.15.73:0/1098660690 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafb40d0670 0x7fafb406c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7fafba6a5640 1 --2- 172.21.15.73:0/1098660690 >> v2:172.21.15.73:3300/0 conn(0x7fafb4159b20 0x7fafb40d0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7fafba6a5640 1 -- 172.21.15.73:0/1098660690 >> 172.21.15.73:0/1098660690 conn(0x7fafb4072100 msgr2=0x7fafb4072510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:17.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7fafba6a5640 1 -- 172.21.15.73:0/1098660690 shutdown_connections 2024-03-29T04:08:17.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.073+0000 7fafba6a5640 1 -- 172.21.15.73:0/1098660690 wait complete. 2024-03-29T04:08:17.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.074+0000 7fa13f7fe640 1 --2- 172.21.15.73:0/2289918049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa130004800 0x7fa130004c80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa13800e340 tx=0x7fa130005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce08e14999dd1f93 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.074+0000 7fa13effd640 1 -- 172.21.15.73:0/2289918049 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12c037070 con 0x7fa130004800 2024-03-29T04:08:17.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.074+0000 7fa13effd640 1 -- 172.21.15.73:0/2289918049 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa12c032600 con 0x7fa130004800 2024-03-29T04:08:17.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.074+0000 7f1f83fff640 1 --2- 172.21.15.73:0/985639822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f84166ea0 0x7f1f84162f80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1f8406fa50 tx=0x7f1f6c02b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bba94287dc0f1e5 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.074+0000 7fab02c88640 1 -- 172.21.15.73:0/1088860051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faaf4009270 msgr2=0x7faaf4039480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.074+0000 7fab02c88640 1 --2- 172.21.15.73:0/1088860051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faaf4009270 0x7faaf4039480 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7faafc02d940 tx=0x7faafc0a7210 comp rx=0 tx=0).stop 2024-03-29T04:08:17.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.075+0000 7f1f837fe640 1 -- 172.21.15.73:0/985639822 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c035020 con 0x7f1f84166ea0 2024-03-29T04:08:17.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.075+0000 7f1f837fe640 1 -- 172.21.15.73:0/985639822 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f6c031870 con 0x7f1f84166ea0 2024-03-29T04:08:17.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.075+0000 7f1f837fe640 1 -- 172.21.15.73:0/985639822 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c031c40 con 0x7f1f84166ea0 2024-03-29T04:08:17.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.075+0000 7f9e2544e640 1 Processor -- start 2024-03-29T04:08:17.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.075+0000 7ff5ea7fc640 1 --2- 172.21.15.73:0/1174175922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5ec0b3c40 0x7ff5ec15c0e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0009750 tx=0x7ff5e002b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3838fc2369adb0d server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.075+0000 7f7d0e32b640 1 -- 172.21.15.73:0/1134484686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d0004ff80 msgr2=0x7f7d00037bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.075+0000 7f7d0e32b640 1 --2- 172.21.15.73:0/1134484686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d0004ff80 0x7f7d00037bb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7d080506a0 tx=0x7f7d080a71b0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.075+0000 7fab02c88640 1 -- 172.21.15.73:0/1088860051 shutdown_connections 2024-03-29T04:08:17.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.075+0000 7fab02c88640 1 --2- 172.21.15.73:0/1088860051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faaf4009270 0x7faaf4039480 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.075+0000 7fab02c88640 1 --2- 172.21.15.73:0/1088860051 >> v2:172.21.15.73:3300/0 conn(0x7faaf4054970 0x7faaf4050290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.075+0000 7fab02c88640 1 -- 172.21.15.73:0/1088860051 >> 172.21.15.73:0/1088860051 conn(0x7faaf4055c40 msgr2=0x7faaf4056050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:17.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.075+0000 7ff5e9ffb640 1 -- 172.21.15.73:0/1174175922 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e0037070 con 0x7ff5ec0b3c40 2024-03-29T04:08:17.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.075+0000 7ff5e9ffb640 1 -- 172.21.15.73:0/1174175922 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5e0030710 con 0x7ff5ec0b3c40 2024-03-29T04:08:17.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.075+0000 7fa13effd640 1 -- 172.21.15.73:0/2289918049 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12c0093d0 con 0x7fa130004800 2024-03-29T04:08:17.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.075+0000 7ff5e9ffb640 1 -- 172.21.15.73:0/1174175922 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e0030ae0 con 0x7ff5ec0b3c40 2024-03-29T04:08:17.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.075+0000 7fab02c88640 1 -- 172.21.15.73:0/1088860051 shutdown_connections 2024-03-29T04:08:17.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.075+0000 7fab02c88640 1 -- 172.21.15.73:0/1088860051 wait complete. 2024-03-29T04:08:17.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.075+0000 7fb613d66640 1 Processor -- start 2024-03-29T04:08:17.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.075+0000 7fafba6a5640 1 Processor -- start 2024-03-29T04:08:17.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.075+0000 7fb613d66640 1 -- start start 2024-03-29T04:08:17.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.075+0000 7fa1452d0640 1 -- 172.21.15.73:0/2289918049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa130004800 msgr2=0x7fa130004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.075+0000 7fa1452d0640 1 --2- 172.21.15.73:0/2289918049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa130004800 0x7fa130004c80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa13800e340 tx=0x7fa130005830 comp rx=0 tx=0).stop 2024-03-29T04:08:17.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.075+0000 7fa144acf640 1 -- 172.21.15.73:0/2289918049 reap_dead start 2024-03-29T04:08:17.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.076+0000 7fafba6a5640 1 -- start start 2024-03-29T04:08:17.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.076+0000 7fa1452d0640 1 -- 172.21.15.73:0/2289918049 shutdown_connections 2024-03-29T04:08:17.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.076+0000 7fa1452d0640 1 -- 172.21.15.73:0/2289918049 >> 172.21.15.73:0/2289918049 conn(0x7fa13801e6c0 msgr2=0x7fa1380553f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:17.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.076+0000 7fa1452d0640 1 -- 172.21.15.73:0/2289918049 shutdown_connections 2024-03-29T04:08:17.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.075+0000 7f9e2544e640 1 -- start start 2024-03-29T04:08:17.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.076+0000 7fa1452d0640 1 -- 172.21.15.73:0/2289918049 wait complete. 2024-03-29T04:08:17.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.076+0000 7f1f89cdb640 1 -- 172.21.15.73:0/985639822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f84166ea0 msgr2=0x7f1f84162f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.076+0000 7ff5f128f640 1 -- 172.21.15.73:0/1174175922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5ec0b3c40 msgr2=0x7ff5ec15c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.076+0000 7ff5f128f640 1 --2- 172.21.15.73:0/1174175922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5ec0b3c40 0x7ff5ec15c0e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0009750 tx=0x7ff5e002b730 comp rx=0 tx=0).stop 2024-03-29T04:08:17.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.076+0000 7f1f89cdb640 1 --2- 172.21.15.73:0/985639822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f84166ea0 0x7f1f84162f80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1f8406fa50 tx=0x7f1f6c02b910 comp rx=0 tx=0).stop 2024-03-29T04:08:17.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.076+0000 7f1f89cdb640 1 -- 172.21.15.73:0/985639822 shutdown_connections 2024-03-29T04:08:17.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.076+0000 7f1f89cdb640 1 --2- 172.21.15.73:0/985639822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f84166ea0 0x7f1f84162f80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.076+0000 7ff5f128f640 1 -- 172.21.15.73:0/1174175922 shutdown_connections 2024-03-29T04:08:17.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.076+0000 7ff5f128f640 1 --2- 172.21.15.73:0/1174175922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5ec0b3c40 0x7ff5ec15c0e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.076+0000 7ff5f128f640 1 -- 172.21.15.73:0/1174175922 >> 172.21.15.73:0/1174175922 conn(0x7ff5ec0b56e0 msgr2=0x7ff5ec0b5af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:17.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.076+0000 7f1f89cdb640 1 --2- 172.21.15.73:0/985639822 >> v2:172.21.15.73:3300/0 conn(0x7f1f840acf20 0x7f1f840ad3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.076+0000 7f1f89cdb640 1 -- 172.21.15.73:0/985639822 >> 172.21.15.73:0/985639822 conn(0x7f1f840b1e20 msgr2=0x7f1f840b2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:17.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.076+0000 7f9e2544e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e2006cc30 0x7f9e201f8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.076+0000 7f9e2544e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e200b4720 0x7f9e2015caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.076+0000 7f9e2544e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e201447a0 0x7f9e201f4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.076+0000 7f9e2544e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9e200b5570 con 0x7f9e200b4720 2024-03-29T04:08:17.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.076+0000 7f9e2544e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2006e3c0 con 0x7f9e2006cc30 2024-03-29T04:08:17.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.076+0000 7f9e2544e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9e200b56f0 con 0x7f9e201447a0 2024-03-29T04:08:17.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.076+0000 7f9e1e7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e200b4720 0x7f9e2015caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.076+0000 7f9e1f7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e201447a0 0x7f9e201f4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.076+0000 7f9e1f7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e201447a0 0x7f9e201f4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:53774/0 (socket says 172.21.15.73:53774) 2024-03-29T04:08:17.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.076+0000 7ff5f128f640 1 -- 172.21.15.73:0/1174175922 shutdown_connections 2024-03-29T04:08:17.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.076+0000 7f9e1f7fe640 1 -- 172.21.15.73:0/628385581 learned_addr learned my addr 172.21.15.73:0/628385581 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:17.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.076+0000 7f9e1effd640 1 --2- 172.21.15.73:0/628385581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e2006cc30 0x7f9e201f8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.077+0000 7ff5f128f640 1 -- 172.21.15.73:0/1174175922 wait complete. 2024-03-29T04:08:17.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.076+0000 7f1f89cdb640 1 -- 172.21.15.73:0/985639822 shutdown_connections 2024-03-29T04:08:17.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.077+0000 7f9e1f7fe640 1 -- 172.21.15.73:0/628385581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e2006cc30 msgr2=0x7f9e201f8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.077+0000 7f9e1f7fe640 1 --2- 172.21.15.73:0/628385581 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e2006cc30 0x7f9e201f8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.077+0000 7f9e1f7fe640 1 -- 172.21.15.73:0/628385581 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e200b4720 msgr2=0x7f9e2015caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.076+0000 7f1f89cdb640 1 -- 172.21.15.73:0/985639822 wait complete. 2024-03-29T04:08:17.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.077+0000 7f9e1f7fe640 1 --2- 172.21.15.73:0/628385581 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e200b4720 0x7f9e2015caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.077+0000 7f9e1f7fe640 1 -- 172.21.15.73:0/628385581 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e201f5190 con 0x7f9e201447a0 2024-03-29T04:08:17.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.077+0000 7fafba6a5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fafb406ca60 0x7fafb40a9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.077+0000 7f9e1e7fc640 1 --2- 172.21.15.73:0/628385581 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e200b4720 0x7f9e2015caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:08:17.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.077+0000 7fab02c88640 1 Processor -- start 2024-03-29T04:08:17.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.077+0000 7fb613d66640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb60400c0d0 0x7fb6040479e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.077+0000 7fb613d66640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb60404f0b0 0x7fb6040d57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.077+0000 7f9e1f7fe640 1 --2- 172.21.15.73:0/628385581 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e201447a0 0x7f9e201f4690 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9e18009eb0 tx=0x7f9e18004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.077+0000 7f7d0e32b640 1 -- 172.21.15.73:0/1134484686 shutdown_connections 2024-03-29T04:08:17.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.077+0000 7f7d0e32b640 1 --2- 172.21.15.73:0/1134484686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d0004ff80 0x7f7d00037bb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.077+0000 7f7d0e32b640 1 --2- 172.21.15.73:0/1134484686 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d000e32d0 0x7f7d00052c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.077+0000 7f7d0e32b640 1 -- 172.21.15.73:0/1134484686 >> 172.21.15.73:0/1134484686 conn(0x7f7d00009fb0 msgr2=0x7f7d0000a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:17.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.077+0000 7f9e077fe640 1 -- 172.21.15.73:0/628385581 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e18044020 con 0x7f9e201447a0 2024-03-29T04:08:17.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.077+0000 7fb611b02640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb60400c0d0 0x7fb6040479e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.077+0000 7fb611b02640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb60400c0d0 0x7fb6040479e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:34550/0 (socket says 172.21.15.73:34550) 2024-03-29T04:08:17.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.077+0000 7fb611b02640 1 -- 172.21.15.73:0/2141269423 learned_addr learned my addr 172.21.15.73:0/2141269423 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:17.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.077+0000 7fb613d66640 1 --2- 172.21.15.73:0/2141269423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6040546c0 0x7fb6040d5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.077+0000 7fa1452d0640 1 Processor -- start 2024-03-29T04:08:17.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.077+0000 7f9e2544e640 1 -- 172.21.15.73:0/628385581 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e201f5470 con 0x7f9e201447a0 2024-03-29T04:08:17.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.077+0000 7fb613d66640 1 -- 172.21.15.73:0/2141269423 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb6040507c0 con 0x7fb60404f0b0 2024-03-29T04:08:17.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.077+0000 7f9e2544e640 1 -- 172.21.15.73:0/628385581 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e201f81f0 con 0x7f9e201447a0 2024-03-29T04:08:17.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.078+0000 7f9e077fe640 1 -- 172.21.15.73:0/628385581 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e1802ca50 con 0x7f9e201447a0 2024-03-29T04:08:17.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.078+0000 7f9e077fe640 1 -- 172.21.15.73:0/628385581 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e18039040 con 0x7f9e201447a0 2024-03-29T04:08:17.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.078+0000 7fa1452d0640 1 -- start start 2024-03-29T04:08:17.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.078+0000 7fb612303640 1 --2- 172.21.15.73:0/2141269423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6040546c0 0x7fb6040d5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.078+0000 7fb613d66640 1 -- 172.21.15.73:0/2141269423 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb604050640 con 0x7fb60400c0d0 2024-03-29T04:08:17.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.078+0000 7fb613d66640 1 -- 172.21.15.73:0/2141269423 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fb60404ff70 con 0x7fb6040546c0 2024-03-29T04:08:17.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.078+0000 7fb611301640 1 --2- 172.21.15.73:0/2141269423 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb60404f0b0 0x7fb6040d57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.077+0000 7fab02c88640 1 -- start start 2024-03-29T04:08:17.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.078+0000 7fb612303640 1 -- 172.21.15.73:0/2141269423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb60400c0d0 msgr2=0x7fb6040479e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.078+0000 7fb612303640 1 --2- 172.21.15.73:0/2141269423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb60400c0d0 0x7fb6040479e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.078+0000 7fb612303640 1 -- 172.21.15.73:0/2141269423 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb60404f0b0 msgr2=0x7fb6040d57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.078+0000 7f9e2544e640 1 -- 172.21.15.73:0/628385581 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9e201f7d20 con 0x7f9e201447a0 2024-03-29T04:08:17.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.078+0000 7f1f89cdb640 1 Processor -- start 2024-03-29T04:08:17.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.078+0000 7fb612303640 1 --2- 172.21.15.73:0/2141269423 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb60404f0b0 0x7fb6040d57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.078+0000 7fb612303640 1 -- 172.21.15.73:0/2141269423 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb604044f20 con 0x7fb6040546c0 2024-03-29T04:08:17.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.079+0000 7fb611301640 1 --2- 172.21.15.73:0/2141269423 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb60404f0b0 0x7fb6040d57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:08:17.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.079+0000 7fab02c88640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faaf4008de0 0x7faaf404be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.079+0000 7fab02c88640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faaf4009270 0x7faaf40df660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.079+0000 7fafba6a5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafb40d0670 0x7fafb4147390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.079+0000 7fafba6a5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafb4159b20 0x7fafb41478d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.079+0000 7fafba6a5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fafb4159f00 con 0x7fafb406ca60 2024-03-29T04:08:17.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.079+0000 7fafba6a5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fafb4163c30 con 0x7fafb40d0670 2024-03-29T04:08:17.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.079+0000 7fafba6a5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fafb40a9d60 con 0x7fafb4159b20 2024-03-29T04:08:17.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.079+0000 7fafb3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fafb406ca60 0x7fafb40a9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.079+0000 7fafb3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fafb406ca60 0x7fafb40a9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45914/0 (socket says 172.21.15.73:45914) 2024-03-29T04:08:17.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.079+0000 7fafb3fff640 1 -- 172.21.15.73:0/4021036238 learned_addr learned my addr 172.21.15.73:0/4021036238 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:17.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.077+0000 7f7d0e32b640 1 -- 172.21.15.73:0/1134484686 shutdown_connections 2024-03-29T04:08:17.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.077+0000 7f7d0e32b640 1 -- 172.21.15.73:0/1134484686 wait complete. 2024-03-29T04:08:17.106 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.079+0000 7ff5f128f640 1 Processor -- start 2024-03-29T04:08:17.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.079+0000 7fab02c88640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faaf4054970 0x7faaf40c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.079+0000 7fab02c88640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7faaf4053a80 con 0x7faaf4054970 2024-03-29T04:08:17.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.079+0000 7fa1452d0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa130004800 0x7fa13804d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.079+0000 7fab02c88640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7faaf40507d0 con 0x7faaf4009270 2024-03-29T04:08:17.107 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.079+0000 7f7d0e32b640 1 Processor -- start 2024-03-29T04:08:17.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.079+0000 7fab02c88640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7faaf4053c00 con 0x7faaf4008de0 2024-03-29T04:08:17.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.079+0000 7fa1452d0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa138052060 0x7fa138179860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.079+0000 7f1f89cdb640 1 -- start start 2024-03-29T04:08:17.108 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.079+0000 7fa1452d0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1380524e0 0x7fa13804fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.079+0000 7fafb8c42640 1 --2- 172.21.15.73:0/4021036238 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafb4159b20 0x7fafb41478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.079+0000 7fafb3fff640 1 -- 172.21.15.73:0/4021036238 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafb4159b20 msgr2=0x7fafb41478d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.079+0000 7fafb3fff640 1 --2- 172.21.15.73:0/4021036238 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fafb4159b20 0x7fafb41478d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.079+0000 7fa13f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa138052060 0x7fa138179860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.079+0000 7fa13f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa138052060 0x7fa138179860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45928/0 (socket says 172.21.15.73:45928) 2024-03-29T04:08:17.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.079+0000 7fa13f7fe640 1 -- 172.21.15.73:0/1987774495 learned_addr learned my addr 172.21.15.73:0/1987774495 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:17.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.079+0000 7fa1452d0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa138007ea0 con 0x7fa138052060 2024-03-29T04:08:17.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.079+0000 7fa1452d0640 1 -- 172.21.15.73:0/1987774495 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa138007980 con 0x7fa1380524e0 2024-03-29T04:08:17.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.079+0000 7fafb3fff640 1 -- 172.21.15.73:0/4021036238 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafb40d0670 msgr2=0x7fafb4147390 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-29T04:08:17.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.079+0000 7fafb3fff640 1 --2- 172.21.15.73:0/4021036238 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafb40d0670 0x7fafb4147390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.079+0000 7fafb3fff640 1 -- 172.21.15.73:0/4021036238 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb4149d80 con 0x7fafb406ca60 2024-03-29T04:08:17.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.079+0000 7fa1452d0640 1 -- 172.21.15.73:0/1987774495 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa13804c8a0 con 0x7fa130004800 2024-03-29T04:08:17.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.079+0000 7fb612303640 1 --2- 172.21.15.73:0/2141269423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6040546c0 0x7fb6040d5d30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb60c06a260 tx=0x7fb60c06da70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.079+0000 7ff5f128f640 1 -- start start 2024-03-29T04:08:17.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.080+0000 7fa13ffff640 1 --2- 172.21.15.73:0/1987774495 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa130004800 0x7fa13804d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.080+0000 7fa144acf640 1 --2- 172.21.15.73:0/1987774495 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1380524e0 0x7fa13804fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.080+0000 7fafb3fff640 1 --2- 172.21.15.73:0/4021036238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fafb406ca60 0x7fafb40a9820 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fafac007e40 tx=0x7fafac00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.080+0000 7f1f89cdb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f840acf20 0x7f1f840c5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.079+0000 7f7d0e32b640 1 -- start start 2024-03-29T04:08:17.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.080+0000 7f1f89cdb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f840cca20 0x7f1f84161bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.080+0000 7fa13f7fe640 1 -- 172.21.15.73:0/1987774495 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa130004800 msgr2=0x7fa13804d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.080+0000 7fa13f7fe640 1 --2- 172.21.15.73:0/1987774495 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa130004800 0x7fa13804d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.080+0000 7fa13f7fe640 1 -- 172.21.15.73:0/1987774495 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1380524e0 msgr2=0x7fa13804fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.080+0000 7fa13f7fe640 1 --2- 172.21.15.73:0/1987774495 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1380524e0 0x7fa13804fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.080+0000 7fa13f7fe640 1 -- 172.21.15.73:0/1987774495 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa13804cb80 con 0x7fa138052060 2024-03-29T04:08:17.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.080+0000 7fb6027fc640 1 -- 172.21.15.73:0/2141269423 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb60c099070 con 0x7fb6040546c0 2024-03-29T04:08:17.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.080+0000 7fb6027fc640 1 -- 172.21.15.73:0/2141269423 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb60c0733e0 con 0x7fb6040546c0 2024-03-29T04:08:17.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.080+0000 7fb6027fc640 1 -- 172.21.15.73:0/2141269423 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb60c073810 con 0x7fb6040546c0 2024-03-29T04:08:17.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.080+0000 7fb613d66640 1 -- 172.21.15.73:0/2141269423 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb604048c50 con 0x7fb6040546c0 2024-03-29T04:08:17.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.080+0000 7fb613d66640 1 -- 172.21.15.73:0/2141269423 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb604049210 con 0x7fb6040546c0 2024-03-29T04:08:17.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.080+0000 7f7d0e32b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d0004ff80 0x7f7d000d5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.080+0000 7f7d0e32b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d00053190 0x7f7d000f6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.080+0000 7f7d0e32b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d000e32d0 0x7f7d00185b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.080+0000 7f7d0e32b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7d00054740 con 0x7f7d00053190 2024-03-29T04:08:17.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.080+0000 7f7d0e32b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7d00054220 con 0x7f7d0004ff80 2024-03-29T04:08:17.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.080+0000 7f7d0e32b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7d0003a900 con 0x7f7d000e32d0 2024-03-29T04:08:17.114 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.080+0000 7f7d0d329640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d0004ff80 0x7f7d000d5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.080+0000 7fafb0ff9640 1 -- 172.21.15.73:0/4021036238 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafac014620 con 0x7fafb406ca60 2024-03-29T04:08:17.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.080+0000 7fafb0ff9640 1 -- 172.21.15.73:0/4021036238 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafac019070 con 0x7fafb406ca60 2024-03-29T04:08:17.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.080+0000 7fafb0ff9640 1 -- 172.21.15.73:0/4021036238 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafac014a00 con 0x7fafb406ca60 2024-03-29T04:08:17.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.081+0000 7fa13f7fe640 1 --2- 172.21.15.73:0/1987774495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa138052060 0x7fa138179860 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa12c009870 tx=0x7fa12c004700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.081+0000 7fafba6a5640 1 -- 172.21.15.73:0/4021036238 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafb414a060 con 0x7fafb406ca60 2024-03-29T04:08:17.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.081+0000 7fafba6a5640 1 -- 172.21.15.73:0/4021036238 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafb414a620 con 0x7fafb406ca60 2024-03-29T04:08:17.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.079+0000 7fab00a24640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faaf4008de0 0x7faaf404be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.079+0000 7faafbfff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faaf4009270 0x7faaf40df660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.079+0000 7fab00a24640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faaf4008de0 0x7faaf404be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:53786/0 (socket says 172.21.15.73:53786) 2024-03-29T04:08:17.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.080+0000 7fab00a24640 1 -- 172.21.15.73:0/1806038822 learned_addr learned my addr 172.21.15.73:0/1806038822 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:17.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.080+0000 7fab01225640 1 --2- 172.21.15.73:0/1806038822 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faaf4054970 0x7faaf40c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.080+0000 7fab01225640 1 -- 172.21.15.73:0/1806038822 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faaf4008de0 msgr2=0x7faaf404be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.080+0000 7fab01225640 1 --2- 172.21.15.73:0/1806038822 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faaf4008de0 0x7faaf404be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.080+0000 7fab01225640 1 -- 172.21.15.73:0/1806038822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faaf4009270 msgr2=0x7faaf40df660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.080+0000 7fab01225640 1 --2- 172.21.15.73:0/1806038822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faaf4009270 0x7faaf40df660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.080+0000 7fab01225640 1 -- 172.21.15.73:0/1806038822 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf4047260 con 0x7faaf4054970 2024-03-29T04:08:17.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.080+0000 7faafbfff640 1 --2- 172.21.15.73:0/1806038822 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faaf4009270 0x7faaf40df660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:08:17.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.081+0000 7fab01225640 1 --2- 172.21.15.73:0/1806038822 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faaf4054970 0x7faaf40c7b20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faafc0506a0 tx=0x7faafc063360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.081+0000 7faaf97fa640 1 -- 172.21.15.73:0/1806038822 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faafc0b4050 con 0x7faaf4054970 2024-03-29T04:08:17.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.081+0000 7faaf97fa640 1 -- 172.21.15.73:0/1806038822 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faafc0b5040 con 0x7faaf4054970 2024-03-29T04:08:17.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.081+0000 7fab02c88640 1 -- 172.21.15.73:0/1806038822 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaf4047540 con 0x7faaf4054970 2024-03-29T04:08:17.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.081+0000 7f1f89cdb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f84166ea0 0x7f1f84162130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.081+0000 7f1f89cdb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1f84167320 con 0x7f1f84166ea0 2024-03-29T04:08:17.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.081+0000 7f1f89cdb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f1f84166980 con 0x7f1f840acf20 2024-03-29T04:08:17.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.081+0000 7f1f89cdb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f1f840c5da0 con 0x7f1f840cca20 2024-03-29T04:08:17.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.081+0000 7f1f88cd9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f840acf20 0x7f1f840c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.081+0000 7ff5f128f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5ec0b2310 0x7ff5ec14db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.081+0000 7ff5f128f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5ec0b3c40 0x7ff5ec1e4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.081+0000 7ff5f128f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5ec15a800 0x7ff5ec1e4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.081+0000 7ff5f128f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff5ec15c620 con 0x7ff5ec0b2310 2024-03-29T04:08:17.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.081+0000 7ff5f128f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff5ec0b00d0 con 0x7ff5ec0b3c40 2024-03-29T04:08:17.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.081+0000 7ff5f128f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff5ec15abe0 con 0x7ff5ec15a800 2024-03-29T04:08:17.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.081+0000 7f1f88cd9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f840acf20 0x7f1f840c5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:34590/0 (socket says 172.21.15.73:34590) 2024-03-29T04:08:17.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.081+0000 7f1f88cd9640 1 -- 172.21.15.73:0/1582552141 learned_addr learned my addr 172.21.15.73:0/1582552141 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:17.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.081+0000 7f1f83fff640 1 --2- 172.21.15.73:0/1582552141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f840cca20 0x7f1f84161bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.081+0000 7f1f894da640 1 --2- 172.21.15.73:0/1582552141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f84166ea0 0x7f1f84162130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.082+0000 7f9e077fe640 1 -- 172.21.15.73:0/628385581 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f9e18047020 con 0x7f9e201447a0 2024-03-29T04:08:17.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.080+0000 7f7d0d329640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d0004ff80 0x7f7d000d5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:34596/0 (socket says 172.21.15.73:34596) 2024-03-29T04:08:17.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.080+0000 7f7d0d329640 1 -- 172.21.15.73:0/813257559 learned_addr learned my addr 172.21.15.73:0/813257559 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:17.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.081+0000 7f7d0d329640 1 -- 172.21.15.73:0/813257559 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d000e32d0 msgr2=0x7f7d00185b20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-29T04:08:17.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.081+0000 7f7d0d329640 1 --2- 172.21.15.73:0/813257559 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7d000e32d0 0x7f7d00185b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.081+0000 7f7d0d329640 1 -- 172.21.15.73:0/813257559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d00053190 msgr2=0x7f7d000f6dd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-29T04:08:17.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.081+0000 7f7d0cb28640 1 --2- 172.21.15.73:0/813257559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d00053190 0x7f7d000f6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.081+0000 7f7d0d329640 1 --2- 172.21.15.73:0/813257559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d00053190 0x7f7d000f6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.082+0000 7f7d0d329640 1 -- 172.21.15.73:0/813257559 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d001866a0 con 0x7f7d0004ff80 2024-03-29T04:08:17.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.082+0000 7ff5eb7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5ec15a800 0x7ff5ec1e4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.082+0000 7fafba6a5640 1 -- 172.21.15.73:0/4021036238 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faf94001030 con 0x7fafb406ca60 2024-03-29T04:08:17.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.082+0000 7ff5ea7fc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5ec0b3c40 0x7ff5ec1e4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.081+0000 7faaf97fa640 1 -- 172.21.15.73:0/1806038822 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faafc0aea60 con 0x7faaf4054970 2024-03-29T04:08:17.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.082+0000 7ff5ea7fc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5ec0b3c40 0x7ff5ec1e4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:34604/0 (socket says 172.21.15.73:34604) 2024-03-29T04:08:17.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.082+0000 7ff5ea7fc640 1 -- 172.21.15.73:0/2744453382 learned_addr learned my addr 172.21.15.73:0/2744453382 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:17.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.081+0000 7fab02c88640 1 -- 172.21.15.73:0/1806038822 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaf4047b00 con 0x7faaf4054970 2024-03-29T04:08:17.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.082+0000 7f1f894da640 1 -- 172.21.15.73:0/1582552141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f840cca20 msgr2=0x7f1f84161bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.082+0000 7f1f894da640 1 --2- 172.21.15.73:0/1582552141 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f840cca20 0x7f1f84161bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.082+0000 7f1f894da640 1 -- 172.21.15.73:0/1582552141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f840acf20 msgr2=0x7f1f840c5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.082+0000 7f1f894da640 1 --2- 172.21.15.73:0/1582552141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f840acf20 0x7f1f840c5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.082+0000 7f1f894da640 1 -- 172.21.15.73:0/1582552141 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f841f8780 con 0x7f1f84166ea0 2024-03-29T04:08:17.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.082+0000 7f7d0d329640 1 --2- 172.21.15.73:0/813257559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d0004ff80 0x7f7d000d5f30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7d0400e9e0 tx=0x7f7d0400eea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.082+0000 7ff5ea7fc640 1 -- 172.21.15.73:0/2744453382 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5ec15a800 msgr2=0x7ff5ec1e4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.082+0000 7ff5ea7fc640 1 --2- 172.21.15.73:0/2744453382 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5ec15a800 0x7ff5ec1e4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.082+0000 7ff5ea7fc640 1 -- 172.21.15.73:0/2744453382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5ec0b2310 msgr2=0x7ff5ec14db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.082+0000 7fab02c88640 1 -- 172.21.15.73:0/1806038822 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faaf4038740 con 0x7faaf4054970 2024-03-29T04:08:17.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.081+0000 7fa13cff9640 1 -- 172.21.15.73:0/1987774495 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12c042020 con 0x7fa138052060 2024-03-29T04:08:17.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.081+0000 7fa13cff9640 1 -- 172.21.15.73:0/1987774495 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa12c038040 con 0x7fa138052060 2024-03-29T04:08:17.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.081+0000 7fa13cff9640 1 -- 172.21.15.73:0/1987774495 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12c037070 con 0x7fa138052060 2024-03-29T04:08:17.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.082+0000 7fa1452d0640 1 -- 172.21.15.73:0/1987774495 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa13804ce60 con 0x7fa138052060 2024-03-29T04:08:17.124 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.083+0000 7fa1452d0640 1 -- 172.21.15.73:0/1987774495 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa13804d420 con 0x7fa138052060 2024-03-29T04:08:17.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.083+0000 7fb613d66640 1 -- 172.21.15.73:0/2141269423 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb604048a00 con 0x7fb6040546c0 2024-03-29T04:08:17.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.082+0000 7ff5eaffd640 1 --2- 172.21.15.73:0/2744453382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5ec0b2310 0x7ff5ec14db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.082+0000 7ff5ea7fc640 1 --2- 172.21.15.73:0/2744453382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5ec0b2310 0x7ff5ec14db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.082+0000 7ff5ea7fc640 1 -- 172.21.15.73:0/2744453382 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5ec150150 con 0x7ff5ec0b3c40 2024-03-29T04:08:17.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.083+0000 7ff5eaffd640 1 --2- 172.21.15.73:0/2744453382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5ec0b2310 0x7ff5ec14db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:08:17.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.082+0000 7f7cfdffb640 1 -- 172.21.15.73:0/813257559 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d04017070 con 0x7f7d0004ff80 2024-03-29T04:08:17.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.082+0000 7f7cfdffb640 1 -- 172.21.15.73:0/813257559 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d0400c970 con 0x7f7d0004ff80 2024-03-29T04:08:17.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.083+0000 7f7cfdffb640 1 -- 172.21.15.73:0/813257559 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d0400cd60 con 0x7f7d0004ff80 2024-03-29T04:08:17.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.083+0000 7ff5ea7fc640 1 --2- 172.21.15.73:0/2744453382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5ec0b3c40 0x7ff5ec1e4050 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff5e002bd40 tx=0x7ff5e00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.083+0000 7f9e077fe640 1 --2- 172.21.15.73:0/628385581 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9e0c06c530 0x7f9e0c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.083+0000 7f9e077fe640 1 -- 172.21.15.73:0/628385581 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9e180ae050 con 0x7f9e201447a0 2024-03-29T04:08:17.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.083+0000 7ff5d37fe640 1 -- 172.21.15.73:0/2744453382 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e0037040 con 0x7ff5ec0b3c40 2024-03-29T04:08:17.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.084+0000 7f1f894da640 1 --2- 172.21.15.73:0/1582552141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f84166ea0 0x7f1f84162130 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1f74007dc0 tx=0x7f1f7400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.083+0000 7f9e077fe640 1 --2- 172.21.15.73:0/628385581 >> [v2:172.21.15.73:6816/4291100709,v1:172.21.15.73:6817/4291100709] conn(0x7f9e0c074750 0x7f9e0c076b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.083+0000 7f9e077fe640 1 -- 172.21.15.73:0/628385581 --> [v2:172.21.15.73:6816/4291100709,v1:172.21.15.73:6817/4291100709] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9e1803ce50 con 0x7f9e0c074750 2024-03-29T04:08:17.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.083+0000 7f9e077fe640 1 -- 172.21.15.73:0/628385581 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9e180ae440 con 0x7f9e201447a0 2024-03-29T04:08:17.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.084+0000 7f9e1e7fc640 1 --2- 172.21.15.73:0/628385581 >> [v2:172.21.15.73:6816/4291100709,v1:172.21.15.73:6817/4291100709] conn(0x7f9e0c074750 0x7f9e0c076b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.083+0000 7ff5f128f640 1 -- 172.21.15.73:0/2744453382 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5ec150430 con 0x7ff5ec0b3c40 2024-03-29T04:08:17.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.083+0000 7ff5f128f640 1 -- 172.21.15.73:0/2744453382 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5ec1509f0 con 0x7ff5ec0b3c40 2024-03-29T04:08:17.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.084+0000 7f9e1effd640 1 --2- 172.21.15.73:0/628385581 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9e0c06c530 0x7f9e0c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.084+0000 7f9e1e7fc640 1 --2- 172.21.15.73:0/628385581 >> [v2:172.21.15.73:6816/4291100709,v1:172.21.15.73:6817/4291100709] conn(0x7f9e0c074750 0x7f9e0c076b70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.084+0000 7f1f817fa640 1 -- 172.21.15.73:0/1582552141 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7400edd0 con 0x7f1f84166ea0 2024-03-29T04:08:17.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.084+0000 7f1f89cdb640 1 -- 172.21.15.73:0/1582552141 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f841f8a60 con 0x7f1f84166ea0 2024-03-29T04:08:17.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.084+0000 7f1f89cdb640 1 -- 172.21.15.73:0/1582552141 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f841f9020 con 0x7f1f84166ea0 2024-03-29T04:08:17.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.084+0000 7f1f817fa640 1 -- 172.21.15.73:0/1582552141 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f74003990 con 0x7f1f84166ea0 2024-03-29T04:08:17.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.084+0000 7fb6027fc640 1 -- 172.21.15.73:0/2141269423 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fb60c09c070 con 0x7fb6040546c0 2024-03-29T04:08:17.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.084+0000 7fb6027fc640 1 --2- 172.21.15.73:0/2141269423 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fb5f006c600 0x7fb5f006eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.085+0000 7fb6027fc640 1 -- 172.21.15.73:0/2141269423 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb60c106360 con 0x7fb6040546c0 2024-03-29T04:08:17.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.085+0000 7fb611b02640 1 --2- 172.21.15.73:0/2141269423 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fb5f006c600 0x7fb5f006eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.085+0000 7fb6027fc640 1 --2- 172.21.15.73:0/2141269423 >> [v2:172.21.15.73:6808/407236597,v1:172.21.15.73:6809/407236597] conn(0x7fb5f0074820 0x7fb5f0076c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.083+0000 7f7d0e32b640 1 -- 172.21.15.73:0/813257559 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d000d4e90 con 0x7f7d0004ff80 2024-03-29T04:08:17.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.083+0000 7f7d0e32b640 1 -- 172.21.15.73:0/813257559 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d000d5450 con 0x7f7d0004ff80 2024-03-29T04:08:17.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.085+0000 7f7d0e32b640 1 -- 172.21.15.73:0/813257559 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7d00005390 con 0x7f7d0004ff80 2024-03-29T04:08:17.130 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.085+0000 7fb6027fc640 1 -- 172.21.15.73:0/2141269423 --> [v2:172.21.15.73:6808/407236597,v1:172.21.15.73:6809/407236597] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb60c072ea0 con 0x7fb5f0074820 2024-03-29T04:08:17.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.085+0000 7fb6027fc640 1 -- 172.21.15.73:0/2141269423 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb60c10d050 con 0x7fb6040546c0 2024-03-29T04:08:17.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.085+0000 7fa13cff9640 1 -- 172.21.15.73:0/1987774495 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fa12c045020 con 0x7fa138052060 2024-03-29T04:08:17.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.085+0000 7fa13cff9640 1 --2- 172.21.15.73:0/1987774495 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa12406c5b0 0x7fa12406ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.085+0000 7fa1452d0640 1 -- 172.21.15.73:0/1987774495 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa1380057e0 con 0x7fa138052060 2024-03-29T04:08:17.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.085+0000 7fa13cff9640 1 -- 172.21.15.73:0/1987774495 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa12c0ad2d0 con 0x7fa138052060 2024-03-29T04:08:17.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.085+0000 7fa13cff9640 1 --2- 172.21.15.73:0/1987774495 >> [v2:172.21.15.73:6818/2387335359,v1:172.21.15.73:6820/2387335359] conn(0x7fa1240747b0 0x7fa124076bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.085+0000 7fa13cff9640 1 -- 172.21.15.73:0/1987774495 --> [v2:172.21.15.73:6818/2387335359,v1:172.21.15.73:6820/2387335359] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa12c04ce80 con 0x7fa1240747b0 2024-03-29T04:08:17.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.085+0000 7fb611301640 1 --2- 172.21.15.73:0/2141269423 >> [v2:172.21.15.73:6808/407236597,v1:172.21.15.73:6809/407236597] conn(0x7fb5f0074820 0x7fb5f0076c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.085+0000 7fb611b02640 1 --2- 172.21.15.73:0/2141269423 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fb5f006c600 0x7fb5f006eac0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb608009560 tx=0x7fb60803c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.085+0000 7f9e1effd640 1 --2- 172.21.15.73:0/628385581 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9e0c06c530 0x7f9e0c06e9f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9e10009a30 tx=0x7f9e10008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.085+0000 7f1f817fa640 1 -- 172.21.15.73:0/1582552141 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f74003d80 con 0x7f1f84166ea0 2024-03-29T04:08:17.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.086+0000 7fa13ffff640 1 --2- 172.21.15.73:0/1987774495 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa12406c5b0 0x7fa12406ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.086+0000 7fb611301640 1 --2- 172.21.15.73:0/2141269423 >> [v2:172.21.15.73:6808/407236597,v1:172.21.15.73:6809/407236597] conn(0x7fb5f0074820 0x7fb5f0076c40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.084+0000 7ff5d37fe640 1 -- 172.21.15.73:0/2744453382 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5e0030ec0 con 0x7ff5ec0b3c40 2024-03-29T04:08:17.133 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.086+0000 7fa13ffff640 1 --2- 172.21.15.73:0/1987774495 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa12406c5b0 0x7fa12406ea70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa1340012f0 tx=0x7fa134001d20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.084+0000 7ff5d37fe640 1 -- 172.21.15.73:0/2744453382 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e0032c80 con 0x7ff5ec0b3c40 2024-03-29T04:08:17.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.086+0000 7fa13cff9640 1 -- 172.21.15.73:0/1987774495 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa12c077620 con 0x7fa138052060 2024-03-29T04:08:17.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.086+0000 7ff5f128f640 1 -- 172.21.15.73:0/2744453382 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff5cc001030 con 0x7ff5ec0b3c40 2024-03-29T04:08:17.134 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.086+0000 7f1f89cdb640 1 -- 172.21.15.73:0/1582552141 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1f68001030 con 0x7f1f84166ea0 2024-03-29T04:08:17.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.086+0000 7fa144acf640 1 --2- 172.21.15.73:0/1987774495 >> [v2:172.21.15.73:6818/2387335359,v1:172.21.15.73:6820/2387335359] conn(0x7fa1240747b0 0x7fa124076bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.087+0000 7f9e077fe640 1 -- 172.21.15.73:0/628385581 <== osd.3 v2:172.21.15.73:6816/4291100709 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9e1803ce50 con 0x7f9e0c074750 2024-03-29T04:08:17.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.086+0000 7faaf97fa640 1 -- 172.21.15.73:0/1806038822 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7faafc0c2020 con 0x7faaf4054970 2024-03-29T04:08:17.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.086+0000 7faaf97fa640 1 --2- 172.21.15.73:0/1806038822 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7faae006c600 0x7faae006eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.086+0000 7fafb0ff9640 1 -- 172.21.15.73:0/4021036238 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fafac014ba0 con 0x7fafb406ca60 2024-03-29T04:08:17.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.087+0000 7faaf97fa640 1 -- 172.21.15.73:0/1806038822 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7faafc1285c0 con 0x7faaf4054970 2024-03-29T04:08:17.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.087+0000 7faaf97fa640 1 --2- 172.21.15.73:0/1806038822 >> [v2:172.21.15.142:6800/1772722570,v1:172.21.15.142:6801/1772722570] conn(0x7faae0074880 0x7faae0076ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.087+0000 7faaf97fa640 1 -- 172.21.15.73:0/1806038822 --> [v2:172.21.15.142:6800/1772722570,v1:172.21.15.142:6801/1772722570] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faafc06d4f0 con 0x7faae0074880 2024-03-29T04:08:17.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.087+0000 7faaf97fa640 1 -- 172.21.15.73:0/1806038822 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7faafc1289b0 con 0x7faaf4054970 2024-03-29T04:08:17.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.087+0000 7fab00a24640 1 --2- 172.21.15.73:0/1806038822 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7faae006c600 0x7faae006eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.087+0000 7fa144acf640 1 --2- 172.21.15.73:0/1987774495 >> [v2:172.21.15.73:6818/2387335359,v1:172.21.15.73:6820/2387335359] conn(0x7fa1240747b0 0x7fa124076bd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.087+0000 7fb6027fc640 1 -- 172.21.15.73:0/2141269423 <== osd.2 v2:172.21.15.73:6808/407236597 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb60c072ea0 con 0x7fb5f0074820 2024-03-29T04:08:17.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.087+0000 7fafb0ff9640 1 --2- 172.21.15.73:0/4021036238 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fafa006c630 0x7fafa006eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.087+0000 7fafb0ff9640 1 -- 172.21.15.73:0/4021036238 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fafac08cdc0 con 0x7fafb406ca60 2024-03-29T04:08:17.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.087+0000 7fafb0ff9640 1 --2- 172.21.15.73:0/4021036238 >> [v2:172.21.15.142:6808/3910589675,v1:172.21.15.142:6809/3910589675] conn(0x7fafa0074850 0x7fafa0076c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.087+0000 7f7cfdffb640 1 -- 172.21.15.73:0/813257559 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f7d0401a070 con 0x7f7d0004ff80 2024-03-29T04:08:17.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.087+0000 7fafb0ff9640 1 -- 172.21.15.73:0/4021036238 --> [v2:172.21.15.142:6808/3910589675,v1:172.21.15.142:6809/3910589675] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fafa0077320 con 0x7fafa0074850 2024-03-29T04:08:17.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.088+0000 7fafb0ff9640 1 -- 172.21.15.73:0/4021036238 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fafac08d1b0 con 0x7fafb406ca60 2024-03-29T04:08:17.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.087+0000 7faafbfff640 1 --2- 172.21.15.73:0/1806038822 >> [v2:172.21.15.142:6800/1772722570,v1:172.21.15.142:6801/1772722570] conn(0x7faae0074880 0x7faae0076ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.088+0000 7fab00a24640 1 --2- 172.21.15.73:0/1806038822 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7faae006c600 0x7faae006eac0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faaf00095e0 tx=0x7faaf0009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.088+0000 7f1f817fa640 1 -- 172.21.15.73:0/1582552141 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f1f7401b020 con 0x7f1f84166ea0 2024-03-29T04:08:17.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.088+0000 7f7cfdffb640 1 --2- 172.21.15.73:0/813257559 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7cec06c600 0x7f7cec06eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.088+0000 7fa13cff9640 1 -- 172.21.15.73:0/1987774495 <== osd.0 v2:172.21.15.73:6818/2387335359 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa12c04ce80 con 0x7fa1240747b0 2024-03-29T04:08:17.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.088+0000 7ff5d37fe640 1 -- 172.21.15.73:0/2744453382 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff5e003a040 con 0x7ff5ec0b3c40 2024-03-29T04:08:17.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.088+0000 7fafb8c42640 1 --2- 172.21.15.73:0/4021036238 >> [v2:172.21.15.142:6808/3910589675,v1:172.21.15.142:6809/3910589675] conn(0x7fafa0074850 0x7fafa0076c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.088+0000 7f7cfdffb640 1 -- 172.21.15.73:0/813257559 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7d0408ba60 con 0x7f7d0004ff80 2024-03-29T04:08:17.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.088+0000 7f7cfdffb640 1 --2- 172.21.15.73:0/813257559 >> [v2:172.21.15.142:6816/3703256194,v1:172.21.15.142:6817/3703256194] conn(0x7f7cec074820 0x7f7cec076c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.088+0000 7f7cfdffb640 1 -- 172.21.15.73:0/813257559 --> [v2:172.21.15.142:6816/3703256194,v1:172.21.15.142:6817/3703256194] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7cec0772f0 con 0x7f7cec074820 2024-03-29T04:08:17.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.088+0000 7f1f817fa640 1 --2- 172.21.15.73:0/1582552141 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f1f6406c530 0x7f1f6406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.088+0000 7f7cfdffb640 1 -- 172.21.15.73:0/813257559 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7d0408be50 con 0x7f7d0004ff80 2024-03-29T04:08:17.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.088+0000 7f7d0db2a640 1 --2- 172.21.15.73:0/813257559 >> [v2:172.21.15.142:6816/3703256194,v1:172.21.15.142:6817/3703256194] conn(0x7f7cec074820 0x7f7cec076c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.089+0000 7ff5d37fe640 1 --2- 172.21.15.73:0/2744453382 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff5d806c600 0x7ff5d806eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.088+0000 7faafbfff640 1 --2- 172.21.15.73:0/1806038822 >> [v2:172.21.15.142:6800/1772722570,v1:172.21.15.142:6801/1772722570] conn(0x7faae0074880 0x7faae0076ca0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.089+0000 7f7d0cb28640 1 --2- 172.21.15.73:0/813257559 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7cec06c600 0x7f7cec06eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.089+0000 7ff5d37fe640 1 -- 172.21.15.73:0/2744453382 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff5e00ad630 con 0x7ff5ec0b3c40 2024-03-29T04:08:17.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.089+0000 7ff5d37fe640 1 --2- 172.21.15.73:0/2744453382 >> [v2:172.21.15.142:6824/4271575803,v1:172.21.15.142:6825/4271575803] conn(0x7ff5d8074820 0x7ff5d8076c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.089+0000 7fafb37fe640 1 --2- 172.21.15.73:0/4021036238 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fafa006c630 0x7fafa006eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.089+0000 7fafb8c42640 1 --2- 172.21.15.73:0/4021036238 >> [v2:172.21.15.142:6808/3910589675,v1:172.21.15.142:6809/3910589675] conn(0x7fafa0074850 0x7fafa0076c70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.089+0000 7ff5d37fe640 1 -- 172.21.15.73:0/2744453382 --> [v2:172.21.15.142:6824/4271575803,v1:172.21.15.142:6825/4271575803] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff5e0051e50 con 0x7ff5d8074820 2024-03-29T04:08:17.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.089+0000 7faaf97fa640 1 -- 172.21.15.73:0/1806038822 <== osd.6 v2:172.21.15.142:6800/1772722570 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faafc06d4f0 con 0x7faae0074880 2024-03-29T04:08:17.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.089+0000 7f1f817fa640 1 -- 172.21.15.73:0/1582552141 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1f7408b850 con 0x7f1f84166ea0 2024-03-29T04:08:17.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.089+0000 7f1f817fa640 1 --2- 172.21.15.73:0/1582552141 >> [v2:172.21.15.73:6800/2431315515,v1:172.21.15.73:6801/2431315515] conn(0x7f1f64074750 0x7f1f64076b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.089+0000 7f1f83fff640 1 --2- 172.21.15.73:0/1582552141 >> [v2:172.21.15.73:6800/2431315515,v1:172.21.15.73:6801/2431315515] conn(0x7f1f64074750 0x7f1f64076b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.089+0000 7f1f88cd9640 1 --2- 172.21.15.73:0/1582552141 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f1f6406c530 0x7f1f6406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.089+0000 7f7d0db2a640 1 --2- 172.21.15.73:0/813257559 >> [v2:172.21.15.142:6816/3703256194,v1:172.21.15.142:6817/3703256194] conn(0x7f7cec074820 0x7f7cec076c40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.089+0000 7f1f83fff640 1 --2- 172.21.15.73:0/1582552141 >> [v2:172.21.15.73:6800/2431315515,v1:172.21.15.73:6801/2431315515] conn(0x7f1f64074750 0x7f1f64076b70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.090+0000 7f1f817fa640 1 -- 172.21.15.73:0/1582552141 --> [v2:172.21.15.73:6800/2431315515,v1:172.21.15.73:6801/2431315515] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1f74012e50 con 0x7f1f64074750 2024-03-29T04:08:17.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.090+0000 7fafb37fe640 1 --2- 172.21.15.73:0/4021036238 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fafa006c630 0x7fafa006eaf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fafb40cfbf0 tx=0x7fafa8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.090+0000 7fafb0ff9640 1 -- 172.21.15.73:0/4021036238 <== osd.7 v2:172.21.15.142:6808/3910589675 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fafa0077320 con 0x7fafa0074850 2024-03-29T04:08:17.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.089+0000 7ff5d37fe640 1 -- 172.21.15.73:0/2744453382 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff5e00ada20 con 0x7ff5ec0b3c40 2024-03-29T04:08:17.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.089+0000 7ff5eb7fe640 1 --2- 172.21.15.73:0/2744453382 >> [v2:172.21.15.142:6824/4271575803,v1:172.21.15.142:6825/4271575803] conn(0x7ff5d8074820 0x7ff5d8076c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.089+0000 7ff5eaffd640 1 --2- 172.21.15.73:0/2744453382 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff5d806c600 0x7ff5d806eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.090+0000 7f1f817fa640 1 -- 172.21.15.73:0/1582552141 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1f740902a0 con 0x7f1f84166ea0 2024-03-29T04:08:17.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.090+0000 7ff5eb7fe640 1 --2- 172.21.15.73:0/2744453382 >> [v2:172.21.15.142:6824/4271575803,v1:172.21.15.142:6825/4271575803] conn(0x7ff5d8074820 0x7ff5d8076c40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.091+0000 7f1f817fa640 1 -- 172.21.15.73:0/1582552141 <== osd.1 v2:172.21.15.73:6800/2431315515 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1f74012e50 con 0x7f1f64074750 2024-03-29T04:08:17.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.091+0000 7ff5eaffd640 1 --2- 172.21.15.73:0/2744453382 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff5d806c600 0x7ff5d806eac0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4000f60 tx=0x7ff5e4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.091+0000 7ff5d37fe640 1 -- 172.21.15.73:0/2744453382 <== osd.5 v2:172.21.15.142:6824/4271575803 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff5e0051e50 con 0x7ff5d8074820 2024-03-29T04:08:17.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.091+0000 7f7d0cb28640 1 --2- 172.21.15.73:0/813257559 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7cec06c600 0x7f7cec06eac0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7d000d3630 tx=0x7f7cf8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.094+0000 7f7cfdffb640 1 -- 172.21.15.73:0/813257559 <== osd.4 v2:172.21.15.142:6816/3703256194 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7cec0772f0 con 0x7f7cec074820 2024-03-29T04:08:17.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.094+0000 7f1f88cd9640 1 --2- 172.21.15.73:0/1582552141 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f1f6406c530 0x7f1f6406e9f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1f840af4c0 tx=0x7f1f7c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.115+0000 7fb613d66640 1 -- 172.21.15.73:0/2141269423 --> [v2:172.21.15.73:6808/407236597,v1:172.21.15.73:6809/407236597] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb6040053c0 con 0x7fb5f0074820 2024-03-29T04:08:17.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.115+0000 7fb6027fc640 1 -- 172.21.15.73:0/2141269423 <== osd.2 v2:172.21.15.73:6808/407236597 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb6040053c0 con 0x7fb5f0074820 2024-03-29T04:08:17.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.116+0000 7fb5effff640 1 -- 172.21.15.73:0/2141269423 >> [v2:172.21.15.73:6808/407236597,v1:172.21.15.73:6809/407236597] conn(0x7fb5f0074820 msgr2=0x7fb5f0076c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.116+0000 7fb5effff640 1 --2- 172.21.15.73:0/2141269423 >> [v2:172.21.15.73:6808/407236597,v1:172.21.15.73:6809/407236597] conn(0x7fb5f0074820 0x7fb5f0076c40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.117+0000 7fb5effff640 1 -- 172.21.15.73:0/2141269423 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fb5f006c600 msgr2=0x7fb5f006eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.117+0000 7fb5effff640 1 --2- 172.21.15.73:0/2141269423 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fb5f006c600 0x7fb5f006eac0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb608009560 tx=0x7fb60803c040 comp rx=0 tx=0).stop 2024-03-29T04:08:17.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.117+0000 7fb5effff640 1 -- 172.21.15.73:0/2141269423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6040546c0 msgr2=0x7fb6040d5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.117+0000 7fb5effff640 1 --2- 172.21.15.73:0/2141269423 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb6040546c0 0x7fb6040d5d30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb60c06a260 tx=0x7fb60c06da70 comp rx=0 tx=0).stop 2024-03-29T04:08:17.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.117+0000 7fb612303640 1 -- 172.21.15.73:0/2141269423 reap_dead start 2024-03-29T04:08:17.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.117+0000 7fb5effff640 1 -- 172.21.15.73:0/2141269423 shutdown_connections 2024-03-29T04:08:17.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.117+0000 7fb5effff640 1 -- 172.21.15.73:0/2141269423 >> 172.21.15.73:0/2141269423 conn(0x7fb604009fe0 msgr2=0x7fb6040365c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:17.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.117+0000 7fb5effff640 1 -- 172.21.15.73:0/2141269423 shutdown_connections 2024-03-29T04:08:17.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.118+0000 7fb5effff640 1 -- 172.21.15.73:0/2141269423 wait complete. 2024-03-29T04:08:17.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.118+0000 7f9e2544e640 1 -- 172.21.15.73:0/628385581 --> [v2:172.21.15.73:6816/4291100709,v1:172.21.15.73:6817/4291100709] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9e20068d50 con 0x7f9e0c074750 2024-03-29T04:08:17.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.119+0000 7f9e077fe640 1 -- 172.21.15.73:0/628385581 <== osd.3 v2:172.21.15.73:6816/4291100709 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9e20068d50 con 0x7f9e0c074750 2024-03-29T04:08:17.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.119+0000 7f9e2544e640 1 -- 172.21.15.73:0/628385581 >> [v2:172.21.15.73:6816/4291100709,v1:172.21.15.73:6817/4291100709] conn(0x7f9e0c074750 msgr2=0x7f9e0c076b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.119+0000 7f9e2544e640 1 --2- 172.21.15.73:0/628385581 >> [v2:172.21.15.73:6816/4291100709,v1:172.21.15.73:6817/4291100709] conn(0x7f9e0c074750 0x7f9e0c076b70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.120+0000 7f9e2544e640 1 -- 172.21.15.73:0/628385581 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9e0c06c530 msgr2=0x7f9e0c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.120+0000 7f9e2544e640 1 --2- 172.21.15.73:0/628385581 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9e0c06c530 0x7f9e0c06e9f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9e10009a30 tx=0x7f9e10008040 comp rx=0 tx=0).stop 2024-03-29T04:08:17.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.120+0000 7f9e2544e640 1 -- 172.21.15.73:0/628385581 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e201447a0 msgr2=0x7f9e201f4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.120+0000 7f9e2544e640 1 --2- 172.21.15.73:0/628385581 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e201447a0 0x7f9e201f4690 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9e18009eb0 tx=0x7f9e18004a40 comp rx=0 tx=0).stop 2024-03-29T04:08:17.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.120+0000 7fa1452d0640 1 -- 172.21.15.73:0/1987774495 --> [v2:172.21.15.73:6818/2387335359,v1:172.21.15.73:6820/2387335359] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa13804d620 con 0x7fa1240747b0 2024-03-29T04:08:17.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.120+0000 7f9e1f7fe640 1 -- 172.21.15.73:0/628385581 reap_dead start 2024-03-29T04:08:17.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.120+0000 7f9e2544e640 1 -- 172.21.15.73:0/628385581 shutdown_connections 2024-03-29T04:08:17.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.120+0000 7f9e2544e640 1 -- 172.21.15.73:0/628385581 >> 172.21.15.73:0/628385581 conn(0x7f9e20072050 msgr2=0x7f9e20143590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:17.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.121+0000 7fa13cff9640 1 -- 172.21.15.73:0/1987774495 <== osd.0 v2:172.21.15.73:6818/2387335359 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa13804d620 con 0x7fa1240747b0 2024-03-29T04:08:17.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.121+0000 7f9e2544e640 1 -- 172.21.15.73:0/628385581 shutdown_connections 2024-03-29T04:08:17.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.121+0000 7f9e2544e640 1 -- 172.21.15.73:0/628385581 wait complete. 2024-03-29T04:08:17.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.121+0000 7fab02c88640 1 -- 172.21.15.73:0/1806038822 --> [v2:172.21.15.142:6800/1772722570,v1:172.21.15.142:6801/1772722570] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faaf4038740 con 0x7faae0074880 2024-03-29T04:08:17.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.121+0000 7fa1452d0640 1 -- 172.21.15.73:0/1987774495 >> [v2:172.21.15.73:6818/2387335359,v1:172.21.15.73:6820/2387335359] conn(0x7fa1240747b0 msgr2=0x7fa124076bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.121+0000 7fa1452d0640 1 --2- 172.21.15.73:0/1987774495 >> [v2:172.21.15.73:6818/2387335359,v1:172.21.15.73:6820/2387335359] conn(0x7fa1240747b0 0x7fa124076bd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.121+0000 7fa1452d0640 1 -- 172.21.15.73:0/1987774495 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa12406c5b0 msgr2=0x7fa12406ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.121+0000 7fa1452d0640 1 --2- 172.21.15.73:0/1987774495 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa12406c5b0 0x7fa12406ea70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa1340012f0 tx=0x7fa134001d20 comp rx=0 tx=0).stop 2024-03-29T04:08:17.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.121+0000 7fa1452d0640 1 -- 172.21.15.73:0/1987774495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa138052060 msgr2=0x7fa138179860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.121+0000 7fa1452d0640 1 --2- 172.21.15.73:0/1987774495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa138052060 0x7fa138179860 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa12c009870 tx=0x7fa12c004700 comp rx=0 tx=0).stop 2024-03-29T04:08:17.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.122+0000 7fa144acf640 1 -- 172.21.15.73:0/1987774495 reap_dead start 2024-03-29T04:08:17.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.122+0000 7faaf97fa640 1 -- 172.21.15.73:0/1806038822 <== osd.6 v2:172.21.15.142:6800/1772722570 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7faae8001320 con 0x7faae0074880 2024-03-29T04:08:17.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.122+0000 7fa1452d0640 1 -- 172.21.15.73:0/1987774495 shutdown_connections 2024-03-29T04:08:17.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.122+0000 7fa1452d0640 1 -- 172.21.15.73:0/1987774495 >> 172.21.15.73:0/1987774495 conn(0x7fa13801e6c0 msgr2=0x7fa138037760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:17.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.122+0000 7fa1452d0640 1 -- 172.21.15.73:0/1987774495 shutdown_connections 2024-03-29T04:08:17.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.122+0000 7fa1452d0640 1 -- 172.21.15.73:0/1987774495 wait complete. 2024-03-29T04:08:17.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.122+0000 7fab02c88640 1 -- 172.21.15.73:0/1806038822 >> [v2:172.21.15.142:6800/1772722570,v1:172.21.15.142:6801/1772722570] conn(0x7faae0074880 msgr2=0x7faae0076ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.122+0000 7fab02c88640 1 --2- 172.21.15.73:0/1806038822 >> [v2:172.21.15.142:6800/1772722570,v1:172.21.15.142:6801/1772722570] conn(0x7faae0074880 0x7faae0076ca0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.123+0000 7fab02c88640 1 -- 172.21.15.73:0/1806038822 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7faae006c600 msgr2=0x7faae006eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.123+0000 7fab02c88640 1 --2- 172.21.15.73:0/1806038822 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7faae006c600 0x7faae006eac0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faaf00095e0 tx=0x7faaf0009190 comp rx=0 tx=0).stop 2024-03-29T04:08:17.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.123+0000 7fab02c88640 1 -- 172.21.15.73:0/1806038822 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faaf4054970 msgr2=0x7faaf40c7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.123+0000 7fab02c88640 1 --2- 172.21.15.73:0/1806038822 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faaf4054970 0x7faaf40c7b20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faafc0506a0 tx=0x7faafc063360 comp rx=0 tx=0).stop 2024-03-29T04:08:17.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.123+0000 7fab01225640 1 -- 172.21.15.73:0/1806038822 reap_dead start 2024-03-29T04:08:17.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.123+0000 7fab02c88640 1 -- 172.21.15.73:0/1806038822 shutdown_connections 2024-03-29T04:08:17.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.123+0000 7fab02c88640 1 -- 172.21.15.73:0/1806038822 >> 172.21.15.73:0/1806038822 conn(0x7faaf4055c40 msgr2=0x7faaf404ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:17.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.123+0000 7fab02c88640 1 -- 172.21.15.73:0/1806038822 shutdown_connections 2024-03-29T04:08:17.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.123+0000 7fab02c88640 1 -- 172.21.15.73:0/1806038822 wait complete. 2024-03-29T04:08:17.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.123+0000 7fafba6a5640 1 -- 172.21.15.73:0/4021036238 --> [v2:172.21.15.142:6808/3910589675,v1:172.21.15.142:6809/3910589675] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faf94002d50 con 0x7fafa0074850 2024-03-29T04:08:17.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.124+0000 7f1f89cdb640 1 -- 172.21.15.73:0/1582552141 --> [v2:172.21.15.73:6800/2431315515,v1:172.21.15.73:6801/2431315515] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1f68002dd0 con 0x7f1f64074750 2024-03-29T04:08:17.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.124+0000 7fafb0ff9640 1 -- 172.21.15.73:0/4021036238 <== osd.7 v2:172.21.15.142:6808/3910589675 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7faf94002d50 con 0x7fafa0074850 2024-03-29T04:08:17.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.124+0000 7f1f817fa640 1 -- 172.21.15.73:0/1582552141 <== osd.1 v2:172.21.15.73:6800/2431315515 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1f68002dd0 con 0x7f1f64074750 2024-03-29T04:08:17.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.124+0000 7fafba6a5640 1 -- 172.21.15.73:0/4021036238 >> [v2:172.21.15.142:6808/3910589675,v1:172.21.15.142:6809/3910589675] conn(0x7fafa0074850 msgr2=0x7fafa0076c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.124+0000 7fafba6a5640 1 --2- 172.21.15.73:0/4021036238 >> [v2:172.21.15.142:6808/3910589675,v1:172.21.15.142:6809/3910589675] conn(0x7fafa0074850 0x7fafa0076c70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.125+0000 7fafba6a5640 1 -- 172.21.15.73:0/4021036238 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fafa006c630 msgr2=0x7fafa006eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.125+0000 7fafba6a5640 1 --2- 172.21.15.73:0/4021036238 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fafa006c630 0x7fafa006eaf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fafb40cfbf0 tx=0x7fafa8008040 comp rx=0 tx=0).stop 2024-03-29T04:08:17.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.125+0000 7fafba6a5640 1 -- 172.21.15.73:0/4021036238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fafb406ca60 msgr2=0x7fafb40a9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.125+0000 7fafba6a5640 1 --2- 172.21.15.73:0/4021036238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fafb406ca60 0x7fafb40a9820 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fafac007e40 tx=0x7fafac00e4b0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.125+0000 7fafb8c42640 1 -- 172.21.15.73:0/4021036238 reap_dead start 2024-03-29T04:08:17.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.125+0000 7ff5f128f640 1 -- 172.21.15.73:0/2744453382 --> [v2:172.21.15.142:6824/4271575803,v1:172.21.15.142:6825/4271575803] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff5cc002dd0 con 0x7ff5d8074820 2024-03-29T04:08:17.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.125+0000 7f1f89cdb640 1 -- 172.21.15.73:0/1582552141 >> [v2:172.21.15.73:6800/2431315515,v1:172.21.15.73:6801/2431315515] conn(0x7f1f64074750 msgr2=0x7f1f64076b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.125+0000 7f1f89cdb640 1 --2- 172.21.15.73:0/1582552141 >> [v2:172.21.15.73:6800/2431315515,v1:172.21.15.73:6801/2431315515] conn(0x7f1f64074750 0x7f1f64076b70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.125+0000 7f1f89cdb640 1 -- 172.21.15.73:0/1582552141 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f1f6406c530 msgr2=0x7f1f6406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.125+0000 7f1f89cdb640 1 --2- 172.21.15.73:0/1582552141 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f1f6406c530 0x7f1f6406e9f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1f840af4c0 tx=0x7f1f7c009040 comp rx=0 tx=0).stop 2024-03-29T04:08:17.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.125+0000 7f1f89cdb640 1 -- 172.21.15.73:0/1582552141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f84166ea0 msgr2=0x7f1f84162130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.125+0000 7f1f89cdb640 1 --2- 172.21.15.73:0/1582552141 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f84166ea0 0x7f1f84162130 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1f74007dc0 tx=0x7f1f7400e4b0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.161 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.125+0000 7f7d0e32b640 1 -- 172.21.15.73:0/813257559 --> [v2:172.21.15.142:6816/3703256194,v1:172.21.15.142:6817/3703256194] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7d00006c00 con 0x7f7cec074820 2024-03-29T04:08:17.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.125+0000 7ff5d37fe640 1 -- 172.21.15.73:0/2744453382 <== osd.5 v2:172.21.15.142:6824/4271575803 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff5cc002dd0 con 0x7ff5d8074820 2024-03-29T04:08:17.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.125+0000 7f7cfdffb640 1 -- 172.21.15.73:0/813257559 <== osd.4 v2:172.21.15.142:6816/3703256194 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7d00006c00 con 0x7f7cec074820 2024-03-29T04:08:17.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.126+0000 7f1f894da640 1 -- 172.21.15.73:0/1582552141 reap_dead start 2024-03-29T04:08:17.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.126+0000 7fafba6a5640 1 -- 172.21.15.73:0/4021036238 shutdown_connections 2024-03-29T04:08:17.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.126+0000 7fafba6a5640 1 -- 172.21.15.73:0/4021036238 >> 172.21.15.73:0/4021036238 conn(0x7fafb4072100 msgr2=0x7fafb4166ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:17.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.126+0000 7f1f89cdb640 1 -- 172.21.15.73:0/1582552141 shutdown_connections 2024-03-29T04:08:17.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.126+0000 7f1f89cdb640 1 -- 172.21.15.73:0/1582552141 >> 172.21.15.73:0/1582552141 conn(0x7f1f840b1e20 msgr2=0x7f1f84162e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:17.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.126+0000 7ff5f128f640 1 -- 172.21.15.73:0/2744453382 >> [v2:172.21.15.142:6824/4271575803,v1:172.21.15.142:6825/4271575803] conn(0x7ff5d8074820 msgr2=0x7ff5d8076c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.126+0000 7ff5f128f640 1 --2- 172.21.15.73:0/2744453382 >> [v2:172.21.15.142:6824/4271575803,v1:172.21.15.142:6825/4271575803] conn(0x7ff5d8074820 0x7ff5d8076c40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.126+0000 7fafba6a5640 1 -- 172.21.15.73:0/4021036238 shutdown_connections 2024-03-29T04:08:17.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.126+0000 7fafba6a5640 1 -- 172.21.15.73:0/4021036238 wait complete. 2024-03-29T04:08:17.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.126+0000 7f1f89cdb640 1 -- 172.21.15.73:0/1582552141 shutdown_connections 2024-03-29T04:08:17.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.126+0000 7f1f89cdb640 1 -- 172.21.15.73:0/1582552141 wait complete. 2024-03-29T04:08:17.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.126+0000 7ff5f128f640 1 -- 172.21.15.73:0/2744453382 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff5d806c600 msgr2=0x7ff5d806eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.126+0000 7ff5f128f640 1 --2- 172.21.15.73:0/2744453382 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff5d806c600 0x7ff5d806eac0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4000f60 tx=0x7ff5e4009040 comp rx=0 tx=0).stop 2024-03-29T04:08:17.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.126+0000 7ff5f128f640 1 -- 172.21.15.73:0/2744453382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5ec0b3c40 msgr2=0x7ff5ec1e4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.126+0000 7ff5f128f640 1 --2- 172.21.15.73:0/2744453382 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5ec0b3c40 0x7ff5ec1e4050 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff5e002bd40 tx=0x7ff5e00046c0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.126+0000 7f7d0e32b640 1 -- 172.21.15.73:0/813257559 >> [v2:172.21.15.142:6816/3703256194,v1:172.21.15.142:6817/3703256194] conn(0x7f7cec074820 msgr2=0x7f7cec076c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.126+0000 7f7d0e32b640 1 --2- 172.21.15.73:0/813257559 >> [v2:172.21.15.142:6816/3703256194,v1:172.21.15.142:6817/3703256194] conn(0x7f7cec074820 0x7f7cec076c40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.126+0000 7ff5eb7fe640 1 -- 172.21.15.73:0/2744453382 reap_dead start 2024-03-29T04:08:17.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.127+0000 7ff5f128f640 1 -- 172.21.15.73:0/2744453382 shutdown_connections 2024-03-29T04:08:17.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.127+0000 7ff5f128f640 1 -- 172.21.15.73:0/2744453382 >> 172.21.15.73:0/2744453382 conn(0x7ff5ec0b56e0 msgr2=0x7ff5ec14f890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:17.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.127+0000 7f7d0e32b640 1 -- 172.21.15.73:0/813257559 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7cec06c600 msgr2=0x7f7cec06eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.127+0000 7f7d0e32b640 1 --2- 172.21.15.73:0/813257559 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7cec06c600 0x7f7cec06eac0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7d000d3630 tx=0x7f7cf8009040 comp rx=0 tx=0).stop 2024-03-29T04:08:17.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.127+0000 7f7d0e32b640 1 -- 172.21.15.73:0/813257559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d0004ff80 msgr2=0x7f7d000d5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.127+0000 7f7d0e32b640 1 --2- 172.21.15.73:0/813257559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d0004ff80 0x7f7d000d5f30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7d0400e9e0 tx=0x7f7d0400eea0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.127+0000 7f7d0db2a640 1 -- 172.21.15.73:0/813257559 reap_dead start 2024-03-29T04:08:17.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.127+0000 7f7d0e32b640 1 -- 172.21.15.73:0/813257559 shutdown_connections 2024-03-29T04:08:17.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.127+0000 7ff5f128f640 1 -- 172.21.15.73:0/2744453382 shutdown_connections 2024-03-29T04:08:17.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.127+0000 7f7d0e32b640 1 -- 172.21.15.73:0/813257559 >> 172.21.15.73:0/813257559 conn(0x7f7d00009fb0 msgr2=0x7f7d0000a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:17.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.128+0000 7f7d0e32b640 1 -- 172.21.15.73:0/813257559 shutdown_connections 2024-03-29T04:08:17.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.128+0000 7f7d0e32b640 1 -- 172.21.15.73:0/813257559 wait complete. 2024-03-29T04:08:17.168 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.128+0000 7ff5f128f640 1 -- 172.21.15.73:0/2744453382 wait complete. 2024-03-29T04:08:17.169 INFO:teuthology.orchestra.run.smithi073.stdout:55834574854 2024-03-29T04:08:17.169 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-29T04:08:17.170 INFO:teuthology.orchestra.run.smithi073.stdout:55834574855 2024-03-29T04:08:17.170 INFO:teuthology.orchestra.run.smithi073.stdout:55834574853 2024-03-29T04:08:17.171 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-29T04:08:17.171 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-29T04:08:17.172 INFO:teuthology.orchestra.run.smithi073.stdout:55834574855 2024-03-29T04:08:17.173 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-29T04:08:17.173 INFO:teuthology.orchestra.run.smithi073.stdout:55834574855 2024-03-29T04:08:17.173 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-29T04:08:17.174 INFO:teuthology.orchestra.run.smithi073.stdout:55834574853 2024-03-29T04:08:17.175 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-29T04:08:17.175 INFO:teuthology.orchestra.run.smithi073.stdout:55834574855 2024-03-29T04:08:17.176 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-29T04:08:17.176 INFO:teuthology.orchestra.run.smithi073.stdout:55834574854 2024-03-29T04:08:17.177 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-29T04:08:17.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.398+0000 7fa9a0ac1640 1 Processor -- start 2024-03-29T04:08:17.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.398+0000 7fa9a0ac1640 1 -- start start 2024-03-29T04:08:17.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.400+0000 7fa9a0ac1640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa99c06da60 0x7fa99c0c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.400+0000 7fa9a0ac1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa99c15abf0 0x7fa99c0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.400+0000 7fa9a0ac1640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa99c15b2f0 con 0x7fa99c0c66d0 2024-03-29T04:08:17.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.400+0000 7fa9a0ac1640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fa99c15b0a0 con 0x7fa99c06da60 2024-03-29T04:08:17.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.400+0000 7fa9a0ac1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa99c15b5d0 con 0x7fa99c15abf0 2024-03-29T04:08:17.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.400+0000 7fa99a59c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa99c06da60 0x7fa99c0c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.400+0000 7fa99a59c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa99c06da60 0x7fa99c0c6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:34606/0 (socket says 172.21.15.73:34606) 2024-03-29T04:08:17.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.400+0000 7fa99a59c640 1 -- 172.21.15.73:0/333847920 learned_addr learned my addr 172.21.15.73:0/333847920 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:17.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.400+0000 7fa99ad9d640 1 --2- 172.21.15.73:0/333847920 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa99c15abf0 0x7fa99c0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.400+0000 7fa99a59c640 1 -- 172.21.15.73:0/333847920 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa99c15abf0 msgr2=0x7fa99c0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:17.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.401+0000 7f2d55037640 1 Processor -- start 2024-03-29T04:08:17.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.401+0000 7f2d55037640 1 -- start start 2024-03-29T04:08:17.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.401+0000 7fd4cde41640 1 Processor -- start 2024-03-29T04:08:17.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.401+0000 7fa99a59c640 1 --2- 172.21.15.73:0/333847920 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa99c15abf0 0x7fa99c0ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.401+0000 7fa99a59c640 1 -- 172.21.15.73:0/333847920 >> v1:172.21.15.142:6789/0 conn(0x7fa99c0c66d0 legacy=0x7fa99c06de40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-29T04:08:17.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.401+0000 7fa99a59c640 1 -- 172.21.15.73:0/333847920 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa99c15b8b0 con 0x7fa99c06da60 2024-03-29T04:08:17.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.401+0000 7fa99ad9d640 1 --2- 172.21.15.73:0/333847920 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa99c15abf0 0x7fa99c0ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:08:17.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.401+0000 7fd4cde41640 1 -- start start 2024-03-29T04:08:17.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.402+0000 7f2efe78d640 1 Processor -- start 2024-03-29T04:08:17.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.402+0000 7f2efe78d640 1 -- start start 2024-03-29T04:08:17.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.402+0000 7f2d55037640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d5006da60 0x7f2d500c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.402+0000 7f2d55037640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2d500c66d0 0x7f2d5015abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.402+0000 7f2d4ed9d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d5006da60 0x7f2d500c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.402+0000 7f2d4ed9d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d5006da60 0x7f2d500c6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:53870/0 (socket says 172.21.15.73:53870) 2024-03-29T04:08:17.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.402+0000 7f2d4ed9d640 1 -- 172.21.15.73:0/49235699 learned_addr learned my addr 172.21.15.73:0/49235699 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:17.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.402+0000 7f2d4e59c640 1 --2- 172.21.15.73:0/49235699 >> v2:172.21.15.142:3300/0 conn(0x7f2d500c66d0 0x7f2d5015abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.402+0000 7f2d55037640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d5015b2f0 con 0x7f2d5006de40 2024-03-29T04:08:17.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.402+0000 7f2d55037640 1 -- 172.21.15.73:0/49235699 --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f2d500cf300 con 0x7f2d500c66d0 2024-03-29T04:08:17.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.402+0000 7f2d55037640 1 -- 172.21.15.73:0/49235699 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2d5015b5d0 con 0x7f2d5006da60 2024-03-29T04:08:17.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.403+0000 7f2d4dd9b640 1 -- 172.21.15.73:0/49235699 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2999070298 0 0) 0x7f2d5015b2f0 con 0x7f2d5006de40 2024-03-29T04:08:17.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.403+0000 7f2d4dd9b640 1 -- 172.21.15.73:0/49235699 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d38003520 con 0x7f2d5006de40 2024-03-29T04:08:17.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.402+0000 7fa99a59c640 1 --2- 172.21.15.73:0/333847920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa99c06da60 0x7fa99c0c6c20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa98c0091e0 tx=0x7fa98c02cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=164e107ae5000d16 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.402+0000 7fa99959a640 1 -- 172.21.15.73:0/333847920 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa98c03a070 con 0x7fa99c06da60 2024-03-29T04:08:17.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.402+0000 7fa99959a640 1 -- 172.21.15.73:0/333847920 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa98c02d9d0 con 0x7fa99c06da60 2024-03-29T04:08:17.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.403+0000 7fa99959a640 1 -- 172.21.15.73:0/333847920 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa98c02dda0 con 0x7fa99c06da60 2024-03-29T04:08:17.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.403+0000 7fd4cde41640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd4c80cd280 0x7fd4c80b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.403+0000 7fd4cde41640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4c80c5020 0x7fd4c80c5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.403+0000 7fd4cde41640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4c81609c0 con 0x7fd4c81605e0 2024-03-29T04:08:17.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.403+0000 7fd4cde41640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fd4c80add40 con 0x7fd4c80cd280 2024-03-29T04:08:17.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.403+0000 7fd4cde41640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd4c80ad130 con 0x7fd4c80c5020 2024-03-29T04:08:17.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.403+0000 7f2efe78d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ef8073690 0x7f2ef80c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.403+0000 7f2efe78d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ef815b5d0 con 0x7f2ef80c66d0 2024-03-29T04:08:17.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.403+0000 7f2efe78d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ef815b8b0 con 0x7f2ef806da60 2024-03-29T04:08:17.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.403+0000 7f2efe78d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2ef815b090 con 0x7f2ef8073690 2024-03-29T04:08:17.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.403+0000 7fd4c7fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4c80c5020 0x7fd4c80c5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.403+0000 7fd4c6ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd4c80cd280 0x7fd4c80b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.403+0000 7fa9a0ac1640 1 -- 172.21.15.73:0/333847920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa99c06da60 msgr2=0x7fa99c0c6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.403+0000 7fa9a0ac1640 1 --2- 172.21.15.73:0/333847920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa99c06da60 0x7fa99c0c6c20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa98c0091e0 tx=0x7fa98c02cc20 comp rx=0 tx=0).stop 2024-03-29T04:08:17.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.403+0000 7fd4c6ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd4c80cd280 0x7fd4c80b30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45974/0 (socket says 172.21.15.73:45974) 2024-03-29T04:08:17.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.403+0000 7fd4c6ffd640 1 -- 172.21.15.73:0/2058429373 learned_addr learned my addr 172.21.15.73:0/2058429373 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:17.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.403+0000 7f2ef77fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2ef80c66d0 0x7f2ef815a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:59030/0 (socket says 172.21.15.73:59030) 2024-03-29T04:08:17.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.403+0000 7f2d4e59c640 1 -- 172.21.15.73:0/49235699 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d5006da60 msgr2=0x7f2d500c6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:17.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.403+0000 7f2d4e59c640 1 --2- 172.21.15.73:0/49235699 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d5006da60 0x7f2d500c6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.403+0000 7f2d4e59c640 1 -- 172.21.15.73:0/49235699 >> v1:172.21.15.73:6789/0 conn(0x7f2d5006de40 legacy=0x7f2d5015e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.403+0000 7f2d4e59c640 1 -- 172.21.15.73:0/49235699 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d5015b8b0 con 0x7f2d500c66d0 2024-03-29T04:08:17.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.403+0000 7f2ef77fe640 1 -- 172.21.15.73:0/2842110284 learned_addr learned my addr 172.21.15.73:0/2842110284 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:17.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.404+0000 7fd4c6ffd640 1 -- 172.21.15.73:0/2058429373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4c80c5020 msgr2=0x7fd4c80c5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:17.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.404+0000 7f2d4e59c640 1 --2- 172.21.15.73:0/49235699 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d500c66d0 0x7f2d5015abf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2d4400ba40 tx=0x7f2d4402dff0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1edfb4b7665ae26 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.404+0000 7f41c0bf4640 1 Processor -- start 2024-03-29T04:08:17.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.404+0000 7f2ef6ffd640 1 -- 172.21.15.73:0/2842110284 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 567892378 0 0) 0x7f2ef815b5d0 con 0x7f2ef80c66d0 2024-03-29T04:08:17.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.404+0000 7f2ef6ffd640 1 -- 172.21.15.73:0/2842110284 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ee0003520 con 0x7f2ef80c66d0 2024-03-29T04:08:17.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.404+0000 7f2ef6ffd640 1 -- 172.21.15.73:0/2842110284 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2553550429 0 0) 0x7f2ee0003520 con 0x7f2ef80c66d0 2024-03-29T04:08:17.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.404+0000 7f2ef6ffd640 1 -- 172.21.15.73:0/2842110284 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ef8073690 msgr2=0x7f2ef80c6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:17.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.404+0000 7f2ef6ffd640 1 --2- 172.21.15.73:0/2842110284 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ef8073690 0x7f2ef80c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.404+0000 7f2ef6ffd640 1 -- 172.21.15.73:0/2842110284 >> v1:172.21.15.142:6789/0 conn(0x7f2ef806da60 legacy=0x7f2ef80ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:17.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.404+0000 7f2ef6ffd640 1 -- 172.21.15.73:0/2842110284 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ef8161830 con 0x7f2ef80c66d0 2024-03-29T04:08:17.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.404+0000 7f2ef6ffd640 1 -- 172.21.15.73:0/2842110284 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1290421750 0 0) 0x7f2eec001670 con 0x7f2ef80c66d0 2024-03-29T04:08:17.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.404+0000 7f2ef6ffd640 1 -- 172.21.15.73:0/2842110284 >> v1:172.21.15.73:6789/0 conn(0x7f2ef80c66d0 legacy=0x7f2ef815a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.404+0000 7f2ef6ffd640 1 --2- 172.21.15.73:0/2842110284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ee00039e0 0x7f2ee0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.404+0000 7f2ef6ffd640 1 --2- 172.21.15.73:0/2842110284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ee0004800 0x7f2ee0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.404+0000 7f2ef6ffd640 1 --2- 172.21.15.73:0/2842110284 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ee00052e0 0x7f2ee00141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.404+0000 7f2ef6ffd640 1 -- 172.21.15.73:0/2842110284 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef815b090 con 0x7f2ee0004800 2024-03-29T04:08:17.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.404+0000 7f2ef6ffd640 1 -- 172.21.15.73:0/2842110284 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee0014930 con 0x7f2ee00039e0 2024-03-29T04:08:17.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.404+0000 7f2ef6ffd640 1 -- 172.21.15.73:0/2842110284 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2ee0014b30 con 0x7f2ee00052e0 2024-03-29T04:08:17.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.404+0000 7fd4c6ffd640 1 --2- 172.21.15.73:0/2058429373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4c80c5020 0x7fd4c80c5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.404+0000 7fd4c6ffd640 1 -- 172.21.15.73:0/2058429373 >> v1:172.21.15.73:6789/0 conn(0x7fd4c81605e0 legacy=0x7fd4c80ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.404+0000 7fd4c6ffd640 1 -- 172.21.15.73:0/2058429373 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4c80ad410 con 0x7fd4c80cd280 2024-03-29T04:08:17.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.404+0000 7fd4c7fff640 1 --2- 172.21.15.73:0/2058429373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4c80c5020 0x7fd4c80c5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:08:17.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.404+0000 7f2ef77fe640 1 --2- 172.21.15.73:0/2842110284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ee0004800 0x7f2ee0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.404+0000 7f2ef7fff640 1 --2- 172.21.15.73:0/2842110284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ee00039e0 0x7f2ee0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.404+0000 7f2d4dd9b640 1 -- 172.21.15.73:0/49235699 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d4403b070 con 0x7f2d500c66d0 2024-03-29T04:08:17.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.404+0000 7f2efcd2a640 1 --2- 172.21.15.73:0/2842110284 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ee00052e0 0x7f2ee00141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.404+0000 7f2d4dd9b640 1 -- 172.21.15.73:0/49235699 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d4402eda0 con 0x7f2d500c66d0 2024-03-29T04:08:17.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.405+0000 7f4301201640 1 Processor -- start 2024-03-29T04:08:17.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.405+0000 7f2d4dd9b640 1 -- 172.21.15.73:0/49235699 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d44036660 con 0x7f2d500c66d0 2024-03-29T04:08:17.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.405+0000 7f4301201640 1 -- start start 2024-03-29T04:08:17.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.405+0000 7fa9a0ac1640 1 -- 172.21.15.73:0/333847920 shutdown_connections 2024-03-29T04:08:17.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.405+0000 7fa9a0ac1640 1 --2- 172.21.15.73:0/333847920 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa99c15abf0 0x7fa99c0ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.405+0000 7fa9a0ac1640 1 --2- 172.21.15.73:0/333847920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa99c06da60 0x7fa99c0c6c20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.405+0000 7fa9a0ac1640 1 -- 172.21.15.73:0/333847920 >> 172.21.15.73:0/333847920 conn(0x7fa99c072ba0 msgr2=0x7fa99c072f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:17.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.405+0000 7f41c0bf4640 1 -- start start 2024-03-29T04:08:17.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.405+0000 7fa9a0ac1640 1 -- 172.21.15.73:0/333847920 shutdown_connections 2024-03-29T04:08:17.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.405+0000 7f1e63c06640 1 Processor -- start 2024-03-29T04:08:17.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.405+0000 7f2ef7fff640 1 -- 172.21.15.73:0/2842110284 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ee00052e0 msgr2=0x7f2ee00141d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:17.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.405+0000 7f2ef7fff640 1 --2- 172.21.15.73:0/2842110284 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ee00052e0 0x7f2ee00141d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.405+0000 7f2ef7fff640 1 -- 172.21.15.73:0/2842110284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ee0004800 msgr2=0x7f2ee0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:17.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.405+0000 7f2ef7fff640 1 --2- 172.21.15.73:0/2842110284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ee0004800 0x7f2ee0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.405+0000 7f2ef7fff640 1 -- 172.21.15.73:0/2842110284 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ef8161830 con 0x7f2ee00039e0 2024-03-29T04:08:17.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.405+0000 7f1e63c06640 1 -- start start 2024-03-29T04:08:17.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.406+0000 7f2d55037640 1 -- 172.21.15.73:0/49235699 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d500c66d0 msgr2=0x7f2d5015abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.406+0000 7f2d55037640 1 --2- 172.21.15.73:0/49235699 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d500c66d0 0x7f2d5015abf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2d4400ba40 tx=0x7f2d4402dff0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.406+0000 7f2d55037640 1 -- 172.21.15.73:0/49235699 shutdown_connections 2024-03-29T04:08:17.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.406+0000 7f2d55037640 1 --2- 172.21.15.73:0/49235699 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d500c66d0 0x7f2d5015abf0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.406+0000 7f2d55037640 1 --2- 172.21.15.73:0/49235699 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d5006da60 0x7f2d500c6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.406+0000 7f2d55037640 1 -- 172.21.15.73:0/49235699 >> 172.21.15.73:0/49235699 conn(0x7f2d50072ba0 msgr2=0x7f2d50072f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:17.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.406+0000 7f2ef7fff640 1 --2- 172.21.15.73:0/2842110284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ee00039e0 0x7f2ee0003de0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80b2e70 tx=0x7f2ee0005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17b7994c4e84cf98 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.406+0000 7f4301201640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f42fc0cee70 0x7f42fc162cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.406+0000 7f41c0bf4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41bc1550e0 0x7f41bc15af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.406+0000 7f41c0bf4640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f41bc06e740 0x7f41bc0b45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.406+0000 7f41c0bf4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f41bc0b4b00 0x7f41bc15e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.406+0000 7f41c0bf4640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f41bc1554c0 con 0x7f41bc06e740 2024-03-29T04:08:17.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.406+0000 7f41c0bf4640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f41bc06b5b0 con 0x7f41bc0b4b00 2024-03-29T04:08:17.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.406+0000 7f41c0bf4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f41bc06ee90 con 0x7f41bc1550e0 2024-03-29T04:08:17.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.406+0000 7f2ef6ffd640 1 -- 172.21.15.73:0/2842110284 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef0039070 con 0x7f2ee00039e0 2024-03-29T04:08:17.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.406+0000 7f2ef6ffd640 1 -- 172.21.15.73:0/2842110284 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ef002ccc0 con 0x7f2ee00039e0 2024-03-29T04:08:17.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.406+0000 7f4301201640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42fc15e880 0x7f42fc0d2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.406+0000 7f4301201640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42fc0d0ac0 con 0x7f42fc15e4a0 2024-03-29T04:08:17.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.406+0000 7f4301201640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f42fc163200 con 0x7f42fc0cee70 2024-03-29T04:08:17.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.406+0000 7f4301201640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f42fc0cf310 con 0x7f42fc15e880 2024-03-29T04:08:17.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.406+0000 7f2ef6ffd640 1 -- 172.21.15.73:0/2842110284 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef0009a10 con 0x7f2ee00039e0 2024-03-29T04:08:17.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.406+0000 7f41bad9d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f41bc0b4b00 0x7f41bc15e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.406+0000 7f2d55037640 1 -- 172.21.15.73:0/49235699 shutdown_connections 2024-03-29T04:08:17.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.405+0000 7fa9a0ac1640 1 -- 172.21.15.73:0/333847920 wait complete. 2024-03-29T04:08:17.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.406+0000 7f4300a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42fc15e880 0x7f42fc0d2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.406+0000 7f2d55037640 1 -- 172.21.15.73:0/49235699 wait complete. 2024-03-29T04:08:17.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.406+0000 7f4300a00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42fc15e880 0x7f42fc0d2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:53924/0 (socket says 172.21.15.73:53924) 2024-03-29T04:08:17.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.406+0000 7f41ba59c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41bc1550e0 0x7f41bc15af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.406+0000 7f41bad9d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f41bc0b4b00 0x7f41bc15e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:34630/0 (socket says 172.21.15.73:34630) 2024-03-29T04:08:17.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.406+0000 7f41ba59c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41bc1550e0 0x7f41bc15af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:53910/0 (socket says 172.21.15.73:53910) 2024-03-29T04:08:17.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.406+0000 7f41bad9d640 1 -- 172.21.15.73:0/3311710209 learned_addr learned my addr 172.21.15.73:0/3311710209 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:17.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.407+0000 7f4300a00640 1 -- 172.21.15.73:0/521424648 learned_addr learned my addr 172.21.15.73:0/521424648 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:17.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.407+0000 7f1e63c06640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1e5c15c740 0x7f1e5c0cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.407+0000 7f1f8dc63640 1 Processor -- start 2024-03-29T04:08:17.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.408+0000 7fd4c6ffd640 1 --2- 172.21.15.73:0/2058429373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4c80cd280 0x7fd4c80b30b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc009870 tx=0x7fd4bc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1709f711424fb8d8 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.407+0000 7f2efe78d640 1 -- 172.21.15.73:0/2842110284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ee00039e0 msgr2=0x7f2ee0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.407+0000 7f2efe78d640 1 --2- 172.21.15.73:0/2842110284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ee00039e0 0x7f2ee0003de0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80b2e70 tx=0x7f2ee0005830 comp rx=0 tx=0).stop 2024-03-29T04:08:17.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.407+0000 7f2efcd2a640 1 -- 172.21.15.73:0/2842110284 reap_dead start 2024-03-29T04:08:17.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.407+0000 7f2efe78d640 1 -- 172.21.15.73:0/2842110284 shutdown_connections 2024-03-29T04:08:17.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.407+0000 7f2efe78d640 1 -- 172.21.15.73:0/2842110284 >> 172.21.15.73:0/2842110284 conn(0x7f2ef8072ba0 msgr2=0x7f2ef8072f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:17.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.407+0000 7f1e63c06640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e5c0d1310 con 0x7f1e5c0d0b30 2024-03-29T04:08:17.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.407+0000 7f1e619a2640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1e5c15c740 0x7f1e5c0cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.407+0000 7f1e621a3640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1e5c0d0b30 0x7f1e5c06fa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:59038/0 (socket says 172.21.15.73:59038) 2024-03-29T04:08:17.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.407+0000 7f1e621a3640 1 -- 172.21.15.73:0/4185599126 learned_addr learned my addr 172.21.15.73:0/4185599126 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:17.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.407+0000 7f1e63c06640 1 -- 172.21.15.73:0/4185599126 --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e5c09ac40 con 0x7f1e5c0cceb0 2024-03-29T04:08:17.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.407+0000 7f1e63c06640 1 -- 172.21.15.73:0/4185599126 --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f1e5c0cd310 con 0x7f1e5c15c740 2024-03-29T04:08:17.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.407+0000 7fa9a0ac1640 1 Processor -- start 2024-03-29T04:08:17.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.407+0000 7fa9a0ac1640 1 -- start start 2024-03-29T04:08:17.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.407+0000 7f41bad9d640 1 -- 172.21.15.73:0/3311710209 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41bc1550e0 msgr2=0x7f41bc15af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:17.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.407+0000 7f41bad9d640 1 --2- 172.21.15.73:0/3311710209 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41bc1550e0 0x7f41bc15af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.407+0000 7f41bad9d640 1 -- 172.21.15.73:0/3311710209 >> v2:172.21.15.73:3300/0 conn(0x7f41bc06e740 msgr2=0x7f41bc0b45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:17.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.407+0000 7f41bad9d640 1 --2- 172.21.15.73:0/3311710209 >> v2:172.21.15.73:3300/0 conn(0x7f41bc06e740 0x7f41bc0b45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.407+0000 7f41bad9d640 1 -- 172.21.15.73:0/3311710209 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41bc06f170 con 0x7f41bc0b4b00 2024-03-29T04:08:17.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.407+0000 7f1f8dc63640 1 -- start start 2024-03-29T04:08:17.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.407+0000 7f42fb7fe640 1 --2- 172.21.15.73:0/521424648 >> v2:172.21.15.73:3300/0 conn(0x7f42fc0cee70 0x7f42fc162cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.407+0000 7f4300a00640 1 -- 172.21.15.73:0/521424648 >> v2:172.21.15.73:3300/0 conn(0x7f42fc0cee70 msgr2=0x7f42fc162cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:17.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.407+0000 7f4300a00640 1 --2- 172.21.15.73:0/521424648 >> v2:172.21.15.73:3300/0 conn(0x7f42fc0cee70 0x7f42fc162cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.407+0000 7f4300a00640 1 -- 172.21.15.73:0/521424648 >> v1:172.21.15.73:6789/0 conn(0x7f42fc15e4a0 legacy=0x7f42fc0d03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:17.407 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.407+0000 7f4300a00640 1 -- 172.21.15.73:0/521424648 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42fc0cf5f0 con 0x7f42fc15e880 2024-03-29T04:08:17.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.407+0000 7f2efe78d640 1 -- 172.21.15.73:0/2842110284 shutdown_connections 2024-03-29T04:08:17.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.407+0000 7f2efe78d640 1 -- 172.21.15.73:0/2842110284 wait complete. 2024-03-29T04:08:17.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.408+0000 7f41bad9d640 1 --2- 172.21.15.73:0/3311710209 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41bc0b4b00 0x7f41bc15e570 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f41bc072f70 tx=0x7f41ac02fd10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c23a93749e6694e5 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.408+0000 7f1e609a0640 1 -- 172.21.15.73:0/4185599126 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1790749441 0 0) 0x7f1e5c09ac40 con 0x7f1e5c0cceb0 2024-03-29T04:08:17.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.408+0000 7f1e609a0640 1 -- 172.21.15.73:0/4185599126 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e48003520 con 0x7f1e5c0cceb0 2024-03-29T04:08:17.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.408+0000 7fd4c67fc640 1 -- 172.21.15.73:0/2058429373 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc035020 con 0x7fd4c80cd280 2024-03-29T04:08:17.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.408+0000 7fd4c67fc640 1 -- 172.21.15.73:0/2058429373 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4bc031640 con 0x7fd4c80cd280 2024-03-29T04:08:17.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.408+0000 7fa9a0ac1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa99c06da60 0x7fa99c0ad630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.408+0000 7f1e619a2640 1 -- 172.21.15.73:0/4185599126 >> v1:172.21.15.142:6789/0 conn(0x7f1e5c0cceb0 legacy=0x7f1e5c0d0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.408+0000 7f1e609a0640 1 -- 172.21.15.73:0/4185599126 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2025308911 0 0) 0x7f1e5c0d1310 con 0x7f1e5c0d0b30 2024-03-29T04:08:17.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.408+0000 7f1e619a2640 1 -- 172.21.15.73:0/4185599126 >> v1:172.21.15.73:6789/0 conn(0x7f1e5c0d0b30 legacy=0x7f1e5c06fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.408+0000 7f1f8dc63640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1f880c6850 0x7f1f880cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.408+0000 7f1f8dc63640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f880c5020 0x7f1f880cc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.409+0000 7fa9a0ac1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa99c0c66d0 0x7fa99c0adb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.409+0000 7f1e619a2640 1 -- 172.21.15.73:0/4185599126 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e5c09af20 con 0x7f1e5c15c740 2024-03-29T04:08:17.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.409+0000 7f1f8dc63640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f88160480 con 0x7f1f8815fc20 2024-03-29T04:08:17.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.409+0000 7f1f8dc63640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f1f88161090 con 0x7f1f880c6850 2024-03-29T04:08:17.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.409+0000 7f1f8dc63640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f1f88160760 con 0x7f1f880c5020 2024-03-29T04:08:17.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.409+0000 7fa99a59c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa99c06da60 0x7fa99c0ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.409+0000 7fa99a59c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa99c06da60 0x7fa99c0ad630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:53940/0 (socket says 172.21.15.73:53940) 2024-03-29T04:08:17.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.409+0000 7fa99a59c640 1 -- 172.21.15.73:0/811136942 learned_addr learned my addr 172.21.15.73:0/811136942 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:17.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.409+0000 7f1f877fe640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f1f8815fc20 0x7f1f880c6140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.73:44300/0 (socket says 172.21.15.73:44300) 2024-03-29T04:08:17.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.409+0000 7f1f877fe640 1 -- 172.21.15.73:0/3304014525 learned_addr learned my addr 172.21.15.73:0/3304014525 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:17.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.409+0000 7fa9a0ac1640 1 --2- 172.21.15.73:0/811136942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa99c15abf0 0x7fa99c0b47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.409+0000 7f1f87fff640 1 --2- 172.21.15.73:0/3304014525 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f880c5020 0x7f1f880cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.409+0000 7f4300a00640 1 --2- 172.21.15.73:0/521424648 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42fc15e880 0x7f42fc0d2890 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f42f4009870 tx=0x7f42f402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfdc8a94f0adb3c6 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.409+0000 7f2d55037640 1 Processor -- start 2024-03-29T04:08:17.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.409+0000 7f41b959a640 1 -- 172.21.15.73:0/3311710209 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41ac00f520 con 0x7f41bc0b4b00 2024-03-29T04:08:17.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.409+0000 7f41b959a640 1 -- 172.21.15.73:0/3311710209 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41ac034070 con 0x7f41bc0b4b00 2024-03-29T04:08:17.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.409+0000 7f41b959a640 1 -- 172.21.15.73:0/3311710209 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41ac004230 con 0x7f41bc0b4b00 2024-03-29T04:08:17.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.409+0000 7f1f867fc640 1 -- 172.21.15.73:0/3304014525 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1303451666 0 0) 0x7f1f88160480 con 0x7f1f8815fc20 2024-03-29T04:08:17.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.409+0000 7f1f867fc640 1 -- 172.21.15.73:0/3304014525 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f70003520 con 0x7f1f8815fc20 2024-03-29T04:08:17.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.409+0000 7f1f87fff640 1 -- 172.21.15.73:0/3304014525 >> v2:172.21.15.73:3300/0 conn(0x7f1f880c6850 msgr2=0x7f1f880cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:17.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.409+0000 7f1f87fff640 1 --2- 172.21.15.73:0/3304014525 >> v2:172.21.15.73:3300/0 conn(0x7f1f880c6850 0x7f1f880cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.409+0000 7f1f87fff640 1 -- 172.21.15.73:0/3304014525 >> v1:172.21.15.142:6789/0 conn(0x7f1f8815fc20 legacy=0x7f1f880c6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.409+0000 7f2d55037640 1 -- start start 2024-03-29T04:08:17.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.409+0000 7f1f87fff640 1 -- 172.21.15.73:0/3304014525 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f88160a40 con 0x7f1f880c5020 2024-03-29T04:08:17.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.409+0000 7fa99ad9d640 1 --2- 172.21.15.73:0/811136942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa99c15abf0 0x7fa99c0b47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.409+0000 7fa999d9b640 1 --2- 172.21.15.73:0/811136942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa99c0c66d0 0x7fa99c0adb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.409+0000 7fd4cde41640 1 -- 172.21.15.73:0/2058429373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4c80cd280 msgr2=0x7fd4c80b30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.409+0000 7fd4c67fc640 1 -- 172.21.15.73:0/2058429373 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc035020 con 0x7fd4c80cd280 2024-03-29T04:08:17.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.409+0000 7fd4cde41640 1 --2- 172.21.15.73:0/2058429373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4c80cd280 0x7fd4c80b30b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc009870 tx=0x7fd4bc02b8f0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.409+0000 7fa9a0ac1640 1 -- 172.21.15.73:0/811136942 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa99c0c5020 con 0x7fa99c0c66d0 2024-03-29T04:08:17.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.409+0000 7fa9a0ac1640 1 -- 172.21.15.73:0/811136942 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa99c15be70 con 0x7fa99c15abf0 2024-03-29T04:08:17.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.410+0000 7fa9a0ac1640 1 -- 172.21.15.73:0/811136942 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa99c0c51a0 con 0x7fa99c06da60 2024-03-29T04:08:17.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.409+0000 7f42faffd640 1 -- 172.21.15.73:0/521424648 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f4035020 con 0x7f42fc15e880 2024-03-29T04:08:17.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.409+0000 7f42faffd640 1 -- 172.21.15.73:0/521424648 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f4031640 con 0x7f42fc15e880 2024-03-29T04:08:17.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.410+0000 7fd4cde41640 1 -- 172.21.15.73:0/2058429373 shutdown_connections 2024-03-29T04:08:17.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.410+0000 7fd4cde41640 1 --2- 172.21.15.73:0/2058429373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4c80c5020 0x7fd4c80c5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.410+0000 7fd4cde41640 1 --2- 172.21.15.73:0/2058429373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4c80cd280 0x7fd4c80b30b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.410+0000 7fd4cde41640 1 -- 172.21.15.73:0/2058429373 >> 172.21.15.73:0/2058429373 conn(0x7fd4c806b510 msgr2=0x7fd4c806b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:17.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.410+0000 7f1e619a2640 1 --2- 172.21.15.73:0/4185599126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e5c15c740 0x7f1e5c0cdea0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1e580097a0 tx=0x7f1e5802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43e0c3e623389eb5 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.418 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.409+0000 7f42faffd640 1 -- 172.21.15.73:0/521424648 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f402d040 con 0x7f42fc15e880 2024-03-29T04:08:17.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.410+0000 7f1f87fff640 1 --2- 172.21.15.73:0/3304014525 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f880c5020 0x7f1f880cc110 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c0097a0 tx=0x7f1f7c02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fd1fb30c640b90 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.410+0000 7f1f867fc640 1 -- 172.21.15.73:0/3304014525 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c0315a0 con 0x7f1f880c5020 2024-03-29T04:08:17.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.410+0000 7f1e609a0640 1 -- 172.21.15.73:0/4185599126 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e58034070 con 0x7f1e5c15c740 2024-03-29T04:08:17.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.410+0000 7f1f867fc640 1 -- 172.21.15.73:0/3304014525 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f7c037070 con 0x7f1f880c5020 2024-03-29T04:08:17.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.410+0000 7f1f867fc640 1 -- 172.21.15.73:0/3304014525 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c0315a0 con 0x7f1f880c5020 2024-03-29T04:08:17.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.410+0000 7fa99ad9d640 1 -- 172.21.15.73:0/811136942 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa99c06da60 msgr2=0x7fa99c0ad630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.410+0000 7fa99ad9d640 1 --2- 172.21.15.73:0/811136942 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa99c06da60 0x7fa99c0ad630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.410+0000 7fa99ad9d640 1 -- 172.21.15.73:0/811136942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa99c0c66d0 msgr2=0x7fa99c0adb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.410+0000 7fa99ad9d640 1 --2- 172.21.15.73:0/811136942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa99c0c66d0 0x7fa99c0adb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.410+0000 7fa99ad9d640 1 -- 172.21.15.73:0/811136942 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa99c201ac0 con 0x7fa99c15abf0 2024-03-29T04:08:17.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.410+0000 7f41c0bf4640 1 -- 172.21.15.73:0/3311710209 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41bc0b4b00 msgr2=0x7f41bc15e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.410+0000 7f41c0bf4640 1 --2- 172.21.15.73:0/3311710209 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41bc0b4b00 0x7f41bc15e570 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f41bc072f70 tx=0x7f41ac02fd10 comp rx=0 tx=0).stop 2024-03-29T04:08:17.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.410+0000 7f2d55037640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d5006da60 0x7f2d5015e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.410+0000 7f4301201640 1 -- 172.21.15.73:0/521424648 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42fc15e880 msgr2=0x7f42fc0d2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.410+0000 7f1e609a0640 1 -- 172.21.15.73:0/4185599126 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e58030610 con 0x7f1e5c15c740 2024-03-29T04:08:17.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.410+0000 7f4301201640 1 --2- 172.21.15.73:0/521424648 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42fc15e880 0x7f42fc0d2890 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f42f4009870 tx=0x7f42f402b8f0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.410+0000 7fa99ad9d640 1 --2- 172.21.15.73:0/811136942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa99c15abf0 0x7fa99c0b47b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa99000c5f0 tx=0x7fa99000cab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f2d55037640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d5006de40 0x7f2d500b5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f4301201640 1 -- 172.21.15.73:0/521424648 shutdown_connections 2024-03-29T04:08:17.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f4301201640 1 --2- 172.21.15.73:0/521424648 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42fc15e880 0x7f42fc0d2890 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f4301201640 1 --2- 172.21.15.73:0/521424648 >> v2:172.21.15.73:3300/0 conn(0x7f42fc0cee70 0x7f42fc162cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f4301201640 1 -- 172.21.15.73:0/521424648 >> 172.21.15.73:0/521424648 conn(0x7f42fc08bfc0 msgr2=0x7f42fc09d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:17.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7fd4cde41640 1 -- 172.21.15.73:0/2058429373 shutdown_connections 2024-03-29T04:08:17.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f1e609a0640 1 -- 172.21.15.73:0/4185599126 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e580309e0 con 0x7f1e5c15c740 2024-03-29T04:08:17.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7fd4cde41640 1 -- 172.21.15.73:0/2058429373 wait complete. 2024-03-29T04:08:17.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f2d4ed9d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d5006da60 0x7f2d5015e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f2d4ed9d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d5006da60 0x7f2d5015e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:53964/0 (socket says 172.21.15.73:53964) 2024-03-29T04:08:17.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f4301201640 1 -- 172.21.15.73:0/521424648 shutdown_connections 2024-03-29T04:08:17.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f4301201640 1 -- 172.21.15.73:0/521424648 wait complete. 2024-03-29T04:08:17.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f2d4e59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d5006de40 0x7f2d500b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f41c0bf4640 1 -- 172.21.15.73:0/3311710209 shutdown_connections 2024-03-29T04:08:17.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f41c0bf4640 1 --2- 172.21.15.73:0/3311710209 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41bc0b4b00 0x7f41bc15e570 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f41c0bf4640 1 --2- 172.21.15.73:0/3311710209 >> v2:172.21.15.73:3300/0 conn(0x7f41bc06e740 0x7f41bc0b45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f41c0bf4640 1 --2- 172.21.15.73:0/3311710209 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41bc1550e0 0x7f41bc15af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.425 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f41c0bf4640 1 -- 172.21.15.73:0/3311710209 >> 172.21.15.73:0/3311710209 conn(0x7f41bc0b2c40 msgr2=0x7f41bc0d08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:17.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f2d4e59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d5006de40 0x7f2d500b5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:46030/0 (socket says 172.21.15.73:46030) 2024-03-29T04:08:17.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f2d4ed9d640 1 -- 172.21.15.73:0/823610426 learned_addr learned my addr 172.21.15.73:0/823610426 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:17.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f2d55037640 1 --2- 172.21.15.73:0/823610426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d500c66d0 0x7f2d500b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.409+0000 7f2efe78d640 1 Processor -- start 2024-03-29T04:08:17.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.409+0000 7f2efe78d640 1 -- start start 2024-03-29T04:08:17.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f2efe78d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ee00039e0 0x7f2ef8205310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f2efe78d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ef80b2910 0x7f2ef80b1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f2efe78d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ef80b21d0 0x7f2ef815d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f2ef7fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ee00039e0 0x7f2ef8205310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f2ef7fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ee00039e0 0x7f2ef8205310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:53972/0 (socket says 172.21.15.73:53972) 2024-03-29T04:08:17.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f2ef7fff640 1 -- 172.21.15.73:0/2742686406 learned_addr learned my addr 172.21.15.73:0/2742686406 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:17.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f2efe78d640 1 -- 172.21.15.73:0/2742686406 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef80c5020 con 0x7f2ef80b21d0 2024-03-29T04:08:17.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f2efe78d640 1 -- 172.21.15.73:0/2742686406 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef815be70 con 0x7f2ef80b2910 2024-03-29T04:08:17.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f2efcd2a640 1 --2- 172.21.15.73:0/2742686406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ef80b21d0 0x7f2ef815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f2efe78d640 1 -- 172.21.15.73:0/2742686406 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2ef80c51a0 con 0x7f2ee00039e0 2024-03-29T04:08:17.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f2ef77fe640 1 --2- 172.21.15.73:0/2742686406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ef80b2910 0x7f2ef80b1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f2ef7fff640 1 -- 172.21.15.73:0/2742686406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ef80b2910 msgr2=0x7f2ef80b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f2ef7fff640 1 --2- 172.21.15.73:0/2742686406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ef80b2910 0x7f2ef80b1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f2ef7fff640 1 -- 172.21.15.73:0/2742686406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ef80b21d0 msgr2=0x7f2ef815d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f2ef7fff640 1 --2- 172.21.15.73:0/2742686406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ef80b21d0 0x7f2ef815d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f2ef7fff640 1 -- 172.21.15.73:0/2742686406 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ef80b01f0 con 0x7f2ee00039e0 2024-03-29T04:08:17.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f2d55037640 1 -- 172.21.15.73:0/823610426 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2d5006e2d0 con 0x7f2d5006de40 2024-03-29T04:08:17.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f2d4f59e640 1 --2- 172.21.15.73:0/823610426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d500c66d0 0x7f2d500b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f2d55037640 1 -- 172.21.15.73:0/823610426 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2d5015be70 con 0x7f2d500c66d0 2024-03-29T04:08:17.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f2d55037640 1 -- 172.21.15.73:0/823610426 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2d500c5020 con 0x7f2d5006da60 2024-03-29T04:08:17.428 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f1e63c06640 1 -- 172.21.15.73:0/4185599126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e5c15c740 msgr2=0x7f1e5c0cdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f1e63c06640 1 --2- 172.21.15.73:0/4185599126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e5c15c740 0x7f1e5c0cdea0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1e580097a0 tx=0x7f1e5802b960 comp rx=0 tx=0).stop 2024-03-29T04:08:17.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7fa98affd640 1 -- 172.21.15.73:0/811136942 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa990015070 con 0x7fa99c15abf0 2024-03-29T04:08:17.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7fa98affd640 1 -- 172.21.15.73:0/811136942 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa990011820 con 0x7fa99c15abf0 2024-03-29T04:08:17.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7fa98affd640 1 -- 172.21.15.73:0/811136942 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa990011c10 con 0x7fa99c15abf0 2024-03-29T04:08:17.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7fa9a0ac1640 1 -- 172.21.15.73:0/811136942 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa99c201da0 con 0x7fa99c15abf0 2024-03-29T04:08:17.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7fa9a0ac1640 1 -- 172.21.15.73:0/811136942 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa99c202360 con 0x7fa99c15abf0 2024-03-29T04:08:17.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.412+0000 7f1f8dc63640 1 -- 172.21.15.73:0/3304014525 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f880c5020 msgr2=0x7f1f880cc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.412+0000 7f1f8dc63640 1 --2- 172.21.15.73:0/3304014525 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f880c5020 0x7f1f880cc110 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c0097a0 tx=0x7f1f7c02b840 comp rx=0 tx=0).stop 2024-03-29T04:08:17.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.411+0000 7f41c0bf4640 1 -- 172.21.15.73:0/3311710209 shutdown_connections 2024-03-29T04:08:17.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.412+0000 7f1f8dc63640 1 -- 172.21.15.73:0/3304014525 shutdown_connections 2024-03-29T04:08:17.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.412+0000 7f1f8dc63640 1 --2- 172.21.15.73:0/3304014525 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f880c5020 0x7f1f880cc110 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.412+0000 7f1f8dc63640 1 --2- 172.21.15.73:0/3304014525 >> v2:172.21.15.73:3300/0 conn(0x7f1f880c6850 0x7f1f880cbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.412+0000 7f1f8dc63640 1 -- 172.21.15.73:0/3304014525 >> 172.21.15.73:0/3304014525 conn(0x7f1f8806b510 msgr2=0x7f1f8806b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:17.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.412+0000 7f2d4e59c640 1 -- 172.21.15.73:0/823610426 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d5006da60 msgr2=0x7f2d5015e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.412+0000 7f2d4e59c640 1 --2- 172.21.15.73:0/823610426 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d5006da60 0x7f2d5015e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.412+0000 7f2d4e59c640 1 -- 172.21.15.73:0/823610426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d500c66d0 msgr2=0x7f2d500b0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.412+0000 7f2d4e59c640 1 --2- 172.21.15.73:0/823610426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d500c66d0 0x7f2d500b0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.412+0000 7f2d4e59c640 1 -- 172.21.15.73:0/823610426 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d500afd30 con 0x7f2d5006de40 2024-03-29T04:08:17.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.412+0000 7f2ef7fff640 1 --2- 172.21.15.73:0/2742686406 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ee00039e0 0x7f2ef8205310 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0009e80 tx=0x7f2ef0004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.412+0000 7f2d4e59c640 1 --2- 172.21.15.73:0/823610426 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d5006de40 0x7f2d500b5430 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2d500cdce0 tx=0x7f2d440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.412+0000 7f41c0bf4640 1 -- 172.21.15.73:0/3311710209 wait complete. 2024-03-29T04:08:17.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.412+0000 7f2d377fe640 1 -- 172.21.15.73:0/823610426 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d44047070 con 0x7f2d5006de40 2024-03-29T04:08:17.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.412+0000 7f2d377fe640 1 -- 172.21.15.73:0/823610426 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d44042630 con 0x7f2d5006de40 2024-03-29T04:08:17.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.412+0000 7f2d55037640 1 -- 172.21.15.73:0/823610426 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d500b0010 con 0x7f2d5006de40 2024-03-29T04:08:17.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.412+0000 7fd4cde41640 1 Processor -- start 2024-03-29T04:08:17.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.414+0000 7fd4cde41640 1 -- start start 2024-03-29T04:08:17.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.416+0000 7fd4cde41640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4c80c5020 0x7fd4c81f8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.413+0000 7f2ef4ff9640 1 -- 172.21.15.73:0/2742686406 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef0065070 con 0x7f2ee00039e0 2024-03-29T04:08:17.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.413+0000 7f2efe78d640 1 -- 172.21.15.73:0/2742686406 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ef80b04d0 con 0x7f2ee00039e0 2024-03-29T04:08:17.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.413+0000 7f2efe78d640 1 -- 172.21.15.73:0/2742686406 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ef80b0a90 con 0x7f2ee00039e0 2024-03-29T04:08:17.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.414+0000 7f2ef4ff9640 1 -- 172.21.15.73:0/2742686406 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ef005b070 con 0x7f2ee00039e0 2024-03-29T04:08:17.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.414+0000 7f2ef4ff9640 1 -- 172.21.15.73:0/2742686406 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef0061850 con 0x7f2ee00039e0 2024-03-29T04:08:17.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.413+0000 7f2d55037640 1 -- 172.21.15.73:0/823610426 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d500b05d0 con 0x7f2d5006de40 2024-03-29T04:08:17.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.413+0000 7f2d377fe640 1 -- 172.21.15.73:0/823610426 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d4403b040 con 0x7f2d5006de40 2024-03-29T04:08:17.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.414+0000 7f2d55037640 1 -- 172.21.15.73:0/823610426 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d30005290 con 0x7f2d5006de40 2024-03-29T04:08:17.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.415+0000 7f2d377fe640 1 -- 172.21.15.73:0/823610426 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f2d4404a070 con 0x7f2d5006de40 2024-03-29T04:08:17.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.416+0000 7f2d377fe640 1 --2- 172.21.15.73:0/823610426 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2d3c06c600 0x7f2d3c06eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.414+0000 7f1e63c06640 1 -- 172.21.15.73:0/4185599126 shutdown_connections 2024-03-29T04:08:17.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.414+0000 7f1e63c06640 1 --2- 172.21.15.73:0/4185599126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e5c15c740 0x7f1e5c0cdea0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.414+0000 7f1e63c06640 1 -- 172.21.15.73:0/4185599126 >> 172.21.15.73:0/4185599126 conn(0x7f1e5c0b3e90 msgr2=0x7f1e5c0b42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:17.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.415+0000 7f1e63c06640 1 -- 172.21.15.73:0/4185599126 shutdown_connections 2024-03-29T04:08:17.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.415+0000 7f1e63c06640 1 -- 172.21.15.73:0/4185599126 wait complete. 2024-03-29T04:08:17.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.413+0000 7fa988ff9640 1 -- 172.21.15.73:0/811136942 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa974005290 con 0x7fa99c15abf0 2024-03-29T04:08:17.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.413+0000 7fa98affd640 1 -- 172.21.15.73:0/811136942 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fa990018070 con 0x7fa99c15abf0 2024-03-29T04:08:17.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.414+0000 7fa98affd640 1 --2- 172.21.15.73:0/811136942 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa97c06c580 0x7fa97c06ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.414+0000 7fa98affd640 1 -- 172.21.15.73:0/811136942 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa99008b480 con 0x7fa99c15abf0 2024-03-29T04:08:17.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.414+0000 7fa99a59c640 1 --2- 172.21.15.73:0/811136942 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa97c06c580 0x7fa97c06ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.415+0000 7fa99a59c640 1 --2- 172.21.15.73:0/811136942 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa97c06c580 0x7fa97c06ea40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa98c009ec0 tx=0x7fa98c031000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.413+0000 7f4301201640 1 Processor -- start 2024-03-29T04:08:17.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.413+0000 7f4301201640 1 -- start start 2024-03-29T04:08:17.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.414+0000 7f4301201640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42fc0cee70 0x7f42fc0b6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.414+0000 7f4301201640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42fc15e4a0 0x7f42fc1f3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.415+0000 7f4301201640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42fc15e880 0x7f42fc15c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.415+0000 7f4301201640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f42fc0cfe90 con 0x7f42fc15e880 2024-03-29T04:08:17.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.415+0000 7f4301201640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f42fc0cfbb0 con 0x7f42fc0cee70 2024-03-29T04:08:17.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.415+0000 7f4301201640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f42fc0d42d0 con 0x7f42fc15e4a0 2024-03-29T04:08:17.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.415+0000 7f4300a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42fc15e880 0x7f42fc15c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.415+0000 7f4300a00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42fc15e880 0x7f42fc15c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:46044/0 (socket says 172.21.15.73:46044) 2024-03-29T04:08:17.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.415+0000 7f4300a00640 1 -- 172.21.15.73:0/1901931396 learned_addr learned my addr 172.21.15.73:0/1901931396 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:17.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.415+0000 7f4300a00640 1 -- 172.21.15.73:0/1901931396 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42fc15e4a0 msgr2=0x7f42fc1f3670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-29T04:08:17.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.415+0000 7f4300a00640 1 --2- 172.21.15.73:0/1901931396 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42fc15e4a0 0x7f42fc1f3670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.415+0000 7f4300a00640 1 -- 172.21.15.73:0/1901931396 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42fc0cee70 msgr2=0x7f42fc0b6f60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-29T04:08:17.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.415+0000 7f4300a00640 1 --2- 172.21.15.73:0/1901931396 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42fc0cee70 0x7f42fc0b6f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.415+0000 7f4300a00640 1 -- 172.21.15.73:0/1901931396 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42fc0b7860 con 0x7f42fc15e880 2024-03-29T04:08:17.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.414+0000 7f41c0bf4640 1 Processor -- start 2024-03-29T04:08:17.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.414+0000 7f41c0bf4640 1 -- start start 2024-03-29T04:08:17.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.415+0000 7f41c0bf4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41bc06e740 0x7f41bc151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.413+0000 7f1f8dc63640 1 -- 172.21.15.73:0/3304014525 shutdown_connections 2024-03-29T04:08:17.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.413+0000 7f1f8dc63640 1 -- 172.21.15.73:0/3304014525 wait complete. 2024-03-29T04:08:17.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.414+0000 7f1f8dc63640 1 Processor -- start 2024-03-29T04:08:17.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.415+0000 7f1f8dc63640 1 -- start start 2024-03-29T04:08:17.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.416+0000 7f1f8dc63640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f880c5020 0x7f1f880c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.416+0000 7f2d377fe640 1 -- 172.21.15.73:0/823610426 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2d440ad440 con 0x7f2d5006de40 2024-03-29T04:08:17.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.416+0000 7f4300a00640 1 --2- 172.21.15.73:0/1901931396 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42fc15e880 0x7f42fc15c5b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f42f402b930 tx=0x7f42f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.416+0000 7fd4cde41640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4c80cd280 0x7fd4c80aee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.416+0000 7fd4c77fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4c80c5020 0x7fd4c81f8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.416+0000 7fd4c77fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4c80c5020 0x7fd4c81f8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:34686/0 (socket says 172.21.15.73:34686) 2024-03-29T04:08:17.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.416+0000 7fd4c6ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4c80cd280 0x7fd4c80aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.416+0000 7f41ba59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41bc06e740 0x7f41bc151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.416+0000 7f41c0bf4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41bc0b4b00 0x7f41bc0b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.416+0000 7f41c0bf4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41bc1550e0 0x7f41bc159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.416+0000 7f41c0bf4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f41bc06f730 con 0x7f41bc06e740 2024-03-29T04:08:17.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.416+0000 7f41c0bf4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f41bc06eb80 con 0x7f41bc1550e0 2024-03-29T04:08:17.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.416+0000 7fd4c6ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4c80cd280 0x7fd4c80aee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:46070/0 (socket says 172.21.15.73:46070) 2024-03-29T04:08:17.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.416+0000 7f41c0bf4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f41bc067330 con 0x7f41bc0b4b00 2024-03-29T04:08:17.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.416+0000 7fd4c77fe640 1 -- 172.21.15.73:0/2152921746 learned_addr learned my addr 172.21.15.73:0/2152921746 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:17.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.416+0000 7f1f8dc63640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f880c6850 0x7f1f881565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.416+0000 7fd4cde41640 1 --2- 172.21.15.73:0/2152921746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4c81605e0 0x7fd4c80af380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.416+0000 7fd4cde41640 1 -- 172.21.15.73:0/2152921746 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c80c5990 con 0x7fd4c80cd280 2024-03-29T04:08:17.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.416+0000 7fd4cde41640 1 -- 172.21.15.73:0/2152921746 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c80ad9d0 con 0x7fd4c80c5020 2024-03-29T04:08:17.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.416+0000 7fd4cde41640 1 -- 172.21.15.73:0/2152921746 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd4c80c5b10 con 0x7fd4c81605e0 2024-03-29T04:08:17.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.416+0000 7f2d4ed9d640 1 --2- 172.21.15.73:0/823610426 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2d3c06c600 0x7f2d3c06eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.416+0000 7f1f877fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f880c5020 0x7f1f880c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.442 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.416+0000 7f1f86ffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f880c6850 0x7f1f881565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.416+0000 7f41b9d9b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41bc0b4b00 0x7f41bc0b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.416+0000 7f41b9d9b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41bc0b4b00 0x7f41bc0b40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:53976/0 (socket says 172.21.15.73:53976) 2024-03-29T04:08:17.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.416+0000 7f41b9d9b640 1 -- 172.21.15.73:0/3509700710 learned_addr learned my addr 172.21.15.73:0/3509700710 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:17.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.416+0000 7f41bad9d640 1 --2- 172.21.15.73:0/3509700710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41bc1550e0 0x7f41bc159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.443 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.416+0000 7f2ef4ff9640 1 -- 172.21.15.73:0/2742686406 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f2ef0068070 con 0x7f2ee00039e0 2024-03-29T04:08:17.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.416+0000 7f1f877fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f880c5020 0x7f1f880c9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:34692/0 (socket says 172.21.15.73:34692) 2024-03-29T04:08:17.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.416+0000 7f1f8dc63640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f8815fc20 0x7f1f88156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.416+0000 7f1f877fe640 1 -- 172.21.15.73:0/260318306 learned_addr learned my addr 172.21.15.73:0/260318306 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:17.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.416+0000 7f1f86ffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f880c6850 0x7f1f881565b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:53982/0 (socket says 172.21.15.73:53982) 2024-03-29T04:08:17.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.416+0000 7f1f8dc63640 1 -- 172.21.15.73:0/260318306 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1f88160260 con 0x7f1f8815fc20 2024-03-29T04:08:17.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.416+0000 7f1f8dc63640 1 -- 172.21.15.73:0/260318306 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f1f881600e0 con 0x7f1f880c5020 2024-03-29T04:08:17.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.416+0000 7f1f8dc63640 1 -- 172.21.15.73:0/260318306 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f1f880b4b20 con 0x7f1f880c6850 2024-03-29T04:08:17.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.417+0000 7f1f87fff640 1 --2- 172.21.15.73:0/260318306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f8815fc20 0x7f1f88156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.417+0000 7f41bad9d640 1 -- 172.21.15.73:0/3509700710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41bc0b4b00 msgr2=0x7f41bc0b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.417+0000 7f41bad9d640 1 --2- 172.21.15.73:0/3509700710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41bc0b4b00 0x7f41bc0b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.417+0000 7f41bad9d640 1 -- 172.21.15.73:0/3509700710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41bc06e740 msgr2=0x7f41bc151d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.417+0000 7fd4c6ffd640 1 -- 172.21.15.73:0/2152921746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4c81605e0 msgr2=0x7fd4c80af380 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-29T04:08:17.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.417+0000 7fd4c6ffd640 1 --2- 172.21.15.73:0/2152921746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4c81605e0 0x7fd4c80af380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.417+0000 7fd4c6ffd640 1 -- 172.21.15.73:0/2152921746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4c80c5020 msgr2=0x7fd4c81f8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.417+0000 7fd4c6ffd640 1 --2- 172.21.15.73:0/2152921746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4c80c5020 0x7fd4c81f8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.417+0000 7fd4c6ffd640 1 -- 172.21.15.73:0/2152921746 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4c808e040 con 0x7fd4c80cd280 2024-03-29T04:08:17.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.417+0000 7f2ef4ff9640 1 --2- 172.21.15.73:0/2742686406 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2ee406c600 0x7f2ee406eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.417+0000 7f2ef4ff9640 1 -- 172.21.15.73:0/2742686406 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2ef00cfe90 con 0x7f2ee00039e0 2024-03-29T04:08:17.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.417+0000 7f2d4ed9d640 1 --2- 172.21.15.73:0/823610426 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2d3c06c600 0x7f2d3c06eac0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2d4000afd0 tx=0x7f2d40008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.417+0000 7f1f877fe640 1 -- 172.21.15.73:0/260318306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f880c6850 msgr2=0x7f1f881565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.417+0000 7fd4c6ffd640 1 --2- 172.21.15.73:0/2152921746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4c80cd280 0x7fd4c80aee40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc033000 tx=0x7fd4bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.417+0000 7f1f877fe640 1 --2- 172.21.15.73:0/260318306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f880c6850 0x7f1f881565b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.417+0000 7f1f877fe640 1 -- 172.21.15.73:0/260318306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f8815fc20 msgr2=0x7f1f88156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.417+0000 7f1e63c06640 1 Processor -- start 2024-03-29T04:08:17.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.417+0000 7f1f877fe640 1 --2- 172.21.15.73:0/260318306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f8815fc20 0x7f1f88156af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.417+0000 7f2ef77fe640 1 --2- 172.21.15.73:0/2742686406 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2ee406c600 0x7f2ee406eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.417+0000 7f1f877fe640 1 -- 172.21.15.73:0/260318306 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f880c8420 con 0x7f1f880c5020 2024-03-29T04:08:17.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.417+0000 7f41bad9d640 1 --2- 172.21.15.73:0/3509700710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41bc06e740 0x7f41bc151d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.417+0000 7f41bad9d640 1 -- 172.21.15.73:0/3509700710 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41bc150fd0 con 0x7f41bc1550e0 2024-03-29T04:08:17.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.417+0000 7f41ba59c640 1 --2- 172.21.15.73:0/3509700710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41bc06e740 0x7f41bc151d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:08:17.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.417+0000 7f1e63c06640 1 -- start start 2024-03-29T04:08:17.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.417+0000 7f1f87fff640 1 --2- 172.21.15.73:0/260318306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f8815fc20 0x7f1f88156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:08:17.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.417+0000 7f2efe78d640 1 -- 172.21.15.73:0/2742686406 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ed8005290 con 0x7f2ee00039e0 2024-03-29T04:08:17.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.417+0000 7f1f877fe640 1 --2- 172.21.15.73:0/260318306 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f880c5020 0x7f1f880c9c00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1f8000cb40 tx=0x7f1f8000a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.418+0000 7f41bad9d640 1 --2- 172.21.15.73:0/3509700710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41bc1550e0 0x7f41bc159370 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f41ac004000 tx=0x7f41ac0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.418+0000 7f1e63c06640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e5c0cceb0 0x7f1e5c0ca390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.418+0000 7f1e63c06640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e5c0d0b30 0x7f1e5c0c71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.418+0000 7f2ef77fe640 1 --2- 172.21.15.73:0/2742686406 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2ee406c600 0x7f2ee406eac0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2eec001eb0 tx=0x7f2eec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.418+0000 7f1e63c06640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e5c15c740 0x7f1e5c153750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.418+0000 7f1e63c06640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1e5c09b4e0 con 0x7f1e5c0cceb0 2024-03-29T04:08:17.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.418+0000 7f1e63c06640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f1e5c09b850 con 0x7f1e5c15c740 2024-03-29T04:08:17.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.418+0000 7f1e63c06640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f1e5c09bce0 con 0x7f1e5c0d0b30 2024-03-29T04:08:17.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.418+0000 7f1e619a2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e5c0cceb0 0x7f1e5c0ca390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.418+0000 7f1f6ffff640 1 -- 172.21.15.73:0/260318306 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f80017070 con 0x7f1f880c5020 2024-03-29T04:08:17.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.418+0000 7f1f6ffff640 1 -- 172.21.15.73:0/260318306 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f8000aca0 con 0x7f1f880c5020 2024-03-29T04:08:17.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.418+0000 7f41aaffd640 1 -- 172.21.15.73:0/3509700710 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41ac0308c0 con 0x7f41bc1550e0 2024-03-29T04:08:17.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.418+0000 7f1f8dc63640 1 -- 172.21.15.73:0/260318306 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f880c7bc0 con 0x7f1f880c5020 2024-03-29T04:08:17.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.418+0000 7f1e621a3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e5c15c740 0x7f1e5c153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.418+0000 7f1e611a1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e5c0d0b30 0x7f1e5c0c71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.418+0000 7f41aaffd640 1 -- 172.21.15.73:0/3509700710 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41ac030a60 con 0x7f41bc1550e0 2024-03-29T04:08:17.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.418+0000 7f1e611a1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e5c0d0b30 0x7f1e5c0c71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:54006/0 (socket says 172.21.15.73:54006) 2024-03-29T04:08:17.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.418+0000 7f1e611a1640 1 -- 172.21.15.73:0/4061411760 learned_addr learned my addr 172.21.15.73:0/4061411760 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:17.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.418+0000 7f41c0bf4640 1 -- 172.21.15.73:0/3509700710 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41bc1512b0 con 0x7f41bc1550e0 2024-03-29T04:08:17.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.418+0000 7f41c0bf4640 1 -- 172.21.15.73:0/3509700710 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41bc151870 con 0x7f41bc1550e0 2024-03-29T04:08:17.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.418+0000 7fa98affd640 1 -- 172.21.15.73:0/811136942 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fa990059500 con 0x7fa99c15abf0 2024-03-29T04:08:17.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.418+0000 7f1f8dc63640 1 -- 172.21.15.73:0/260318306 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f880c7e60 con 0x7f1f880c5020 2024-03-29T04:08:17.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.419+0000 7f41aaffd640 1 -- 172.21.15.73:0/3509700710 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41ac030e30 con 0x7f41bc1550e0 2024-03-29T04:08:17.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.419+0000 7f1f6ffff640 1 -- 172.21.15.73:0/260318306 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f80012600 con 0x7f1f880c5020 2024-03-29T04:08:17.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.419+0000 7f1e611a1640 1 -- 172.21.15.73:0/4061411760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e5c15c740 msgr2=0x7f1e5c153750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.419+0000 7f1e611a1640 1 --2- 172.21.15.73:0/4061411760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e5c15c740 0x7f1e5c153750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.419+0000 7f1e611a1640 1 -- 172.21.15.73:0/4061411760 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e5c0cceb0 msgr2=0x7f1e5c0ca390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.419+0000 7f1e611a1640 1 --2- 172.21.15.73:0/4061411760 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e5c0cceb0 0x7f1e5c0ca390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.419+0000 7f1e611a1640 1 -- 172.21.15.73:0/4061411760 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e5c153c90 con 0x7f1e5c0d0b30 2024-03-29T04:08:17.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.419+0000 7f1e611a1640 1 --2- 172.21.15.73:0/4061411760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e5c0d0b30 0x7f1e5c0c71f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00c430 tx=0x7f1e4c00c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.420+0000 7f1f8dc63640 1 -- 172.21.15.73:0/260318306 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f68005290 con 0x7f1f880c5020 2024-03-29T04:08:17.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.420+0000 7f41c0bf4640 1 -- 172.21.15.73:0/3509700710 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41bc1527c0 con 0x7f41bc1550e0 2024-03-29T04:08:17.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.420+0000 7f41aaffd640 1 -- 172.21.15.73:0/3509700710 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f41ac036070 con 0x7f41bc1550e0 2024-03-29T04:08:17.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.420+0000 7f1f6ffff640 1 -- 172.21.15.73:0/260318306 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f1f8001a070 con 0x7f1f880c5020 2024-03-29T04:08:17.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.421+0000 7f1f6ffff640 1 --2- 172.21.15.73:0/260318306 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f1f7406c600 0x7f1f7406eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.421+0000 7f41aaffd640 1 --2- 172.21.15.73:0/3509700710 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f419c06c580 0x7f419c06ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.421+0000 7f1f6ffff640 1 -- 172.21.15.73:0/260318306 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1f8008b3c0 con 0x7f1f880c5020 2024-03-29T04:08:17.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.421+0000 7f41aaffd640 1 -- 172.21.15.73:0/3509700710 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f41ac0ad590 con 0x7f41bc1550e0 2024-03-29T04:08:17.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.422+0000 7f41ba59c640 1 --2- 172.21.15.73:0/3509700710 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f419c06c580 0x7f419c06ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.422+0000 7f1f86ffd640 1 --2- 172.21.15.73:0/260318306 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f1f7406c600 0x7f1f7406eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.459 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.422+0000 7f1f86ffd640 1 --2- 172.21.15.73:0/260318306 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f1f7406c600 0x7f1f7406eac0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1f8815b660 tx=0x7f1f78009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.422+0000 7f42f8ff9640 1 -- 172.21.15.73:0/1901931396 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f4040070 con 0x7f42fc15e880 2024-03-29T04:08:17.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.422+0000 7f2d377fe640 1 -- 172.21.15.73:0/823610426 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f2d4407b440 con 0x7f2d5006de40 2024-03-29T04:08:17.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.422+0000 7f41ba59c640 1 --2- 172.21.15.73:0/3509700710 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f419c06c580 0x7f419c06ea40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f41b0009a20 tx=0x7f41b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.422+0000 7fd4affff640 1 -- 172.21.15.73:0/2152921746 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc035050 con 0x7fd4c80cd280 2024-03-29T04:08:17.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.422+0000 7fd4cde41640 1 -- 172.21.15.73:0/2152921746 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4c809dbc0 con 0x7fd4c80cd280 2024-03-29T04:08:17.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.422+0000 7fd4affff640 1 -- 172.21.15.73:0/2152921746 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4bc003820 con 0x7fd4c80cd280 2024-03-29T04:08:17.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.422+0000 7f4301201640 1 -- 172.21.15.73:0/1901931396 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42fc0b7b40 con 0x7f42fc15e880 2024-03-29T04:08:17.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.422+0000 7f4301201640 1 -- 172.21.15.73:0/1901931396 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42fc15f0b0 con 0x7f42fc15e880 2024-03-29T04:08:17.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.422+0000 7f42f8ff9640 1 -- 172.21.15.73:0/1901931396 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f4039b70 con 0x7f42fc15e880 2024-03-29T04:08:17.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.423+0000 7f1e527fc640 1 -- 172.21.15.73:0/4061411760 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c017070 con 0x7f1e5c0d0b30 2024-03-29T04:08:17.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.423+0000 7f1e527fc640 1 -- 172.21.15.73:0/4061411760 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e4c0052d0 con 0x7f1e5c0d0b30 2024-03-29T04:08:17.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.423+0000 7f1e63c06640 1 -- 172.21.15.73:0/4061411760 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e5c0c7940 con 0x7f1e5c0d0b30 2024-03-29T04:08:17.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.422+0000 7f42f8ff9640 1 -- 172.21.15.73:0/1901931396 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f4035040 con 0x7f42fc15e880 2024-03-29T04:08:17.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.423+0000 7f1e527fc640 1 -- 172.21.15.73:0/4061411760 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c011890 con 0x7f1e5c0d0b30 2024-03-29T04:08:17.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.423+0000 7f1e63c06640 1 -- 172.21.15.73:0/4061411760 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e5c0c7f00 con 0x7f1e5c0d0b30 2024-03-29T04:08:17.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.424+0000 7f1e63c06640 1 -- 172.21.15.73:0/4061411760 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e5c068d50 con 0x7f1e5c0d0b30 2024-03-29T04:08:17.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.425+0000 7f42f8ff9640 1 -- 172.21.15.73:0/1901931396 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f42f404b060 con 0x7f42fc15e880 2024-03-29T04:08:17.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.423+0000 7f2ef4ff9640 1 -- 172.21.15.73:0/2742686406 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f2ef0008030 con 0x7f2ee00039e0 2024-03-29T04:08:17.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.425+0000 7fd4affff640 1 -- 172.21.15.73:0/2152921746 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc02d040 con 0x7fd4c80cd280 2024-03-29T04:08:17.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.425+0000 7fd4cde41640 1 -- 172.21.15.73:0/2152921746 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4c808e300 con 0x7fd4c80cd280 2024-03-29T04:08:17.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.425+0000 7f1e527fc640 1 -- 172.21.15.73:0/4061411760 <== mon.2 v2:172.21.15.142:3301/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f1e4c01a070 con 0x7f1e5c0d0b30 2024-03-29T04:08:17.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.425+0000 7f1e527fc640 1 --2- 172.21.15.73:0/4061411760 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f1e4006c530 0x7f1e4006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.426+0000 7f1e527fc640 1 -- 172.21.15.73:0/4061411760 <== mon.2 v2:172.21.15.142:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1e4c08a950 con 0x7f1e5c0d0b30 2024-03-29T04:08:17.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.426+0000 7f1e619a2640 1 --2- 172.21.15.73:0/4061411760 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f1e4006c530 0x7f1e4006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.426+0000 7f41aaffd640 1 -- 172.21.15.73:0/3509700710 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f41ac07bd20 con 0x7f41bc1550e0 2024-03-29T04:08:17.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.426+0000 7f42f8ff9640 1 --2- 172.21.15.73:0/1901931396 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f42dc06c530 0x7f42dc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.427+0000 7f42fbfff640 1 --2- 172.21.15.73:0/1901931396 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f42dc06c530 0x7f42dc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.427+0000 7f4301201640 1 -- 172.21.15.73:0/1901931396 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42e0005290 con 0x7f42fc15e880 2024-03-29T04:08:17.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.427+0000 7f1e619a2640 1 --2- 172.21.15.73:0/4061411760 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f1e4006c530 0x7f1e4006e9f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1e58036000 tx=0x7f1e5803b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.427+0000 7f42fbfff640 1 --2- 172.21.15.73:0/1901931396 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f42dc06c530 0x7f42dc06e9f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f42fc0cac20 tx=0x7f42ec007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.427+0000 7f42f8ff9640 1 -- 172.21.15.73:0/1901931396 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f42f40ad010 con 0x7f42fc15e880 2024-03-29T04:08:17.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.427+0000 7fd4cde41640 1 -- 172.21.15.73:0/2152921746 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4c8068640 con 0x7fd4c80cd280 2024-03-29T04:08:17.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.428+0000 7fd4affff640 1 -- 172.21.15.73:0/2152921746 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fd4bc038020 con 0x7fd4c80cd280 2024-03-29T04:08:17.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.428+0000 7fd4affff640 1 --2- 172.21.15.73:0/2152921746 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd4b406c580 0x7fd4b406ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:17.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.428+0000 7fd4affff640 1 -- 172.21.15.73:0/2152921746 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd4bc0ad3c0 con 0x7fd4c80cd280 2024-03-29T04:08:17.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.428+0000 7fd4c77fe640 1 --2- 172.21.15.73:0/2152921746 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd4b406c580 0x7fd4b406ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:17.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.429+0000 7fd4c77fe640 1 --2- 172.21.15.73:0/2152921746 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd4b406c580 0x7fd4b406ea40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8000f60 tx=0x7fd4b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:17.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.430+0000 7f1f6ffff640 1 -- 172.21.15.73:0/260318306 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f1f80059400 con 0x7f1f880c5020 2024-03-29T04:08:17.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.430+0000 7f1e527fc640 1 -- 172.21.15.73:0/4061411760 <== mon.2 v2:172.21.15.142:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f1e4c058910 con 0x7f1e5c0d0b30 2024-03-29T04:08:17.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.437+0000 7f42f8ff9640 1 -- 172.21.15.73:0/1901931396 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f42f407b590 con 0x7f42fc15e880 2024-03-29T04:08:17.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.446+0000 7fd4affff640 1 -- 172.21.15.73:0/2152921746 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fd4bc07ba70 con 0x7fd4c80cd280 2024-03-29T04:08:17.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.829+0000 7f2efe78d640 1 -- 172.21.15.73:0/2742686406 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f2ed8005580 con 0x7f2ee00039e0 2024-03-29T04:08:17.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.829+0000 7f2ef4ff9640 1 -- 172.21.15.73:0/2742686406 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2ef009ded0 con 0x7f2ee00039e0 2024-03-29T04:08:17.809 INFO:teuthology.orchestra.run.smithi073.stdout:55834574854 2024-03-29T04:08:17.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.831+0000 7fa988ff9640 1 -- 172.21.15.73:0/811136942 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fa974005580 con 0x7fa99c15abf0 2024-03-29T04:08:17.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.831+0000 7fa98affd640 1 -- 172.21.15.73:0/811136942 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa99005d800 con 0x7fa99c15abf0 2024-03-29T04:08:17.811 INFO:teuthology.orchestra.run.smithi073.stdout:55834574855 2024-03-29T04:08:17.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.832+0000 7f2efe78d640 1 -- 172.21.15.73:0/2742686406 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2ee406c600 msgr2=0x7f2ee406eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.833+0000 7f2efe78d640 1 --2- 172.21.15.73:0/2742686406 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2ee406c600 0x7f2ee406eac0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2eec001eb0 tx=0x7f2eec009040 comp rx=0 tx=0).stop 2024-03-29T04:08:17.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.833+0000 7f2efe78d640 1 -- 172.21.15.73:0/2742686406 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ee00039e0 msgr2=0x7f2ef8205310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.833+0000 7f2efe78d640 1 --2- 172.21.15.73:0/2742686406 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ee00039e0 0x7f2ef8205310 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0009e80 tx=0x7f2ef0004a40 comp rx=0 tx=0).stop 2024-03-29T04:08:17.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.833+0000 7f2efe78d640 1 -- 172.21.15.73:0/2742686406 shutdown_connections 2024-03-29T04:08:17.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.833+0000 7f2efe78d640 1 --2- 172.21.15.73:0/2742686406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ef80b21d0 0x7f2ef815d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.833+0000 7f2efe78d640 1 --2- 172.21.15.73:0/2742686406 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2ee406c600 0x7f2ee406eac0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.833+0000 7f2efe78d640 1 --2- 172.21.15.73:0/2742686406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ef80b2910 0x7f2ef80b1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.833+0000 7f2efe78d640 1 --2- 172.21.15.73:0/2742686406 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ee00039e0 0x7f2ef8205310 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.833+0000 7f2efe78d640 1 -- 172.21.15.73:0/2742686406 >> 172.21.15.73:0/2742686406 conn(0x7f2ef8072ba0 msgr2=0x7f2ef8160d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:17.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.834+0000 7f2efe78d640 1 -- 172.21.15.73:0/2742686406 shutdown_connections 2024-03-29T04:08:17.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.834+0000 7f2efe78d640 1 -- 172.21.15.73:0/2742686406 wait complete. 2024-03-29T04:08:17.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.834+0000 7fa9a0ac1640 1 -- 172.21.15.73:0/811136942 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa97c06c580 msgr2=0x7fa97c06ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.834+0000 7fa9a0ac1640 1 --2- 172.21.15.73:0/811136942 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa97c06c580 0x7fa97c06ea40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa98c009ec0 tx=0x7fa98c031000 comp rx=0 tx=0).stop 2024-03-29T04:08:17.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.834+0000 7fa9a0ac1640 1 -- 172.21.15.73:0/811136942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa99c15abf0 msgr2=0x7fa99c0b47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.834+0000 7fa9a0ac1640 1 --2- 172.21.15.73:0/811136942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa99c15abf0 0x7fa99c0b47b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa99000c5f0 tx=0x7fa99000cab0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.834+0000 7fa9a0ac1640 1 -- 172.21.15.73:0/811136942 shutdown_connections 2024-03-29T04:08:17.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.834+0000 7fa9a0ac1640 1 --2- 172.21.15.73:0/811136942 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa97c06c580 0x7fa97c06ea40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.834+0000 7fa9a0ac1640 1 --2- 172.21.15.73:0/811136942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa99c15abf0 0x7fa99c0b47b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.834+0000 7fa9a0ac1640 1 --2- 172.21.15.73:0/811136942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa99c0c66d0 0x7fa99c0adb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.834+0000 7fa9a0ac1640 1 --2- 172.21.15.73:0/811136942 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa99c06da60 0x7fa99c0ad630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.834+0000 7fa9a0ac1640 1 -- 172.21.15.73:0/811136942 >> 172.21.15.73:0/811136942 conn(0x7fa99c072ba0 msgr2=0x7fa99c0b5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:17.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.835+0000 7fa9a0ac1640 1 -- 172.21.15.73:0/811136942 shutdown_connections 2024-03-29T04:08:17.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.835+0000 7fa9a0ac1640 1 -- 172.21.15.73:0/811136942 wait complete. 2024-03-29T04:08:17.830 INFO:teuthology.orchestra.run.smithi073.stdout:55834574855 2024-03-29T04:08:17.832 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2024-03-29T04:08:17.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.850+0000 7f2d55037640 1 -- 172.21.15.73:0/823610426 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f2d30005580 con 0x7f2d5006de40 2024-03-29T04:08:17.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.850+0000 7f2d377fe640 1 -- 172.21.15.73:0/823610426 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2d4407f740 con 0x7f2d5006de40 2024-03-29T04:08:17.832 DEBUG:teuthology.parallel:result is None 2024-03-29T04:08:17.833 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2024-03-29T04:08:17.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.853+0000 7f41c0bf4640 1 -- 172.21.15.73:0/3509700710 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f41bc0b5840 con 0x7f41bc1550e0 2024-03-29T04:08:17.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.853+0000 7f4301201640 1 -- 172.21.15.73:0/1901931396 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f42e0005580 con 0x7f42fc15e880 2024-03-29T04:08:17.833 DEBUG:teuthology.parallel:result is None 2024-03-29T04:08:17.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.853+0000 7f41aaffd640 1 -- 172.21.15.73:0/3509700710 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f41bc0b5840 con 0x7f41bc1550e0 2024-03-29T04:08:17.834 INFO:teuthology.orchestra.run.smithi073.stdout:55834574855 2024-03-29T04:08:17.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.853+0000 7f1e63c06640 1 -- 172.21.15.73:0/4061411760 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f1e5c0b4af0 con 0x7f1e5c0d0b30 2024-03-29T04:08:17.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.853+0000 7f42f8ff9640 1 -- 172.21.15.73:0/1901931396 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f42f407ae90 con 0x7f42fc15e880 2024-03-29T04:08:17.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.853+0000 7f2d55037640 1 -- 172.21.15.73:0/823610426 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2d3c06c600 msgr2=0x7f2d3c06eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.853+0000 7f2d55037640 1 --2- 172.21.15.73:0/823610426 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2d3c06c600 0x7f2d3c06eac0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2d4000afd0 tx=0x7f2d40008040 comp rx=0 tx=0).stop 2024-03-29T04:08:17.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.853+0000 7f2d55037640 1 -- 172.21.15.73:0/823610426 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d5006de40 msgr2=0x7f2d500b5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.853+0000 7f2d55037640 1 --2- 172.21.15.73:0/823610426 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d5006de40 0x7f2d500b5430 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2d500cdce0 tx=0x7f2d440046c0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.836 INFO:teuthology.orchestra.run.smithi073.stdout:55834574853 2024-03-29T04:08:17.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.853+0000 7f2d55037640 1 -- 172.21.15.73:0/823610426 shutdown_connections 2024-03-29T04:08:17.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.854+0000 7f2d55037640 1 --2- 172.21.15.73:0/823610426 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2d3c06c600 0x7f2d3c06eac0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.854+0000 7f2d55037640 1 --2- 172.21.15.73:0/823610426 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d500c66d0 0x7f2d500b0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.854+0000 7f2d55037640 1 --2- 172.21.15.73:0/823610426 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d5006de40 0x7f2d500b5430 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.854+0000 7f2d55037640 1 --2- 172.21.15.73:0/823610426 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2d5006da60 0x7f2d5015e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.854+0000 7f2d55037640 1 -- 172.21.15.73:0/823610426 >> 172.21.15.73:0/823610426 conn(0x7f2d50072ba0 msgr2=0x7f2d50159cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:17.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.854+0000 7f1e527fc640 1 -- 172.21.15.73:0/4061411760 <== mon.2 v2:172.21.15.142:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1e4c05cc10 con 0x7f1e5c0d0b30 2024-03-29T04:08:17.837 INFO:teuthology.orchestra.run.smithi073.stdout:55834574855 2024-03-29T04:08:17.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.854+0000 7f2d55037640 1 -- 172.21.15.73:0/823610426 shutdown_connections 2024-03-29T04:08:17.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.854+0000 7f2d55037640 1 -- 172.21.15.73:0/823610426 wait complete. 2024-03-29T04:08:17.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.855+0000 7f41c0bf4640 1 -- 172.21.15.73:0/3509700710 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f419c06c580 msgr2=0x7f419c06ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.855+0000 7f41c0bf4640 1 --2- 172.21.15.73:0/3509700710 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f419c06c580 0x7f419c06ea40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f41b0009a20 tx=0x7f41b0008040 comp rx=0 tx=0).stop 2024-03-29T04:08:17.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.855+0000 7f41c0bf4640 1 -- 172.21.15.73:0/3509700710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41bc1550e0 msgr2=0x7f41bc159370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.855+0000 7f41c0bf4640 1 --2- 172.21.15.73:0/3509700710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41bc1550e0 0x7f41bc159370 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f41ac004000 tx=0x7f41ac0046c0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.856+0000 7f41c0bf4640 1 -- 172.21.15.73:0/3509700710 shutdown_connections 2024-03-29T04:08:17.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.856+0000 7f41c0bf4640 1 --2- 172.21.15.73:0/3509700710 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f419c06c580 0x7f419c06ea40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.856+0000 7f41c0bf4640 1 --2- 172.21.15.73:0/3509700710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41bc1550e0 0x7f41bc159370 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.856+0000 7f41c0bf4640 1 --2- 172.21.15.73:0/3509700710 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41bc0b4b00 0x7f41bc0b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.856+0000 7f41c0bf4640 1 --2- 172.21.15.73:0/3509700710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41bc06e740 0x7f41bc151d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.856+0000 7f41c0bf4640 1 -- 172.21.15.73:0/3509700710 >> 172.21.15.73:0/3509700710 conn(0x7f41bc0b2c40 msgr2=0x7f41bc15d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:17.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.856+0000 7f41c0bf4640 1 -- 172.21.15.73:0/3509700710 shutdown_connections 2024-03-29T04:08:17.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.856+0000 7f41c0bf4640 1 -- 172.21.15.73:0/3509700710 wait complete. 2024-03-29T04:08:17.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.856+0000 7f4301201640 1 -- 172.21.15.73:0/1901931396 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f42dc06c530 msgr2=0x7f42dc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.856+0000 7f4301201640 1 --2- 172.21.15.73:0/1901931396 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f42dc06c530 0x7f42dc06e9f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f42fc0cac20 tx=0x7f42ec007d30 comp rx=0 tx=0).stop 2024-03-29T04:08:17.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.856+0000 7f4301201640 1 -- 172.21.15.73:0/1901931396 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42fc15e880 msgr2=0x7f42fc15c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.856+0000 7f4301201640 1 --2- 172.21.15.73:0/1901931396 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42fc15e880 0x7f42fc15c5b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f42f402b930 tx=0x7f42f40046c0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.856+0000 7f4301201640 1 -- 172.21.15.73:0/1901931396 shutdown_connections 2024-03-29T04:08:17.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.856+0000 7f4301201640 1 --2- 172.21.15.73:0/1901931396 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42fc15e880 0x7f42fc15c5b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.856+0000 7f4301201640 1 --2- 172.21.15.73:0/1901931396 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42fc15e4a0 0x7f42fc1f3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.856+0000 7f4301201640 1 --2- 172.21.15.73:0/1901931396 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f42dc06c530 0x7f42dc06e9f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.856+0000 7f4301201640 1 --2- 172.21.15.73:0/1901931396 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42fc0cee70 0x7f42fc0b6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.856+0000 7f4301201640 1 -- 172.21.15.73:0/1901931396 >> 172.21.15.73:0/1901931396 conn(0x7f42fc08bfc0 msgr2=0x7f42fc0d1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:17.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.857+0000 7f4301201640 1 -- 172.21.15.73:0/1901931396 shutdown_connections 2024-03-29T04:08:17.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.857+0000 7f4301201640 1 -- 172.21.15.73:0/1901931396 wait complete. 2024-03-29T04:08:17.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.857+0000 7f1e63c06640 1 -- 172.21.15.73:0/4061411760 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f1e4006c530 msgr2=0x7f1e4006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.857+0000 7f1e63c06640 1 --2- 172.21.15.73:0/4061411760 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f1e4006c530 0x7f1e4006e9f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1e58036000 tx=0x7f1e5803b040 comp rx=0 tx=0).stop 2024-03-29T04:08:17.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.857+0000 7f1e63c06640 1 -- 172.21.15.73:0/4061411760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e5c0d0b30 msgr2=0x7f1e5c0c71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.857+0000 7f1e63c06640 1 --2- 172.21.15.73:0/4061411760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e5c0d0b30 0x7f1e5c0c71f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00c430 tx=0x7f1e4c00c8f0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.857+0000 7f1e63c06640 1 -- 172.21.15.73:0/4061411760 shutdown_connections 2024-03-29T04:08:17.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.857+0000 7f1e63c06640 1 --2- 172.21.15.73:0/4061411760 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f1e4006c530 0x7f1e4006e9f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.857+0000 7f1e63c06640 1 --2- 172.21.15.73:0/4061411760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1e5c15c740 0x7f1e5c153750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.857+0000 7f1e63c06640 1 --2- 172.21.15.73:0/4061411760 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1e5c0d0b30 0x7f1e5c0c71f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.857+0000 7f1e63c06640 1 --2- 172.21.15.73:0/4061411760 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e5c0cceb0 0x7f1e5c0ca390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.857+0000 7f1e63c06640 1 -- 172.21.15.73:0/4061411760 >> 172.21.15.73:0/4061411760 conn(0x7f1e5c0b3e90 msgr2=0x7f1e5c0b1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:17.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.857+0000 7f1e63c06640 1 -- 172.21.15.73:0/4061411760 shutdown_connections 2024-03-29T04:08:17.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.857+0000 7f1e63c06640 1 -- 172.21.15.73:0/4061411760 wait complete. 2024-03-29T04:08:17.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.861+0000 7f1f8dc63640 1 -- 172.21.15.73:0/260318306 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f1f68005580 con 0x7f1f880c5020 2024-03-29T04:08:17.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.861+0000 7f1f6ffff640 1 -- 172.21.15.73:0/260318306 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1f8005d700 con 0x7f1f880c5020 2024-03-29T04:08:17.843 INFO:teuthology.orchestra.run.smithi073.stdout:55834574854 2024-03-29T04:08:17.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.861+0000 7fd4cde41640 1 -- 172.21.15.73:0/2152921746 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fd4c806f1d0 con 0x7fd4c80cd280 2024-03-29T04:08:17.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.862+0000 7fd4affff640 1 -- 172.21.15.73:0/2152921746 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd4bc07b370 con 0x7fd4c80cd280 2024-03-29T04:08:17.844 INFO:teuthology.orchestra.run.smithi073.stdout:55834574853 2024-03-29T04:08:17.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.864+0000 7f1f8dc63640 1 -- 172.21.15.73:0/260318306 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f1f7406c600 msgr2=0x7f1f7406eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.864+0000 7f1f8dc63640 1 --2- 172.21.15.73:0/260318306 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f1f7406c600 0x7f1f7406eac0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1f8815b660 tx=0x7f1f78009060 comp rx=0 tx=0).stop 2024-03-29T04:08:17.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.864+0000 7f1f8dc63640 1 -- 172.21.15.73:0/260318306 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f880c5020 msgr2=0x7f1f880c9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.864+0000 7f1f8dc63640 1 --2- 172.21.15.73:0/260318306 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f880c5020 0x7f1f880c9c00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1f8000cb40 tx=0x7f1f8000a060 comp rx=0 tx=0).stop 2024-03-29T04:08:17.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.864+0000 7f1f8dc63640 1 -- 172.21.15.73:0/260318306 shutdown_connections 2024-03-29T04:08:17.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.864+0000 7f1f8dc63640 1 --2- 172.21.15.73:0/260318306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f8815fc20 0x7f1f88156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.864+0000 7f1f8dc63640 1 --2- 172.21.15.73:0/260318306 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f880c6850 0x7f1f881565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.864+0000 7f1f8dc63640 1 --2- 172.21.15.73:0/260318306 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f1f7406c600 0x7f1f7406eac0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.864+0000 7f1f8dc63640 1 --2- 172.21.15.73:0/260318306 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f880c5020 0x7f1f880c9c00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.864+0000 7f1f8dc63640 1 -- 172.21.15.73:0/260318306 >> 172.21.15.73:0/260318306 conn(0x7f1f8806b510 msgr2=0x7f1f8806b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:17.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.865+0000 7f1f8dc63640 1 -- 172.21.15.73:0/260318306 shutdown_connections 2024-03-29T04:08:17.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.865+0000 7f1f8dc63640 1 -- 172.21.15.73:0/260318306 wait complete. 2024-03-29T04:08:17.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.865+0000 7fd4cde41640 1 -- 172.21.15.73:0/2152921746 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd4b406c580 msgr2=0x7fd4b406ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.865+0000 7fd4cde41640 1 --2- 172.21.15.73:0/2152921746 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd4b406c580 0x7fd4b406ea40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8000f60 tx=0x7fd4b8009040 comp rx=0 tx=0).stop 2024-03-29T04:08:17.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.865+0000 7fd4cde41640 1 -- 172.21.15.73:0/2152921746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4c80cd280 msgr2=0x7fd4c80aee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:17.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.865+0000 7fd4cde41640 1 --2- 172.21.15.73:0/2152921746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4c80cd280 0x7fd4c80aee40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc033000 tx=0x7fd4bc0046c0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.866+0000 7fd4cde41640 1 -- 172.21.15.73:0/2152921746 shutdown_connections 2024-03-29T04:08:17.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.866+0000 7fd4cde41640 1 --2- 172.21.15.73:0/2152921746 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd4c81605e0 0x7fd4c80af380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.866+0000 7fd4cde41640 1 --2- 172.21.15.73:0/2152921746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4c80cd280 0x7fd4c80aee40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.866+0000 7fd4cde41640 1 --2- 172.21.15.73:0/2152921746 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd4b406c580 0x7fd4b406ea40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.866+0000 7fd4cde41640 1 --2- 172.21.15.73:0/2152921746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd4c80c5020 0x7fd4c81f8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:17.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.866+0000 7fd4cde41640 1 -- 172.21.15.73:0/2152921746 >> 172.21.15.73:0/2152921746 conn(0x7fd4c806b510 msgr2=0x7fd4c806f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:17.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.866+0000 7fd4cde41640 1 -- 172.21.15.73:0/2152921746 shutdown_connections 2024-03-29T04:08:17.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:17.866+0000 7fd4cde41640 1 -- 172.21.15.73:0/2152921746 wait complete. 2024-03-29T04:08:17.851 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2024-03-29T04:08:17.851 DEBUG:teuthology.parallel:result is None 2024-03-29T04:08:17.856 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2024-03-29T04:08:17.856 DEBUG:teuthology.parallel:result is None 2024-03-29T04:08:17.858 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2024-03-29T04:08:17.858 DEBUG:teuthology.parallel:result is None 2024-03-29T04:08:17.859 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2024-03-29T04:08:17.859 DEBUG:teuthology.parallel:result is None 2024-03-29T04:08:17.860 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2024-03-29T04:08:17.860 DEBUG:teuthology.parallel:result is None 2024-03-29T04:08:17.863 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2024-03-29T04:08:17.863 DEBUG:teuthology.parallel:result is None 2024-03-29T04:08:17.863 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-29T04:08:17.863 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-29T04:08:18.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.023+0000 7ff5f7274640 1 Processor -- start 2024-03-29T04:08:18.003 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.023+0000 7ff5f7274640 1 -- start start 2024-03-29T04:08:18.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.024+0000 7ff5f7274640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff5f015e870 0x7ff5f00b26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:18.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.024+0000 7ff5f7274640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5f00ae1b0 0x7ff5f006b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:18.004 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.024+0000 7ff5f7274640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5f00b41d0 con 0x7ff5f00ae630 2024-03-29T04:08:18.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.024+0000 7ff5f7274640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7ff5f00b6510 con 0x7ff5f015e870 2024-03-29T04:08:18.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.024+0000 7ff5f7274640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff5f00b4470 con 0x7ff5f00ae1b0 2024-03-29T04:08:18.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.024+0000 7ff5f5010640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff5f015e870 0x7ff5f00b26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:18.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.024+0000 7ff5f5811640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff5f00ae630 0x7ff5f00b16d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52176/0 (socket says 172.21.15.73:52176) 2024-03-29T04:08:18.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.024+0000 7ff5f5010640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff5f015e870 0x7ff5f00b26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42304/0 (socket says 172.21.15.73:42304) 2024-03-29T04:08:18.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.024+0000 7ff5f5811640 1 -- 172.21.15.73:0/2863475601 learned_addr learned my addr 172.21.15.73:0/2863475601 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:18.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.025+0000 7ff5f480f640 1 --2- 172.21.15.73:0/2863475601 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5f00ae1b0 0x7ff5f006b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:18.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.025+0000 7ff5f5010640 1 -- 172.21.15.73:0/2863475601 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5f00ae1b0 msgr2=0x7ff5f006b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:18.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.025+0000 7ff5f5010640 1 --2- 172.21.15.73:0/2863475601 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5f00ae1b0 0x7ff5f006b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:18.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.025+0000 7ff5f5010640 1 -- 172.21.15.73:0/2863475601 >> v1:172.21.15.73:6789/0 conn(0x7ff5f00ae630 legacy=0x7ff5f00b16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:18.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.025+0000 7ff5f5010640 1 -- 172.21.15.73:0/2863475601 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5f00b4750 con 0x7ff5f015e870 2024-03-29T04:08:18.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.025+0000 7ff5e7fff640 1 -- 172.21.15.73:0/2863475601 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2740199679 0 0) 0x7ff5f00b41d0 con 0x7ff5f00ae630 2024-03-29T04:08:18.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.025+0000 7ff5f5010640 1 --2- 172.21.15.73:0/2863475601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5f015e870 0x7ff5f00b26d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec009d90 tx=0x7ff5ec02be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2e4fcc963a0e6e server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:18.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.025+0000 7ff5e7fff640 1 -- 172.21.15.73:0/2863475601 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec039070 con 0x7ff5f015e870 2024-03-29T04:08:18.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.026+0000 7ff5e7fff640 1 -- 172.21.15.73:0/2863475601 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5ec02cbc0 con 0x7ff5f015e870 2024-03-29T04:08:18.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.026+0000 7ff5e7fff640 1 -- 172.21.15.73:0/2863475601 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec034440 con 0x7ff5f015e870 2024-03-29T04:08:18.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.026+0000 7ff5f7274640 1 -- 172.21.15.73:0/2863475601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5f015e870 msgr2=0x7ff5f00b26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:18.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.026+0000 7ff5f7274640 1 --2- 172.21.15.73:0/2863475601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5f015e870 0x7ff5f00b26d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec009d90 tx=0x7ff5ec02be10 comp rx=0 tx=0).stop 2024-03-29T04:08:18.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.026+0000 7ff5f7274640 1 -- 172.21.15.73:0/2863475601 shutdown_connections 2024-03-29T04:08:18.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.026+0000 7ff5f7274640 1 --2- 172.21.15.73:0/2863475601 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5f00ae1b0 0x7ff5f006b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:18.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.026+0000 7ff5f7274640 1 --2- 172.21.15.73:0/2863475601 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5f015e870 0x7ff5f00b26d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:18.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.026+0000 7ff5f7274640 1 -- 172.21.15.73:0/2863475601 >> 172.21.15.73:0/2863475601 conn(0x7ff5f00b66f0 msgr2=0x7ff5f00b6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:18.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.026+0000 7ff5f7274640 1 -- 172.21.15.73:0/2863475601 shutdown_connections 2024-03-29T04:08:18.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.026+0000 7ff5f7274640 1 -- 172.21.15.73:0/2863475601 wait complete. 2024-03-29T04:08:18.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.027+0000 7ff5f7274640 1 Processor -- start 2024-03-29T04:08:18.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.027+0000 7ff5f7274640 1 -- start start 2024-03-29T04:08:18.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.028+0000 7ff5f7274640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5f00ae1b0 0x7ff5f0157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:18.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.028+0000 7ff5f7274640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5f00ae630 0x7ff5f0153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:18.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.028+0000 7ff5f7274640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5f015e870 0x7ff5f01f43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:18.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.028+0000 7ff5f7274640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f00b04c0 con 0x7ff5f00ae630 2024-03-29T04:08:18.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.028+0000 7ff5f7274640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f015ec50 con 0x7ff5f00ae1b0 2024-03-29T04:08:18.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.028+0000 7ff5f7274640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff5f00b2c10 con 0x7ff5f015e870 2024-03-29T04:08:18.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.028+0000 7ff5f480f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5f00ae630 0x7ff5f0153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:18.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.028+0000 7ff5f480f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5f00ae630 0x7ff5f0153730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42306/0 (socket says 172.21.15.73:42306) 2024-03-29T04:08:18.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.028+0000 7ff5f480f640 1 -- 172.21.15.73:0/1722247858 learned_addr learned my addr 172.21.15.73:0/1722247858 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:18.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.028+0000 7ff5f5010640 1 --2- 172.21.15.73:0/1722247858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5f00ae1b0 0x7ff5f0157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:18.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.028+0000 7ff5f5811640 1 --2- 172.21.15.73:0/1722247858 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5f015e870 0x7ff5f01f43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:18.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.028+0000 7ff5f480f640 1 -- 172.21.15.73:0/1722247858 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5f015e870 msgr2=0x7ff5f01f43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:18.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.028+0000 7ff5f480f640 1 --2- 172.21.15.73:0/1722247858 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5f015e870 0x7ff5f01f43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:18.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.028+0000 7ff5f480f640 1 -- 172.21.15.73:0/1722247858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5f00ae1b0 msgr2=0x7ff5f0157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:18.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.028+0000 7ff5f480f640 1 --2- 172.21.15.73:0/1722247858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5f00ae1b0 0x7ff5f0157160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:18.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.028+0000 7ff5f480f640 1 -- 172.21.15.73:0/1722247858 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5f01576a0 con 0x7ff5f00ae630 2024-03-29T04:08:18.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.029+0000 7ff5f480f640 1 --2- 172.21.15.73:0/1722247858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5f00ae630 0x7ff5f0153730 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff5e000e870 tx=0x7ff5e000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:18.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.029+0000 7ff5e5ffb640 1 -- 172.21.15.73:0/1722247858 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e0017070 con 0x7ff5f00ae630 2024-03-29T04:08:18.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.029+0000 7ff5e5ffb640 1 -- 172.21.15.73:0/1722247858 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5e000c940 con 0x7ff5f00ae630 2024-03-29T04:08:18.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.029+0000 7ff5f7274640 1 -- 172.21.15.73:0/1722247858 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5f0158190 con 0x7ff5f00ae630 2024-03-29T04:08:18.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.029+0000 7ff5e5ffb640 1 -- 172.21.15.73:0/1722247858 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5e000cd30 con 0x7ff5f00ae630 2024-03-29T04:08:18.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.029+0000 7ff5f7274640 1 -- 172.21.15.73:0/1722247858 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5f0158750 con 0x7ff5f00ae630 2024-03-29T04:08:18.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.030+0000 7ff5f7274640 1 -- 172.21.15.73:0/1722247858 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5f0068d50 con 0x7ff5f00ae630 2024-03-29T04:08:18.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.030+0000 7ff5e5ffb640 1 -- 172.21.15.73:0/1722247858 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff5e001a070 con 0x7ff5f00ae630 2024-03-29T04:08:18.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.031+0000 7ff5e5ffb640 1 --2- 172.21.15.73:0/1722247858 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff5d406c530 0x7ff5d406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:18.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.031+0000 7ff5e5ffb640 1 -- 172.21.15.73:0/1722247858 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff5e008b520 con 0x7ff5f00ae630 2024-03-29T04:08:18.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.031+0000 7ff5f5010640 1 --2- 172.21.15.73:0/1722247858 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff5d406c530 0x7ff5d406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:18.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.031+0000 7ff5f5010640 1 --2- 172.21.15.73:0/1722247858 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff5d406c530 0x7ff5d406e9f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec036000 tx=0x7ff5ec030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:18.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.035+0000 7ff5e5ffb640 1 -- 172.21.15.73:0/1722247858 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7ff5e00594f0 con 0x7ff5f00ae630 2024-03-29T04:08:18.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.206+0000 7ff5f7274640 1 -- 172.21.15.73:0/1722247858 --> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff5f01616e0 con 0x7ff5d406c530 2024-03-29T04:08:18.191 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.212+0000 7ff5e5ffb640 1 -- 172.21.15.73:0/1722247858 <== mgr.4104 v2:172.21.15.73:6832/1640471941 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251860 (secure 0 0 0) 0x7ff5f01616e0 con 0x7ff5d406c530 2024-03-29T04:08:18.194 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:18.195 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-29T04:08:18.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.214+0000 7ff5f7274640 1 -- 172.21.15.73:0/1722247858 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff5d406c530 msgr2=0x7ff5d406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:18.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.214+0000 7ff5f7274640 1 --2- 172.21.15.73:0/1722247858 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff5d406c530 0x7ff5d406e9f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec036000 tx=0x7ff5ec030000 comp rx=0 tx=0).stop 2024-03-29T04:08:18.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.214+0000 7ff5f7274640 1 -- 172.21.15.73:0/1722247858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5f00ae630 msgr2=0x7ff5f0153730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:18.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.214+0000 7ff5f7274640 1 --2- 172.21.15.73:0/1722247858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5f00ae630 0x7ff5f0153730 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff5e000e870 tx=0x7ff5e000ec70 comp rx=0 tx=0).stop 2024-03-29T04:08:18.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.215+0000 7ff5f7274640 1 -- 172.21.15.73:0/1722247858 shutdown_connections 2024-03-29T04:08:18.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.215+0000 7ff5f7274640 1 --2- 172.21.15.73:0/1722247858 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff5f015e870 0x7ff5f01f43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:18.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.215+0000 7ff5f7274640 1 --2- 172.21.15.73:0/1722247858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5f00ae630 0x7ff5f0153730 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:18.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.215+0000 7ff5f7274640 1 --2- 172.21.15.73:0/1722247858 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff5d406c530 0x7ff5d406e9f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:18.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.215+0000 7ff5f7274640 1 --2- 172.21.15.73:0/1722247858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff5f00ae1b0 0x7ff5f0157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:18.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.215+0000 7ff5f7274640 1 -- 172.21.15.73:0/1722247858 >> 172.21.15.73:0/1722247858 conn(0x7ff5f00b66f0 msgr2=0x7ff5f00aeab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:18.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.215+0000 7ff5f7274640 1 -- 172.21.15.73:0/1722247858 shutdown_connections 2024-03-29T04:08:18.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.215+0000 7ff5f7274640 1 -- 172.21.15.73:0/1722247858 wait complete. 2024-03-29T04:08:18.205 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-03-29T04:08:17.523678+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":181,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219096,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755624,"statfs":{"total":773094113280,"available":772869758976,"internally_reserved":0,"allocated":2990080,"data_stored":1790396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001148"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.737637+0000","last_change":"2024-03-29T04:08:12.587912+0000","last_active":"2024-03-29T04:08:13.737637+0000","last_peered":"2024-03-29T04:08:13.737637+0000","last_clean":"2024-03-29T04:08:13.737637+0000","last_became_active":"2024-03-29T04:08:12.587593+0000","last_became_peered":"2024-03-29T04:08:12.587593+0000","last_unstale":"2024-03-29T04:08:13.737637+0000","last_undegraded":"2024-03-29T04:08:13.737637+0000","last_fullsized":"2024-03-29T04:08:13.737637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:41:05.262468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.583588+0000","last_change":"2024-03-29T04:08:12.582178+0000","last_active":"2024-03-29T04:08:13.583588+0000","last_peered":"2024-03-29T04:08:13.583588+0000","last_clean":"2024-03-29T04:08:13.583588+0000","last_became_active":"2024-03-29T04:08:12.581920+0000","last_became_peered":"2024-03-29T04:08:12.581920+0000","last_unstale":"2024-03-29T04:08:13.583588+0000","last_undegraded":"2024-03-29T04:08:13.583588+0000","last_fullsized":"2024-03-29T04:08:13.583588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:50:17.616748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299855+0000","last_change":"2024-03-29T04:08:12.584079+0000","last_active":"2024-03-29T04:08:15.299855+0000","last_peered":"2024-03-29T04:08:15.299855+0000","last_clean":"2024-03-29T04:08:15.299855+0000","last_became_active":"2024-03-29T04:08:12.583240+0000","last_became_peered":"2024-03-29T04:08:12.583240+0000","last_unstale":"2024-03-29T04:08:15.299855+0000","last_undegraded":"2024-03-29T04:08:15.299855+0000","last_fullsized":"2024-03-29T04:08:15.299855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:44:46.187079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299689+0000","last_change":"2024-03-29T04:08:12.595090+0000","last_active":"2024-03-29T04:08:15.299689+0000","last_peered":"2024-03-29T04:08:15.299689+0000","last_clean":"2024-03-29T04:08:15.299689+0000","last_became_active":"2024-03-29T04:08:12.594477+0000","last_became_peered":"2024-03-29T04:08:12.594477+0000","last_unstale":"2024-03-29T04:08:15.299689+0000","last_undegraded":"2024-03-29T04:08:15.299689+0000","last_fullsized":"2024-03-29T04:08:15.299689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:09:42.069575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.737392+0000","last_change":"2024-03-29T04:08:12.595546+0000","last_active":"2024-03-29T04:08:13.737392+0000","last_peered":"2024-03-29T04:08:13.737392+0000","last_clean":"2024-03-29T04:08:13.737392+0000","last_became_active":"2024-03-29T04:08:12.595270+0000","last_became_peered":"2024-03-29T04:08:12.595270+0000","last_unstale":"2024-03-29T04:08:13.737392+0000","last_undegraded":"2024-03-29T04:08:13.737392+0000","last_fullsized":"2024-03-29T04:08:13.737392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:09:42.069575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299409+0000","last_change":"2024-03-29T04:08:12.598973+0000","last_active":"2024-03-29T04:08:15.299409+0000","last_peered":"2024-03-29T04:08:15.299409+0000","last_clean":"2024-03-29T04:08:15.299409+0000","last_became_active":"2024-03-29T04:08:12.598463+0000","last_became_peered":"2024-03-29T04:08:12.598463+0000","last_unstale":"2024-03-29T04:08:15.299409+0000","last_undegraded":"2024-03-29T04:08:15.299409+0000","last_fullsized":"2024-03-29T04:08:15.299409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T13:00:12.842920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.737198+0000","last_change":"2024-03-29T04:08:12.590636+0000","last_active":"2024-03-29T04:08:13.737198+0000","last_peered":"2024-03-29T04:08:13.737198+0000","last_clean":"2024-03-29T04:08:13.737198+0000","last_became_active":"2024-03-29T04:08:12.590365+0000","last_became_peered":"2024-03-29T04:08:12.590365+0000","last_unstale":"2024-03-29T04:08:13.737198+0000","last_undegraded":"2024-03-29T04:08:13.737198+0000","last_fullsized":"2024-03-29T04:08:13.737198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:45:14.018822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:14.907931+0000","last_change":"2024-03-29T04:08:12.594929+0000","last_active":"2024-03-29T04:08:14.907931+0000","last_peered":"2024-03-29T04:08:14.907931+0000","last_clean":"2024-03-29T04:08:14.907931+0000","last_became_active":"2024-03-29T04:08:12.594646+0000","last_became_peered":"2024-03-29T04:08:12.594646+0000","last_unstale":"2024-03-29T04:08:14.907931+0000","last_undegraded":"2024-03-29T04:08:14.907931+0000","last_fullsized":"2024-03-29T04:08:14.907931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:51:30.023734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.737677+0000","last_change":"2024-03-29T04:08:12.597651+0000","last_active":"2024-03-29T04:08:13.737677+0000","last_peered":"2024-03-29T04:08:13.737677+0000","last_clean":"2024-03-29T04:08:13.737677+0000","last_became_active":"2024-03-29T04:08:12.597389+0000","last_became_peered":"2024-03-29T04:08:12.597389+0000","last_unstale":"2024-03-29T04:08:13.737677+0000","last_undegraded":"2024-03-29T04:08:13.737677+0000","last_fullsized":"2024-03-29T04:08:13.737677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:40:21.785851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.585221+0000","last_change":"2024-03-29T04:08:12.588278+0000","last_active":"2024-03-29T04:08:13.585221+0000","last_peered":"2024-03-29T04:08:13.585221+0000","last_clean":"2024-03-29T04:08:13.585221+0000","last_became_active":"2024-03-29T04:08:12.587891+0000","last_became_peered":"2024-03-29T04:08:12.587891+0000","last_unstale":"2024-03-29T04:08:13.585221+0000","last_undegraded":"2024-03-29T04:08:13.585221+0000","last_fullsized":"2024-03-29T04:08:13.585221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T13:00:12.842920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.584536+0000","last_change":"2024-03-29T04:08:12.590703+0000","last_active":"2024-03-29T04:08:13.584536+0000","last_peered":"2024-03-29T04:08:13.584536+0000","last_clean":"2024-03-29T04:08:13.584536+0000","last_became_active":"2024-03-29T04:08:12.590420+0000","last_became_peered":"2024-03-29T04:08:12.590420+0000","last_unstale":"2024-03-29T04:08:13.584536+0000","last_undegraded":"2024-03-29T04:08:13.584536+0000","last_fullsized":"2024-03-29T04:08:13.584536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:50:17.616748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.585994+0000","last_change":"2024-03-29T04:08:12.587297+0000","last_active":"2024-03-29T04:08:13.585994+0000","last_peered":"2024-03-29T04:08:13.585994+0000","last_clean":"2024-03-29T04:08:13.585994+0000","last_became_active":"2024-03-29T04:08:12.587036+0000","last_became_peered":"2024-03-29T04:08:12.587036+0000","last_unstale":"2024-03-29T04:08:13.585994+0000","last_undegraded":"2024-03-29T04:08:13.585994+0000","last_fullsized":"2024-03-29T04:08:13.585994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:46:43.492166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:14.908212+0000","last_change":"2024-03-29T04:08:12.580578+0000","last_active":"2024-03-29T04:08:14.908212+0000","last_peered":"2024-03-29T04:08:14.908212+0000","last_clean":"2024-03-29T04:08:14.908212+0000","last_became_active":"2024-03-29T04:08:12.580335+0000","last_became_peered":"2024-03-29T04:08:12.580335+0000","last_unstale":"2024-03-29T04:08:14.908212+0000","last_undegraded":"2024-03-29T04:08:14.908212+0000","last_fullsized":"2024-03-29T04:08:14.908212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T13:00:12.842920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299804+0000","last_change":"2024-03-29T04:08:12.584573+0000","last_active":"2024-03-29T04:08:15.299804+0000","last_peered":"2024-03-29T04:08:15.299804+0000","last_clean":"2024-03-29T04:08:15.299804+0000","last_became_active":"2024-03-29T04:08:12.584294+0000","last_became_peered":"2024-03-29T04:08:12.584294+0000","last_unstale":"2024-03-29T04:08:15.299804+0000","last_undegraded":"2024-03-29T04:08:15.299804+0000","last_fullsized":"2024-03-29T04:08:15.299804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:47:13.560160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.583614+0000","last_change":"2024-03-29T04:08:12.588885+0000","last_active":"2024-03-29T04:08:13.583614+0000","last_peered":"2024-03-29T04:08:13.583614+0000","last_clean":"2024-03-29T04:08:13.583614+0000","last_became_active":"2024-03-29T04:08:12.588581+0000","last_became_peered":"2024-03-29T04:08:12.588581+0000","last_unstale":"2024-03-29T04:08:13.583614+0000","last_undegraded":"2024-03-29T04:08:13.583614+0000","last_fullsized":"2024-03-29T04:08:13.583614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T13:00:12.842920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299347+0000","last_change":"2024-03-29T04:08:12.595787+0000","last_active":"2024-03-29T04:08:15.299347+0000","last_peered":"2024-03-29T04:08:15.299347+0000","last_clean":"2024-03-29T04:08:15.299347+0000","last_became_active":"2024-03-29T04:08:12.595403+0000","last_became_peered":"2024-03-29T04:08:12.595403+0000","last_unstale":"2024-03-29T04:08:15.299347+0000","last_undegraded":"2024-03-29T04:08:15.299347+0000","last_fullsized":"2024-03-29T04:08:15.299347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:50:17.616748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299914+0000","last_change":"2024-03-29T04:08:12.598647+0000","last_active":"2024-03-29T04:08:15.299914+0000","last_peered":"2024-03-29T04:08:15.299914+0000","last_clean":"2024-03-29T04:08:15.299914+0000","last_became_active":"2024-03-29T04:08:12.597742+0000","last_became_peered":"2024-03-29T04:08:12.597742+0000","last_unstale":"2024-03-29T04:08:15.299914+0000","last_undegraded":"2024-03-29T04:08:15.299914+0000","last_fullsized":"2024-03-29T04:08:15.299914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T10:36:55.055976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.300025+0000","last_change":"2024-03-29T04:08:12.583931+0000","last_active":"2024-03-29T04:08:15.300025+0000","last_peered":"2024-03-29T04:08:15.300025+0000","last_clean":"2024-03-29T04:08:15.300025+0000","last_became_active":"2024-03-29T04:08:12.583644+0000","last_became_peered":"2024-03-29T04:08:12.583644+0000","last_unstale":"2024-03-29T04:08:15.300025+0000","last_undegraded":"2024-03-29T04:08:15.300025+0000","last_fullsized":"2024-03-29T04:08:15.300025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:39:27.893573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.737641+0000","last_change":"2024-03-29T04:08:12.596215+0000","last_active":"2024-03-29T04:08:13.737641+0000","last_peered":"2024-03-29T04:08:13.737641+0000","last_clean":"2024-03-29T04:08:13.737641+0000","last_became_active":"2024-03-29T04:08:12.595946+0000","last_became_peered":"2024-03-29T04:08:12.595946+0000","last_unstale":"2024-03-29T04:08:13.737641+0000","last_undegraded":"2024-03-29T04:08:13.737641+0000","last_fullsized":"2024-03-29T04:08:13.737641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T10:36:55.055976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.584363+0000","last_change":"2024-03-29T04:08:12.591240+0000","last_active":"2024-03-29T04:08:13.584363+0000","last_peered":"2024-03-29T04:08:13.584363+0000","last_clean":"2024-03-29T04:08:13.584363+0000","last_became_active":"2024-03-29T04:08:12.590916+0000","last_became_peered":"2024-03-29T04:08:12.590916+0000","last_unstale":"2024-03-29T04:08:13.584363+0000","last_undegraded":"2024-03-29T04:08:13.584363+0000","last_fullsized":"2024-03-29T04:08:13.584363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:43:58.842293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.300241+0000","last_change":"2024-03-29T04:08:12.591775+0000","last_active":"2024-03-29T04:08:15.300241+0000","last_peered":"2024-03-29T04:08:15.300241+0000","last_clean":"2024-03-29T04:08:15.300241+0000","last_became_active":"2024-03-29T04:08:12.591502+0000","last_became_peered":"2024-03-29T04:08:12.591502+0000","last_unstale":"2024-03-29T04:08:15.300241+0000","last_undegraded":"2024-03-29T04:08:15.300241+0000","last_fullsized":"2024-03-29T04:08:15.300241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:50:17.616748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299508+0000","last_change":"2024-03-29T04:08:12.598535+0000","last_active":"2024-03-29T04:08:15.299508+0000","last_peered":"2024-03-29T04:08:15.299508+0000","last_clean":"2024-03-29T04:08:15.299508+0000","last_became_active":"2024-03-29T04:08:12.594745+0000","last_became_peered":"2024-03-29T04:08:12.594745+0000","last_unstale":"2024-03-29T04:08:15.299508+0000","last_undegraded":"2024-03-29T04:08:15.299508+0000","last_fullsized":"2024-03-29T04:08:15.299508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:45:14.018822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:14.908014+0000","last_change":"2024-03-29T04:08:12.588823+0000","last_active":"2024-03-29T04:08:14.908014+0000","last_peered":"2024-03-29T04:08:14.908014+0000","last_clean":"2024-03-29T04:08:14.908014+0000","last_became_active":"2024-03-29T04:08:12.588560+0000","last_became_peered":"2024-03-29T04:08:12.588560+0000","last_unstale":"2024-03-29T04:08:14.908014+0000","last_undegraded":"2024-03-29T04:08:14.908014+0000","last_fullsized":"2024-03-29T04:08:14.908014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T10:10:20.492063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299433+0000","last_change":"2024-03-29T04:08:12.598196+0000","last_active":"2024-03-29T04:08:15.299433+0000","last_peered":"2024-03-29T04:08:15.299433+0000","last_clean":"2024-03-29T04:08:15.299433+0000","last_became_active":"2024-03-29T04:08:12.594199+0000","last_became_peered":"2024-03-29T04:08:12.594199+0000","last_unstale":"2024-03-29T04:08:15.299433+0000","last_undegraded":"2024-03-29T04:08:15.299433+0000","last_fullsized":"2024-03-29T04:08:15.299433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:55:07.377171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:14.908282+0000","last_change":"2024-03-29T04:08:12.588950+0000","last_active":"2024-03-29T04:08:14.908282+0000","last_peered":"2024-03-29T04:08:14.908282+0000","last_clean":"2024-03-29T04:08:14.908282+0000","last_became_active":"2024-03-29T04:08:12.588659+0000","last_became_peered":"2024-03-29T04:08:12.588659+0000","last_unstale":"2024-03-29T04:08:14.908282+0000","last_undegraded":"2024-03-29T04:08:14.908282+0000","last_fullsized":"2024-03-29T04:08:14.908282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:55:07.377171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.585376+0000","last_change":"2024-03-29T04:08:12.589789+0000","last_active":"2024-03-29T04:08:13.585376+0000","last_peered":"2024-03-29T04:08:13.585376+0000","last_clean":"2024-03-29T04:08:13.585376+0000","last_became_active":"2024-03-29T04:08:12.587505+0000","last_became_peered":"2024-03-29T04:08:12.587505+0000","last_unstale":"2024-03-29T04:08:13.585376+0000","last_undegraded":"2024-03-29T04:08:13.585376+0000","last_fullsized":"2024-03-29T04:08:13.585376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:55:07.377171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.583427+0000","last_change":"2024-03-29T04:08:12.582545+0000","last_active":"2024-03-29T04:08:13.583427+0000","last_peered":"2024-03-29T04:08:13.583427+0000","last_clean":"2024-03-29T04:08:13.583427+0000","last_became_active":"2024-03-29T04:08:12.582268+0000","last_became_peered":"2024-03-29T04:08:12.582268+0000","last_unstale":"2024-03-29T04:08:13.583427+0000","last_undegraded":"2024-03-29T04:08:13.583427+0000","last_fullsized":"2024-03-29T04:08:13.583427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:24:45.816098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:14.908319+0000","last_change":"2024-03-29T04:08:12.589186+0000","last_active":"2024-03-29T04:08:14.908319+0000","last_peered":"2024-03-29T04:08:14.908319+0000","last_clean":"2024-03-29T04:08:14.908319+0000","last_became_active":"2024-03-29T04:08:12.588882+0000","last_became_peered":"2024-03-29T04:08:12.588882+0000","last_unstale":"2024-03-29T04:08:14.908319+0000","last_undegraded":"2024-03-29T04:08:14.908319+0000","last_fullsized":"2024-03-29T04:08:14.908319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:45:14.018822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.300381+0000","last_change":"2024-03-29T04:08:12.584300+0000","last_active":"2024-03-29T04:08:15.300381+0000","last_peered":"2024-03-29T04:08:15.300381+0000","last_clean":"2024-03-29T04:08:15.300381+0000","last_became_active":"2024-03-29T04:08:12.583925+0000","last_became_peered":"2024-03-29T04:08:12.583925+0000","last_unstale":"2024-03-29T04:08:15.300381+0000","last_undegraded":"2024-03-29T04:08:15.300381+0000","last_fullsized":"2024-03-29T04:08:15.300381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T13:00:12.842920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299551+0000","last_change":"2024-03-29T04:08:12.593957+0000","last_active":"2024-03-29T04:08:15.299551+0000","last_peered":"2024-03-29T04:08:15.299551+0000","last_clean":"2024-03-29T04:08:15.299551+0000","last_became_active":"2024-03-29T04:08:12.593694+0000","last_became_peered":"2024-03-29T04:08:12.593694+0000","last_unstale":"2024-03-29T04:08:15.299551+0000","last_undegraded":"2024-03-29T04:08:15.299551+0000","last_fullsized":"2024-03-29T04:08:15.299551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:23:42.952899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.300313+0000","last_change":"2024-03-29T04:08:12.587534+0000","last_active":"2024-03-29T04:08:15.300313+0000","last_peered":"2024-03-29T04:08:15.300313+0000","last_clean":"2024-03-29T04:08:15.300313+0000","last_became_active":"2024-03-29T04:08:12.587244+0000","last_became_peered":"2024-03-29T04:08:12.587244+0000","last_unstale":"2024-03-29T04:08:15.300313+0000","last_undegraded":"2024-03-29T04:08:15.300313+0000","last_fullsized":"2024-03-29T04:08:15.300313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:46:43.492166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.584165+0000","last_change":"2024-03-29T04:08:12.588798+0000","last_active":"2024-03-29T04:08:13.584165+0000","last_peered":"2024-03-29T04:08:13.584165+0000","last_clean":"2024-03-29T04:08:13.584165+0000","last_became_active":"2024-03-29T04:08:12.588526+0000","last_became_peered":"2024-03-29T04:08:12.588526+0000","last_unstale":"2024-03-29T04:08:13.584165+0000","last_undegraded":"2024-03-29T04:08:13.584165+0000","last_fullsized":"2024-03-29T04:08:13.584165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:51:30.023734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.585743+0000","last_change":"2024-03-29T04:08:12.586895+0000","last_active":"2024-03-29T04:08:13.585743+0000","last_peered":"2024-03-29T04:08:13.585743+0000","last_clean":"2024-03-29T04:08:13.585743+0000","last_became_active":"2024-03-29T04:08:12.586616+0000","last_became_peered":"2024-03-29T04:08:12.586616+0000","last_unstale":"2024-03-29T04:08:13.585743+0000","last_undegraded":"2024-03-29T04:08:13.585743+0000","last_fullsized":"2024-03-29T04:08:13.585743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:39:27.893573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:14.908364+0000","last_change":"2024-03-29T04:08:11.581036+0000","last_active":"2024-03-29T04:08:14.908364+0000","last_peered":"2024-03-29T04:08:14.908364+0000","last_clean":"2024-03-29T04:08:14.908364+0000","last_became_active":"2024-03-29T04:08:11.580771+0000","last_became_peered":"2024-03-29T04:08:11.580771+0000","last_unstale":"2024-03-29T04:08:14.908364+0000","last_undegraded":"2024-03-29T04:08:14.908364+0000","last_fullsized":"2024-03-29T04:08:14.908364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T13:31:02.796965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.300444+0000","last_change":"2024-03-29T04:08:12.591216+0000","last_active":"2024-03-29T04:08:15.300444+0000","last_peered":"2024-03-29T04:08:15.300444+0000","last_clean":"2024-03-29T04:08:15.300444+0000","last_became_active":"2024-03-29T04:08:12.590900+0000","last_became_peered":"2024-03-29T04:08:12.590900+0000","last_unstale":"2024-03-29T04:08:15.300444+0000","last_undegraded":"2024-03-29T04:08:15.300444+0000","last_fullsized":"2024-03-29T04:08:15.300444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:55:07.377171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.584792+0000","last_change":"2024-03-29T04:08:11.578220+0000","last_active":"2024-03-29T04:08:13.584792+0000","last_peered":"2024-03-29T04:08:13.584792+0000","last_clean":"2024-03-29T04:08:13.584792+0000","last_became_active":"2024-03-29T04:08:11.577710+0000","last_became_peered":"2024-03-29T04:08:11.577710+0000","last_unstale":"2024-03-29T04:08:13.584792+0000","last_undegraded":"2024-03-29T04:08:13.584792+0000","last_fullsized":"2024-03-29T04:08:13.584792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:04:46.456846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:14.907996+0000","last_change":"2024-03-29T04:08:11.579579+0000","last_active":"2024-03-29T04:08:14.907996+0000","last_peered":"2024-03-29T04:08:14.907996+0000","last_clean":"2024-03-29T04:08:14.907996+0000","last_became_active":"2024-03-29T04:08:11.578445+0000","last_became_peered":"2024-03-29T04:08:11.578445+0000","last_unstale":"2024-03-29T04:08:14.907996+0000","last_undegraded":"2024-03-29T04:08:14.907996+0000","last_fullsized":"2024-03-29T04:08:14.907996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T10:32:34.230140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:14.908005+0000","last_change":"2024-03-29T04:08:12.587465+0000","last_active":"2024-03-29T04:08:14.908005+0000","last_peered":"2024-03-29T04:08:14.908005+0000","last_clean":"2024-03-29T04:08:14.908005+0000","last_became_active":"2024-03-29T04:08:12.587202+0000","last_became_peered":"2024-03-29T04:08:12.587202+0000","last_unstale":"2024-03-29T04:08:14.908005+0000","last_undegraded":"2024-03-29T04:08:14.908005+0000","last_fullsized":"2024-03-29T04:08:14.908005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:24:45.816098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299460+0000","last_change":"2024-03-29T04:08:11.584446+0000","last_active":"2024-03-29T04:08:15.299460+0000","last_peered":"2024-03-29T04:08:15.299460+0000","last_clean":"2024-03-29T04:08:15.299460+0000","last_became_active":"2024-03-29T04:08:11.584105+0000","last_became_peered":"2024-03-29T04:08:11.584105+0000","last_unstale":"2024-03-29T04:08:15.299460+0000","last_undegraded":"2024-03-29T04:08:15.299460+0000","last_fullsized":"2024-03-29T04:08:15.299460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:22:23.215000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.583377+0000","last_change":"2024-03-29T04:08:12.580898+0000","last_active":"2024-03-29T04:08:13.583377+0000","last_peered":"2024-03-29T04:08:13.583377+0000","last_clean":"2024-03-29T04:08:13.583377+0000","last_became_active":"2024-03-29T04:08:12.580579+0000","last_became_peered":"2024-03-29T04:08:12.580579+0000","last_unstale":"2024-03-29T04:08:13.583377+0000","last_undegraded":"2024-03-29T04:08:13.583377+0000","last_fullsized":"2024-03-29T04:08:13.583377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:51:30.023734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.584658+0000","last_change":"2024-03-29T04:08:11.584262+0000","last_active":"2024-03-29T04:08:13.584658+0000","last_peered":"2024-03-29T04:08:13.584658+0000","last_clean":"2024-03-29T04:08:13.584658+0000","last_became_active":"2024-03-29T04:08:11.583668+0000","last_became_peered":"2024-03-29T04:08:11.583668+0000","last_unstale":"2024-03-29T04:08:13.584658+0000","last_undegraded":"2024-03-29T04:08:13.584658+0000","last_fullsized":"2024-03-29T04:08:13.584658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:43:45.627953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299642+0000","last_change":"2024-03-29T04:08:12.595602+0000","last_active":"2024-03-29T04:08:15.299642+0000","last_peered":"2024-03-29T04:08:15.299642+0000","last_clean":"2024-03-29T04:08:15.299642+0000","last_became_active":"2024-03-29T04:08:12.595332+0000","last_became_peered":"2024-03-29T04:08:12.595332+0000","last_unstale":"2024-03-29T04:08:15.299642+0000","last_undegraded":"2024-03-29T04:08:15.299642+0000","last_fullsized":"2024-03-29T04:08:15.299642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T11:05:08.038425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299696+0000","last_change":"2024-03-29T04:08:11.586122+0000","last_active":"2024-03-29T04:08:15.299696+0000","last_peered":"2024-03-29T04:08:15.299696+0000","last_clean":"2024-03-29T04:08:15.299696+0000","last_became_active":"2024-03-29T04:08:11.585845+0000","last_became_peered":"2024-03-29T04:08:11.585845+0000","last_unstale":"2024-03-29T04:08:15.299696+0000","last_undegraded":"2024-03-29T04:08:15.299696+0000","last_fullsized":"2024-03-29T04:08:15.299696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:43:45.627953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.300176+0000","last_change":"2024-03-29T04:08:12.591051+0000","last_active":"2024-03-29T04:08:15.300176+0000","last_peered":"2024-03-29T04:08:15.300176+0000","last_clean":"2024-03-29T04:08:15.300176+0000","last_became_active":"2024-03-29T04:08:12.590728+0000","last_became_peered":"2024-03-29T04:08:12.590728+0000","last_unstale":"2024-03-29T04:08:15.300176+0000","last_undegraded":"2024-03-29T04:08:15.300176+0000","last_fullsized":"2024-03-29T04:08:15.300176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:43:58.842293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.583699+0000","last_change":"2024-03-29T04:08:11.583944+0000","last_active":"2024-03-29T04:08:13.583699+0000","last_peered":"2024-03-29T04:08:13.583699+0000","last_clean":"2024-03-29T04:08:13.583699+0000","last_became_active":"2024-03-29T04:08:11.583666+0000","last_became_peered":"2024-03-29T04:08:11.583666+0000","last_unstale":"2024-03-29T04:08:13.583699+0000","last_undegraded":"2024-03-29T04:08:13.583699+0000","last_fullsized":"2024-03-29T04:08:13.583699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:04:46.456846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.586034+0000","last_change":"2024-03-29T04:08:12.590849+0000","last_active":"2024-03-29T04:08:13.586034+0000","last_peered":"2024-03-29T04:08:13.586034+0000","last_clean":"2024-03-29T04:08:13.586034+0000","last_became_active":"2024-03-29T04:08:12.590510+0000","last_became_peered":"2024-03-29T04:08:12.590510+0000","last_unstale":"2024-03-29T04:08:13.586034+0000","last_undegraded":"2024-03-29T04:08:13.586034+0000","last_fullsized":"2024-03-29T04:08:13.586034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:25:50.715560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.584472+0000","last_change":"2024-03-29T04:08:11.579283+0000","last_active":"2024-03-29T04:08:13.584472+0000","last_peered":"2024-03-29T04:08:13.584472+0000","last_clean":"2024-03-29T04:08:13.584472+0000","last_became_active":"2024-03-29T04:08:11.578990+0000","last_became_peered":"2024-03-29T04:08:11.578990+0000","last_unstale":"2024-03-29T04:08:13.584472+0000","last_undegraded":"2024-03-29T04:08:13.584472+0000","last_fullsized":"2024-03-29T04:08:13.584472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T13:31:02.796965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.737424+0000","last_change":"2024-03-29T04:08:12.586665+0000","last_active":"2024-03-29T04:08:13.737424+0000","last_peered":"2024-03-29T04:08:13.737424+0000","last_clean":"2024-03-29T04:08:13.737424+0000","last_became_active":"2024-03-29T04:08:12.586394+0000","last_became_peered":"2024-03-29T04:08:12.586394+0000","last_unstale":"2024-03-29T04:08:13.737424+0000","last_undegraded":"2024-03-29T04:08:13.737424+0000","last_fullsized":"2024-03-29T04:08:13.737424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:56:07.686818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.300443+0000","last_change":"2024-03-29T04:08:11.581071+0000","last_active":"2024-03-29T04:08:15.300443+0000","last_peered":"2024-03-29T04:08:15.300443+0000","last_clean":"2024-03-29T04:08:15.300443+0000","last_became_active":"2024-03-29T04:08:11.580803+0000","last_became_peered":"2024-03-29T04:08:11.580803+0000","last_unstale":"2024-03-29T04:08:15.300443+0000","last_undegraded":"2024-03-29T04:08:15.300443+0000","last_fullsized":"2024-03-29T04:08:15.300443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T10:32:34.230140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299913+0000","last_change":"2024-03-29T04:08:12.591431+0000","last_active":"2024-03-29T04:08:15.299913+0000","last_peered":"2024-03-29T04:08:15.299913+0000","last_clean":"2024-03-29T04:08:15.299913+0000","last_became_active":"2024-03-29T04:08:12.591158+0000","last_became_peered":"2024-03-29T04:08:12.591158+0000","last_unstale":"2024-03-29T04:08:15.299913+0000","last_undegraded":"2024-03-29T04:08:15.299913+0000","last_fullsized":"2024-03-29T04:08:15.299913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:23:55.560819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299597+0000","last_change":"2024-03-29T04:08:11.585963+0000","last_active":"2024-03-29T04:08:15.299597+0000","last_peered":"2024-03-29T04:08:15.299597+0000","last_clean":"2024-03-29T04:08:15.299597+0000","last_became_active":"2024-03-29T04:08:11.585663+0000","last_became_peered":"2024-03-29T04:08:11.585663+0000","last_unstale":"2024-03-29T04:08:15.299597+0000","last_undegraded":"2024-03-29T04:08:15.299597+0000","last_fullsized":"2024-03-29T04:08:15.299597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:29:57.151204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.737367+0000","last_change":"2024-03-29T04:08:12.593510+0000","last_active":"2024-03-29T04:08:13.737367+0000","last_peered":"2024-03-29T04:08:13.737367+0000","last_clean":"2024-03-29T04:08:13.737367+0000","last_became_active":"2024-03-29T04:08:12.593129+0000","last_became_peered":"2024-03-29T04:08:12.593129+0000","last_unstale":"2024-03-29T04:08:13.737367+0000","last_undegraded":"2024-03-29T04:08:13.737367+0000","last_fullsized":"2024-03-29T04:08:13.737367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T11:05:08.038425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.584229+0000","last_change":"2024-03-29T04:08:11.578269+0000","last_active":"2024-03-29T04:08:13.584229+0000","last_peered":"2024-03-29T04:08:13.584229+0000","last_clean":"2024-03-29T04:08:13.584229+0000","last_became_active":"2024-03-29T04:08:11.578014+0000","last_became_peered":"2024-03-29T04:08:11.578014+0000","last_unstale":"2024-03-29T04:08:13.584229+0000","last_undegraded":"2024-03-29T04:08:13.584229+0000","last_fullsized":"2024-03-29T04:08:13.584229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:29:57.151204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.584235+0000","last_change":"2024-03-29T04:08:12.587831+0000","last_active":"2024-03-29T04:08:13.584235+0000","last_peered":"2024-03-29T04:08:13.584235+0000","last_clean":"2024-03-29T04:08:13.584235+0000","last_became_active":"2024-03-29T04:08:12.587537+0000","last_became_peered":"2024-03-29T04:08:12.587537+0000","last_unstale":"2024-03-29T04:08:13.584235+0000","last_undegraded":"2024-03-29T04:08:13.584235+0000","last_fullsized":"2024-03-29T04:08:13.584235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T10:10:20.492063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299725+0000","last_change":"2024-03-29T04:08:11.579486+0000","last_active":"2024-03-29T04:08:15.299725+0000","last_peered":"2024-03-29T04:08:15.299725+0000","last_clean":"2024-03-29T04:08:15.299725+0000","last_became_active":"2024-03-29T04:08:11.579186+0000","last_became_peered":"2024-03-29T04:08:11.579186+0000","last_unstale":"2024-03-29T04:08:15.299725+0000","last_undegraded":"2024-03-29T04:08:15.299725+0000","last_fullsized":"2024-03-29T04:08:15.299725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T16:04:14.386764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.737201+0000","last_change":"2024-03-29T04:08:12.593018+0000","last_active":"2024-03-29T04:08:13.737201+0000","last_peered":"2024-03-29T04:08:13.737201+0000","last_clean":"2024-03-29T04:08:13.737201+0000","last_became_active":"2024-03-29T04:08:12.592716+0000","last_became_peered":"2024-03-29T04:08:12.592716+0000","last_unstale":"2024-03-29T04:08:13.737201+0000","last_undegraded":"2024-03-29T04:08:13.737201+0000","last_fullsized":"2024-03-29T04:08:13.737201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:23:42.952899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.585619+0000","last_change":"2024-03-29T04:08:11.579702+0000","last_active":"2024-03-29T04:08:13.585619+0000","last_peered":"2024-03-29T04:08:13.585619+0000","last_clean":"2024-03-29T04:08:13.585619+0000","last_became_active":"2024-03-29T04:08:11.579407+0000","last_became_peered":"2024-03-29T04:08:11.579407+0000","last_unstale":"2024-03-29T04:08:13.585619+0000","last_undegraded":"2024-03-29T04:08:13.585619+0000","last_fullsized":"2024-03-29T04:08:13.585619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:58:15.647153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.737593+0000","last_change":"2024-03-29T04:08:12.592883+0000","last_active":"2024-03-29T04:08:13.737593+0000","last_peered":"2024-03-29T04:08:13.737593+0000","last_clean":"2024-03-29T04:08:13.737593+0000","last_became_active":"2024-03-29T04:08:12.592611+0000","last_became_peered":"2024-03-29T04:08:12.592611+0000","last_unstale":"2024-03-29T04:08:13.737593+0000","last_undegraded":"2024-03-29T04:08:13.737593+0000","last_fullsized":"2024-03-29T04:08:13.737593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:15:58.105186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.300111+0000","last_change":"2024-03-29T04:08:11.581905+0000","last_active":"2024-03-29T04:08:15.300111+0000","last_peered":"2024-03-29T04:08:15.300111+0000","last_clean":"2024-03-29T04:08:15.300111+0000","last_became_active":"2024-03-29T04:08:11.581367+0000","last_became_peered":"2024-03-29T04:08:11.581367+0000","last_unstale":"2024-03-29T04:08:15.300111+0000","last_undegraded":"2024-03-29T04:08:15.300111+0000","last_fullsized":"2024-03-29T04:08:15.300111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:43:45.627953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.737722+0000","last_change":"2024-03-29T04:08:12.592388+0000","last_active":"2024-03-29T04:08:13.737722+0000","last_peered":"2024-03-29T04:08:13.737722+0000","last_clean":"2024-03-29T04:08:13.737722+0000","last_became_active":"2024-03-29T04:08:12.592126+0000","last_became_peered":"2024-03-29T04:08:12.592126+0000","last_unstale":"2024-03-29T04:08:13.737722+0000","last_undegraded":"2024-03-29T04:08:13.737722+0000","last_fullsized":"2024-03-29T04:08:13.737722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:37:09.099737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.583643+0000","last_change":"2024-03-29T04:08:11.574823+0000","last_active":"2024-03-29T04:08:13.583643+0000","last_peered":"2024-03-29T04:08:13.583643+0000","last_clean":"2024-03-29T04:08:13.583643+0000","last_became_active":"2024-03-29T04:08:11.574536+0000","last_became_peered":"2024-03-29T04:08:11.574536+0000","last_unstale":"2024-03-29T04:08:13.583643+0000","last_undegraded":"2024-03-29T04:08:13.583643+0000","last_fullsized":"2024-03-29T04:08:13.583643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:39:26.883608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299845+0000","last_change":"2024-03-29T04:08:12.595008+0000","last_active":"2024-03-29T04:08:15.299845+0000","last_peered":"2024-03-29T04:08:15.299845+0000","last_clean":"2024-03-29T04:08:15.299845+0000","last_became_active":"2024-03-29T04:08:12.594429+0000","last_became_peered":"2024-03-29T04:08:12.594429+0000","last_unstale":"2024-03-29T04:08:15.299845+0000","last_undegraded":"2024-03-29T04:08:15.299845+0000","last_fullsized":"2024-03-29T04:08:15.299845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:41:05.262468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299821+0000","last_change":"2024-03-29T04:08:11.584568+0000","last_active":"2024-03-29T04:08:15.299821+0000","last_peered":"2024-03-29T04:08:15.299821+0000","last_clean":"2024-03-29T04:08:15.299821+0000","last_became_active":"2024-03-29T04:08:11.584246+0000","last_became_peered":"2024-03-29T04:08:11.584246+0000","last_unstale":"2024-03-29T04:08:15.299821+0000","last_undegraded":"2024-03-29T04:08:15.299821+0000","last_fullsized":"2024-03-29T04:08:15.299821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T13:31:02.796965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.737400+0000","last_change":"2024-03-29T04:08:12.597064+0000","last_active":"2024-03-29T04:08:13.737400+0000","last_peered":"2024-03-29T04:08:13.737400+0000","last_clean":"2024-03-29T04:08:13.737400+0000","last_became_active":"2024-03-29T04:08:12.596790+0000","last_became_peered":"2024-03-29T04:08:12.596790+0000","last_unstale":"2024-03-29T04:08:13.737400+0000","last_undegraded":"2024-03-29T04:08:13.737400+0000","last_fullsized":"2024-03-29T04:08:13.737400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:46:49.958297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.737176+0000","last_change":"2024-03-29T04:08:01.885311+0000","last_active":"2024-03-29T04:08:13.737176+0000","last_peered":"2024-03-29T04:08:13.737176+0000","last_clean":"2024-03-29T04:08:13.737176+0000","last_became_active":"2024-03-29T04:08:01.884340+0000","last_became_peered":"2024-03-29T04:08:01.884340+0000","last_unstale":"2024-03-29T04:08:13.737176+0000","last_undegraded":"2024-03-29T04:08:13.737176+0000","last_fullsized":"2024-03-29T04:08:13.737176+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:00.511520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:00.511520+0000","last_clean_scrub_stamp":"2024-03-29T04:08:00.511520+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:40:25.245419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299419+0000","last_change":"2024-03-29T04:08:11.585258+0000","last_active":"2024-03-29T04:08:15.299419+0000","last_peered":"2024-03-29T04:08:15.299419+0000","last_clean":"2024-03-29T04:08:15.299419+0000","last_became_active":"2024-03-29T04:08:11.584935+0000","last_became_peered":"2024-03-29T04:08:11.584935+0000","last_unstale":"2024-03-29T04:08:15.299419+0000","last_undegraded":"2024-03-29T04:08:15.299419+0000","last_fullsized":"2024-03-29T04:08:15.299419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T13:31:02.796965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:14.908187+0000","last_change":"2024-03-29T04:08:12.594912+0000","last_active":"2024-03-29T04:08:14.908187+0000","last_peered":"2024-03-29T04:08:14.908187+0000","last_clean":"2024-03-29T04:08:14.908187+0000","last_became_active":"2024-03-29T04:08:12.594603+0000","last_became_peered":"2024-03-29T04:08:12.594603+0000","last_unstale":"2024-03-29T04:08:14.908187+0000","last_undegraded":"2024-03-29T04:08:14.908187+0000","last_fullsized":"2024-03-29T04:08:14.908187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:50:17.616748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.737093+0000","last_change":"2024-03-29T04:08:11.586269+0000","last_active":"2024-03-29T04:08:13.737093+0000","last_peered":"2024-03-29T04:08:13.737093+0000","last_clean":"2024-03-29T04:08:13.737093+0000","last_became_active":"2024-03-29T04:08:11.585746+0000","last_became_peered":"2024-03-29T04:08:11.585746+0000","last_unstale":"2024-03-29T04:08:13.737093+0000","last_undegraded":"2024-03-29T04:08:13.737093+0000","last_fullsized":"2024-03-29T04:08:13.737093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:29:57.151204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.300078+0000","last_change":"2024-03-29T04:08:12.590744+0000","last_active":"2024-03-29T04:08:15.300078+0000","last_peered":"2024-03-29T04:08:15.300078+0000","last_clean":"2024-03-29T04:08:15.300078+0000","last_became_active":"2024-03-29T04:08:12.590441+0000","last_became_peered":"2024-03-29T04:08:12.590441+0000","last_unstale":"2024-03-29T04:08:15.300078+0000","last_undegraded":"2024-03-29T04:08:15.300078+0000","last_fullsized":"2024-03-29T04:08:15.300078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:24:45.816098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.300303+0000","last_change":"2024-03-29T04:08:11.581639+0000","last_active":"2024-03-29T04:08:15.300303+0000","last_peered":"2024-03-29T04:08:15.300303+0000","last_clean":"2024-03-29T04:08:15.300303+0000","last_became_active":"2024-03-29T04:08:11.581291+0000","last_became_peered":"2024-03-29T04:08:11.581291+0000","last_unstale":"2024-03-29T04:08:15.300303+0000","last_undegraded":"2024-03-29T04:08:15.300303+0000","last_fullsized":"2024-03-29T04:08:15.300303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:22:23.215000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.583397+0000","last_change":"2024-03-29T04:08:12.584723+0000","last_active":"2024-03-29T04:08:13.583397+0000","last_peered":"2024-03-29T04:08:13.583397+0000","last_clean":"2024-03-29T04:08:13.583397+0000","last_became_active":"2024-03-29T04:08:12.584466+0000","last_became_peered":"2024-03-29T04:08:12.584466+0000","last_unstale":"2024-03-29T04:08:13.583397+0000","last_undegraded":"2024-03-29T04:08:13.583397+0000","last_fullsized":"2024-03-29T04:08:13.583397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T10:10:20.492063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299650+0000","last_change":"2024-03-29T04:08:11.587034+0000","last_active":"2024-03-29T04:08:15.299650+0000","last_peered":"2024-03-29T04:08:15.299650+0000","last_clean":"2024-03-29T04:08:15.299650+0000","last_became_active":"2024-03-29T04:08:11.586720+0000","last_became_peered":"2024-03-29T04:08:11.586720+0000","last_unstale":"2024-03-29T04:08:15.299650+0000","last_undegraded":"2024-03-29T04:08:15.299650+0000","last_fullsized":"2024-03-29T04:08:15.299650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:04:46.456846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.585542+0000","last_change":"2024-03-29T04:08:12.591148+0000","last_active":"2024-03-29T04:08:13.585542+0000","last_peered":"2024-03-29T04:08:13.585542+0000","last_clean":"2024-03-29T04:08:13.585542+0000","last_became_active":"2024-03-29T04:08:12.590076+0000","last_became_peered":"2024-03-29T04:08:12.590076+0000","last_unstale":"2024-03-29T04:08:13.585542+0000","last_undegraded":"2024-03-29T04:08:13.585542+0000","last_fullsized":"2024-03-29T04:08:13.585542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:29:58.161169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.583559+0000","last_change":"2024-03-29T04:08:11.582158+0000","last_active":"2024-03-29T04:08:13.583559+0000","last_peered":"2024-03-29T04:08:13.583559+0000","last_clean":"2024-03-29T04:08:13.583559+0000","last_became_active":"2024-03-29T04:08:11.581893+0000","last_became_peered":"2024-03-29T04:08:11.581893+0000","last_unstale":"2024-03-29T04:08:13.583559+0000","last_undegraded":"2024-03-29T04:08:13.583559+0000","last_fullsized":"2024-03-29T04:08:13.583559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:22:23.215000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299829+0000","last_change":"2024-03-29T04:08:12.595023+0000","last_active":"2024-03-29T04:08:15.299829+0000","last_peered":"2024-03-29T04:08:15.299829+0000","last_clean":"2024-03-29T04:08:15.299829+0000","last_became_active":"2024-03-29T04:08:12.594277+0000","last_became_peered":"2024-03-29T04:08:12.594277+0000","last_unstale":"2024-03-29T04:08:15.299829+0000","last_undegraded":"2024-03-29T04:08:15.299829+0000","last_fullsized":"2024-03-29T04:08:15.299829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:15:58.105186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.737646+0000","last_change":"2024-03-29T04:08:11.586951+0000","last_active":"2024-03-29T04:08:13.737646+0000","last_peered":"2024-03-29T04:08:13.737646+0000","last_clean":"2024-03-29T04:08:13.737646+0000","last_became_active":"2024-03-29T04:08:11.586654+0000","last_became_peered":"2024-03-29T04:08:11.586654+0000","last_unstale":"2024-03-29T04:08:13.737646+0000","last_undegraded":"2024-03-29T04:08:13.737646+0000","last_fullsized":"2024-03-29T04:08:13.737646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:46:42.482201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.583449+0000","last_change":"2024-03-29T04:08:12.584288+0000","last_active":"2024-03-29T04:08:13.583449+0000","last_peered":"2024-03-29T04:08:13.583449+0000","last_clean":"2024-03-29T04:08:13.583449+0000","last_became_active":"2024-03-29T04:08:12.584022+0000","last_became_peered":"2024-03-29T04:08:12.584022+0000","last_unstale":"2024-03-29T04:08:13.583449+0000","last_undegraded":"2024-03-29T04:08:13.583449+0000","last_fullsized":"2024-03-29T04:08:13.583449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:43:58.842293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.583617+0000","last_change":"2024-03-29T04:08:11.575033+0000","last_active":"2024-03-29T04:08:13.583617+0000","last_peered":"2024-03-29T04:08:13.583617+0000","last_clean":"2024-03-29T04:08:13.583617+0000","last_became_active":"2024-03-29T04:08:11.574736+0000","last_became_peered":"2024-03-29T04:08:11.574736+0000","last_unstale":"2024-03-29T04:08:13.583617+0000","last_undegraded":"2024-03-29T04:08:13.583617+0000","last_fullsized":"2024-03-29T04:08:13.583617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:29:57.151204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:14.908370+0000","last_change":"2024-03-29T04:08:12.592175+0000","last_active":"2024-03-29T04:08:14.908370+0000","last_peered":"2024-03-29T04:08:14.908370+0000","last_clean":"2024-03-29T04:08:14.908370+0000","last_became_active":"2024-03-29T04:08:12.591851+0000","last_became_peered":"2024-03-29T04:08:12.591851+0000","last_unstale":"2024-03-29T04:08:14.908370+0000","last_undegraded":"2024-03-29T04:08:14.908370+0000","last_fullsized":"2024-03-29T04:08:14.908370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T11:05:08.038425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.584745+0000","last_change":"2024-03-29T04:08:11.581692+0000","last_active":"2024-03-29T04:08:13.584745+0000","last_peered":"2024-03-29T04:08:13.584745+0000","last_clean":"2024-03-29T04:08:13.584745+0000","last_became_active":"2024-03-29T04:08:11.580542+0000","last_became_peered":"2024-03-29T04:08:11.580542+0000","last_unstale":"2024-03-29T04:08:13.584745+0000","last_undegraded":"2024-03-29T04:08:13.584745+0000","last_fullsized":"2024-03-29T04:08:13.584745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:22:23.215000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299959+0000","last_change":"2024-03-29T04:08:12.584745+0000","last_active":"2024-03-29T04:08:15.299959+0000","last_peered":"2024-03-29T04:08:15.299959+0000","last_clean":"2024-03-29T04:08:15.299959+0000","last_became_active":"2024-03-29T04:08:12.584417+0000","last_became_peered":"2024-03-29T04:08:12.584417+0000","last_unstale":"2024-03-29T04:08:15.299959+0000","last_undegraded":"2024-03-29T04:08:15.299959+0000","last_fullsized":"2024-03-29T04:08:15.299959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:51:30.023734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.737082+0000","last_change":"2024-03-29T04:08:11.587081+0000","last_active":"2024-03-29T04:08:13.737082+0000","last_peered":"2024-03-29T04:08:13.737082+0000","last_clean":"2024-03-29T04:08:13.737082+0000","last_became_active":"2024-03-29T04:08:11.586729+0000","last_became_peered":"2024-03-29T04:08:11.586729+0000","last_unstale":"2024-03-29T04:08:13.737082+0000","last_undegraded":"2024-03-29T04:08:13.737082+0000","last_fullsized":"2024-03-29T04:08:13.737082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:04:46.456846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.585566+0000","last_change":"2024-03-29T04:08:12.586216+0000","last_active":"2024-03-29T04:08:13.585566+0000","last_peered":"2024-03-29T04:08:13.585566+0000","last_clean":"2024-03-29T04:08:13.585566+0000","last_became_active":"2024-03-29T04:08:12.585834+0000","last_became_peered":"2024-03-29T04:08:12.585834+0000","last_unstale":"2024-03-29T04:08:13.585566+0000","last_undegraded":"2024-03-29T04:08:13.585566+0000","last_fullsized":"2024-03-29T04:08:13.585566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:04:47.466811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.583476+0000","last_change":"2024-03-29T04:08:11.580924+0000","last_active":"2024-03-29T04:08:13.583476+0000","last_peered":"2024-03-29T04:08:13.583476+0000","last_clean":"2024-03-29T04:08:13.583476+0000","last_became_active":"2024-03-29T04:08:11.580668+0000","last_became_peered":"2024-03-29T04:08:11.580668+0000","last_unstale":"2024-03-29T04:08:13.583476+0000","last_undegraded":"2024-03-29T04:08:13.583476+0000","last_fullsized":"2024-03-29T04:08:13.583476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:46:42.482201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:14.908090+0000","last_change":"2024-03-29T04:08:12.582417+0000","last_active":"2024-03-29T04:08:14.908090+0000","last_peered":"2024-03-29T04:08:14.908090+0000","last_clean":"2024-03-29T04:08:14.908090+0000","last_became_active":"2024-03-29T04:08:12.582157+0000","last_became_peered":"2024-03-29T04:08:12.582157+0000","last_unstale":"2024-03-29T04:08:14.908090+0000","last_undegraded":"2024-03-29T04:08:14.908090+0000","last_fullsized":"2024-03-29T04:08:14.908090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:43:58.842293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.583687+0000","last_change":"2024-03-29T04:08:11.579852+0000","last_active":"2024-03-29T04:08:13.583687+0000","last_peered":"2024-03-29T04:08:13.583687+0000","last_clean":"2024-03-29T04:08:13.583687+0000","last_became_active":"2024-03-29T04:08:11.579507+0000","last_became_peered":"2024-03-29T04:08:11.579507+0000","last_unstale":"2024-03-29T04:08:13.583687+0000","last_undegraded":"2024-03-29T04:08:13.583687+0000","last_fullsized":"2024-03-29T04:08:13.583687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:43:45.627953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:14.908353+0000","last_change":"2024-03-29T04:08:12.586892+0000","last_active":"2024-03-29T04:08:14.908353+0000","last_peered":"2024-03-29T04:08:14.908353+0000","last_clean":"2024-03-29T04:08:14.908353+0000","last_became_active":"2024-03-29T04:08:12.586624+0000","last_became_peered":"2024-03-29T04:08:12.586624+0000","last_unstale":"2024-03-29T04:08:14.908353+0000","last_undegraded":"2024-03-29T04:08:14.908353+0000","last_fullsized":"2024-03-29T04:08:14.908353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:23:42.952899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.737521+0000","last_change":"2024-03-29T04:08:11.583745+0000","last_active":"2024-03-29T04:08:13.737521+0000","last_peered":"2024-03-29T04:08:13.737521+0000","last_clean":"2024-03-29T04:08:13.737521+0000","last_became_active":"2024-03-29T04:08:11.583507+0000","last_became_peered":"2024-03-29T04:08:11.583507+0000","last_unstale":"2024-03-29T04:08:13.737521+0000","last_undegraded":"2024-03-29T04:08:13.737521+0000","last_fullsized":"2024-03-29T04:08:13.737521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:39:26.883608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.584255+0000","last_change":"2024-03-29T04:08:12.590902+0000","last_active":"2024-03-29T04:08:13.584255+0000","last_peered":"2024-03-29T04:08:13.584255+0000","last_clean":"2024-03-29T04:08:13.584255+0000","last_became_active":"2024-03-29T04:08:12.590480+0000","last_became_peered":"2024-03-29T04:08:12.590480+0000","last_unstale":"2024-03-29T04:08:13.584255+0000","last_undegraded":"2024-03-29T04:08:13.584255+0000","last_fullsized":"2024-03-29T04:08:13.584255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:24:45.816098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299773+0000","last_change":"2024-03-29T04:08:12.595229+0000","last_active":"2024-03-29T04:08:15.299773+0000","last_peered":"2024-03-29T04:08:15.299773+0000","last_clean":"2024-03-29T04:08:15.299773+0000","last_became_active":"2024-03-29T04:08:12.594665+0000","last_became_peered":"2024-03-29T04:08:12.594665+0000","last_unstale":"2024-03-29T04:08:15.299773+0000","last_undegraded":"2024-03-29T04:08:15.299773+0000","last_fullsized":"2024-03-29T04:08:15.299773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:56:07.686818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.737411+0000","last_change":"2024-03-29T04:08:11.587908+0000","last_active":"2024-03-29T04:08:13.737411+0000","last_peered":"2024-03-29T04:08:13.737411+0000","last_clean":"2024-03-29T04:08:13.737411+0000","last_became_active":"2024-03-29T04:08:11.587602+0000","last_became_peered":"2024-03-29T04:08:11.587602+0000","last_unstale":"2024-03-29T04:08:13.737411+0000","last_undegraded":"2024-03-29T04:08:13.737411+0000","last_fullsized":"2024-03-29T04:08:13.737411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:22:23.215000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299799+0000","last_change":"2024-03-29T04:08:12.598292+0000","last_active":"2024-03-29T04:08:15.299799+0000","last_peered":"2024-03-29T04:08:15.299799+0000","last_clean":"2024-03-29T04:08:15.299799+0000","last_became_active":"2024-03-29T04:08:12.594781+0000","last_became_peered":"2024-03-29T04:08:12.594781+0000","last_unstale":"2024-03-29T04:08:15.299799+0000","last_undegraded":"2024-03-29T04:08:15.299799+0000","last_fullsized":"2024-03-29T04:08:15.299799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:46:49.958297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.737555+0000","last_change":"2024-03-29T04:08:11.583436+0000","last_active":"2024-03-29T04:08:13.737555+0000","last_peered":"2024-03-29T04:08:13.737555+0000","last_clean":"2024-03-29T04:08:13.737555+0000","last_became_active":"2024-03-29T04:08:11.583187+0000","last_became_peered":"2024-03-29T04:08:11.583187+0000","last_unstale":"2024-03-29T04:08:13.737555+0000","last_undegraded":"2024-03-29T04:08:13.737555+0000","last_fullsized":"2024-03-29T04:08:13.737555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:25:49.705595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.300042+0000","last_change":"2024-03-29T04:08:12.591815+0000","last_active":"2024-03-29T04:08:15.300042+0000","last_peered":"2024-03-29T04:08:15.300042+0000","last_clean":"2024-03-29T04:08:15.300042+0000","last_became_active":"2024-03-29T04:08:12.590845+0000","last_became_peered":"2024-03-29T04:08:12.590845+0000","last_unstale":"2024-03-29T04:08:15.300042+0000","last_undegraded":"2024-03-29T04:08:15.300042+0000","last_fullsized":"2024-03-29T04:08:15.300042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T10:10:20.492063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:14.908445+0000","last_change":"2024-03-29T04:08:11.583808+0000","last_active":"2024-03-29T04:08:14.908445+0000","last_peered":"2024-03-29T04:08:14.908445+0000","last_clean":"2024-03-29T04:08:14.908445+0000","last_became_active":"2024-03-29T04:08:11.583401+0000","last_became_peered":"2024-03-29T04:08:11.583401+0000","last_unstale":"2024-03-29T04:08:14.908445+0000","last_undegraded":"2024-03-29T04:08:14.908445+0000","last_fullsized":"2024-03-29T04:08:14.908445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T16:04:14.386764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:14.908427+0000","last_change":"2024-03-29T04:08:12.583667+0000","last_active":"2024-03-29T04:08:14.908427+0000","last_peered":"2024-03-29T04:08:14.908427+0000","last_clean":"2024-03-29T04:08:14.908427+0000","last_became_active":"2024-03-29T04:08:12.583396+0000","last_became_peered":"2024-03-29T04:08:12.583396+0000","last_unstale":"2024-03-29T04:08:14.908427+0000","last_undegraded":"2024-03-29T04:08:14.908427+0000","last_fullsized":"2024-03-29T04:08:14.908427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:09:42.069575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.300326+0000","last_change":"2024-03-29T04:08:11.583448+0000","last_active":"2024-03-29T04:08:15.300326+0000","last_peered":"2024-03-29T04:08:15.300326+0000","last_clean":"2024-03-29T04:08:15.300326+0000","last_became_active":"2024-03-29T04:08:11.583190+0000","last_became_peered":"2024-03-29T04:08:11.583190+0000","last_unstale":"2024-03-29T04:08:15.300326+0000","last_undegraded":"2024-03-29T04:08:15.300326+0000","last_fullsized":"2024-03-29T04:08:15.300326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T16:04:14.386764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":666611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-29T04:08:18.209 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-29T04:08:18.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.366+0000 7f5e063f2640 1 Processor -- start 2024-03-29T04:08:18.346 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.366+0000 7f5e063f2640 1 -- start start 2024-03-29T04:08:18.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.367+0000 7f5e063f2640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5e0015ec60 0x7f5e000ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:18.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.367+0000 7f5e063f2640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e000cf7f0 con 0x7f5e000b4340 2024-03-29T04:08:18.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.367+0000 7f5e063f2640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e000cea70 con 0x7f5e0015e880 2024-03-29T04:08:18.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.367+0000 7f5e063f2640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f5e000cfe00 con 0x7f5e0015ec60 2024-03-29T04:08:18.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.367+0000 7f5dff7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5e0015ec60 0x7f5e000ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:18.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.367+0000 7f5e0498f640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f5e000b4340 0x7f5e000d0290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52184/0 (socket says 172.21.15.73:52184) 2024-03-29T04:08:18.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.367+0000 7f5e0498f640 1 -- 172.21.15.73:0/273238415 learned_addr learned my addr 172.21.15.73:0/273238415 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:18.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.367+0000 7f5dff7fe640 1 -- 172.21.15.73:0/273238415 >> v1:172.21.15.142:6789/0 conn(0x7f5e0015e880 legacy=0x7f5e000cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:18.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.367+0000 7f5dff7fe640 1 -- 172.21.15.73:0/273238415 >> v1:172.21.15.73:6789/0 conn(0x7f5e000b4340 legacy=0x7f5e000d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:18.348 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.367+0000 7f5dff7fe640 1 -- 172.21.15.73:0/273238415 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e000ced50 con 0x7f5e0015ec60 2024-03-29T04:08:18.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.368+0000 7f5dff7fe640 1 --2- 172.21.15.73:0/273238415 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e0015ec60 0x7f5e000ce450 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5df40097a0 tx=0x7f5df402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7d2ff34fb989da8 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:18.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.368+0000 7f5dfeffd640 1 -- 172.21.15.73:0/273238415 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df4034070 con 0x7f5e0015ec60 2024-03-29T04:08:18.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.368+0000 7f5dfeffd640 1 -- 172.21.15.73:0/273238415 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5df4030610 con 0x7f5e0015ec60 2024-03-29T04:08:18.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.368+0000 7f5dfeffd640 1 -- 172.21.15.73:0/273238415 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df40309e0 con 0x7f5e0015ec60 2024-03-29T04:08:18.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.369+0000 7f5e063f2640 1 -- 172.21.15.73:0/273238415 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e0015ec60 msgr2=0x7f5e000ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:18.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.369+0000 7f5e063f2640 1 --2- 172.21.15.73:0/273238415 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e0015ec60 0x7f5e000ce450 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5df40097a0 tx=0x7f5df402b960 comp rx=0 tx=0).stop 2024-03-29T04:08:18.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.369+0000 7f5e063f2640 1 -- 172.21.15.73:0/273238415 shutdown_connections 2024-03-29T04:08:18.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.369+0000 7f5e063f2640 1 --2- 172.21.15.73:0/273238415 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e0015ec60 0x7f5e000ce450 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:18.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.369+0000 7f5e063f2640 1 -- 172.21.15.73:0/273238415 >> 172.21.15.73:0/273238415 conn(0x7f5e000b6860 msgr2=0x7f5e000b6c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:18.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.369+0000 7f5e063f2640 1 -- 172.21.15.73:0/273238415 shutdown_connections 2024-03-29T04:08:18.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.369+0000 7f5e063f2640 1 -- 172.21.15.73:0/273238415 wait complete. 2024-03-29T04:08:18.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.370+0000 7f5e063f2640 1 Processor -- start 2024-03-29T04:08:18.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.370+0000 7f5e063f2640 1 -- start start 2024-03-29T04:08:18.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.371+0000 7f5e063f2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e000b4340 0x7f5e0014dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:18.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.371+0000 7f5e063f2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e0015e880 0x7f5e001605d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:18.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.371+0000 7f5e063f2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e0015ec60 0x7f5e00152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:18.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.371+0000 7f5e063f2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5e000d1b30 con 0x7f5e000b4340 2024-03-29T04:08:18.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.371+0000 7f5e063f2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5e000d19b0 con 0x7f5e0015e880 2024-03-29T04:08:18.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.371+0000 7f5e063f2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f5e00169580 con 0x7f5e0015ec60 2024-03-29T04:08:18.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.371+0000 7f5dfffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e000b4340 0x7f5e0014dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:18.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.371+0000 7f5dfffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e000b4340 0x7f5e0014dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42326/0 (socket says 172.21.15.73:42326) 2024-03-29T04:08:18.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.371+0000 7f5dfffff640 1 -- 172.21.15.73:0/671943232 learned_addr learned my addr 172.21.15.73:0/671943232 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:18.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.371+0000 7f5e0498f640 1 --2- 172.21.15.73:0/671943232 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e0015ec60 0x7f5e00152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:18.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.371+0000 7f5dff7fe640 1 --2- 172.21.15.73:0/671943232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e0015e880 0x7f5e001605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:18.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.371+0000 7f5dfffff640 1 -- 172.21.15.73:0/671943232 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e0015ec60 msgr2=0x7f5e00152840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:18.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.371+0000 7f5dfffff640 1 --2- 172.21.15.73:0/671943232 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e0015ec60 0x7f5e00152840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:18.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.371+0000 7f5dfffff640 1 -- 172.21.15.73:0/671943232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e0015e880 msgr2=0x7f5e001605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:18.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.371+0000 7f5dfffff640 1 --2- 172.21.15.73:0/671943232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e0015e880 0x7f5e001605d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:18.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.371+0000 7f5dfffff640 1 -- 172.21.15.73:0/671943232 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e00161000 con 0x7f5e000b4340 2024-03-29T04:08:18.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.371+0000 7f5dfffff640 1 --2- 172.21.15.73:0/671943232 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e000b4340 0x7f5e0014dc20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5df000c400 tx=0x7f5df000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:18.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.371+0000 7f5dfcff9640 1 -- 172.21.15.73:0/671943232 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df00052d0 con 0x7f5e000b4340 2024-03-29T04:08:18.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.372+0000 7f5dfcff9640 1 -- 172.21.15.73:0/671943232 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5df0005490 con 0x7f5e000b4340 2024-03-29T04:08:18.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.372+0000 7f5e063f2640 1 -- 172.21.15.73:0/671943232 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e001612e0 con 0x7f5e000b4340 2024-03-29T04:08:18.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.372+0000 7f5dfcff9640 1 -- 172.21.15.73:0/671943232 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df0007260 con 0x7f5e000b4340 2024-03-29T04:08:18.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.372+0000 7f5e063f2640 1 -- 172.21.15.73:0/671943232 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e001618a0 con 0x7f5e000b4340 2024-03-29T04:08:18.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.373+0000 7f5e063f2640 1 -- 172.21.15.73:0/671943232 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e00068640 con 0x7f5e000b4340 2024-03-29T04:08:18.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.373+0000 7f5dfcff9640 1 -- 172.21.15.73:0/671943232 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f5df0007400 con 0x7f5e000b4340 2024-03-29T04:08:18.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.373+0000 7f5dfcff9640 1 --2- 172.21.15.73:0/671943232 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f5dec06c530 0x7f5dec06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:18.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.373+0000 7f5dfcff9640 1 -- 172.21.15.73:0/671943232 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5df008ac40 con 0x7f5e000b4340 2024-03-29T04:08:18.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.373+0000 7f5dff7fe640 1 --2- 172.21.15.73:0/671943232 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f5dec06c530 0x7f5dec06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:18.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.374+0000 7f5dff7fe640 1 --2- 172.21.15.73:0/671943232 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f5dec06c530 0x7f5dec06e9f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5df4036000 tx=0x7f5df403b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:18.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.378+0000 7f5dfcff9640 1 -- 172.21.15.73:0/671943232 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f5df0058b80 con 0x7f5e000b4340 2024-03-29T04:08:18.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.550+0000 7f5e063f2640 1 -- 172.21.15.73:0/671943232 --> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5e000b1e90 con 0x7f5dec06c530 2024-03-29T04:08:18.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.556+0000 7f5dfcff9640 1 -- 172.21.15.73:0/671943232 <== mgr.4104 v2:172.21.15.73:6832/1640471941 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251860 (secure 0 0 0) 0x7f5e000b1e90 con 0x7f5dec06c530 2024-03-29T04:08:18.539 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:18.540 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-29T04:08:18.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.559+0000 7f5e063f2640 1 -- 172.21.15.73:0/671943232 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f5dec06c530 msgr2=0x7f5dec06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:18.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.559+0000 7f5e063f2640 1 --2- 172.21.15.73:0/671943232 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f5dec06c530 0x7f5dec06e9f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5df4036000 tx=0x7f5df403b040 comp rx=0 tx=0).stop 2024-03-29T04:08:18.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.559+0000 7f5e063f2640 1 -- 172.21.15.73:0/671943232 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e000b4340 msgr2=0x7f5e0014dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:18.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.559+0000 7f5e063f2640 1 --2- 172.21.15.73:0/671943232 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e000b4340 0x7f5e0014dc20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5df000c400 tx=0x7f5df000c8c0 comp rx=0 tx=0).stop 2024-03-29T04:08:18.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.559+0000 7f5e063f2640 1 -- 172.21.15.73:0/671943232 shutdown_connections 2024-03-29T04:08:18.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.559+0000 7f5e063f2640 1 --2- 172.21.15.73:0/671943232 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5e0015ec60 0x7f5e00152840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:18.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.559+0000 7f5e063f2640 1 --2- 172.21.15.73:0/671943232 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f5dec06c530 0x7f5dec06e9f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:18.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.559+0000 7f5e063f2640 1 --2- 172.21.15.73:0/671943232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e0015e880 0x7f5e001605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:18.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.559+0000 7f5e063f2640 1 --2- 172.21.15.73:0/671943232 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e000b4340 0x7f5e0014dc20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:18.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.559+0000 7f5e063f2640 1 -- 172.21.15.73:0/671943232 >> 172.21.15.73:0/671943232 conn(0x7f5e000b6860 msgr2=0x7f5e0006e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:18.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.560+0000 7f5e063f2640 1 -- 172.21.15.73:0/671943232 shutdown_connections 2024-03-29T04:08:18.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.560+0000 7f5e063f2640 1 -- 172.21.15.73:0/671943232 wait complete. 2024-03-29T04:08:18.550 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-03-29T04:08:17.523678+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":181,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219096,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755624,"statfs":{"total":773094113280,"available":772869758976,"internally_reserved":0,"allocated":2990080,"data_stored":1790396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001148"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.737637+0000","last_change":"2024-03-29T04:08:12.587912+0000","last_active":"2024-03-29T04:08:13.737637+0000","last_peered":"2024-03-29T04:08:13.737637+0000","last_clean":"2024-03-29T04:08:13.737637+0000","last_became_active":"2024-03-29T04:08:12.587593+0000","last_became_peered":"2024-03-29T04:08:12.587593+0000","last_unstale":"2024-03-29T04:08:13.737637+0000","last_undegraded":"2024-03-29T04:08:13.737637+0000","last_fullsized":"2024-03-29T04:08:13.737637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:41:05.262468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.583588+0000","last_change":"2024-03-29T04:08:12.582178+0000","last_active":"2024-03-29T04:08:13.583588+0000","last_peered":"2024-03-29T04:08:13.583588+0000","last_clean":"2024-03-29T04:08:13.583588+0000","last_became_active":"2024-03-29T04:08:12.581920+0000","last_became_peered":"2024-03-29T04:08:12.581920+0000","last_unstale":"2024-03-29T04:08:13.583588+0000","last_undegraded":"2024-03-29T04:08:13.583588+0000","last_fullsized":"2024-03-29T04:08:13.583588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:50:17.616748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299855+0000","last_change":"2024-03-29T04:08:12.584079+0000","last_active":"2024-03-29T04:08:15.299855+0000","last_peered":"2024-03-29T04:08:15.299855+0000","last_clean":"2024-03-29T04:08:15.299855+0000","last_became_active":"2024-03-29T04:08:12.583240+0000","last_became_peered":"2024-03-29T04:08:12.583240+0000","last_unstale":"2024-03-29T04:08:15.299855+0000","last_undegraded":"2024-03-29T04:08:15.299855+0000","last_fullsized":"2024-03-29T04:08:15.299855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:44:46.187079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299689+0000","last_change":"2024-03-29T04:08:12.595090+0000","last_active":"2024-03-29T04:08:15.299689+0000","last_peered":"2024-03-29T04:08:15.299689+0000","last_clean":"2024-03-29T04:08:15.299689+0000","last_became_active":"2024-03-29T04:08:12.594477+0000","last_became_peered":"2024-03-29T04:08:12.594477+0000","last_unstale":"2024-03-29T04:08:15.299689+0000","last_undegraded":"2024-03-29T04:08:15.299689+0000","last_fullsized":"2024-03-29T04:08:15.299689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:09:42.069575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.737392+0000","last_change":"2024-03-29T04:08:12.595546+0000","last_active":"2024-03-29T04:08:13.737392+0000","last_peered":"2024-03-29T04:08:13.737392+0000","last_clean":"2024-03-29T04:08:13.737392+0000","last_became_active":"2024-03-29T04:08:12.595270+0000","last_became_peered":"2024-03-29T04:08:12.595270+0000","last_unstale":"2024-03-29T04:08:13.737392+0000","last_undegraded":"2024-03-29T04:08:13.737392+0000","last_fullsized":"2024-03-29T04:08:13.737392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:09:42.069575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299409+0000","last_change":"2024-03-29T04:08:12.598973+0000","last_active":"2024-03-29T04:08:15.299409+0000","last_peered":"2024-03-29T04:08:15.299409+0000","last_clean":"2024-03-29T04:08:15.299409+0000","last_became_active":"2024-03-29T04:08:12.598463+0000","last_became_peered":"2024-03-29T04:08:12.598463+0000","last_unstale":"2024-03-29T04:08:15.299409+0000","last_undegraded":"2024-03-29T04:08:15.299409+0000","last_fullsized":"2024-03-29T04:08:15.299409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T13:00:12.842920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.737198+0000","last_change":"2024-03-29T04:08:12.590636+0000","last_active":"2024-03-29T04:08:13.737198+0000","last_peered":"2024-03-29T04:08:13.737198+0000","last_clean":"2024-03-29T04:08:13.737198+0000","last_became_active":"2024-03-29T04:08:12.590365+0000","last_became_peered":"2024-03-29T04:08:12.590365+0000","last_unstale":"2024-03-29T04:08:13.737198+0000","last_undegraded":"2024-03-29T04:08:13.737198+0000","last_fullsized":"2024-03-29T04:08:13.737198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:45:14.018822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:14.907931+0000","last_change":"2024-03-29T04:08:12.594929+0000","last_active":"2024-03-29T04:08:14.907931+0000","last_peered":"2024-03-29T04:08:14.907931+0000","last_clean":"2024-03-29T04:08:14.907931+0000","last_became_active":"2024-03-29T04:08:12.594646+0000","last_became_peered":"2024-03-29T04:08:12.594646+0000","last_unstale":"2024-03-29T04:08:14.907931+0000","last_undegraded":"2024-03-29T04:08:14.907931+0000","last_fullsized":"2024-03-29T04:08:14.907931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:51:30.023734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.737677+0000","last_change":"2024-03-29T04:08:12.597651+0000","last_active":"2024-03-29T04:08:13.737677+0000","last_peered":"2024-03-29T04:08:13.737677+0000","last_clean":"2024-03-29T04:08:13.737677+0000","last_became_active":"2024-03-29T04:08:12.597389+0000","last_became_peered":"2024-03-29T04:08:12.597389+0000","last_unstale":"2024-03-29T04:08:13.737677+0000","last_undegraded":"2024-03-29T04:08:13.737677+0000","last_fullsized":"2024-03-29T04:08:13.737677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:40:21.785851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.585221+0000","last_change":"2024-03-29T04:08:12.588278+0000","last_active":"2024-03-29T04:08:13.585221+0000","last_peered":"2024-03-29T04:08:13.585221+0000","last_clean":"2024-03-29T04:08:13.585221+0000","last_became_active":"2024-03-29T04:08:12.587891+0000","last_became_peered":"2024-03-29T04:08:12.587891+0000","last_unstale":"2024-03-29T04:08:13.585221+0000","last_undegraded":"2024-03-29T04:08:13.585221+0000","last_fullsized":"2024-03-29T04:08:13.585221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T13:00:12.842920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.584536+0000","last_change":"2024-03-29T04:08:12.590703+0000","last_active":"2024-03-29T04:08:13.584536+0000","last_peered":"2024-03-29T04:08:13.584536+0000","last_clean":"2024-03-29T04:08:13.584536+0000","last_became_active":"2024-03-29T04:08:12.590420+0000","last_became_peered":"2024-03-29T04:08:12.590420+0000","last_unstale":"2024-03-29T04:08:13.584536+0000","last_undegraded":"2024-03-29T04:08:13.584536+0000","last_fullsized":"2024-03-29T04:08:13.584536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:50:17.616748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.585994+0000","last_change":"2024-03-29T04:08:12.587297+0000","last_active":"2024-03-29T04:08:13.585994+0000","last_peered":"2024-03-29T04:08:13.585994+0000","last_clean":"2024-03-29T04:08:13.585994+0000","last_became_active":"2024-03-29T04:08:12.587036+0000","last_became_peered":"2024-03-29T04:08:12.587036+0000","last_unstale":"2024-03-29T04:08:13.585994+0000","last_undegraded":"2024-03-29T04:08:13.585994+0000","last_fullsized":"2024-03-29T04:08:13.585994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:46:43.492166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:14.908212+0000","last_change":"2024-03-29T04:08:12.580578+0000","last_active":"2024-03-29T04:08:14.908212+0000","last_peered":"2024-03-29T04:08:14.908212+0000","last_clean":"2024-03-29T04:08:14.908212+0000","last_became_active":"2024-03-29T04:08:12.580335+0000","last_became_peered":"2024-03-29T04:08:12.580335+0000","last_unstale":"2024-03-29T04:08:14.908212+0000","last_undegraded":"2024-03-29T04:08:14.908212+0000","last_fullsized":"2024-03-29T04:08:14.908212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T13:00:12.842920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299804+0000","last_change":"2024-03-29T04:08:12.584573+0000","last_active":"2024-03-29T04:08:15.299804+0000","last_peered":"2024-03-29T04:08:15.299804+0000","last_clean":"2024-03-29T04:08:15.299804+0000","last_became_active":"2024-03-29T04:08:12.584294+0000","last_became_peered":"2024-03-29T04:08:12.584294+0000","last_unstale":"2024-03-29T04:08:15.299804+0000","last_undegraded":"2024-03-29T04:08:15.299804+0000","last_fullsized":"2024-03-29T04:08:15.299804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:47:13.560160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.583614+0000","last_change":"2024-03-29T04:08:12.588885+0000","last_active":"2024-03-29T04:08:13.583614+0000","last_peered":"2024-03-29T04:08:13.583614+0000","last_clean":"2024-03-29T04:08:13.583614+0000","last_became_active":"2024-03-29T04:08:12.588581+0000","last_became_peered":"2024-03-29T04:08:12.588581+0000","last_unstale":"2024-03-29T04:08:13.583614+0000","last_undegraded":"2024-03-29T04:08:13.583614+0000","last_fullsized":"2024-03-29T04:08:13.583614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T13:00:12.842920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299347+0000","last_change":"2024-03-29T04:08:12.595787+0000","last_active":"2024-03-29T04:08:15.299347+0000","last_peered":"2024-03-29T04:08:15.299347+0000","last_clean":"2024-03-29T04:08:15.299347+0000","last_became_active":"2024-03-29T04:08:12.595403+0000","last_became_peered":"2024-03-29T04:08:12.595403+0000","last_unstale":"2024-03-29T04:08:15.299347+0000","last_undegraded":"2024-03-29T04:08:15.299347+0000","last_fullsized":"2024-03-29T04:08:15.299347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:50:17.616748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299914+0000","last_change":"2024-03-29T04:08:12.598647+0000","last_active":"2024-03-29T04:08:15.299914+0000","last_peered":"2024-03-29T04:08:15.299914+0000","last_clean":"2024-03-29T04:08:15.299914+0000","last_became_active":"2024-03-29T04:08:12.597742+0000","last_became_peered":"2024-03-29T04:08:12.597742+0000","last_unstale":"2024-03-29T04:08:15.299914+0000","last_undegraded":"2024-03-29T04:08:15.299914+0000","last_fullsized":"2024-03-29T04:08:15.299914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T10:36:55.055976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.300025+0000","last_change":"2024-03-29T04:08:12.583931+0000","last_active":"2024-03-29T04:08:15.300025+0000","last_peered":"2024-03-29T04:08:15.300025+0000","last_clean":"2024-03-29T04:08:15.300025+0000","last_became_active":"2024-03-29T04:08:12.583644+0000","last_became_peered":"2024-03-29T04:08:12.583644+0000","last_unstale":"2024-03-29T04:08:15.300025+0000","last_undegraded":"2024-03-29T04:08:15.300025+0000","last_fullsized":"2024-03-29T04:08:15.300025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:39:27.893573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.737641+0000","last_change":"2024-03-29T04:08:12.596215+0000","last_active":"2024-03-29T04:08:13.737641+0000","last_peered":"2024-03-29T04:08:13.737641+0000","last_clean":"2024-03-29T04:08:13.737641+0000","last_became_active":"2024-03-29T04:08:12.595946+0000","last_became_peered":"2024-03-29T04:08:12.595946+0000","last_unstale":"2024-03-29T04:08:13.737641+0000","last_undegraded":"2024-03-29T04:08:13.737641+0000","last_fullsized":"2024-03-29T04:08:13.737641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T10:36:55.055976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.584363+0000","last_change":"2024-03-29T04:08:12.591240+0000","last_active":"2024-03-29T04:08:13.584363+0000","last_peered":"2024-03-29T04:08:13.584363+0000","last_clean":"2024-03-29T04:08:13.584363+0000","last_became_active":"2024-03-29T04:08:12.590916+0000","last_became_peered":"2024-03-29T04:08:12.590916+0000","last_unstale":"2024-03-29T04:08:13.584363+0000","last_undegraded":"2024-03-29T04:08:13.584363+0000","last_fullsized":"2024-03-29T04:08:13.584363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:43:58.842293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.300241+0000","last_change":"2024-03-29T04:08:12.591775+0000","last_active":"2024-03-29T04:08:15.300241+0000","last_peered":"2024-03-29T04:08:15.300241+0000","last_clean":"2024-03-29T04:08:15.300241+0000","last_became_active":"2024-03-29T04:08:12.591502+0000","last_became_peered":"2024-03-29T04:08:12.591502+0000","last_unstale":"2024-03-29T04:08:15.300241+0000","last_undegraded":"2024-03-29T04:08:15.300241+0000","last_fullsized":"2024-03-29T04:08:15.300241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:50:17.616748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299508+0000","last_change":"2024-03-29T04:08:12.598535+0000","last_active":"2024-03-29T04:08:15.299508+0000","last_peered":"2024-03-29T04:08:15.299508+0000","last_clean":"2024-03-29T04:08:15.299508+0000","last_became_active":"2024-03-29T04:08:12.594745+0000","last_became_peered":"2024-03-29T04:08:12.594745+0000","last_unstale":"2024-03-29T04:08:15.299508+0000","last_undegraded":"2024-03-29T04:08:15.299508+0000","last_fullsized":"2024-03-29T04:08:15.299508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:45:14.018822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:14.908014+0000","last_change":"2024-03-29T04:08:12.588823+0000","last_active":"2024-03-29T04:08:14.908014+0000","last_peered":"2024-03-29T04:08:14.908014+0000","last_clean":"2024-03-29T04:08:14.908014+0000","last_became_active":"2024-03-29T04:08:12.588560+0000","last_became_peered":"2024-03-29T04:08:12.588560+0000","last_unstale":"2024-03-29T04:08:14.908014+0000","last_undegraded":"2024-03-29T04:08:14.908014+0000","last_fullsized":"2024-03-29T04:08:14.908014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T10:10:20.492063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299433+0000","last_change":"2024-03-29T04:08:12.598196+0000","last_active":"2024-03-29T04:08:15.299433+0000","last_peered":"2024-03-29T04:08:15.299433+0000","last_clean":"2024-03-29T04:08:15.299433+0000","last_became_active":"2024-03-29T04:08:12.594199+0000","last_became_peered":"2024-03-29T04:08:12.594199+0000","last_unstale":"2024-03-29T04:08:15.299433+0000","last_undegraded":"2024-03-29T04:08:15.299433+0000","last_fullsized":"2024-03-29T04:08:15.299433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:55:07.377171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:14.908282+0000","last_change":"2024-03-29T04:08:12.588950+0000","last_active":"2024-03-29T04:08:14.908282+0000","last_peered":"2024-03-29T04:08:14.908282+0000","last_clean":"2024-03-29T04:08:14.908282+0000","last_became_active":"2024-03-29T04:08:12.588659+0000","last_became_peered":"2024-03-29T04:08:12.588659+0000","last_unstale":"2024-03-29T04:08:14.908282+0000","last_undegraded":"2024-03-29T04:08:14.908282+0000","last_fullsized":"2024-03-29T04:08:14.908282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:55:07.377171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.585376+0000","last_change":"2024-03-29T04:08:12.589789+0000","last_active":"2024-03-29T04:08:13.585376+0000","last_peered":"2024-03-29T04:08:13.585376+0000","last_clean":"2024-03-29T04:08:13.585376+0000","last_became_active":"2024-03-29T04:08:12.587505+0000","last_became_peered":"2024-03-29T04:08:12.587505+0000","last_unstale":"2024-03-29T04:08:13.585376+0000","last_undegraded":"2024-03-29T04:08:13.585376+0000","last_fullsized":"2024-03-29T04:08:13.585376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:55:07.377171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.583427+0000","last_change":"2024-03-29T04:08:12.582545+0000","last_active":"2024-03-29T04:08:13.583427+0000","last_peered":"2024-03-29T04:08:13.583427+0000","last_clean":"2024-03-29T04:08:13.583427+0000","last_became_active":"2024-03-29T04:08:12.582268+0000","last_became_peered":"2024-03-29T04:08:12.582268+0000","last_unstale":"2024-03-29T04:08:13.583427+0000","last_undegraded":"2024-03-29T04:08:13.583427+0000","last_fullsized":"2024-03-29T04:08:13.583427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:24:45.816098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:14.908319+0000","last_change":"2024-03-29T04:08:12.589186+0000","last_active":"2024-03-29T04:08:14.908319+0000","last_peered":"2024-03-29T04:08:14.908319+0000","last_clean":"2024-03-29T04:08:14.908319+0000","last_became_active":"2024-03-29T04:08:12.588882+0000","last_became_peered":"2024-03-29T04:08:12.588882+0000","last_unstale":"2024-03-29T04:08:14.908319+0000","last_undegraded":"2024-03-29T04:08:14.908319+0000","last_fullsized":"2024-03-29T04:08:14.908319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:45:14.018822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.300381+0000","last_change":"2024-03-29T04:08:12.584300+0000","last_active":"2024-03-29T04:08:15.300381+0000","last_peered":"2024-03-29T04:08:15.300381+0000","last_clean":"2024-03-29T04:08:15.300381+0000","last_became_active":"2024-03-29T04:08:12.583925+0000","last_became_peered":"2024-03-29T04:08:12.583925+0000","last_unstale":"2024-03-29T04:08:15.300381+0000","last_undegraded":"2024-03-29T04:08:15.300381+0000","last_fullsized":"2024-03-29T04:08:15.300381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T13:00:12.842920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299551+0000","last_change":"2024-03-29T04:08:12.593957+0000","last_active":"2024-03-29T04:08:15.299551+0000","last_peered":"2024-03-29T04:08:15.299551+0000","last_clean":"2024-03-29T04:08:15.299551+0000","last_became_active":"2024-03-29T04:08:12.593694+0000","last_became_peered":"2024-03-29T04:08:12.593694+0000","last_unstale":"2024-03-29T04:08:15.299551+0000","last_undegraded":"2024-03-29T04:08:15.299551+0000","last_fullsized":"2024-03-29T04:08:15.299551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:23:42.952899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.300313+0000","last_change":"2024-03-29T04:08:12.587534+0000","last_active":"2024-03-29T04:08:15.300313+0000","last_peered":"2024-03-29T04:08:15.300313+0000","last_clean":"2024-03-29T04:08:15.300313+0000","last_became_active":"2024-03-29T04:08:12.587244+0000","last_became_peered":"2024-03-29T04:08:12.587244+0000","last_unstale":"2024-03-29T04:08:15.300313+0000","last_undegraded":"2024-03-29T04:08:15.300313+0000","last_fullsized":"2024-03-29T04:08:15.300313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:46:43.492166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.584165+0000","last_change":"2024-03-29T04:08:12.588798+0000","last_active":"2024-03-29T04:08:13.584165+0000","last_peered":"2024-03-29T04:08:13.584165+0000","last_clean":"2024-03-29T04:08:13.584165+0000","last_became_active":"2024-03-29T04:08:12.588526+0000","last_became_peered":"2024-03-29T04:08:12.588526+0000","last_unstale":"2024-03-29T04:08:13.584165+0000","last_undegraded":"2024-03-29T04:08:13.584165+0000","last_fullsized":"2024-03-29T04:08:13.584165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:51:30.023734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.585743+0000","last_change":"2024-03-29T04:08:12.586895+0000","last_active":"2024-03-29T04:08:13.585743+0000","last_peered":"2024-03-29T04:08:13.585743+0000","last_clean":"2024-03-29T04:08:13.585743+0000","last_became_active":"2024-03-29T04:08:12.586616+0000","last_became_peered":"2024-03-29T04:08:12.586616+0000","last_unstale":"2024-03-29T04:08:13.585743+0000","last_undegraded":"2024-03-29T04:08:13.585743+0000","last_fullsized":"2024-03-29T04:08:13.585743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:39:27.893573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:14.908364+0000","last_change":"2024-03-29T04:08:11.581036+0000","last_active":"2024-03-29T04:08:14.908364+0000","last_peered":"2024-03-29T04:08:14.908364+0000","last_clean":"2024-03-29T04:08:14.908364+0000","last_became_active":"2024-03-29T04:08:11.580771+0000","last_became_peered":"2024-03-29T04:08:11.580771+0000","last_unstale":"2024-03-29T04:08:14.908364+0000","last_undegraded":"2024-03-29T04:08:14.908364+0000","last_fullsized":"2024-03-29T04:08:14.908364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T13:31:02.796965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.300444+0000","last_change":"2024-03-29T04:08:12.591216+0000","last_active":"2024-03-29T04:08:15.300444+0000","last_peered":"2024-03-29T04:08:15.300444+0000","last_clean":"2024-03-29T04:08:15.300444+0000","last_became_active":"2024-03-29T04:08:12.590900+0000","last_became_peered":"2024-03-29T04:08:12.590900+0000","last_unstale":"2024-03-29T04:08:15.300444+0000","last_undegraded":"2024-03-29T04:08:15.300444+0000","last_fullsized":"2024-03-29T04:08:15.300444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:55:07.377171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.584792+0000","last_change":"2024-03-29T04:08:11.578220+0000","last_active":"2024-03-29T04:08:13.584792+0000","last_peered":"2024-03-29T04:08:13.584792+0000","last_clean":"2024-03-29T04:08:13.584792+0000","last_became_active":"2024-03-29T04:08:11.577710+0000","last_became_peered":"2024-03-29T04:08:11.577710+0000","last_unstale":"2024-03-29T04:08:13.584792+0000","last_undegraded":"2024-03-29T04:08:13.584792+0000","last_fullsized":"2024-03-29T04:08:13.584792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:04:46.456846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:14.907996+0000","last_change":"2024-03-29T04:08:11.579579+0000","last_active":"2024-03-29T04:08:14.907996+0000","last_peered":"2024-03-29T04:08:14.907996+0000","last_clean":"2024-03-29T04:08:14.907996+0000","last_became_active":"2024-03-29T04:08:11.578445+0000","last_became_peered":"2024-03-29T04:08:11.578445+0000","last_unstale":"2024-03-29T04:08:14.907996+0000","last_undegraded":"2024-03-29T04:08:14.907996+0000","last_fullsized":"2024-03-29T04:08:14.907996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T10:32:34.230140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:14.908005+0000","last_change":"2024-03-29T04:08:12.587465+0000","last_active":"2024-03-29T04:08:14.908005+0000","last_peered":"2024-03-29T04:08:14.908005+0000","last_clean":"2024-03-29T04:08:14.908005+0000","last_became_active":"2024-03-29T04:08:12.587202+0000","last_became_peered":"2024-03-29T04:08:12.587202+0000","last_unstale":"2024-03-29T04:08:14.908005+0000","last_undegraded":"2024-03-29T04:08:14.908005+0000","last_fullsized":"2024-03-29T04:08:14.908005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:24:45.816098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299460+0000","last_change":"2024-03-29T04:08:11.584446+0000","last_active":"2024-03-29T04:08:15.299460+0000","last_peered":"2024-03-29T04:08:15.299460+0000","last_clean":"2024-03-29T04:08:15.299460+0000","last_became_active":"2024-03-29T04:08:11.584105+0000","last_became_peered":"2024-03-29T04:08:11.584105+0000","last_unstale":"2024-03-29T04:08:15.299460+0000","last_undegraded":"2024-03-29T04:08:15.299460+0000","last_fullsized":"2024-03-29T04:08:15.299460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:22:23.215000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.583377+0000","last_change":"2024-03-29T04:08:12.580898+0000","last_active":"2024-03-29T04:08:13.583377+0000","last_peered":"2024-03-29T04:08:13.583377+0000","last_clean":"2024-03-29T04:08:13.583377+0000","last_became_active":"2024-03-29T04:08:12.580579+0000","last_became_peered":"2024-03-29T04:08:12.580579+0000","last_unstale":"2024-03-29T04:08:13.583377+0000","last_undegraded":"2024-03-29T04:08:13.583377+0000","last_fullsized":"2024-03-29T04:08:13.583377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:51:30.023734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.584658+0000","last_change":"2024-03-29T04:08:11.584262+0000","last_active":"2024-03-29T04:08:13.584658+0000","last_peered":"2024-03-29T04:08:13.584658+0000","last_clean":"2024-03-29T04:08:13.584658+0000","last_became_active":"2024-03-29T04:08:11.583668+0000","last_became_peered":"2024-03-29T04:08:11.583668+0000","last_unstale":"2024-03-29T04:08:13.584658+0000","last_undegraded":"2024-03-29T04:08:13.584658+0000","last_fullsized":"2024-03-29T04:08:13.584658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:43:45.627953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299642+0000","last_change":"2024-03-29T04:08:12.595602+0000","last_active":"2024-03-29T04:08:15.299642+0000","last_peered":"2024-03-29T04:08:15.299642+0000","last_clean":"2024-03-29T04:08:15.299642+0000","last_became_active":"2024-03-29T04:08:12.595332+0000","last_became_peered":"2024-03-29T04:08:12.595332+0000","last_unstale":"2024-03-29T04:08:15.299642+0000","last_undegraded":"2024-03-29T04:08:15.299642+0000","last_fullsized":"2024-03-29T04:08:15.299642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T11:05:08.038425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299696+0000","last_change":"2024-03-29T04:08:11.586122+0000","last_active":"2024-03-29T04:08:15.299696+0000","last_peered":"2024-03-29T04:08:15.299696+0000","last_clean":"2024-03-29T04:08:15.299696+0000","last_became_active":"2024-03-29T04:08:11.585845+0000","last_became_peered":"2024-03-29T04:08:11.585845+0000","last_unstale":"2024-03-29T04:08:15.299696+0000","last_undegraded":"2024-03-29T04:08:15.299696+0000","last_fullsized":"2024-03-29T04:08:15.299696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:43:45.627953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.300176+0000","last_change":"2024-03-29T04:08:12.591051+0000","last_active":"2024-03-29T04:08:15.300176+0000","last_peered":"2024-03-29T04:08:15.300176+0000","last_clean":"2024-03-29T04:08:15.300176+0000","last_became_active":"2024-03-29T04:08:12.590728+0000","last_became_peered":"2024-03-29T04:08:12.590728+0000","last_unstale":"2024-03-29T04:08:15.300176+0000","last_undegraded":"2024-03-29T04:08:15.300176+0000","last_fullsized":"2024-03-29T04:08:15.300176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:43:58.842293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.583699+0000","last_change":"2024-03-29T04:08:11.583944+0000","last_active":"2024-03-29T04:08:13.583699+0000","last_peered":"2024-03-29T04:08:13.583699+0000","last_clean":"2024-03-29T04:08:13.583699+0000","last_became_active":"2024-03-29T04:08:11.583666+0000","last_became_peered":"2024-03-29T04:08:11.583666+0000","last_unstale":"2024-03-29T04:08:13.583699+0000","last_undegraded":"2024-03-29T04:08:13.583699+0000","last_fullsized":"2024-03-29T04:08:13.583699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:04:46.456846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.586034+0000","last_change":"2024-03-29T04:08:12.590849+0000","last_active":"2024-03-29T04:08:13.586034+0000","last_peered":"2024-03-29T04:08:13.586034+0000","last_clean":"2024-03-29T04:08:13.586034+0000","last_became_active":"2024-03-29T04:08:12.590510+0000","last_became_peered":"2024-03-29T04:08:12.590510+0000","last_unstale":"2024-03-29T04:08:13.586034+0000","last_undegraded":"2024-03-29T04:08:13.586034+0000","last_fullsized":"2024-03-29T04:08:13.586034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:25:50.715560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.584472+0000","last_change":"2024-03-29T04:08:11.579283+0000","last_active":"2024-03-29T04:08:13.584472+0000","last_peered":"2024-03-29T04:08:13.584472+0000","last_clean":"2024-03-29T04:08:13.584472+0000","last_became_active":"2024-03-29T04:08:11.578990+0000","last_became_peered":"2024-03-29T04:08:11.578990+0000","last_unstale":"2024-03-29T04:08:13.584472+0000","last_undegraded":"2024-03-29T04:08:13.584472+0000","last_fullsized":"2024-03-29T04:08:13.584472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T13:31:02.796965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.737424+0000","last_change":"2024-03-29T04:08:12.586665+0000","last_active":"2024-03-29T04:08:13.737424+0000","last_peered":"2024-03-29T04:08:13.737424+0000","last_clean":"2024-03-29T04:08:13.737424+0000","last_became_active":"2024-03-29T04:08:12.586394+0000","last_became_peered":"2024-03-29T04:08:12.586394+0000","last_unstale":"2024-03-29T04:08:13.737424+0000","last_undegraded":"2024-03-29T04:08:13.737424+0000","last_fullsized":"2024-03-29T04:08:13.737424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:56:07.686818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.300443+0000","last_change":"2024-03-29T04:08:11.581071+0000","last_active":"2024-03-29T04:08:15.300443+0000","last_peered":"2024-03-29T04:08:15.300443+0000","last_clean":"2024-03-29T04:08:15.300443+0000","last_became_active":"2024-03-29T04:08:11.580803+0000","last_became_peered":"2024-03-29T04:08:11.580803+0000","last_unstale":"2024-03-29T04:08:15.300443+0000","last_undegraded":"2024-03-29T04:08:15.300443+0000","last_fullsized":"2024-03-29T04:08:15.300443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T10:32:34.230140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299913+0000","last_change":"2024-03-29T04:08:12.591431+0000","last_active":"2024-03-29T04:08:15.299913+0000","last_peered":"2024-03-29T04:08:15.299913+0000","last_clean":"2024-03-29T04:08:15.299913+0000","last_became_active":"2024-03-29T04:08:12.591158+0000","last_became_peered":"2024-03-29T04:08:12.591158+0000","last_unstale":"2024-03-29T04:08:15.299913+0000","last_undegraded":"2024-03-29T04:08:15.299913+0000","last_fullsized":"2024-03-29T04:08:15.299913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:23:55.560819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299597+0000","last_change":"2024-03-29T04:08:11.585963+0000","last_active":"2024-03-29T04:08:15.299597+0000","last_peered":"2024-03-29T04:08:15.299597+0000","last_clean":"2024-03-29T04:08:15.299597+0000","last_became_active":"2024-03-29T04:08:11.585663+0000","last_became_peered":"2024-03-29T04:08:11.585663+0000","last_unstale":"2024-03-29T04:08:15.299597+0000","last_undegraded":"2024-03-29T04:08:15.299597+0000","last_fullsized":"2024-03-29T04:08:15.299597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:29:57.151204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.737367+0000","last_change":"2024-03-29T04:08:12.593510+0000","last_active":"2024-03-29T04:08:13.737367+0000","last_peered":"2024-03-29T04:08:13.737367+0000","last_clean":"2024-03-29T04:08:13.737367+0000","last_became_active":"2024-03-29T04:08:12.593129+0000","last_became_peered":"2024-03-29T04:08:12.593129+0000","last_unstale":"2024-03-29T04:08:13.737367+0000","last_undegraded":"2024-03-29T04:08:13.737367+0000","last_fullsized":"2024-03-29T04:08:13.737367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T11:05:08.038425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.584229+0000","last_change":"2024-03-29T04:08:11.578269+0000","last_active":"2024-03-29T04:08:13.584229+0000","last_peered":"2024-03-29T04:08:13.584229+0000","last_clean":"2024-03-29T04:08:13.584229+0000","last_became_active":"2024-03-29T04:08:11.578014+0000","last_became_peered":"2024-03-29T04:08:11.578014+0000","last_unstale":"2024-03-29T04:08:13.584229+0000","last_undegraded":"2024-03-29T04:08:13.584229+0000","last_fullsized":"2024-03-29T04:08:13.584229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:29:57.151204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.584235+0000","last_change":"2024-03-29T04:08:12.587831+0000","last_active":"2024-03-29T04:08:13.584235+0000","last_peered":"2024-03-29T04:08:13.584235+0000","last_clean":"2024-03-29T04:08:13.584235+0000","last_became_active":"2024-03-29T04:08:12.587537+0000","last_became_peered":"2024-03-29T04:08:12.587537+0000","last_unstale":"2024-03-29T04:08:13.584235+0000","last_undegraded":"2024-03-29T04:08:13.584235+0000","last_fullsized":"2024-03-29T04:08:13.584235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T10:10:20.492063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299725+0000","last_change":"2024-03-29T04:08:11.579486+0000","last_active":"2024-03-29T04:08:15.299725+0000","last_peered":"2024-03-29T04:08:15.299725+0000","last_clean":"2024-03-29T04:08:15.299725+0000","last_became_active":"2024-03-29T04:08:11.579186+0000","last_became_peered":"2024-03-29T04:08:11.579186+0000","last_unstale":"2024-03-29T04:08:15.299725+0000","last_undegraded":"2024-03-29T04:08:15.299725+0000","last_fullsized":"2024-03-29T04:08:15.299725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T16:04:14.386764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.737201+0000","last_change":"2024-03-29T04:08:12.593018+0000","last_active":"2024-03-29T04:08:13.737201+0000","last_peered":"2024-03-29T04:08:13.737201+0000","last_clean":"2024-03-29T04:08:13.737201+0000","last_became_active":"2024-03-29T04:08:12.592716+0000","last_became_peered":"2024-03-29T04:08:12.592716+0000","last_unstale":"2024-03-29T04:08:13.737201+0000","last_undegraded":"2024-03-29T04:08:13.737201+0000","last_fullsized":"2024-03-29T04:08:13.737201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:23:42.952899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.585619+0000","last_change":"2024-03-29T04:08:11.579702+0000","last_active":"2024-03-29T04:08:13.585619+0000","last_peered":"2024-03-29T04:08:13.585619+0000","last_clean":"2024-03-29T04:08:13.585619+0000","last_became_active":"2024-03-29T04:08:11.579407+0000","last_became_peered":"2024-03-29T04:08:11.579407+0000","last_unstale":"2024-03-29T04:08:13.585619+0000","last_undegraded":"2024-03-29T04:08:13.585619+0000","last_fullsized":"2024-03-29T04:08:13.585619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:58:15.647153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.737593+0000","last_change":"2024-03-29T04:08:12.592883+0000","last_active":"2024-03-29T04:08:13.737593+0000","last_peered":"2024-03-29T04:08:13.737593+0000","last_clean":"2024-03-29T04:08:13.737593+0000","last_became_active":"2024-03-29T04:08:12.592611+0000","last_became_peered":"2024-03-29T04:08:12.592611+0000","last_unstale":"2024-03-29T04:08:13.737593+0000","last_undegraded":"2024-03-29T04:08:13.737593+0000","last_fullsized":"2024-03-29T04:08:13.737593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:15:58.105186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.300111+0000","last_change":"2024-03-29T04:08:11.581905+0000","last_active":"2024-03-29T04:08:15.300111+0000","last_peered":"2024-03-29T04:08:15.300111+0000","last_clean":"2024-03-29T04:08:15.300111+0000","last_became_active":"2024-03-29T04:08:11.581367+0000","last_became_peered":"2024-03-29T04:08:11.581367+0000","last_unstale":"2024-03-29T04:08:15.300111+0000","last_undegraded":"2024-03-29T04:08:15.300111+0000","last_fullsized":"2024-03-29T04:08:15.300111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:43:45.627953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.737722+0000","last_change":"2024-03-29T04:08:12.592388+0000","last_active":"2024-03-29T04:08:13.737722+0000","last_peered":"2024-03-29T04:08:13.737722+0000","last_clean":"2024-03-29T04:08:13.737722+0000","last_became_active":"2024-03-29T04:08:12.592126+0000","last_became_peered":"2024-03-29T04:08:12.592126+0000","last_unstale":"2024-03-29T04:08:13.737722+0000","last_undegraded":"2024-03-29T04:08:13.737722+0000","last_fullsized":"2024-03-29T04:08:13.737722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:37:09.099737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.583643+0000","last_change":"2024-03-29T04:08:11.574823+0000","last_active":"2024-03-29T04:08:13.583643+0000","last_peered":"2024-03-29T04:08:13.583643+0000","last_clean":"2024-03-29T04:08:13.583643+0000","last_became_active":"2024-03-29T04:08:11.574536+0000","last_became_peered":"2024-03-29T04:08:11.574536+0000","last_unstale":"2024-03-29T04:08:13.583643+0000","last_undegraded":"2024-03-29T04:08:13.583643+0000","last_fullsized":"2024-03-29T04:08:13.583643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:39:26.883608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299845+0000","last_change":"2024-03-29T04:08:12.595008+0000","last_active":"2024-03-29T04:08:15.299845+0000","last_peered":"2024-03-29T04:08:15.299845+0000","last_clean":"2024-03-29T04:08:15.299845+0000","last_became_active":"2024-03-29T04:08:12.594429+0000","last_became_peered":"2024-03-29T04:08:12.594429+0000","last_unstale":"2024-03-29T04:08:15.299845+0000","last_undegraded":"2024-03-29T04:08:15.299845+0000","last_fullsized":"2024-03-29T04:08:15.299845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:41:05.262468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299821+0000","last_change":"2024-03-29T04:08:11.584568+0000","last_active":"2024-03-29T04:08:15.299821+0000","last_peered":"2024-03-29T04:08:15.299821+0000","last_clean":"2024-03-29T04:08:15.299821+0000","last_became_active":"2024-03-29T04:08:11.584246+0000","last_became_peered":"2024-03-29T04:08:11.584246+0000","last_unstale":"2024-03-29T04:08:15.299821+0000","last_undegraded":"2024-03-29T04:08:15.299821+0000","last_fullsized":"2024-03-29T04:08:15.299821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T13:31:02.796965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.737400+0000","last_change":"2024-03-29T04:08:12.597064+0000","last_active":"2024-03-29T04:08:13.737400+0000","last_peered":"2024-03-29T04:08:13.737400+0000","last_clean":"2024-03-29T04:08:13.737400+0000","last_became_active":"2024-03-29T04:08:12.596790+0000","last_became_peered":"2024-03-29T04:08:12.596790+0000","last_unstale":"2024-03-29T04:08:13.737400+0000","last_undegraded":"2024-03-29T04:08:13.737400+0000","last_fullsized":"2024-03-29T04:08:13.737400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:46:49.958297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.737176+0000","last_change":"2024-03-29T04:08:01.885311+0000","last_active":"2024-03-29T04:08:13.737176+0000","last_peered":"2024-03-29T04:08:13.737176+0000","last_clean":"2024-03-29T04:08:13.737176+0000","last_became_active":"2024-03-29T04:08:01.884340+0000","last_became_peered":"2024-03-29T04:08:01.884340+0000","last_unstale":"2024-03-29T04:08:13.737176+0000","last_undegraded":"2024-03-29T04:08:13.737176+0000","last_fullsized":"2024-03-29T04:08:13.737176+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:00.511520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:00.511520+0000","last_clean_scrub_stamp":"2024-03-29T04:08:00.511520+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:40:25.245419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299419+0000","last_change":"2024-03-29T04:08:11.585258+0000","last_active":"2024-03-29T04:08:15.299419+0000","last_peered":"2024-03-29T04:08:15.299419+0000","last_clean":"2024-03-29T04:08:15.299419+0000","last_became_active":"2024-03-29T04:08:11.584935+0000","last_became_peered":"2024-03-29T04:08:11.584935+0000","last_unstale":"2024-03-29T04:08:15.299419+0000","last_undegraded":"2024-03-29T04:08:15.299419+0000","last_fullsized":"2024-03-29T04:08:15.299419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T13:31:02.796965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:14.908187+0000","last_change":"2024-03-29T04:08:12.594912+0000","last_active":"2024-03-29T04:08:14.908187+0000","last_peered":"2024-03-29T04:08:14.908187+0000","last_clean":"2024-03-29T04:08:14.908187+0000","last_became_active":"2024-03-29T04:08:12.594603+0000","last_became_peered":"2024-03-29T04:08:12.594603+0000","last_unstale":"2024-03-29T04:08:14.908187+0000","last_undegraded":"2024-03-29T04:08:14.908187+0000","last_fullsized":"2024-03-29T04:08:14.908187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:50:17.616748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.737093+0000","last_change":"2024-03-29T04:08:11.586269+0000","last_active":"2024-03-29T04:08:13.737093+0000","last_peered":"2024-03-29T04:08:13.737093+0000","last_clean":"2024-03-29T04:08:13.737093+0000","last_became_active":"2024-03-29T04:08:11.585746+0000","last_became_peered":"2024-03-29T04:08:11.585746+0000","last_unstale":"2024-03-29T04:08:13.737093+0000","last_undegraded":"2024-03-29T04:08:13.737093+0000","last_fullsized":"2024-03-29T04:08:13.737093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:29:57.151204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.300078+0000","last_change":"2024-03-29T04:08:12.590744+0000","last_active":"2024-03-29T04:08:15.300078+0000","last_peered":"2024-03-29T04:08:15.300078+0000","last_clean":"2024-03-29T04:08:15.300078+0000","last_became_active":"2024-03-29T04:08:12.590441+0000","last_became_peered":"2024-03-29T04:08:12.590441+0000","last_unstale":"2024-03-29T04:08:15.300078+0000","last_undegraded":"2024-03-29T04:08:15.300078+0000","last_fullsized":"2024-03-29T04:08:15.300078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:24:45.816098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.300303+0000","last_change":"2024-03-29T04:08:11.581639+0000","last_active":"2024-03-29T04:08:15.300303+0000","last_peered":"2024-03-29T04:08:15.300303+0000","last_clean":"2024-03-29T04:08:15.300303+0000","last_became_active":"2024-03-29T04:08:11.581291+0000","last_became_peered":"2024-03-29T04:08:11.581291+0000","last_unstale":"2024-03-29T04:08:15.300303+0000","last_undegraded":"2024-03-29T04:08:15.300303+0000","last_fullsized":"2024-03-29T04:08:15.300303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:22:23.215000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.583397+0000","last_change":"2024-03-29T04:08:12.584723+0000","last_active":"2024-03-29T04:08:13.583397+0000","last_peered":"2024-03-29T04:08:13.583397+0000","last_clean":"2024-03-29T04:08:13.583397+0000","last_became_active":"2024-03-29T04:08:12.584466+0000","last_became_peered":"2024-03-29T04:08:12.584466+0000","last_unstale":"2024-03-29T04:08:13.583397+0000","last_undegraded":"2024-03-29T04:08:13.583397+0000","last_fullsized":"2024-03-29T04:08:13.583397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T10:10:20.492063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299650+0000","last_change":"2024-03-29T04:08:11.587034+0000","last_active":"2024-03-29T04:08:15.299650+0000","last_peered":"2024-03-29T04:08:15.299650+0000","last_clean":"2024-03-29T04:08:15.299650+0000","last_became_active":"2024-03-29T04:08:11.586720+0000","last_became_peered":"2024-03-29T04:08:11.586720+0000","last_unstale":"2024-03-29T04:08:15.299650+0000","last_undegraded":"2024-03-29T04:08:15.299650+0000","last_fullsized":"2024-03-29T04:08:15.299650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:04:46.456846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.585542+0000","last_change":"2024-03-29T04:08:12.591148+0000","last_active":"2024-03-29T04:08:13.585542+0000","last_peered":"2024-03-29T04:08:13.585542+0000","last_clean":"2024-03-29T04:08:13.585542+0000","last_became_active":"2024-03-29T04:08:12.590076+0000","last_became_peered":"2024-03-29T04:08:12.590076+0000","last_unstale":"2024-03-29T04:08:13.585542+0000","last_undegraded":"2024-03-29T04:08:13.585542+0000","last_fullsized":"2024-03-29T04:08:13.585542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:29:58.161169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.583559+0000","last_change":"2024-03-29T04:08:11.582158+0000","last_active":"2024-03-29T04:08:13.583559+0000","last_peered":"2024-03-29T04:08:13.583559+0000","last_clean":"2024-03-29T04:08:13.583559+0000","last_became_active":"2024-03-29T04:08:11.581893+0000","last_became_peered":"2024-03-29T04:08:11.581893+0000","last_unstale":"2024-03-29T04:08:13.583559+0000","last_undegraded":"2024-03-29T04:08:13.583559+0000","last_fullsized":"2024-03-29T04:08:13.583559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:22:23.215000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299829+0000","last_change":"2024-03-29T04:08:12.595023+0000","last_active":"2024-03-29T04:08:15.299829+0000","last_peered":"2024-03-29T04:08:15.299829+0000","last_clean":"2024-03-29T04:08:15.299829+0000","last_became_active":"2024-03-29T04:08:12.594277+0000","last_became_peered":"2024-03-29T04:08:12.594277+0000","last_unstale":"2024-03-29T04:08:15.299829+0000","last_undegraded":"2024-03-29T04:08:15.299829+0000","last_fullsized":"2024-03-29T04:08:15.299829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:15:58.105186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.737646+0000","last_change":"2024-03-29T04:08:11.586951+0000","last_active":"2024-03-29T04:08:13.737646+0000","last_peered":"2024-03-29T04:08:13.737646+0000","last_clean":"2024-03-29T04:08:13.737646+0000","last_became_active":"2024-03-29T04:08:11.586654+0000","last_became_peered":"2024-03-29T04:08:11.586654+0000","last_unstale":"2024-03-29T04:08:13.737646+0000","last_undegraded":"2024-03-29T04:08:13.737646+0000","last_fullsized":"2024-03-29T04:08:13.737646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:46:42.482201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.583449+0000","last_change":"2024-03-29T04:08:12.584288+0000","last_active":"2024-03-29T04:08:13.583449+0000","last_peered":"2024-03-29T04:08:13.583449+0000","last_clean":"2024-03-29T04:08:13.583449+0000","last_became_active":"2024-03-29T04:08:12.584022+0000","last_became_peered":"2024-03-29T04:08:12.584022+0000","last_unstale":"2024-03-29T04:08:13.583449+0000","last_undegraded":"2024-03-29T04:08:13.583449+0000","last_fullsized":"2024-03-29T04:08:13.583449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:43:58.842293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.583617+0000","last_change":"2024-03-29T04:08:11.575033+0000","last_active":"2024-03-29T04:08:13.583617+0000","last_peered":"2024-03-29T04:08:13.583617+0000","last_clean":"2024-03-29T04:08:13.583617+0000","last_became_active":"2024-03-29T04:08:11.574736+0000","last_became_peered":"2024-03-29T04:08:11.574736+0000","last_unstale":"2024-03-29T04:08:13.583617+0000","last_undegraded":"2024-03-29T04:08:13.583617+0000","last_fullsized":"2024-03-29T04:08:13.583617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:29:57.151204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:14.908370+0000","last_change":"2024-03-29T04:08:12.592175+0000","last_active":"2024-03-29T04:08:14.908370+0000","last_peered":"2024-03-29T04:08:14.908370+0000","last_clean":"2024-03-29T04:08:14.908370+0000","last_became_active":"2024-03-29T04:08:12.591851+0000","last_became_peered":"2024-03-29T04:08:12.591851+0000","last_unstale":"2024-03-29T04:08:14.908370+0000","last_undegraded":"2024-03-29T04:08:14.908370+0000","last_fullsized":"2024-03-29T04:08:14.908370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T11:05:08.038425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.584745+0000","last_change":"2024-03-29T04:08:11.581692+0000","last_active":"2024-03-29T04:08:13.584745+0000","last_peered":"2024-03-29T04:08:13.584745+0000","last_clean":"2024-03-29T04:08:13.584745+0000","last_became_active":"2024-03-29T04:08:11.580542+0000","last_became_peered":"2024-03-29T04:08:11.580542+0000","last_unstale":"2024-03-29T04:08:13.584745+0000","last_undegraded":"2024-03-29T04:08:13.584745+0000","last_fullsized":"2024-03-29T04:08:13.584745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:22:23.215000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299959+0000","last_change":"2024-03-29T04:08:12.584745+0000","last_active":"2024-03-29T04:08:15.299959+0000","last_peered":"2024-03-29T04:08:15.299959+0000","last_clean":"2024-03-29T04:08:15.299959+0000","last_became_active":"2024-03-29T04:08:12.584417+0000","last_became_peered":"2024-03-29T04:08:12.584417+0000","last_unstale":"2024-03-29T04:08:15.299959+0000","last_undegraded":"2024-03-29T04:08:15.299959+0000","last_fullsized":"2024-03-29T04:08:15.299959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:51:30.023734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.737082+0000","last_change":"2024-03-29T04:08:11.587081+0000","last_active":"2024-03-29T04:08:13.737082+0000","last_peered":"2024-03-29T04:08:13.737082+0000","last_clean":"2024-03-29T04:08:13.737082+0000","last_became_active":"2024-03-29T04:08:11.586729+0000","last_became_peered":"2024-03-29T04:08:11.586729+0000","last_unstale":"2024-03-29T04:08:13.737082+0000","last_undegraded":"2024-03-29T04:08:13.737082+0000","last_fullsized":"2024-03-29T04:08:13.737082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:04:46.456846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.585566+0000","last_change":"2024-03-29T04:08:12.586216+0000","last_active":"2024-03-29T04:08:13.585566+0000","last_peered":"2024-03-29T04:08:13.585566+0000","last_clean":"2024-03-29T04:08:13.585566+0000","last_became_active":"2024-03-29T04:08:12.585834+0000","last_became_peered":"2024-03-29T04:08:12.585834+0000","last_unstale":"2024-03-29T04:08:13.585566+0000","last_undegraded":"2024-03-29T04:08:13.585566+0000","last_fullsized":"2024-03-29T04:08:13.585566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:04:47.466811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.583476+0000","last_change":"2024-03-29T04:08:11.580924+0000","last_active":"2024-03-29T04:08:13.583476+0000","last_peered":"2024-03-29T04:08:13.583476+0000","last_clean":"2024-03-29T04:08:13.583476+0000","last_became_active":"2024-03-29T04:08:11.580668+0000","last_became_peered":"2024-03-29T04:08:11.580668+0000","last_unstale":"2024-03-29T04:08:13.583476+0000","last_undegraded":"2024-03-29T04:08:13.583476+0000","last_fullsized":"2024-03-29T04:08:13.583476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:46:42.482201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:14.908090+0000","last_change":"2024-03-29T04:08:12.582417+0000","last_active":"2024-03-29T04:08:14.908090+0000","last_peered":"2024-03-29T04:08:14.908090+0000","last_clean":"2024-03-29T04:08:14.908090+0000","last_became_active":"2024-03-29T04:08:12.582157+0000","last_became_peered":"2024-03-29T04:08:12.582157+0000","last_unstale":"2024-03-29T04:08:14.908090+0000","last_undegraded":"2024-03-29T04:08:14.908090+0000","last_fullsized":"2024-03-29T04:08:14.908090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:43:58.842293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.583687+0000","last_change":"2024-03-29T04:08:11.579852+0000","last_active":"2024-03-29T04:08:13.583687+0000","last_peered":"2024-03-29T04:08:13.583687+0000","last_clean":"2024-03-29T04:08:13.583687+0000","last_became_active":"2024-03-29T04:08:11.579507+0000","last_became_peered":"2024-03-29T04:08:11.579507+0000","last_unstale":"2024-03-29T04:08:13.583687+0000","last_undegraded":"2024-03-29T04:08:13.583687+0000","last_fullsized":"2024-03-29T04:08:13.583687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:43:45.627953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:14.908353+0000","last_change":"2024-03-29T04:08:12.586892+0000","last_active":"2024-03-29T04:08:14.908353+0000","last_peered":"2024-03-29T04:08:14.908353+0000","last_clean":"2024-03-29T04:08:14.908353+0000","last_became_active":"2024-03-29T04:08:12.586624+0000","last_became_peered":"2024-03-29T04:08:12.586624+0000","last_unstale":"2024-03-29T04:08:14.908353+0000","last_undegraded":"2024-03-29T04:08:14.908353+0000","last_fullsized":"2024-03-29T04:08:14.908353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:23:42.952899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.737521+0000","last_change":"2024-03-29T04:08:11.583745+0000","last_active":"2024-03-29T04:08:13.737521+0000","last_peered":"2024-03-29T04:08:13.737521+0000","last_clean":"2024-03-29T04:08:13.737521+0000","last_became_active":"2024-03-29T04:08:11.583507+0000","last_became_peered":"2024-03-29T04:08:11.583507+0000","last_unstale":"2024-03-29T04:08:13.737521+0000","last_undegraded":"2024-03-29T04:08:13.737521+0000","last_fullsized":"2024-03-29T04:08:13.737521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:39:26.883608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.584255+0000","last_change":"2024-03-29T04:08:12.590902+0000","last_active":"2024-03-29T04:08:13.584255+0000","last_peered":"2024-03-29T04:08:13.584255+0000","last_clean":"2024-03-29T04:08:13.584255+0000","last_became_active":"2024-03-29T04:08:12.590480+0000","last_became_peered":"2024-03-29T04:08:12.590480+0000","last_unstale":"2024-03-29T04:08:13.584255+0000","last_undegraded":"2024-03-29T04:08:13.584255+0000","last_fullsized":"2024-03-29T04:08:13.584255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:24:45.816098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299773+0000","last_change":"2024-03-29T04:08:12.595229+0000","last_active":"2024-03-29T04:08:15.299773+0000","last_peered":"2024-03-29T04:08:15.299773+0000","last_clean":"2024-03-29T04:08:15.299773+0000","last_became_active":"2024-03-29T04:08:12.594665+0000","last_became_peered":"2024-03-29T04:08:12.594665+0000","last_unstale":"2024-03-29T04:08:15.299773+0000","last_undegraded":"2024-03-29T04:08:15.299773+0000","last_fullsized":"2024-03-29T04:08:15.299773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:56:07.686818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.737411+0000","last_change":"2024-03-29T04:08:11.587908+0000","last_active":"2024-03-29T04:08:13.737411+0000","last_peered":"2024-03-29T04:08:13.737411+0000","last_clean":"2024-03-29T04:08:13.737411+0000","last_became_active":"2024-03-29T04:08:11.587602+0000","last_became_peered":"2024-03-29T04:08:11.587602+0000","last_unstale":"2024-03-29T04:08:13.737411+0000","last_undegraded":"2024-03-29T04:08:13.737411+0000","last_fullsized":"2024-03-29T04:08:13.737411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:22:23.215000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.299799+0000","last_change":"2024-03-29T04:08:12.598292+0000","last_active":"2024-03-29T04:08:15.299799+0000","last_peered":"2024-03-29T04:08:15.299799+0000","last_clean":"2024-03-29T04:08:15.299799+0000","last_became_active":"2024-03-29T04:08:12.594781+0000","last_became_peered":"2024-03-29T04:08:12.594781+0000","last_unstale":"2024-03-29T04:08:15.299799+0000","last_undegraded":"2024-03-29T04:08:15.299799+0000","last_fullsized":"2024-03-29T04:08:15.299799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:46:49.958297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:13.737555+0000","last_change":"2024-03-29T04:08:11.583436+0000","last_active":"2024-03-29T04:08:13.737555+0000","last_peered":"2024-03-29T04:08:13.737555+0000","last_clean":"2024-03-29T04:08:13.737555+0000","last_became_active":"2024-03-29T04:08:11.583187+0000","last_became_peered":"2024-03-29T04:08:11.583187+0000","last_unstale":"2024-03-29T04:08:13.737555+0000","last_undegraded":"2024-03-29T04:08:13.737555+0000","last_fullsized":"2024-03-29T04:08:13.737555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:25:49.705595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.300042+0000","last_change":"2024-03-29T04:08:12.591815+0000","last_active":"2024-03-29T04:08:15.300042+0000","last_peered":"2024-03-29T04:08:15.300042+0000","last_clean":"2024-03-29T04:08:15.300042+0000","last_became_active":"2024-03-29T04:08:12.590845+0000","last_became_peered":"2024-03-29T04:08:12.590845+0000","last_unstale":"2024-03-29T04:08:15.300042+0000","last_undegraded":"2024-03-29T04:08:15.300042+0000","last_fullsized":"2024-03-29T04:08:15.300042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T10:10:20.492063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:14.908445+0000","last_change":"2024-03-29T04:08:11.583808+0000","last_active":"2024-03-29T04:08:14.908445+0000","last_peered":"2024-03-29T04:08:14.908445+0000","last_clean":"2024-03-29T04:08:14.908445+0000","last_became_active":"2024-03-29T04:08:11.583401+0000","last_became_peered":"2024-03-29T04:08:11.583401+0000","last_unstale":"2024-03-29T04:08:14.908445+0000","last_undegraded":"2024-03-29T04:08:14.908445+0000","last_fullsized":"2024-03-29T04:08:14.908445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T16:04:14.386764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:14.908427+0000","last_change":"2024-03-29T04:08:12.583667+0000","last_active":"2024-03-29T04:08:14.908427+0000","last_peered":"2024-03-29T04:08:14.908427+0000","last_clean":"2024-03-29T04:08:14.908427+0000","last_became_active":"2024-03-29T04:08:12.583396+0000","last_became_peered":"2024-03-29T04:08:12.583396+0000","last_unstale":"2024-03-29T04:08:14.908427+0000","last_undegraded":"2024-03-29T04:08:14.908427+0000","last_fullsized":"2024-03-29T04:08:14.908427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:11.559439+0000","last_clean_scrub_stamp":"2024-03-29T04:08:11.559439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:09:42.069575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-29T04:08:15.300326+0000","last_change":"2024-03-29T04:08:11.583448+0000","last_active":"2024-03-29T04:08:15.300326+0000","last_peered":"2024-03-29T04:08:15.300326+0000","last_clean":"2024-03-29T04:08:15.300326+0000","last_became_active":"2024-03-29T04:08:11.583190+0000","last_became_peered":"2024-03-29T04:08:11.583190+0000","last_unstale":"2024-03-29T04:08:15.300326+0000","last_undegraded":"2024-03-29T04:08:15.300326+0000","last_fullsized":"2024-03-29T04:08:15.300326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:10.549474+0000","last_clean_scrub_stamp":"2024-03-29T04:08:10.549474+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T16:04:14.386764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":666611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-29T04:08:18.553 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-29T04:08:18.554 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-29T04:08:18.554 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-29T04:08:18.554 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-29T04:08:18.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.710+0000 7f7cea8d9640 1 Processor -- start 2024-03-29T04:08:18.699 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.710+0000 7f7cea8d9640 1 -- start start 2024-03-29T04:08:18.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.711+0000 7f7cea8d9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ce40d2f50 0x7f7ce4162330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:18.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.711+0000 7f7cea8d9640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ce415ec40 con 0x7f7ce415e860 2024-03-29T04:08:18.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.711+0000 7f7cea8d9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ce40d15d0 con 0x7f7ce40d10d0 2024-03-29T04:08:18.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.711+0000 7f7cea8d9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7ce4070140 con 0x7f7ce40d2f50 2024-03-29T04:08:18.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.711+0000 7f7ce3fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7ce415e860 0x7f7ce40705d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52192/0 (socket says 172.21.15.73:52192) 2024-03-29T04:08:18.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.711+0000 7f7ce3fff640 1 -- 172.21.15.73:0/144269558 learned_addr learned my addr 172.21.15.73:0/144269558 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:18.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.711+0000 7f7ce8e76640 1 --2- 172.21.15.73:0/144269558 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ce40d2f50 0x7f7ce4162330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:18.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.711+0000 7f7ce2ffd640 1 -- 172.21.15.73:0/144269558 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4256597543 0 0) 0x7f7ce415ec40 con 0x7f7ce415e860 2024-03-29T04:08:18.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.711+0000 7f7ce2ffd640 1 -- 172.21.15.73:0/144269558 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ccc003520 con 0x7f7ce415e860 2024-03-29T04:08:18.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.711+0000 7f7ce2ffd640 1 -- 172.21.15.73:0/144269558 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1937636005 0 0) 0x7f7ce40d15d0 con 0x7f7ce40d10d0 2024-03-29T04:08:18.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.711+0000 7f7ce2ffd640 1 -- 172.21.15.73:0/144269558 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ce415ec40 con 0x7f7ce40d10d0 2024-03-29T04:08:18.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.711+0000 7f7ce8e76640 1 -- 172.21.15.73:0/144269558 >> v1:172.21.15.142:6789/0 conn(0x7f7ce40d10d0 legacy=0x7f7ce40cca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:18.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.711+0000 7f7ce8e76640 1 -- 172.21.15.73:0/144269558 >> v1:172.21.15.73:6789/0 conn(0x7f7ce415e860 legacy=0x7f7ce40705d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:18.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.711+0000 7f7ce8e76640 1 -- 172.21.15.73:0/144269558 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ce40d18b0 con 0x7f7ce40d2f50 2024-03-29T04:08:18.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.712+0000 7f7ce8e76640 1 --2- 172.21.15.73:0/144269558 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ce40d2f50 0x7f7ce4162330 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc009dc0 tx=0x7f7cdc02bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d948067a2a25fe47 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:18.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.712+0000 7f7ce2ffd640 1 -- 172.21.15.73:0/144269558 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cdc039070 con 0x7f7ce40d2f50 2024-03-29T04:08:18.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.712+0000 7f7ce2ffd640 1 -- 172.21.15.73:0/144269558 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cdc02ccd0 con 0x7f7ce40d2f50 2024-03-29T04:08:18.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.712+0000 7f7ce2ffd640 1 -- 172.21.15.73:0/144269558 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cdc034660 con 0x7f7ce40d2f50 2024-03-29T04:08:18.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.713+0000 7f7cea8d9640 1 -- 172.21.15.73:0/144269558 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ce40d2f50 msgr2=0x7f7ce4162330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:18.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.713+0000 7f7cea8d9640 1 --2- 172.21.15.73:0/144269558 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ce40d2f50 0x7f7ce4162330 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc009dc0 tx=0x7f7cdc02bf20 comp rx=0 tx=0).stop 2024-03-29T04:08:18.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.713+0000 7f7cea8d9640 1 -- 172.21.15.73:0/144269558 shutdown_connections 2024-03-29T04:08:18.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.713+0000 7f7cea8d9640 1 --2- 172.21.15.73:0/144269558 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ce40d2f50 0x7f7ce4162330 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:18.702 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.713+0000 7f7cea8d9640 1 -- 172.21.15.73:0/144269558 >> 172.21.15.73:0/144269558 conn(0x7f7ce40d2430 msgr2=0x7f7ce40d2840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:18.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.713+0000 7f7cea8d9640 1 -- 172.21.15.73:0/144269558 shutdown_connections 2024-03-29T04:08:18.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.713+0000 7f7cea8d9640 1 -- 172.21.15.73:0/144269558 wait complete. 2024-03-29T04:08:18.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.714+0000 7f7cea8d9640 1 Processor -- start 2024-03-29T04:08:18.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.714+0000 7f7cea8d9640 1 -- start start 2024-03-29T04:08:18.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.715+0000 7f7cea8d9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ce40d10d0 0x7f7ce41620e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:18.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.715+0000 7f7cea8d9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ce40d2f50 0x7f7ce4158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:18.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.715+0000 7f7cea8d9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ce415e860 0x7f7ce40b0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:18.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.715+0000 7f7cea8d9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce4163090 con 0x7f7ce40d10d0 2024-03-29T04:08:18.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.715+0000 7f7cea8d9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce406fdd0 con 0x7f7ce40d2f50 2024-03-29T04:08:18.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.715+0000 7f7cea8d9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7ce4070ce0 con 0x7f7ce415e860 2024-03-29T04:08:18.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.715+0000 7f7ce3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ce40d10d0 0x7f7ce41620e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:18.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.715+0000 7f7ce3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ce40d10d0 0x7f7ce41620e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42342/0 (socket says 172.21.15.73:42342) 2024-03-29T04:08:18.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.715+0000 7f7ce3fff640 1 -- 172.21.15.73:0/2790594475 learned_addr learned my addr 172.21.15.73:0/2790594475 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:18.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.715+0000 7f7ce8e76640 1 --2- 172.21.15.73:0/2790594475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ce415e860 0x7f7ce40b0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:18.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.715+0000 7f7ce37fe640 1 --2- 172.21.15.73:0/2790594475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ce40d2f50 0x7f7ce4158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:18.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.715+0000 7f7ce3fff640 1 -- 172.21.15.73:0/2790594475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ce415e860 msgr2=0x7f7ce40b0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:18.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.715+0000 7f7ce3fff640 1 --2- 172.21.15.73:0/2790594475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ce415e860 0x7f7ce40b0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:18.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.715+0000 7f7ce3fff640 1 -- 172.21.15.73:0/2790594475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ce40d2f50 msgr2=0x7f7ce4158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:18.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.715+0000 7f7ce3fff640 1 --2- 172.21.15.73:0/2790594475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ce40d2f50 0x7f7ce4158e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:18.705 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.715+0000 7f7ce3fff640 1 -- 172.21.15.73:0/2790594475 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ce41599e0 con 0x7f7ce40d10d0 2024-03-29T04:08:18.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.715+0000 7f7ce8e76640 1 --2- 172.21.15.73:0/2790594475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ce415e860 0x7f7ce40b0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:08:18.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.715+0000 7f7ce3fff640 1 --2- 172.21.15.73:0/2790594475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ce40d10d0 0x7f7ce41620e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7cd400c500 tx=0x7f7cd400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:18.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.716+0000 7f7ce0ff9640 1 -- 172.21.15.73:0/2790594475 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd4017070 con 0x7f7ce40d10d0 2024-03-29T04:08:18.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.716+0000 7f7ce0ff9640 1 -- 172.21.15.73:0/2790594475 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cd4005ce0 con 0x7f7ce40d10d0 2024-03-29T04:08:18.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.716+0000 7f7cea8d9640 1 -- 172.21.15.73:0/2790594475 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ce415bfd0 con 0x7f7ce40d10d0 2024-03-29T04:08:18.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.716+0000 7f7ce0ff9640 1 -- 172.21.15.73:0/2790594475 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd40072f0 con 0x7f7ce40d10d0 2024-03-29T04:08:18.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.716+0000 7f7cea8d9640 1 -- 172.21.15.73:0/2790594475 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ce415c590 con 0x7f7ce40d10d0 2024-03-29T04:08:18.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.717+0000 7f7cea8d9640 1 -- 172.21.15.73:0/2790594475 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ce4068640 con 0x7f7ce40d10d0 2024-03-29T04:08:18.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.717+0000 7f7ce0ff9640 1 -- 172.21.15.73:0/2790594475 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f7cd401a070 con 0x7f7ce40d10d0 2024-03-29T04:08:18.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.717+0000 7f7ce0ff9640 1 --2- 172.21.15.73:0/2790594475 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7cd006c530 0x7f7cd006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:18.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.718+0000 7f7ce37fe640 1 --2- 172.21.15.73:0/2790594475 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7cd006c530 0x7f7cd006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:18.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.718+0000 7f7ce0ff9640 1 -- 172.21.15.73:0/2790594475 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7cd408a920 con 0x7f7ce40d10d0 2024-03-29T04:08:18.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.718+0000 7f7ce37fe640 1 --2- 172.21.15.73:0/2790594475 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7cd006c530 0x7f7cd006e9f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8007fd0 tx=0x7f7cd8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:18.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.722+0000 7f7ce0ff9640 1 -- 172.21.15.73:0/2790594475 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f7cd4058a40 con 0x7f7ce40d10d0 2024-03-29T04:08:18.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.934+0000 7f7cea8d9640 1 -- 172.21.15.73:0/2790594475 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7ce40b83b0 con 0x7f7ce40d10d0 2024-03-29T04:08:18.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.934+0000 7f7ce0ff9640 1 -- 172.21.15.73:0/2790594475 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f7cd405cd40 con 0x7f7ce40d10d0 2024-03-29T04:08:18.914 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:18.914 INFO:teuthology.orchestra.run.smithi073.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-29T04:08:18.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.937+0000 7f7cea8d9640 1 -- 172.21.15.73:0/2790594475 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7cd006c530 msgr2=0x7f7cd006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:18.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.937+0000 7f7cea8d9640 1 --2- 172.21.15.73:0/2790594475 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7cd006c530 0x7f7cd006e9f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8007fd0 tx=0x7f7cd8009040 comp rx=0 tx=0).stop 2024-03-29T04:08:18.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.937+0000 7f7cea8d9640 1 -- 172.21.15.73:0/2790594475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ce40d10d0 msgr2=0x7f7ce41620e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:18.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.937+0000 7f7cea8d9640 1 --2- 172.21.15.73:0/2790594475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ce40d10d0 0x7f7ce41620e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7cd400c500 tx=0x7f7cd400c9c0 comp rx=0 tx=0).stop 2024-03-29T04:08:18.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.937+0000 7f7cea8d9640 1 -- 172.21.15.73:0/2790594475 shutdown_connections 2024-03-29T04:08:18.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.937+0000 7f7cea8d9640 1 --2- 172.21.15.73:0/2790594475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7ce415e860 0x7f7ce40b0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:18.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.937+0000 7f7cea8d9640 1 --2- 172.21.15.73:0/2790594475 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7cd006c530 0x7f7cd006e9f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:18.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.937+0000 7f7cea8d9640 1 --2- 172.21.15.73:0/2790594475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ce40d2f50 0x7f7ce4158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:18.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.937+0000 7f7cea8d9640 1 --2- 172.21.15.73:0/2790594475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ce40d10d0 0x7f7ce41620e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:18.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.937+0000 7f7cea8d9640 1 -- 172.21.15.73:0/2790594475 >> 172.21.15.73:0/2790594475 conn(0x7f7ce40d2430 msgr2=0x7f7ce415c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:18.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.937+0000 7f7cea8d9640 1 -- 172.21.15.73:0/2790594475 shutdown_connections 2024-03-29T04:08:18.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:18.937+0000 7f7cea8d9640 1 -- 172.21.15.73:0/2790594475 wait complete. 2024-03-29T04:08:18.928 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-29T04:08:18.928 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-29T04:08:19.028 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.049+0000 7f98b1fbd640 1 Processor -- start 2024-03-29T04:08:19.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.049+0000 7f98b1fbd640 1 -- start start 2024-03-29T04:08:19.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.049+0000 7f98b1fbd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f98ac06f3f0 0x7f98ac072b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:19.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.049+0000 7f98b1fbd640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98ac071ae0 con 0x7f98ac0730c0 2024-03-29T04:08:19.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.049+0000 7f98b1fbd640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98ac071dc0 con 0x7f98ac15b370 2024-03-29T04:08:19.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.049+0000 7f98b1fbd640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f98ac0b39d0 con 0x7f98ac06f3f0 2024-03-29T04:08:19.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.050+0000 7f98aaffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f98ac06f3f0 0x7f98ac072b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:19.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.050+0000 7f98abfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f98ac0730c0 0x7f98ac15f0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52198/0 (socket says 172.21.15.73:52198) 2024-03-29T04:08:19.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.050+0000 7f98abfff640 1 -- 172.21.15.73:0/1480703150 learned_addr learned my addr 172.21.15.73:0/1480703150 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:19.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.050+0000 7f98aaffd640 1 -- 172.21.15.73:0/1480703150 >> v1:172.21.15.142:6789/0 conn(0x7f98ac15b370 legacy=0x7f98ac0b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:19.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.050+0000 7f98aaffd640 1 -- 172.21.15.73:0/1480703150 >> v1:172.21.15.73:6789/0 conn(0x7f98ac0730c0 legacy=0x7f98ac15f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:19.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.050+0000 7f98aaffd640 1 -- 172.21.15.73:0/1480703150 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98ac0720a0 con 0x7f98ac06f3f0 2024-03-29T04:08:19.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.050+0000 7f98aa7fc640 1 -- 172.21.15.73:0/1480703150 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 481171797 0 0) 0x7f98ac071ae0 con 0x7f98ac0730c0 2024-03-29T04:08:19.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.050+0000 7f98aaffd640 1 --2- 172.21.15.73:0/1480703150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98ac06f3f0 0x7f98ac072b80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f98a00097a0 tx=0x7f98a002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0de789638070418 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:19.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.051+0000 7f98aa7fc640 1 -- 172.21.15.73:0/1480703150 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a0034070 con 0x7f98ac06f3f0 2024-03-29T04:08:19.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.051+0000 7f98aa7fc640 1 -- 172.21.15.73:0/1480703150 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98a0030610 con 0x7f98ac06f3f0 2024-03-29T04:08:19.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.051+0000 7f98aa7fc640 1 -- 172.21.15.73:0/1480703150 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a00309e0 con 0x7f98ac06f3f0 2024-03-29T04:08:19.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.051+0000 7f98b1fbd640 1 -- 172.21.15.73:0/1480703150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98ac06f3f0 msgr2=0x7f98ac072b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:19.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.051+0000 7f98b1fbd640 1 --2- 172.21.15.73:0/1480703150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98ac06f3f0 0x7f98ac072b80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f98a00097a0 tx=0x7f98a002b960 comp rx=0 tx=0).stop 2024-03-29T04:08:19.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.051+0000 7f98b1fbd640 1 -- 172.21.15.73:0/1480703150 shutdown_connections 2024-03-29T04:08:19.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.051+0000 7f98b1fbd640 1 --2- 172.21.15.73:0/1480703150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98ac06f3f0 0x7f98ac072b80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:19.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.051+0000 7f98b1fbd640 1 -- 172.21.15.73:0/1480703150 >> 172.21.15.73:0/1480703150 conn(0x7f98ac06b510 msgr2=0x7f98ac06b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:19.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.051+0000 7f98b1fbd640 1 -- 172.21.15.73:0/1480703150 shutdown_connections 2024-03-29T04:08:19.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.051+0000 7f98b1fbd640 1 -- 172.21.15.73:0/1480703150 wait complete. 2024-03-29T04:08:19.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.052+0000 7f98b1fbd640 1 Processor -- start 2024-03-29T04:08:19.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.053+0000 7f98b1fbd640 1 -- start start 2024-03-29T04:08:19.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.053+0000 7f98b1fbd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98ac06f3f0 0x7f98ac15cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:19.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.053+0000 7f98b1fbd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98ac0730c0 0x7f98ac14f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:19.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.053+0000 7f98b1fbd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98ac15b370 0x7f98ac15e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:19.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.053+0000 7f98b1fbd640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f98ac073550 con 0x7f98ac06f3f0 2024-03-29T04:08:19.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.053+0000 7f98b1fbd640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f98ac072660 con 0x7f98ac0730c0 2024-03-29T04:08:19.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.053+0000 7f98b1fbd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f98ac15b750 con 0x7f98ac15b370 2024-03-29T04:08:19.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.053+0000 7f98ab7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98ac06f3f0 0x7f98ac15cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:19.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.053+0000 7f98ab7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98ac06f3f0 0x7f98ac15cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42358/0 (socket says 172.21.15.73:42358) 2024-03-29T04:08:19.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.053+0000 7f98ab7fe640 1 -- 172.21.15.73:0/2999757170 learned_addr learned my addr 172.21.15.73:0/2999757170 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:19.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.053+0000 7f98abfff640 1 --2- 172.21.15.73:0/2999757170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98ac15b370 0x7f98ac15e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:19.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.053+0000 7f98aaffd640 1 --2- 172.21.15.73:0/2999757170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98ac0730c0 0x7f98ac14f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:19.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.054+0000 7f98ab7fe640 1 -- 172.21.15.73:0/2999757170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98ac15b370 msgr2=0x7f98ac15e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:19.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.054+0000 7f98ab7fe640 1 --2- 172.21.15.73:0/2999757170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98ac15b370 0x7f98ac15e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:19.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.054+0000 7f98ab7fe640 1 -- 172.21.15.73:0/2999757170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98ac0730c0 msgr2=0x7f98ac14f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:19.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.054+0000 7f98ab7fe640 1 --2- 172.21.15.73:0/2999757170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98ac0730c0 0x7f98ac14f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:19.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.054+0000 7f98ab7fe640 1 -- 172.21.15.73:0/2999757170 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98ac15bb20 con 0x7f98ac06f3f0 2024-03-29T04:08:19.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.054+0000 7f98ab7fe640 1 --2- 172.21.15.73:0/2999757170 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98ac06f3f0 0x7f98ac15cbc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f989c00c480 tx=0x7f989c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:19.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.054+0000 7f9893fff640 1 -- 172.21.15.73:0/2999757170 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f989c0052d0 con 0x7f98ac06f3f0 2024-03-29T04:08:19.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.054+0000 7f9893fff640 1 -- 172.21.15.73:0/2999757170 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f989c005470 con 0x7f98ac06f3f0 2024-03-29T04:08:19.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.054+0000 7f9893fff640 1 -- 172.21.15.73:0/2999757170 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f989c012870 con 0x7f98ac06f3f0 2024-03-29T04:08:19.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.054+0000 7f98b1fbd640 1 -- 172.21.15.73:0/2999757170 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98ac15be00 con 0x7f98ac06f3f0 2024-03-29T04:08:19.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.054+0000 7f98b1fbd640 1 -- 172.21.15.73:0/2999757170 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98ac15c3c0 con 0x7f98ac06f3f0 2024-03-29T04:08:19.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.055+0000 7f98b1fbd640 1 -- 172.21.15.73:0/2999757170 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98ac0ad360 con 0x7f98ac06f3f0 2024-03-29T04:08:19.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.055+0000 7f9893fff640 1 -- 172.21.15.73:0/2999757170 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f989c012a10 con 0x7f98ac06f3f0 2024-03-29T04:08:19.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.056+0000 7f9893fff640 1 --2- 172.21.15.73:0/2999757170 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f989806c530 0x7f989806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:19.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.056+0000 7f98aaffd640 1 --2- 172.21.15.73:0/2999757170 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f989806c530 0x7f989806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:19.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.056+0000 7f9893fff640 1 -- 172.21.15.73:0/2999757170 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f989c08b180 con 0x7f98ac06f3f0 2024-03-29T04:08:19.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.056+0000 7f98aaffd640 1 --2- 172.21.15.73:0/2999757170 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f989806c530 0x7f989806e9f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f98a0036000 tx=0x7f98a003b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:19.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.060+0000 7f9893fff640 1 -- 172.21.15.73:0/2999757170 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f98ac0ad360 con 0x7f98ac06f3f0 2024-03-29T04:08:19.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.234+0000 7f98b1fbd640 1 -- 172.21.15.73:0/2999757170 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f98ac068640 con 0x7f98ac06f3f0 2024-03-29T04:08:19.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.235+0000 7f9893fff640 1 -- 172.21.15.73:0/2999757170 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16605 (secure 0 0 0) 0x7f989c0591e0 con 0x7f98ac06f3f0 2024-03-29T04:08:19.215 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:19.216 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"6bff1617-b138-4517-acca-3ecaae3f2bb3","created":"2024-03-29T04:07:47.346864+0000","modified":"2024-03-29T04:08:13.577603+0000","last_up_change":"2024-03-29T04:07:58.507139+0000","last_in_change":"2024-03-29T04:07:49.637816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-29T04:07:59.537301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-29T04:08:09.570906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-29T04:08:10.882349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"925d7de1-14ab-48c0-aebd-7bded108f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6820","nonce":2387335359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6824","nonce":2387335359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6831","nonce":2387335359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6828","nonce":2387335359}]},"public_addr":"172.21.15.73:6820/2387335359","cluster_addr":"172.21.15.73:6824/2387335359","heartbeat_back_addr":"172.21.15.73:6831/2387335359","heartbeat_front_addr":"172.21.15.73:6828/2387335359","state":["exists","up"]},{"osd":1,"uuid":"6b182102-882a-4e0c-99db-0afae5cfb38b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6801","nonce":2431315515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6803","nonce":2431315515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6807","nonce":2431315515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6805","nonce":2431315515}]},"public_addr":"172.21.15.73:6801/2431315515","cluster_addr":"172.21.15.73:6803/2431315515","heartbeat_back_addr":"172.21.15.73:6807/2431315515","heartbeat_front_addr":"172.21.15.73:6805/2431315515","state":["exists","up"]},{"osd":2,"uuid":"8040902e-b0b8-4a21-bf64-ce1c222115ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6809","nonce":407236597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6811","nonce":407236597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6815","nonce":407236597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6813","nonce":407236597}]},"public_addr":"172.21.15.73:6809/407236597","cluster_addr":"172.21.15.73:6811/407236597","heartbeat_back_addr":"172.21.15.73:6815/407236597","heartbeat_front_addr":"172.21.15.73:6813/407236597","state":["exists","up"]},{"osd":3,"uuid":"1bab19ee-3775-4ce1-a4ce-cf7cda3bbbf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6817","nonce":4291100709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6821","nonce":4291100709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6829","nonce":4291100709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6825","nonce":4291100709}]},"public_addr":"172.21.15.73:6817/4291100709","cluster_addr":"172.21.15.73:6821/4291100709","heartbeat_back_addr":"172.21.15.73:6829/4291100709","heartbeat_front_addr":"172.21.15.73:6825/4291100709","state":["exists","up"]},{"osd":4,"uuid":"b0c74337-8fe4-47dc-b3da-2d07591b1f6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6817","nonce":3703256194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6819","nonce":3703256194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6823","nonce":3703256194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6821","nonce":3703256194}]},"public_addr":"172.21.15.142:6817/3703256194","cluster_addr":"172.21.15.142:6819/3703256194","heartbeat_back_addr":"172.21.15.142:6823/3703256194","heartbeat_front_addr":"172.21.15.142:6821/3703256194","state":["exists","up"]},{"osd":5,"uuid":"9ce36410-a29a-42c6-99f4-f95d4afdd7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6825","nonce":4271575803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6827","nonce":4271575803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6831","nonce":4271575803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6829","nonce":4271575803}]},"public_addr":"172.21.15.142:6825/4271575803","cluster_addr":"172.21.15.142:6827/4271575803","heartbeat_back_addr":"172.21.15.142:6831/4271575803","heartbeat_front_addr":"172.21.15.142:6829/4271575803","state":["exists","up"]},{"osd":6,"uuid":"aec4264a-64ac-428e-a860-d2920a304019","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6801","nonce":1772722570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6803","nonce":1772722570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6807","nonce":1772722570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6805","nonce":1772722570}]},"public_addr":"172.21.15.142:6801/1772722570","cluster_addr":"172.21.15.142:6803/1772722570","heartbeat_back_addr":"172.21.15.142:6807/1772722570","heartbeat_front_addr":"172.21.15.142:6805/1772722570","state":["exists","up"]},{"osd":7,"uuid":"fe599052-8e5a-4c7a-91e7-52d1bae24a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6809","nonce":3910589675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6811","nonce":3910589675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6815","nonce":3910589675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6813","nonce":3910589675}]},"public_addr":"172.21.15.142:6809/3910589675","cluster_addr":"172.21.15.142:6811/3910589675","heartbeat_back_addr":"172.21.15.142:6815/3910589675","heartbeat_front_addr":"172.21.15.142:6813/3910589675","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.835096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.587210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.786547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.778004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.843740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.791160+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.837992+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.718722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:08:19.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.237+0000 7f98b1fbd640 1 -- 172.21.15.73:0/2999757170 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f989806c530 msgr2=0x7f989806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:19.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.237+0000 7f98b1fbd640 1 --2- 172.21.15.73:0/2999757170 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f989806c530 0x7f989806e9f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f98a0036000 tx=0x7f98a003b040 comp rx=0 tx=0).stop 2024-03-29T04:08:19.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.237+0000 7f98b1fbd640 1 -- 172.21.15.73:0/2999757170 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98ac06f3f0 msgr2=0x7f98ac15cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:19.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.237+0000 7f98b1fbd640 1 --2- 172.21.15.73:0/2999757170 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98ac06f3f0 0x7f98ac15cbc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f989c00c480 tx=0x7f989c00c940 comp rx=0 tx=0).stop 2024-03-29T04:08:19.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.237+0000 7f98b1fbd640 1 -- 172.21.15.73:0/2999757170 shutdown_connections 2024-03-29T04:08:19.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.237+0000 7f98b1fbd640 1 --2- 172.21.15.73:0/2999757170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98ac15b370 0x7f98ac15e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:19.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.237+0000 7f98b1fbd640 1 --2- 172.21.15.73:0/2999757170 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f989806c530 0x7f989806e9f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:19.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.237+0000 7f98b1fbd640 1 --2- 172.21.15.73:0/2999757170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98ac0730c0 0x7f98ac14f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:19.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.237+0000 7f98b1fbd640 1 --2- 172.21.15.73:0/2999757170 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98ac06f3f0 0x7f98ac15cbc0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:19.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.237+0000 7f98b1fbd640 1 -- 172.21.15.73:0/2999757170 >> 172.21.15.73:0/2999757170 conn(0x7f98ac06b510 msgr2=0x7f98ac1577c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:19.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.238+0000 7f98b1fbd640 1 -- 172.21.15.73:0/2999757170 shutdown_connections 2024-03-29T04:08:19.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.238+0000 7f98b1fbd640 1 -- 172.21.15.73:0/2999757170 wait complete. 2024-03-29T04:08:19.228 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-29T04:07:59.537301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-29T04:08:09.570906+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-29T04:08:10.882349+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-29T04:08:19.229 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-29T04:08:19.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.352+0000 7f7dab340640 1 Processor -- start 2024-03-29T04:08:19.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.352+0000 7f7dab340640 1 -- start start 2024-03-29T04:08:19.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.353+0000 7f7dab340640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7da40cfde0 0x7f7da40d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:19.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.353+0000 7f7dab340640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7da415ed00 con 0x7f7da40d0f90 2024-03-29T04:08:19.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.353+0000 7f7dab340640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7da40d21e0 con 0x7f7da415e920 2024-03-29T04:08:19.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.353+0000 7f7dab340640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7da40d2480 con 0x7f7da40cfde0 2024-03-29T04:08:19.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.353+0000 7f7da98dd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7da40d0f90 0x7f7da406c6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52214/0 (socket says 172.21.15.73:52214) 2024-03-29T04:08:19.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.353+0000 7f7da98dd640 1 -- 172.21.15.73:0/733668814 learned_addr learned my addr 172.21.15.73:0/733668814 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:19.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.353+0000 7f7da88db640 1 --2- 172.21.15.73:0/733668814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7da40cfde0 0x7f7da40d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:19.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.353+0000 7f7d9bfff640 1 -- 172.21.15.73:0/733668814 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1175182971 0 0) 0x7f7da415ed00 con 0x7f7da40d0f90 2024-03-29T04:08:19.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.353+0000 7f7d9bfff640 1 -- 172.21.15.73:0/733668814 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d90003520 con 0x7f7da40d0f90 2024-03-29T04:08:19.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.353+0000 7f7d9bfff640 1 -- 172.21.15.73:0/733668814 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1187715906 0 0) 0x7f7da40d21e0 con 0x7f7da415e920 2024-03-29T04:08:19.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.354+0000 7f7d9bfff640 1 -- 172.21.15.73:0/733668814 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7da415ed00 con 0x7f7da415e920 2024-03-29T04:08:19.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.354+0000 7f7da88db640 1 -- 172.21.15.73:0/733668814 >> v1:172.21.15.142:6789/0 conn(0x7f7da415e920 legacy=0x7f7da40d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:19.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.354+0000 7f7da88db640 1 -- 172.21.15.73:0/733668814 >> v1:172.21.15.73:6789/0 conn(0x7f7da40d0f90 legacy=0x7f7da406c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:19.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.354+0000 7f7da88db640 1 -- 172.21.15.73:0/733668814 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7da40d2760 con 0x7f7da40cfde0 2024-03-29T04:08:19.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.354+0000 7f7da88db640 1 --2- 172.21.15.73:0/733668814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7da40cfde0 0x7f7da40d0240 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7d94009800 tx=0x7f7d9402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4ba697121da143c server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:19.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.355+0000 7f7d9bfff640 1 -- 172.21.15.73:0/733668814 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d94035020 con 0x7f7da40cfde0 2024-03-29T04:08:19.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.355+0000 7f7d9bfff640 1 -- 172.21.15.73:0/733668814 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d94031890 con 0x7f7da40cfde0 2024-03-29T04:08:19.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.355+0000 7f7d9bfff640 1 -- 172.21.15.73:0/733668814 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d94031c60 con 0x7f7da40cfde0 2024-03-29T04:08:19.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.355+0000 7f7dab340640 1 -- 172.21.15.73:0/733668814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7da40cfde0 msgr2=0x7f7da40d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:19.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.355+0000 7f7dab340640 1 --2- 172.21.15.73:0/733668814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7da40cfde0 0x7f7da40d0240 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7d94009800 tx=0x7f7d9402b930 comp rx=0 tx=0).stop 2024-03-29T04:08:19.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.355+0000 7f7dab340640 1 -- 172.21.15.73:0/733668814 shutdown_connections 2024-03-29T04:08:19.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.355+0000 7f7dab340640 1 --2- 172.21.15.73:0/733668814 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7da40cfde0 0x7f7da40d0240 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:19.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.355+0000 7f7dab340640 1 -- 172.21.15.73:0/733668814 >> 172.21.15.73:0/733668814 conn(0x7f7da408bfc0 msgr2=0x7f7da40d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:19.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.355+0000 7f7dab340640 1 -- 172.21.15.73:0/733668814 shutdown_connections 2024-03-29T04:08:19.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.355+0000 7f7dab340640 1 -- 172.21.15.73:0/733668814 wait complete. 2024-03-29T04:08:19.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.356+0000 7f7dab340640 1 Processor -- start 2024-03-29T04:08:19.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.356+0000 7f7dab340640 1 -- start start 2024-03-29T04:08:19.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.357+0000 7f7dab340640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7da40cfde0 0x7f7da40c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:19.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.357+0000 7f7dab340640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7da40d0f90 0x7f7da4161330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:19.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.357+0000 7f7dab340640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7da415e920 0x7f7da41f3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:19.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.357+0000 7f7dab340640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7da40d4ef0 con 0x7f7da40cfde0 2024-03-29T04:08:19.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.357+0000 7f7dab340640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7da40d2d20 con 0x7f7da40d0f90 2024-03-29T04:08:19.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.357+0000 7f7dab340640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7da40d5070 con 0x7f7da415e920 2024-03-29T04:08:19.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.357+0000 7f7da90dc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7da40cfde0 0x7f7da40c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:19.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.357+0000 7f7da90dc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7da40cfde0 0x7f7da40c8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42360/0 (socket says 172.21.15.73:42360) 2024-03-29T04:08:19.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.357+0000 7f7da90dc640 1 -- 172.21.15.73:0/29289962 learned_addr learned my addr 172.21.15.73:0/29289962 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:19.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.357+0000 7f7da98dd640 1 --2- 172.21.15.73:0/29289962 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7da415e920 0x7f7da41f3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:19.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.357+0000 7f7da88db640 1 --2- 172.21.15.73:0/29289962 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7da40d0f90 0x7f7da4161330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:19.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.357+0000 7f7da90dc640 1 -- 172.21.15.73:0/29289962 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7da415e920 msgr2=0x7f7da41f3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:19.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.357+0000 7f7da90dc640 1 --2- 172.21.15.73:0/29289962 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7da415e920 0x7f7da41f3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:19.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.357+0000 7f7da90dc640 1 -- 172.21.15.73:0/29289962 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7da40d0f90 msgr2=0x7f7da4161330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:19.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.357+0000 7f7da90dc640 1 --2- 172.21.15.73:0/29289962 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7da40d0f90 0x7f7da4161330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:19.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.357+0000 7f7da90dc640 1 -- 172.21.15.73:0/29289962 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7da41e8400 con 0x7f7da40cfde0 2024-03-29T04:08:19.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.357+0000 7f7da88db640 1 --2- 172.21.15.73:0/29289962 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7da40d0f90 0x7f7da4161330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:08:19.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.358+0000 7f7da90dc640 1 --2- 172.21.15.73:0/29289962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7da40cfde0 0x7f7da40c8b30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7da000c7d0 tx=0x7f7da000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:19.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.358+0000 7f7d99ffb640 1 -- 172.21.15.73:0/29289962 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da0003b70 con 0x7f7da40cfde0 2024-03-29T04:08:19.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.358+0000 7f7d99ffb640 1 -- 172.21.15.73:0/29289962 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7da0003d30 con 0x7f7da40cfde0 2024-03-29T04:08:19.342 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.358+0000 7f7d99ffb640 1 -- 172.21.15.73:0/29289962 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da000aa30 con 0x7f7da40cfde0 2024-03-29T04:08:19.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.358+0000 7f7dab340640 1 -- 172.21.15.73:0/29289962 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7da41e86e0 con 0x7f7da40cfde0 2024-03-29T04:08:19.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.358+0000 7f7dab340640 1 -- 172.21.15.73:0/29289962 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7da41e8ca0 con 0x7f7da40cfde0 2024-03-29T04:08:19.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.359+0000 7f7dab340640 1 -- 172.21.15.73:0/29289962 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7da40a2560 con 0x7f7da40cfde0 2024-03-29T04:08:19.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.359+0000 7f7d99ffb640 1 -- 172.21.15.73:0/29289962 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f7da000abd0 con 0x7f7da40cfde0 2024-03-29T04:08:19.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.359+0000 7f7d99ffb640 1 --2- 172.21.15.73:0/29289962 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7d8806c530 0x7f7d8806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:19.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.360+0000 7f7d99ffb640 1 -- 172.21.15.73:0/29289962 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7da008b560 con 0x7f7da40cfde0 2024-03-29T04:08:19.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.360+0000 7f7da88db640 1 --2- 172.21.15.73:0/29289962 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7d8806c530 0x7f7d8806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:19.343 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.360+0000 7f7da88db640 1 --2- 172.21.15.73:0/29289962 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7d8806c530 0x7f7d8806e9f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7d94036000 tx=0x7f7d94008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:19.344 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.364+0000 7f7d99ffb640 1 -- 172.21.15.73:0/29289962 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f7da0059b80 con 0x7f7da40cfde0 2024-03-29T04:08:19.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.537+0000 7f7dab340640 1 -- 172.21.15.73:0/29289962 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7da404f9d0 con 0x7f7da40cfde0 2024-03-29T04:08:19.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.537+0000 7f7d99ffb640 1 -- 172.21.15.73:0/29289962 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f7da0059480 con 0x7f7da40cfde0 2024-03-29T04:08:19.517 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-03-29T04:08:19.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.539+0000 7f7dab340640 1 -- 172.21.15.73:0/29289962 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7d8806c530 msgr2=0x7f7d8806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:19.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.539+0000 7f7dab340640 1 --2- 172.21.15.73:0/29289962 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7d8806c530 0x7f7d8806e9f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7d94036000 tx=0x7f7d94008030 comp rx=0 tx=0).stop 2024-03-29T04:08:19.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.539+0000 7f7dab340640 1 -- 172.21.15.73:0/29289962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7da40cfde0 msgr2=0x7f7da40c8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:19.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.539+0000 7f7dab340640 1 --2- 172.21.15.73:0/29289962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7da40cfde0 0x7f7da40c8b30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7da000c7d0 tx=0x7f7da000cc90 comp rx=0 tx=0).stop 2024-03-29T04:08:19.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.539+0000 7f7dab340640 1 -- 172.21.15.73:0/29289962 shutdown_connections 2024-03-29T04:08:19.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.539+0000 7f7dab340640 1 --2- 172.21.15.73:0/29289962 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7da415e920 0x7f7da41f3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:19.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.539+0000 7f7dab340640 1 --2- 172.21.15.73:0/29289962 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7d8806c530 0x7f7d8806e9f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:19.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.539+0000 7f7dab340640 1 --2- 172.21.15.73:0/29289962 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7da40d0f90 0x7f7da4161330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:19.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.539+0000 7f7dab340640 1 --2- 172.21.15.73:0/29289962 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7da40cfde0 0x7f7da40c8b30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:19.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.539+0000 7f7dab340640 1 -- 172.21.15.73:0/29289962 >> 172.21.15.73:0/29289962 conn(0x7f7da408bfc0 msgr2=0x7f7da406c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:19.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.539+0000 7f7dab340640 1 -- 172.21.15.73:0/29289962 shutdown_connections 2024-03-29T04:08:19.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.539+0000 7f7dab340640 1 -- 172.21.15.73:0/29289962 wait complete. 2024-03-29T04:08:19.529 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-29T04:08:19.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.655+0000 7f3ec498d640 1 Processor -- start 2024-03-29T04:08:19.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.655+0000 7f3ec498d640 1 -- start start 2024-03-29T04:08:19.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.655+0000 7f3ec498d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3ec015e920 0x7f3ec00d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:19.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.655+0000 7f3ec498d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ec00d3780 con 0x7f3ec00cfde0 2024-03-29T04:08:19.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.655+0000 7f3ec498d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ec015ed00 con 0x7f3ec00d16a0 2024-03-29T04:08:19.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.655+0000 7f3ec498d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f3ec00d21e0 con 0x7f3ec015e920 2024-03-29T04:08:19.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.656+0000 7f3eb7fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3ec00cfde0 0x7f3ec00d0f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52216/0 (socket says 172.21.15.73:52216) 2024-03-29T04:08:19.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.656+0000 7f3eb7fff640 1 -- 172.21.15.73:0/3102679587 learned_addr learned my addr 172.21.15.73:0/3102679587 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:19.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.656+0000 7f3ebe59c640 1 --2- 172.21.15.73:0/3102679587 >> v2:172.21.15.142:3300/0 conn(0x7f3ec015e920 0x7f3ec00d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:19.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.656+0000 7f3ebdd9b640 1 -- 172.21.15.73:0/3102679587 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 430388166 0 0) 0x7f3ea8001110 con 0x7f3ec00cfde0 2024-03-29T04:08:19.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.656+0000 7f3ebdd9b640 1 -- 172.21.15.73:0/3102679587 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3eac003520 con 0x7f3ec00cfde0 2024-03-29T04:08:19.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.656+0000 7f3ebdd9b640 1 -- 172.21.15.73:0/3102679587 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3664732087 0 0) 0x7f3ec015ed00 con 0x7f3ec00d16a0 2024-03-29T04:08:19.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.656+0000 7f3ebdd9b640 1 -- 172.21.15.73:0/3102679587 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ea8001110 con 0x7f3ec00d16a0 2024-03-29T04:08:19.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.656+0000 7f3ebe59c640 1 -- 172.21.15.73:0/3102679587 >> v1:172.21.15.142:6789/0 conn(0x7f3ec00d16a0 legacy=0x7f3ec006c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:19.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.656+0000 7f3ebe59c640 1 -- 172.21.15.73:0/3102679587 >> v1:172.21.15.73:6789/0 conn(0x7f3ec00cfde0 legacy=0x7f3ec00d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:19.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.656+0000 7f3ebe59c640 1 -- 172.21.15.73:0/3102679587 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ec00d2480 con 0x7f3ec015e920 2024-03-29T04:08:19.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.657+0000 7f3ebe59c640 1 --2- 172.21.15.73:0/3102679587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ec015e920 0x7f3ec00d3240 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3eb00097a0 tx=0x7f3eb002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c5e476df1d05bbc server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:19.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.657+0000 7f3ebdd9b640 1 -- 172.21.15.73:0/3102679587 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb0034070 con 0x7f3ec015e920 2024-03-29T04:08:19.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.657+0000 7f3ebdd9b640 1 -- 172.21.15.73:0/3102679587 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eb0030610 con 0x7f3ec015e920 2024-03-29T04:08:19.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.657+0000 7f3ebdd9b640 1 -- 172.21.15.73:0/3102679587 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb00309e0 con 0x7f3ec015e920 2024-03-29T04:08:19.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.657+0000 7f3ec498d640 1 -- 172.21.15.73:0/3102679587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ec015e920 msgr2=0x7f3ec00d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:19.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.657+0000 7f3ec498d640 1 --2- 172.21.15.73:0/3102679587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ec015e920 0x7f3ec00d3240 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3eb00097a0 tx=0x7f3eb002b960 comp rx=0 tx=0).stop 2024-03-29T04:08:19.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.657+0000 7f3ec498d640 1 -- 172.21.15.73:0/3102679587 shutdown_connections 2024-03-29T04:08:19.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.657+0000 7f3ec498d640 1 --2- 172.21.15.73:0/3102679587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ec015e920 0x7f3ec00d3240 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:19.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.657+0000 7f3ec498d640 1 -- 172.21.15.73:0/3102679587 >> 172.21.15.73:0/3102679587 conn(0x7f3ec008bfc0 msgr2=0x7f3ec00d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:19.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.658+0000 7f3ec498d640 1 -- 172.21.15.73:0/3102679587 shutdown_connections 2024-03-29T04:08:19.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.658+0000 7f3ec498d640 1 -- 172.21.15.73:0/3102679587 wait complete. 2024-03-29T04:08:19.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.659+0000 7f3ec498d640 1 Processor -- start 2024-03-29T04:08:19.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.659+0000 7f3ec498d640 1 -- start start 2024-03-29T04:08:19.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.660+0000 7f3ec498d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ec00cfde0 0x7f3ec014aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:19.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.660+0000 7f3ec498d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ec00d16a0 0x7f3ec014df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:19.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.660+0000 7f3ec498d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ec015e920 0x7f3ec00c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:19.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.660+0000 7f3ec498d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec00d2d20 con 0x7f3ec00cfde0 2024-03-29T04:08:19.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.660+0000 7f3ec498d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec00d2a40 con 0x7f3ec015e920 2024-03-29T04:08:19.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.660+0000 7f3ec498d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f3ec00d4ef0 con 0x7f3ec00d16a0 2024-03-29T04:08:19.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.660+0000 7f3ebe59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ec00cfde0 0x7f3ec014aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:19.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.660+0000 7f3ebe59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ec00cfde0 0x7f3ec014aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42370/0 (socket says 172.21.15.73:42370) 2024-03-29T04:08:19.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.660+0000 7f3ebe59c640 1 -- 172.21.15.73:0/3584166955 learned_addr learned my addr 172.21.15.73:0/3584166955 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:19.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.660+0000 7f3ebed9d640 1 --2- 172.21.15.73:0/3584166955 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ec015e920 0x7f3ec00c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:19.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.660+0000 7f3eb7fff640 1 --2- 172.21.15.73:0/3584166955 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ec00d16a0 0x7f3ec014df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:19.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.660+0000 7f3ebe59c640 1 -- 172.21.15.73:0/3584166955 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ec00d16a0 msgr2=0x7f3ec014df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:19.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.660+0000 7f3ebe59c640 1 --2- 172.21.15.73:0/3584166955 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ec00d16a0 0x7f3ec014df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:19.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.660+0000 7f3ebe59c640 1 -- 172.21.15.73:0/3584166955 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ec015e920 msgr2=0x7f3ec00c82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:19.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.660+0000 7f3ebe59c640 1 --2- 172.21.15.73:0/3584166955 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ec015e920 0x7f3ec00c82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:19.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.660+0000 7f3ebe59c640 1 -- 172.21.15.73:0/3584166955 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ec014b1e0 con 0x7f3ec00cfde0 2024-03-29T04:08:19.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.660+0000 7f3ebe59c640 1 --2- 172.21.15.73:0/3584166955 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ec00cfde0 0x7f3ec014aca0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3eb002bf70 tx=0x7f3eb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:19.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.660+0000 7f3eb6ffd640 1 -- 172.21.15.73:0/3584166955 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb0034040 con 0x7f3ec00cfde0 2024-03-29T04:08:19.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.660+0000 7f3eb6ffd640 1 -- 172.21.15.73:0/3584166955 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eb0030410 con 0x7f3ec00cfde0 2024-03-29T04:08:19.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.660+0000 7f3ec498d640 1 -- 172.21.15.73:0/3584166955 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ec01602c0 con 0x7f3ec00cfde0 2024-03-29T04:08:19.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.660+0000 7f3eb6ffd640 1 -- 172.21.15.73:0/3584166955 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb0006e10 con 0x7f3ec00cfde0 2024-03-29T04:08:19.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.660+0000 7f3ec498d640 1 -- 172.21.15.73:0/3584166955 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ec0160880 con 0x7f3ec00cfde0 2024-03-29T04:08:19.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.661+0000 7f3ec498d640 1 -- 172.21.15.73:0/3584166955 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ec00a2560 con 0x7f3ec00cfde0 2024-03-29T04:08:19.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.662+0000 7f3eb6ffd640 1 -- 172.21.15.73:0/3584166955 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f3eb0037070 con 0x7f3ec00cfde0 2024-03-29T04:08:19.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.662+0000 7f3eb6ffd640 1 --2- 172.21.15.73:0/3584166955 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3ea006c530 0x7f3ea006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:19.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.662+0000 7f3eb6ffd640 1 -- 172.21.15.73:0/3584166955 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3eb00ad4a0 con 0x7f3ec00cfde0 2024-03-29T04:08:19.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.662+0000 7f3eb7fff640 1 --2- 172.21.15.73:0/3584166955 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3ea006c530 0x7f3ea006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:19.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.663+0000 7f3eb7fff640 1 --2- 172.21.15.73:0/3584166955 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3ea006c530 0x7f3ea006e9f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3ec01e8ca0 tx=0x7f3ea8007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:19.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.666+0000 7f3eb6ffd640 1 -- 172.21.15.73:0/3584166955 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f3eb007b470 con 0x7f3ec00cfde0 2024-03-29T04:08:19.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.840+0000 7f3ec498d640 1 -- 172.21.15.73:0/3584166955 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3ec004f9d0 con 0x7f3ec00cfde0 2024-03-29T04:08:19.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.841+0000 7f3eb6ffd640 1 -- 172.21.15.73:0/3584166955 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f3eb007f770 con 0x7f3ec00cfde0 2024-03-29T04:08:19.821 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-03-29T04:08:19.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.842+0000 7f3ec498d640 1 -- 172.21.15.73:0/3584166955 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3ea006c530 msgr2=0x7f3ea006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:19.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.842+0000 7f3ec498d640 1 --2- 172.21.15.73:0/3584166955 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3ea006c530 0x7f3ea006e9f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3ec01e8ca0 tx=0x7f3ea8007d50 comp rx=0 tx=0).stop 2024-03-29T04:08:19.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.842+0000 7f3ec498d640 1 -- 172.21.15.73:0/3584166955 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ec00cfde0 msgr2=0x7f3ec014aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:19.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.842+0000 7f3ec498d640 1 --2- 172.21.15.73:0/3584166955 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ec00cfde0 0x7f3ec014aca0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3eb002bf70 tx=0x7f3eb00046c0 comp rx=0 tx=0).stop 2024-03-29T04:08:19.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.842+0000 7f3ec498d640 1 -- 172.21.15.73:0/3584166955 shutdown_connections 2024-03-29T04:08:19.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.842+0000 7f3ec498d640 1 --2- 172.21.15.73:0/3584166955 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3ea006c530 0x7f3ea006e9f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:19.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.842+0000 7f3ec498d640 1 --2- 172.21.15.73:0/3584166955 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3ec015e920 0x7f3ec00c82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:19.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.842+0000 7f3ec498d640 1 --2- 172.21.15.73:0/3584166955 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3ec00d16a0 0x7f3ec014df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:19.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.842+0000 7f3ec498d640 1 --2- 172.21.15.73:0/3584166955 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ec00cfde0 0x7f3ec014aca0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:19.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.843+0000 7f3ec498d640 1 -- 172.21.15.73:0/3584166955 >> 172.21.15.73:0/3584166955 conn(0x7f3ec008bfc0 msgr2=0x7f3ec00d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:19.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.843+0000 7f3ec498d640 1 -- 172.21.15.73:0/3584166955 shutdown_connections 2024-03-29T04:08:19.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.843+0000 7f3ec498d640 1 -- 172.21.15.73:0/3584166955 wait complete. 2024-03-29T04:08:19.833 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-29T04:08:19.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.956+0000 7fb002688640 1 Processor -- start 2024-03-29T04:08:19.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.956+0000 7fb002688640 1 -- start start 2024-03-29T04:08:19.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.957+0000 7fb002688640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faffc0ce680 0x7faffc09b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:19.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.957+0000 7fb002688640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faffc0cea60 0x7faffc09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:19.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.957+0000 7fb002688640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7faffc070ee0 0x7faffc09af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:19.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.957+0000 7fb002688640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7faffc0d0a30 con 0x7faffc070ee0 2024-03-29T04:08:19.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.957+0000 7fb002688640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7faffc070650 con 0x7faffc0ce680 2024-03-29T04:08:19.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.957+0000 7fb002688640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7faffc0d0c80 con 0x7faffc0cea60 2024-03-29T04:08:19.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.957+0000 7fb000c25640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7faffc070ee0 0x7faffc09af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:19.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.957+0000 7fb000c25640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7faffc070ee0 0x7faffc09af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42372/0 (socket says 172.21.15.73:42372) 2024-03-29T04:08:19.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.957+0000 7fb000c25640 1 -- 172.21.15.73:0/2211280510 learned_addr learned my addr 172.21.15.73:0/2211280510 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:19.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.957+0000 7faffbfff640 1 --2- 172.21.15.73:0/2211280510 >> v2:172.21.15.142:3300/0 conn(0x7faffc0ce680 0x7faffc09b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:19.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.957+0000 7faffb7fe640 1 --2- 172.21.15.73:0/2211280510 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faffc0cea60 0x7faffc09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:19.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.958+0000 7fb000c25640 1 -- 172.21.15.73:0/2211280510 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faffc0cea60 msgr2=0x7faffc09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:19.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.958+0000 7fb000c25640 1 --2- 172.21.15.73:0/2211280510 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faffc0cea60 0x7faffc09aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:19.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.958+0000 7fb000c25640 1 -- 172.21.15.73:0/2211280510 >> v2:172.21.15.142:3300/0 conn(0x7faffc0ce680 msgr2=0x7faffc09b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:19.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.958+0000 7fb000c25640 1 --2- 172.21.15.73:0/2211280510 >> v2:172.21.15.142:3300/0 conn(0x7faffc0ce680 0x7faffc09b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:19.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.958+0000 7fb000c25640 1 -- 172.21.15.73:0/2211280510 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faffc0d0f60 con 0x7faffc070ee0 2024-03-29T04:08:19.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.958+0000 7fb000c25640 1 --2- 172.21.15.73:0/2211280510 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faffc070ee0 0x7faffc09af70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faffc0736d0 tx=0x7faff402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a64afd7171610f13 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:19.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.958+0000 7faffaffd640 1 -- 172.21.15.73:0/2211280510 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff402c9e0 con 0x7faffc070ee0 2024-03-29T04:08:19.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.959+0000 7faffaffd640 1 -- 172.21.15.73:0/2211280510 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faff402cb80 con 0x7faffc070ee0 2024-03-29T04:08:19.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.959+0000 7faffaffd640 1 -- 172.21.15.73:0/2211280510 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff40343f0 con 0x7faffc070ee0 2024-03-29T04:08:19.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.959+0000 7fb002688640 1 -- 172.21.15.73:0/2211280510 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faffc070ee0 msgr2=0x7faffc09af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:19.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.959+0000 7fb002688640 1 --2- 172.21.15.73:0/2211280510 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faffc070ee0 0x7faffc09af70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faffc0736d0 tx=0x7faff402be40 comp rx=0 tx=0).stop 2024-03-29T04:08:19.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.959+0000 7fb002688640 1 -- 172.21.15.73:0/2211280510 shutdown_connections 2024-03-29T04:08:19.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.959+0000 7fb002688640 1 --2- 172.21.15.73:0/2211280510 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faffc070ee0 0x7faffc09af70 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:19.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.959+0000 7fb002688640 1 --2- 172.21.15.73:0/2211280510 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faffc0cea60 0x7faffc09aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:19.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.959+0000 7fb002688640 1 --2- 172.21.15.73:0/2211280510 >> v2:172.21.15.142:3300/0 conn(0x7faffc0ce680 0x7faffc09b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:19.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.959+0000 7fb002688640 1 -- 172.21.15.73:0/2211280510 >> 172.21.15.73:0/2211280510 conn(0x7faffc0b3f40 msgr2=0x7faffc0b4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:19.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.959+0000 7fb002688640 1 -- 172.21.15.73:0/2211280510 shutdown_connections 2024-03-29T04:08:19.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.959+0000 7fb002688640 1 -- 172.21.15.73:0/2211280510 wait complete. 2024-03-29T04:08:19.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.960+0000 7fb002688640 1 Processor -- start 2024-03-29T04:08:19.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.960+0000 7fb002688640 1 -- start start 2024-03-29T04:08:19.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.961+0000 7fb002688640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faffc070ee0 0x7faffc0c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:19.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.961+0000 7fb002688640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faffc0ce680 0x7faffc0b74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:19.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.961+0000 7fb002688640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faffc0cea60 0x7faffc14e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:19.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.961+0000 7fb002688640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7faffc070ae0 con 0x7faffc0ce680 2024-03-29T04:08:19.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.961+0000 7fb002688640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7faffc09bcb0 con 0x7faffc0cea60 2024-03-29T04:08:19.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.961+0000 7fb002688640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7faffc070c60 con 0x7faffc070ee0 2024-03-29T04:08:19.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.961+0000 7faffb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faffc0ce680 0x7faffc0b74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:19.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.961+0000 7faffb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faffc0ce680 0x7faffc0b74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42388/0 (socket says 172.21.15.73:42388) 2024-03-29T04:08:19.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.961+0000 7faffb7fe640 1 -- 172.21.15.73:0/1526725051 learned_addr learned my addr 172.21.15.73:0/1526725051 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:19.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.961+0000 7faffbfff640 1 --2- 172.21.15.73:0/1526725051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faffc070ee0 0x7faffc0c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:19.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.961+0000 7fb000c25640 1 --2- 172.21.15.73:0/1526725051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faffc0cea60 0x7faffc14e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:19.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.962+0000 7faffb7fe640 1 -- 172.21.15.73:0/1526725051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faffc070ee0 msgr2=0x7faffc0c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:19.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.962+0000 7faffb7fe640 1 --2- 172.21.15.73:0/1526725051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faffc070ee0 0x7faffc0c8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:19.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.962+0000 7faffb7fe640 1 -- 172.21.15.73:0/1526725051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faffc0cea60 msgr2=0x7faffc14e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:19.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.962+0000 7faffb7fe640 1 --2- 172.21.15.73:0/1526725051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faffc0cea60 0x7faffc14e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:19.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.962+0000 7faffb7fe640 1 -- 172.21.15.73:0/1526725051 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faffc0c6240 con 0x7faffc0ce680 2024-03-29T04:08:19.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.962+0000 7faffb7fe640 1 --2- 172.21.15.73:0/1526725051 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faffc0ce680 0x7faffc0b74c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7faff000e980 tx=0x7faff000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:19.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.962+0000 7faff8ff9640 1 -- 172.21.15.73:0/1526725051 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff0017070 con 0x7faffc0ce680 2024-03-29T04:08:19.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.962+0000 7faff8ff9640 1 -- 172.21.15.73:0/1526725051 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faff000ca00 con 0x7faffc0ce680 2024-03-29T04:08:19.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.962+0000 7fb002688640 1 -- 172.21.15.73:0/1526725051 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faffc0c67d0 con 0x7faffc0ce680 2024-03-29T04:08:19.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.962+0000 7faff8ff9640 1 -- 172.21.15.73:0/1526725051 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff000cdd0 con 0x7faffc0ce680 2024-03-29T04:08:19.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.962+0000 7fb002688640 1 -- 172.21.15.73:0/1526725051 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faffc0c6d90 con 0x7faffc0ce680 2024-03-29T04:08:19.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.963+0000 7fb002688640 1 -- 172.21.15.73:0/1526725051 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faffc0c8ab0 con 0x7faffc0ce680 2024-03-29T04:08:19.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.963+0000 7faff8ff9640 1 -- 172.21.15.73:0/1526725051 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7faff001a070 con 0x7faffc0ce680 2024-03-29T04:08:19.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.964+0000 7faff8ff9640 1 --2- 172.21.15.73:0/1526725051 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fafe806c530 0x7fafe806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:19.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.964+0000 7faffbfff640 1 --2- 172.21.15.73:0/1526725051 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fafe806c530 0x7fafe806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:19.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.964+0000 7faff8ff9640 1 -- 172.21.15.73:0/1526725051 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7faff008b660 con 0x7faffc0ce680 2024-03-29T04:08:19.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.964+0000 7faffbfff640 1 --2- 172.21.15.73:0/1526725051 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fafe806c530 0x7fafe806e9f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fafec009a20 tx=0x7fafec009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:19.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:19.968+0000 7faff8ff9640 1 -- 172.21.15.73:0/1526725051 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7faff0059630 con 0x7faffc0ce680 2024-03-29T04:08:20.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.143+0000 7fb002688640 1 -- 172.21.15.73:0/1526725051 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7faffc0a0520 con 0x7faffc0ce680 2024-03-29T04:08:20.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.143+0000 7faff8ff9640 1 -- 172.21.15.73:0/1526725051 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7faff005d930 con 0x7faffc0ce680 2024-03-29T04:08:20.161 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-29T04:08:20.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.145+0000 7fb002688640 1 -- 172.21.15.73:0/1526725051 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fafe806c530 msgr2=0x7fafe806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:20.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.145+0000 7fb002688640 1 --2- 172.21.15.73:0/1526725051 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fafe806c530 0x7fafe806e9f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fafec009a20 tx=0x7fafec009190 comp rx=0 tx=0).stop 2024-03-29T04:08:20.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.145+0000 7fb002688640 1 -- 172.21.15.73:0/1526725051 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faffc0ce680 msgr2=0x7faffc0b74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:20.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.145+0000 7fb002688640 1 --2- 172.21.15.73:0/1526725051 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faffc0ce680 0x7faffc0b74c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7faff000e980 tx=0x7faff000ee40 comp rx=0 tx=0).stop 2024-03-29T04:08:20.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.145+0000 7fb002688640 1 -- 172.21.15.73:0/1526725051 shutdown_connections 2024-03-29T04:08:20.162 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.145+0000 7fb002688640 1 --2- 172.21.15.73:0/1526725051 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fafe806c530 0x7fafe806e9f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:20.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.145+0000 7fb002688640 1 --2- 172.21.15.73:0/1526725051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faffc0cea60 0x7faffc14e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:20.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.145+0000 7fb002688640 1 --2- 172.21.15.73:0/1526725051 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faffc0ce680 0x7faffc0b74c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:20.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.145+0000 7fb002688640 1 --2- 172.21.15.73:0/1526725051 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faffc070ee0 0x7faffc0c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:20.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.145+0000 7fb002688640 1 -- 172.21.15.73:0/1526725051 >> 172.21.15.73:0/1526725051 conn(0x7faffc0b3f40 msgr2=0x7faffc0b1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:20.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.145+0000 7fb002688640 1 -- 172.21.15.73:0/1526725051 shutdown_connections 2024-03-29T04:08:20.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.145+0000 7fb002688640 1 -- 172.21.15.73:0/1526725051 wait complete. 2024-03-29T04:08:20.163 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-29T04:08:20.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.283+0000 7fbcb7a74640 1 Processor -- start 2024-03-29T04:08:20.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.283+0000 7fbcb7a74640 1 -- start start 2024-03-29T04:08:20.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.283+0000 7fbcb7a74640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbcb015b370 0x7fbcb00b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:20.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.283+0000 7fbcb7a74640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbcb006f3f0 0x7fbcb0072b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:20.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.283+0000 7fbcb7a74640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcb0071ae0 con 0x7fbcb00730c0 2024-03-29T04:08:20.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.283+0000 7fbcb7a74640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fbcb0071dc0 con 0x7fbcb006f3f0 2024-03-29T04:08:20.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.283+0000 7fbcb7a74640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fbcb00720a0 con 0x7fbcb015b370 2024-03-29T04:08:20.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.284+0000 7fbcb500f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbcb006f3f0 0x7fbcb0072b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:20.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.284+0000 7fbcb6011640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fbcb00730c0 0x7fbcb00ae020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52230/0 (socket says 172.21.15.73:52230) 2024-03-29T04:08:20.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.284+0000 7fbcb500f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbcb006f3f0 0x7fbcb0072b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42392/0 (socket says 172.21.15.73:42392) 2024-03-29T04:08:20.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.284+0000 7fbcb6011640 1 -- 172.21.15.73:0/3783554167 learned_addr learned my addr 172.21.15.73:0/3783554167 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:20.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.284+0000 7fbcb5810640 1 --2- 172.21.15.73:0/3783554167 >> v2:172.21.15.142:3300/0 conn(0x7fbcb015b370 0x7fbcb00b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:20.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.284+0000 7fbcb500f640 1 -- 172.21.15.73:0/3783554167 >> v2:172.21.15.142:3300/0 conn(0x7fbcb015b370 msgr2=0x7fbcb00b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:20.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.284+0000 7fbcb500f640 1 --2- 172.21.15.73:0/3783554167 >> v2:172.21.15.142:3300/0 conn(0x7fbcb015b370 0x7fbcb00b32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:20.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.284+0000 7fbcb500f640 1 -- 172.21.15.73:0/3783554167 >> v1:172.21.15.73:6789/0 conn(0x7fbcb00730c0 legacy=0x7fbcb00ae020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:20.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.284+0000 7fbcb480e640 1 -- 172.21.15.73:0/3783554167 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1309733298 0 0) 0x7fbcb0071ae0 con 0x7fbcb00730c0 2024-03-29T04:08:20.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.284+0000 7fbcb500f640 1 -- 172.21.15.73:0/3783554167 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcb0072380 con 0x7fbcb006f3f0 2024-03-29T04:08:20.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.284+0000 7fbcb5810640 1 --2- 172.21.15.73:0/3783554167 >> v2:172.21.15.142:3300/0 conn(0x7fbcb015b370 0x7fbcb00b32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:08:20.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.285+0000 7fbcb500f640 1 --2- 172.21.15.73:0/3783554167 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcb006f3f0 0x7fbcb0072b80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbcb00d12e0 tx=0x7fbcac02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d9569d702660aa server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:20.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.285+0000 7fbcb480e640 1 -- 172.21.15.73:0/3783554167 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcac035020 con 0x7fbcb006f3f0 2024-03-29T04:08:20.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.285+0000 7fbcb480e640 1 -- 172.21.15.73:0/3783554167 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcac031830 con 0x7fbcb006f3f0 2024-03-29T04:08:20.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.285+0000 7fbcb480e640 1 -- 172.21.15.73:0/3783554167 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcac031c00 con 0x7fbcb006f3f0 2024-03-29T04:08:20.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.285+0000 7fbcb7a74640 1 -- 172.21.15.73:0/3783554167 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcb006f3f0 msgr2=0x7fbcb0072b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:20.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.285+0000 7fbcb7a74640 1 --2- 172.21.15.73:0/3783554167 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcb006f3f0 0x7fbcb0072b80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbcb00d12e0 tx=0x7fbcac02b8d0 comp rx=0 tx=0).stop 2024-03-29T04:08:20.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.285+0000 7fbcb7a74640 1 -- 172.21.15.73:0/3783554167 shutdown_connections 2024-03-29T04:08:20.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.285+0000 7fbcb7a74640 1 --2- 172.21.15.73:0/3783554167 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcb006f3f0 0x7fbcb0072b80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:20.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.285+0000 7fbcb7a74640 1 --2- 172.21.15.73:0/3783554167 >> v2:172.21.15.142:3300/0 conn(0x7fbcb015b370 0x7fbcb00b32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:20.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.285+0000 7fbcb7a74640 1 -- 172.21.15.73:0/3783554167 >> 172.21.15.73:0/3783554167 conn(0x7fbcb006b510 msgr2=0x7fbcb006b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:20.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.285+0000 7fbcb7a74640 1 -- 172.21.15.73:0/3783554167 shutdown_connections 2024-03-29T04:08:20.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.285+0000 7fbcb7a74640 1 -- 172.21.15.73:0/3783554167 wait complete. 2024-03-29T04:08:20.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.287+0000 7fbcb7a74640 1 Processor -- start 2024-03-29T04:08:20.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.287+0000 7fbcb7a74640 1 -- start start 2024-03-29T04:08:20.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.287+0000 7fbcb7a74640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbcb006f3f0 0x7fbcb014a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:20.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.287+0000 7fbcb7a74640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbcb00730c0 0x7fbcb0148860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:20.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.287+0000 7fbcb7a74640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcb015b370 0x7fbcb00cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:20.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.287+0000 7fbcb7a74640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb00b3800 con 0x7fbcb015b370 2024-03-29T04:08:20.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.287+0000 7fbcb7a74640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb0073550 con 0x7fbcb006f3f0 2024-03-29T04:08:20.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.287+0000 7fbcb7a74640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fbcb00b3980 con 0x7fbcb00730c0 2024-03-29T04:08:20.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.287+0000 7fbcb6011640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcb015b370 0x7fbcb00cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:20.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.287+0000 7fbcb6011640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcb015b370 0x7fbcb00cdf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42398/0 (socket says 172.21.15.73:42398) 2024-03-29T04:08:20.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.287+0000 7fbcb6011640 1 -- 172.21.15.73:0/282565017 learned_addr learned my addr 172.21.15.73:0/282565017 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:20.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.287+0000 7fbcb500f640 1 --2- 172.21.15.73:0/282565017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbcb00730c0 0x7fbcb0148860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:20.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.287+0000 7fbcb5810640 1 --2- 172.21.15.73:0/282565017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbcb006f3f0 0x7fbcb014a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:20.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.288+0000 7fbcb6011640 1 -- 172.21.15.73:0/282565017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbcb00730c0 msgr2=0x7fbcb0148860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:20.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.288+0000 7fbcb6011640 1 --2- 172.21.15.73:0/282565017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbcb00730c0 0x7fbcb0148860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:20.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.288+0000 7fbcb6011640 1 -- 172.21.15.73:0/282565017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbcb006f3f0 msgr2=0x7fbcb014a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:20.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.288+0000 7fbcb6011640 1 --2- 172.21.15.73:0/282565017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbcb006f3f0 0x7fbcb014a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:20.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.288+0000 7fbcb6011640 1 -- 172.21.15.73:0/282565017 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcb014a700 con 0x7fbcb015b370 2024-03-29T04:08:20.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.288+0000 7fbcb6011640 1 --2- 172.21.15.73:0/282565017 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcb015b370 0x7fbcb00cdf30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbca800c7e0 tx=0x7fbca800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:20.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.288+0000 7fbca67fc640 1 -- 172.21.15.73:0/282565017 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca8018070 con 0x7fbcb015b370 2024-03-29T04:08:20.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.288+0000 7fbca67fc640 1 -- 172.21.15.73:0/282565017 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbca800a640 con 0x7fbcb015b370 2024-03-29T04:08:20.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.288+0000 7fbcb7a74640 1 -- 172.21.15.73:0/282565017 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcb014a9e0 con 0x7fbcb015b370 2024-03-29T04:08:20.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.288+0000 7fbca67fc640 1 -- 172.21.15.73:0/282565017 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca800aa30 con 0x7fbcb015b370 2024-03-29T04:08:20.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.288+0000 7fbcb7a74640 1 -- 172.21.15.73:0/282565017 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcb014afa0 con 0x7fbcb015b370 2024-03-29T04:08:20.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.289+0000 7fbcb7a74640 1 -- 172.21.15.73:0/282565017 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcb0068640 con 0x7fbcb015b370 2024-03-29T04:08:20.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.289+0000 7fbca67fc640 1 -- 172.21.15.73:0/282565017 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fbca801b070 con 0x7fbcb015b370 2024-03-29T04:08:20.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.290+0000 7fbca67fc640 1 --2- 172.21.15.73:0/282565017 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fbc9406c530 0x7fbc9406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:20.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.290+0000 7fbcb5810640 1 --2- 172.21.15.73:0/282565017 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fbc9406c530 0x7fbc9406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:20.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.290+0000 7fbca67fc640 1 -- 172.21.15.73:0/282565017 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fbca808aca0 con 0x7fbcb015b370 2024-03-29T04:08:20.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.290+0000 7fbcb5810640 1 --2- 172.21.15.73:0/282565017 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fbc9406c530 0x7fbc9406e9f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbca0009560 tx=0x7fbca0009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:20.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.294+0000 7fbca67fc640 1 -- 172.21.15.73:0/282565017 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fbca8058c70 con 0x7fbcb015b370 2024-03-29T04:08:20.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.507+0000 7fbcb7a74640 1 -- 172.21.15.73:0/282565017 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbcb00d0000 con 0x7fbcb015b370 2024-03-29T04:08:20.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.508+0000 7fbca67fc640 1 -- 172.21.15.73:0/282565017 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5178 (secure 0 0 0) 0x7fbca805cf70 con 0x7fbcb015b370 2024-03-29T04:08:20.488 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:20.488 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2101608781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2101608781},{"type":"v1","addr":"172.21.15.142:6834","nonce":2101608781}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3626787216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":3626787216},{"type":"v1","addr":"172.21.15.73:6837","nonce":3626787216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1987252283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1987252283},{"type":"v1","addr":"172.21.15.73:6836","nonce":1987252283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-29T04:08:11.922090+0000","modified":"2024-03-29T04:08:13.918938+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6835/569863112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":569863112},{"type":"v1","addr":"172.21.15.142:6835","nonce":569863112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-03-29T04:08:20.488 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 6 2024-03-29T04:08:20.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.510+0000 7fbcb7a74640 1 -- 172.21.15.73:0/282565017 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fbc9406c530 msgr2=0x7fbc9406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:20.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.510+0000 7fbcb7a74640 1 --2- 172.21.15.73:0/282565017 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fbc9406c530 0x7fbc9406e9f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbca0009560 tx=0x7fbca0009190 comp rx=0 tx=0).stop 2024-03-29T04:08:20.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.510+0000 7fbcb7a74640 1 -- 172.21.15.73:0/282565017 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcb015b370 msgr2=0x7fbcb00cdf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:20.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.510+0000 7fbcb7a74640 1 --2- 172.21.15.73:0/282565017 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcb015b370 0x7fbcb00cdf30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbca800c7e0 tx=0x7fbca800cca0 comp rx=0 tx=0).stop 2024-03-29T04:08:20.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.510+0000 7fbcb7a74640 1 -- 172.21.15.73:0/282565017 shutdown_connections 2024-03-29T04:08:20.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.510+0000 7fbcb7a74640 1 --2- 172.21.15.73:0/282565017 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbcb015b370 0x7fbcb00cdf30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:20.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.510+0000 7fbcb7a74640 1 --2- 172.21.15.73:0/282565017 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fbcb00730c0 0x7fbcb0148860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:20.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.510+0000 7fbcb7a74640 1 --2- 172.21.15.73:0/282565017 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fbc9406c530 0x7fbc9406e9f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:20.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.510+0000 7fbcb7a74640 1 --2- 172.21.15.73:0/282565017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbcb006f3f0 0x7fbcb014a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:20.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.510+0000 7fbcb7a74640 1 -- 172.21.15.73:0/282565017 >> 172.21.15.73:0/282565017 conn(0x7fbcb006b510 msgr2=0x7fbcb014bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:20.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.510+0000 7fbcb7a74640 1 -- 172.21.15.73:0/282565017 shutdown_connections 2024-03-29T04:08:20.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.510+0000 7fbcb7a74640 1 -- 172.21.15.73:0/282565017 wait complete. 2024-03-29T04:08:20.501 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-29T04:08:20.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.623+0000 7f3be27ba640 1 Processor -- start 2024-03-29T04:08:20.603 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.623+0000 7f3be27ba640 1 -- start start 2024-03-29T04:08:20.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.624+0000 7f3be27ba640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3bdc0d1100 0x7f3bdc09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:20.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.624+0000 7f3be27ba640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3bdc0ce120 0x7f3bdc09af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:20.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.624+0000 7f3be27ba640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bdc15cb70 con 0x7f3bdc15c790 2024-03-29T04:08:20.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.624+0000 7f3be27ba640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f3bdc09ba70 con 0x7f3bdc0d1100 2024-03-29T04:08:20.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.624+0000 7f3be27ba640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f3bdc0cdc90 con 0x7f3bdc0ce120 2024-03-29T04:08:20.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.624+0000 7f3bdb7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3bdc0d1100 0x7f3bdc09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:20.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.624+0000 7f3bdb7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3bdc0d1100 0x7f3bdc09aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42408/0 (socket says 172.21.15.73:42408) 2024-03-29T04:08:20.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.624+0000 7f3bdb7fe640 1 -- 172.21.15.73:0/3840220318 learned_addr learned my addr 172.21.15.73:0/3840220318 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:20.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.624+0000 7f3be0d57640 1 --2- 172.21.15.73:0/3840220318 >> v2:172.21.15.142:3300/0 conn(0x7f3bdc0ce120 0x7f3bdc09af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:20.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.625+0000 7f3bdb7fe640 1 -- 172.21.15.73:0/3840220318 >> v2:172.21.15.142:3300/0 conn(0x7f3bdc0ce120 msgr2=0x7f3bdc09af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:20.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.625+0000 7f3bdb7fe640 1 --2- 172.21.15.73:0/3840220318 >> v2:172.21.15.142:3300/0 conn(0x7f3bdc0ce120 0x7f3bdc09af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:20.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.625+0000 7f3bdb7fe640 1 -- 172.21.15.73:0/3840220318 >> v1:172.21.15.142:6789/0 conn(0x7f3bdc15c790 legacy=0x7f3bdc0d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:20.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.625+0000 7f3bdb7fe640 1 -- 172.21.15.73:0/3840220318 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bdc0cd080 con 0x7f3bdc0d1100 2024-03-29T04:08:20.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.625+0000 7f3bdb7fe640 1 --2- 172.21.15.73:0/3840220318 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bdc0d1100 0x7f3bdc09aa30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0cccb0 tx=0x7f3bd002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c75b474a55e0d65e server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:20.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.625+0000 7f3bdaffd640 1 -- 172.21.15.73:0/3840220318 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd0034070 con 0x7f3bdc0d1100 2024-03-29T04:08:20.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.626+0000 7f3bdaffd640 1 -- 172.21.15.73:0/3840220318 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bd0030860 con 0x7f3bdc0d1100 2024-03-29T04:08:20.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.626+0000 7f3bdaffd640 1 -- 172.21.15.73:0/3840220318 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd0030c30 con 0x7f3bdc0d1100 2024-03-29T04:08:20.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.626+0000 7f3be27ba640 1 -- 172.21.15.73:0/3840220318 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bdc0d1100 msgr2=0x7f3bdc09aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:20.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.626+0000 7f3be27ba640 1 --2- 172.21.15.73:0/3840220318 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bdc0d1100 0x7f3bdc09aa30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0cccb0 tx=0x7f3bd002b9a0 comp rx=0 tx=0).stop 2024-03-29T04:08:20.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.626+0000 7f3be27ba640 1 -- 172.21.15.73:0/3840220318 shutdown_connections 2024-03-29T04:08:20.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.626+0000 7f3be27ba640 1 --2- 172.21.15.73:0/3840220318 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bdc0d1100 0x7f3bdc09aa30 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:20.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.626+0000 7f3be27ba640 1 --2- 172.21.15.73:0/3840220318 >> v2:172.21.15.142:3300/0 conn(0x7f3bdc0ce120 0x7f3bdc09af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:20.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.626+0000 7f3be27ba640 1 -- 172.21.15.73:0/3840220318 >> 172.21.15.73:0/3840220318 conn(0x7f3bdc0b3f00 msgr2=0x7f3bdc0b4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:20.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.626+0000 7f3be27ba640 1 -- 172.21.15.73:0/3840220318 shutdown_connections 2024-03-29T04:08:20.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.626+0000 7f3be27ba640 1 -- 172.21.15.73:0/3840220318 wait complete. 2024-03-29T04:08:20.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.627+0000 7f3be27ba640 1 Processor -- start 2024-03-29T04:08:20.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.627+0000 7f3be27ba640 1 -- start start 2024-03-29T04:08:20.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.628+0000 7f3be27ba640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bdc0ce120 0x7f3bdc15f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:20.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.628+0000 7f3be27ba640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bdc15c790 0x7f3bdc0c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:20.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.628+0000 7f3be27ba640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bdc15cd80 0x7f3bdc0b7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:20.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.628+0000 7f3be27ba640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3bdc0cd920 con 0x7f3bdc15cd80 2024-03-29T04:08:20.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.628+0000 7f3be27ba640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3bdc0cd640 con 0x7f3bdc0ce120 2024-03-29T04:08:20.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.628+0000 7f3be27ba640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f3bdc0b1d00 con 0x7f3bdc15c790 2024-03-29T04:08:20.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.628+0000 7f3be0d57640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bdc15cd80 0x7f3bdc0b7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:20.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.628+0000 7f3be0d57640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bdc15cd80 0x7f3bdc0b7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42412/0 (socket says 172.21.15.73:42412) 2024-03-29T04:08:20.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.628+0000 7f3bdbfff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bdc0ce120 0x7f3bdc15f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:20.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.628+0000 7f3be0d57640 1 -- 172.21.15.73:0/3420120695 learned_addr learned my addr 172.21.15.73:0/3420120695 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:20.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.628+0000 7f3bdb7fe640 1 --2- 172.21.15.73:0/3420120695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bdc15c790 0x7f3bdc0c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:20.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.628+0000 7f3be0d57640 1 -- 172.21.15.73:0/3420120695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bdc15c790 msgr2=0x7f3bdc0c7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:20.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.628+0000 7f3be0d57640 1 --2- 172.21.15.73:0/3420120695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bdc15c790 0x7f3bdc0c7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:20.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.629+0000 7f3be0d57640 1 -- 172.21.15.73:0/3420120695 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bdc0ce120 msgr2=0x7f3bdc15f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:20.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.629+0000 7f3be0d57640 1 --2- 172.21.15.73:0/3420120695 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bdc0ce120 0x7f3bdc15f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:20.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.629+0000 7f3be0d57640 1 -- 172.21.15.73:0/3420120695 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bdc0b7140 con 0x7f3bdc15cd80 2024-03-29T04:08:20.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.629+0000 7f3bdbfff640 1 --2- 172.21.15.73:0/3420120695 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bdc0ce120 0x7f3bdc15f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:08:20.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.629+0000 7f3be0d57640 1 --2- 172.21.15.73:0/3420120695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bdc15cd80 0x7f3bdc0b7600 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3bd400efc0 tx=0x7f3bd400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:20.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.629+0000 7f3bd8ff9640 1 -- 172.21.15.73:0/3420120695 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd4018020 con 0x7f3bdc15cd80 2024-03-29T04:08:20.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.629+0000 7f3bd8ff9640 1 -- 172.21.15.73:0/3420120695 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bd4014480 con 0x7f3bdc15cd80 2024-03-29T04:08:20.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.629+0000 7f3bd8ff9640 1 -- 172.21.15.73:0/3420120695 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd4014870 con 0x7f3bdc15cd80 2024-03-29T04:08:20.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.629+0000 7f3be27ba640 1 -- 172.21.15.73:0/3420120695 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bdc0c8450 con 0x7f3bdc15cd80 2024-03-29T04:08:20.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.629+0000 7f3be27ba640 1 -- 172.21.15.73:0/3420120695 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bdc0b56e0 con 0x7f3bdc15cd80 2024-03-29T04:08:20.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.630+0000 7f3be27ba640 1 -- 172.21.15.73:0/3420120695 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bdc068d50 con 0x7f3bdc15cd80 2024-03-29T04:08:20.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.630+0000 7f3bd8ff9640 1 -- 172.21.15.73:0/3420120695 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f3bd4005d10 con 0x7f3bdc15cd80 2024-03-29T04:08:20.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.631+0000 7f3bd8ff9640 1 --2- 172.21.15.73:0/3420120695 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3bc806c530 0x7f3bc806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:20.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.631+0000 7f3bdbfff640 1 --2- 172.21.15.73:0/3420120695 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3bc806c530 0x7f3bc806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:20.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.631+0000 7f3bd8ff9640 1 -- 172.21.15.73:0/3420120695 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3bd408c420 con 0x7f3bdc15cd80 2024-03-29T04:08:20.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.631+0000 7f3bdbfff640 1 --2- 172.21.15.73:0/3420120695 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3bc806c530 0x7f3bc806e9f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc001ad0 tx=0x7f3bcc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:20.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.635+0000 7f3bd8ff9640 1 -- 172.21.15.73:0/3420120695 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f3bd4022030 con 0x7f3bdc15cd80 2024-03-29T04:08:20.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.811+0000 7f3be27ba640 1 -- 172.21.15.73:0/3420120695 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3bdc0b4ab0 con 0x7f3bdc15cd80 2024-03-29T04:08:20.791 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.812+0000 7f3bd8ff9640 1 -- 172.21.15.73:0/3420120695 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16605 (secure 0 0 0) 0x7f3bdc0b7140 con 0x7f3bdc15cd80 2024-03-29T04:08:20.792 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:20.792 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"6bff1617-b138-4517-acca-3ecaae3f2bb3","created":"2024-03-29T04:07:47.346864+0000","modified":"2024-03-29T04:08:13.577603+0000","last_up_change":"2024-03-29T04:07:58.507139+0000","last_in_change":"2024-03-29T04:07:49.637816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-29T04:07:59.537301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-29T04:08:09.570906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-29T04:08:10.882349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"925d7de1-14ab-48c0-aebd-7bded108f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6820","nonce":2387335359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6824","nonce":2387335359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6831","nonce":2387335359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6828","nonce":2387335359}]},"public_addr":"172.21.15.73:6820/2387335359","cluster_addr":"172.21.15.73:6824/2387335359","heartbeat_back_addr":"172.21.15.73:6831/2387335359","heartbeat_front_addr":"172.21.15.73:6828/2387335359","state":["exists","up"]},{"osd":1,"uuid":"6b182102-882a-4e0c-99db-0afae5cfb38b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6801","nonce":2431315515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6803","nonce":2431315515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6807","nonce":2431315515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6805","nonce":2431315515}]},"public_addr":"172.21.15.73:6801/2431315515","cluster_addr":"172.21.15.73:6803/2431315515","heartbeat_back_addr":"172.21.15.73:6807/2431315515","heartbeat_front_addr":"172.21.15.73:6805/2431315515","state":["exists","up"]},{"osd":2,"uuid":"8040902e-b0b8-4a21-bf64-ce1c222115ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6809","nonce":407236597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6811","nonce":407236597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6815","nonce":407236597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6813","nonce":407236597}]},"public_addr":"172.21.15.73:6809/407236597","cluster_addr":"172.21.15.73:6811/407236597","heartbeat_back_addr":"172.21.15.73:6815/407236597","heartbeat_front_addr":"172.21.15.73:6813/407236597","state":["exists","up"]},{"osd":3,"uuid":"1bab19ee-3775-4ce1-a4ce-cf7cda3bbbf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6817","nonce":4291100709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6821","nonce":4291100709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6829","nonce":4291100709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6825","nonce":4291100709}]},"public_addr":"172.21.15.73:6817/4291100709","cluster_addr":"172.21.15.73:6821/4291100709","heartbeat_back_addr":"172.21.15.73:6829/4291100709","heartbeat_front_addr":"172.21.15.73:6825/4291100709","state":["exists","up"]},{"osd":4,"uuid":"b0c74337-8fe4-47dc-b3da-2d07591b1f6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6817","nonce":3703256194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6819","nonce":3703256194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6823","nonce":3703256194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6821","nonce":3703256194}]},"public_addr":"172.21.15.142:6817/3703256194","cluster_addr":"172.21.15.142:6819/3703256194","heartbeat_back_addr":"172.21.15.142:6823/3703256194","heartbeat_front_addr":"172.21.15.142:6821/3703256194","state":["exists","up"]},{"osd":5,"uuid":"9ce36410-a29a-42c6-99f4-f95d4afdd7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6825","nonce":4271575803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6827","nonce":4271575803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6831","nonce":4271575803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6829","nonce":4271575803}]},"public_addr":"172.21.15.142:6825/4271575803","cluster_addr":"172.21.15.142:6827/4271575803","heartbeat_back_addr":"172.21.15.142:6831/4271575803","heartbeat_front_addr":"172.21.15.142:6829/4271575803","state":["exists","up"]},{"osd":6,"uuid":"aec4264a-64ac-428e-a860-d2920a304019","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6801","nonce":1772722570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6803","nonce":1772722570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6807","nonce":1772722570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6805","nonce":1772722570}]},"public_addr":"172.21.15.142:6801/1772722570","cluster_addr":"172.21.15.142:6803/1772722570","heartbeat_back_addr":"172.21.15.142:6807/1772722570","heartbeat_front_addr":"172.21.15.142:6805/1772722570","state":["exists","up"]},{"osd":7,"uuid":"fe599052-8e5a-4c7a-91e7-52d1bae24a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6809","nonce":3910589675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6811","nonce":3910589675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6815","nonce":3910589675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6813","nonce":3910589675}]},"public_addr":"172.21.15.142:6809/3910589675","cluster_addr":"172.21.15.142:6811/3910589675","heartbeat_back_addr":"172.21.15.142:6815/3910589675","heartbeat_front_addr":"172.21.15.142:6813/3910589675","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.835096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.587210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.786547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.778004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.843740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.791160+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.837992+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.718722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:08:20.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.814+0000 7f3be27ba640 1 -- 172.21.15.73:0/3420120695 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3bc806c530 msgr2=0x7f3bc806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:20.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.814+0000 7f3be27ba640 1 --2- 172.21.15.73:0/3420120695 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3bc806c530 0x7f3bc806e9f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc001ad0 tx=0x7f3bcc009040 comp rx=0 tx=0).stop 2024-03-29T04:08:20.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.814+0000 7f3be27ba640 1 -- 172.21.15.73:0/3420120695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bdc15cd80 msgr2=0x7f3bdc0b7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:20.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.814+0000 7f3be27ba640 1 --2- 172.21.15.73:0/3420120695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bdc15cd80 0x7f3bdc0b7600 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3bd400efc0 tx=0x7f3bd400c490 comp rx=0 tx=0).stop 2024-03-29T04:08:20.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.814+0000 7f3be27ba640 1 -- 172.21.15.73:0/3420120695 shutdown_connections 2024-03-29T04:08:20.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.814+0000 7f3be27ba640 1 --2- 172.21.15.73:0/3420120695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bdc15cd80 0x7f3bdc0b7600 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:20.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.814+0000 7f3be27ba640 1 --2- 172.21.15.73:0/3420120695 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bdc15c790 0x7f3bdc0c7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:20.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.814+0000 7f3be27ba640 1 --2- 172.21.15.73:0/3420120695 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3bc806c530 0x7f3bc806e9f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:20.794 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.814+0000 7f3be27ba640 1 --2- 172.21.15.73:0/3420120695 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bdc0ce120 0x7f3bdc15f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:20.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.814+0000 7f3be27ba640 1 -- 172.21.15.73:0/3420120695 >> 172.21.15.73:0/3420120695 conn(0x7f3bdc0b3f00 msgr2=0x7f3bdc0b2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:20.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.814+0000 7f3be27ba640 1 -- 172.21.15.73:0/3420120695 shutdown_connections 2024-03-29T04:08:20.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.814+0000 7f3be27ba640 1 -- 172.21.15.73:0/3420120695 wait complete. 2024-03-29T04:08:20.805 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-29T04:07:59.537301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-29T04:08:09.570906+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-29T04:08:10.882349+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-29T04:08:20.805 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-29T04:08:20.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.928+0000 7f107e633640 1 Processor -- start 2024-03-29T04:08:20.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.928+0000 7f107e633640 1 -- start start 2024-03-29T04:08:20.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.928+0000 7f107e633640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f10781624b0 0x7f10780b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:20.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.928+0000 7f107e633640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f107806d1b0 con 0x7f10780ccea0 2024-03-29T04:08:20.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.928+0000 7f107e633640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f107806d470 con 0x7f10780cca60 2024-03-29T04:08:20.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.928+0000 7f107e633640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f10780d0a10 con 0x7f10781624b0 2024-03-29T04:08:20.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.929+0000 7f107cbd0640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f10780ccea0 0x7f1078162890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52244/0 (socket says 172.21.15.73:52244) 2024-03-29T04:08:20.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.929+0000 7f107cbd0640 1 -- 172.21.15.73:0/2550525575 learned_addr learned my addr 172.21.15.73:0/2550525575 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:20.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.929+0000 7f1077fff640 1 --2- 172.21.15.73:0/2550525575 >> v2:172.21.15.142:3300/0 conn(0x7f10781624b0 0x7f10780b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:20.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.929+0000 7f1076ffd640 1 -- 172.21.15.73:0/2550525575 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 634192287 0 0) 0x7f107806d1b0 con 0x7f10780ccea0 2024-03-29T04:08:20.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.929+0000 7f1076ffd640 1 -- 172.21.15.73:0/2550525575 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1060003520 con 0x7f10780ccea0 2024-03-29T04:08:20.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.929+0000 7f1077fff640 1 -- 172.21.15.73:0/2550525575 >> v1:172.21.15.142:6789/0 conn(0x7f10780cca60 legacy=0x7f10780d0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:20.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.929+0000 7f1077fff640 1 -- 172.21.15.73:0/2550525575 >> v1:172.21.15.73:6789/0 conn(0x7f10780ccea0 legacy=0x7f1078162890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:20.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.929+0000 7f1076ffd640 1 -- 172.21.15.73:0/2550525575 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 519080704 0 0) 0x7f107806d470 con 0x7f10780cca60 2024-03-29T04:08:20.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.929+0000 7f1077fff640 1 -- 172.21.15.73:0/2550525575 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f107806d750 con 0x7f10781624b0 2024-03-29T04:08:20.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.930+0000 7f1077fff640 1 --2- 172.21.15.73:0/2550525575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10781624b0 0x7f10780b33b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f10680097a0 tx=0x7f106802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93c15f2629985616 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:20.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.930+0000 7f1076ffd640 1 -- 172.21.15.73:0/2550525575 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1068034070 con 0x7f10781624b0 2024-03-29T04:08:20.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.930+0000 7f1076ffd640 1 -- 172.21.15.73:0/2550525575 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1068030610 con 0x7f10781624b0 2024-03-29T04:08:20.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.930+0000 7f1076ffd640 1 -- 172.21.15.73:0/2550525575 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10680309c0 con 0x7f10781624b0 2024-03-29T04:08:20.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.930+0000 7f107e633640 1 -- 172.21.15.73:0/2550525575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10781624b0 msgr2=0x7f10780b33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:20.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.930+0000 7f107e633640 1 --2- 172.21.15.73:0/2550525575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10781624b0 0x7f10780b33b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f10680097a0 tx=0x7f106802b960 comp rx=0 tx=0).stop 2024-03-29T04:08:20.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.930+0000 7f107e633640 1 -- 172.21.15.73:0/2550525575 shutdown_connections 2024-03-29T04:08:20.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.930+0000 7f107e633640 1 --2- 172.21.15.73:0/2550525575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10781624b0 0x7f10780b33b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:20.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.930+0000 7f107e633640 1 -- 172.21.15.73:0/2550525575 >> 172.21.15.73:0/2550525575 conn(0x7f10780b3f00 msgr2=0x7f10780b4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:20.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.930+0000 7f107e633640 1 -- 172.21.15.73:0/2550525575 shutdown_connections 2024-03-29T04:08:20.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.930+0000 7f107e633640 1 -- 172.21.15.73:0/2550525575 wait complete. 2024-03-29T04:08:20.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.931+0000 7f107e633640 1 Processor -- start 2024-03-29T04:08:20.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.932+0000 7f107e633640 1 -- start start 2024-03-29T04:08:20.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.932+0000 7f107e633640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10780cca60 0x7f10781493d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:20.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.932+0000 7f107e633640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10780ccea0 0x7f1078160030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:20.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.932+0000 7f107e633640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10781624b0 0x7f107815b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:20.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.932+0000 7f107e633640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f107815feb0 con 0x7f10781624b0 2024-03-29T04:08:20.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.932+0000 7f107e633640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f107815fd30 con 0x7f10780cca60 2024-03-29T04:08:20.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.932+0000 7f107e633640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f10780d15b0 con 0x7f10780ccea0 2024-03-29T04:08:20.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.933+0000 7f107cbd0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10781624b0 0x7f107815b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:20.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.933+0000 7f107cbd0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10781624b0 0x7f107815b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42426/0 (socket says 172.21.15.73:42426) 2024-03-29T04:08:20.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.933+0000 7f107cbd0640 1 -- 172.21.15.73:0/710635533 learned_addr learned my addr 172.21.15.73:0/710635533 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:20.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.933+0000 7f1077fff640 1 --2- 172.21.15.73:0/710635533 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10780cca60 0x7f10781493d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:20.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.933+0000 7f10777fe640 1 --2- 172.21.15.73:0/710635533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10780ccea0 0x7f1078160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:20.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.933+0000 7f107cbd0640 1 -- 172.21.15.73:0/710635533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10780ccea0 msgr2=0x7f1078160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:20.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.933+0000 7f107cbd0640 1 --2- 172.21.15.73:0/710635533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10780ccea0 0x7f1078160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:20.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.933+0000 7f107cbd0640 1 -- 172.21.15.73:0/710635533 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10780cca60 msgr2=0x7f10781493d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:20.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.933+0000 7f107cbd0640 1 --2- 172.21.15.73:0/710635533 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10780cca60 0x7f10781493d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:20.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.933+0000 7f107cbd0640 1 -- 172.21.15.73:0/710635533 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1078160ab0 con 0x7f10781624b0 2024-03-29T04:08:20.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.933+0000 7f1077fff640 1 --2- 172.21.15.73:0/710635533 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10780cca60 0x7f10781493d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:08:20.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.933+0000 7f107cbd0640 1 --2- 172.21.15.73:0/710635533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10781624b0 0x7f107815b8c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f107000cb40 tx=0x7f107000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:20.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.933+0000 7f1074ff9640 1 -- 172.21.15.73:0/710635533 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1070017070 con 0x7f10781624b0 2024-03-29T04:08:20.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.933+0000 7f1074ff9640 1 -- 172.21.15.73:0/710635533 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f107000ac40 con 0x7f10781624b0 2024-03-29T04:08:20.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.933+0000 7f107e633640 1 -- 172.21.15.73:0/710635533 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1078160d90 con 0x7f10781624b0 2024-03-29T04:08:20.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.933+0000 7f1074ff9640 1 -- 172.21.15.73:0/710635533 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1070012400 con 0x7f10781624b0 2024-03-29T04:08:20.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.933+0000 7f107e633640 1 -- 172.21.15.73:0/710635533 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1078161350 con 0x7f10781624b0 2024-03-29T04:08:20.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.934+0000 7f107e633640 1 -- 172.21.15.73:0/710635533 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1078161680 con 0x7f10781624b0 2024-03-29T04:08:20.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.934+0000 7f1074ff9640 1 -- 172.21.15.73:0/710635533 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f107001a070 con 0x7f10781624b0 2024-03-29T04:08:20.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.935+0000 7f1074ff9640 1 --2- 172.21.15.73:0/710635533 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f106406c560 0x7f106406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:20.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.935+0000 7f1074ff9640 1 -- 172.21.15.73:0/710635533 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f107008b440 con 0x7f10781624b0 2024-03-29T04:08:20.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.935+0000 7f1077fff640 1 --2- 172.21.15.73:0/710635533 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f106406c560 0x7f106406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:20.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.935+0000 7f1077fff640 1 --2- 172.21.15.73:0/710635533 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f106406c560 0x7f106406ea20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1068036000 tx=0x7f106803b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:20.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:20.939+0000 7f1074ff9640 1 -- 172.21.15.73:0/710635533 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f1070059420 con 0x7f10781624b0 2024-03-29T04:08:21.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.112+0000 7f107e633640 1 -- 172.21.15.73:0/710635533 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f10780a04c0 con 0x7f10781624b0 2024-03-29T04:08:21.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.113+0000 7f1074ff9640 1 -- 172.21.15.73:0/710635533 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f107005d720 con 0x7f10781624b0 2024-03-29T04:08:21.092 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-03-29T04:08:21.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.114+0000 7f107e633640 1 -- 172.21.15.73:0/710635533 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f106406c560 msgr2=0x7f106406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:21.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.114+0000 7f107e633640 1 --2- 172.21.15.73:0/710635533 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f106406c560 0x7f106406ea20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1068036000 tx=0x7f106803b040 comp rx=0 tx=0).stop 2024-03-29T04:08:21.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.114+0000 7f107e633640 1 -- 172.21.15.73:0/710635533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10781624b0 msgr2=0x7f107815b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:21.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.114+0000 7f107e633640 1 --2- 172.21.15.73:0/710635533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10781624b0 0x7f107815b8c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f107000cb40 tx=0x7f107000a060 comp rx=0 tx=0).stop 2024-03-29T04:08:21.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.114+0000 7f107e633640 1 -- 172.21.15.73:0/710635533 shutdown_connections 2024-03-29T04:08:21.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.114+0000 7f107e633640 1 --2- 172.21.15.73:0/710635533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10781624b0 0x7f107815b8c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:21.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.114+0000 7f107e633640 1 --2- 172.21.15.73:0/710635533 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f10780ccea0 0x7f1078160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:21.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.114+0000 7f107e633640 1 --2- 172.21.15.73:0/710635533 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f106406c560 0x7f106406ea20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:21.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.114+0000 7f107e633640 1 --2- 172.21.15.73:0/710635533 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10780cca60 0x7f10781493d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:21.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.114+0000 7f107e633640 1 -- 172.21.15.73:0/710635533 >> 172.21.15.73:0/710635533 conn(0x7f10780b3f00 msgr2=0x7f10780747d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:21.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.115+0000 7f107e633640 1 -- 172.21.15.73:0/710635533 shutdown_connections 2024-03-29T04:08:21.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.115+0000 7f107e633640 1 -- 172.21.15.73:0/710635533 wait complete. 2024-03-29T04:08:21.105 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-29T04:08:21.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.228+0000 7f2cd857c640 1 Processor -- start 2024-03-29T04:08:21.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.228+0000 7f2cd857c640 1 -- start start 2024-03-29T04:08:21.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.229+0000 7f2cd857c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2cd015e4d0 0x7f2cd006c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:21.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.229+0000 7f2cd857c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2cd00d0e70 0x7f2cd00d2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:21.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.229+0000 7f2cd857c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cd00d13e0 con 0x7f2cd015e8b0 2024-03-29T04:08:21.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.229+0000 7f2cd857c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f2cd00cf6b0 con 0x7f2cd015e4d0 2024-03-29T04:08:21.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.229+0000 7f2cd857c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f2cd00d16c0 con 0x7f2cd00d0e70 2024-03-29T04:08:21.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.229+0000 7f2cd6318640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2cd015e4d0 0x7f2cd006c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:21.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.229+0000 7f2cd6318640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2cd015e4d0 0x7f2cd006c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42432/0 (socket says 172.21.15.73:42432) 2024-03-29T04:08:21.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.229+0000 7f2cd5b17640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2cd015e8b0 0x7f2cd00d2350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52258/0 (socket says 172.21.15.73:52258) 2024-03-29T04:08:21.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.229+0000 7f2cd6318640 1 -- 172.21.15.73:0/913084331 learned_addr learned my addr 172.21.15.73:0/913084331 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:21.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.230+0000 7f2cd6b19640 1 --2- 172.21.15.73:0/913084331 >> v2:172.21.15.142:3300/0 conn(0x7f2cd00d0e70 0x7f2cd00d2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:21.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.230+0000 7f2cd6318640 1 -- 172.21.15.73:0/913084331 >> v2:172.21.15.142:3300/0 conn(0x7f2cd00d0e70 msgr2=0x7f2cd00d2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:21.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.230+0000 7f2cd6318640 1 --2- 172.21.15.73:0/913084331 >> v2:172.21.15.142:3300/0 conn(0x7f2cd00d0e70 0x7f2cd00d2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:21.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.230+0000 7f2cd6318640 1 -- 172.21.15.73:0/913084331 >> v1:172.21.15.73:6789/0 conn(0x7f2cd015e8b0 legacy=0x7f2cd00d2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:21.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.230+0000 7f2cd6318640 1 -- 172.21.15.73:0/913084331 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cd00d19a0 con 0x7f2cd015e4d0 2024-03-29T04:08:21.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.230+0000 7f2cd6318640 1 --2- 172.21.15.73:0/913084331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cd015e4d0 0x7f2cd006c740 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2cd00cebf0 tx=0x7f2ccc02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c9cdaf4096492b8 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:21.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.231+0000 7f2cd5316640 1 -- 172.21.15.73:0/913084331 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc02cb20 con 0x7f2cd015e4d0 2024-03-29T04:08:21.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.231+0000 7f2cd5316640 1 -- 172.21.15.73:0/913084331 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ccc02ccc0 con 0x7f2cd015e4d0 2024-03-29T04:08:21.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.231+0000 7f2cd5316640 1 -- 172.21.15.73:0/913084331 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc034610 con 0x7f2cd015e4d0 2024-03-29T04:08:21.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.231+0000 7f2cd857c640 1 -- 172.21.15.73:0/913084331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cd015e4d0 msgr2=0x7f2cd006c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:21.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.231+0000 7f2cd857c640 1 --2- 172.21.15.73:0/913084331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cd015e4d0 0x7f2cd006c740 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2cd00cebf0 tx=0x7f2ccc02bf80 comp rx=0 tx=0).stop 2024-03-29T04:08:21.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.231+0000 7f2cd857c640 1 -- 172.21.15.73:0/913084331 shutdown_connections 2024-03-29T04:08:21.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.231+0000 7f2cd857c640 1 --2- 172.21.15.73:0/913084331 >> v2:172.21.15.142:3300/0 conn(0x7f2cd00d0e70 0x7f2cd00d2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:21.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.231+0000 7f2cd857c640 1 --2- 172.21.15.73:0/913084331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cd015e4d0 0x7f2cd006c740 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:21.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.231+0000 7f2cd857c640 1 -- 172.21.15.73:0/913084331 >> 172.21.15.73:0/913084331 conn(0x7f2cd008bfc0 msgr2=0x7f2cd00d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:21.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.231+0000 7f2cd857c640 1 -- 172.21.15.73:0/913084331 shutdown_connections 2024-03-29T04:08:21.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.231+0000 7f2cd857c640 1 -- 172.21.15.73:0/913084331 wait complete. 2024-03-29T04:08:21.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.232+0000 7f2cd857c640 1 Processor -- start 2024-03-29T04:08:21.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.232+0000 7f2cd857c640 1 -- start start 2024-03-29T04:08:21.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.233+0000 7f2cd857c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cd00d0e70 0x7f2cd015b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:21.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.233+0000 7f2cd857c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cd015e4d0 0x7f2cd00cd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:21.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.233+0000 7f2cd857c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cd015e8b0 0x7f2cd00cdc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:21.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.233+0000 7f2cd857c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd00d3130 con 0x7f2cd015e4d0 2024-03-29T04:08:21.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.233+0000 7f2cd857c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd00cf2d0 con 0x7f2cd015e8b0 2024-03-29T04:08:21.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.233+0000 7f2cd857c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2cd00d32b0 con 0x7f2cd00d0e70 2024-03-29T04:08:21.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.233+0000 7f2cd5b17640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cd015e4d0 0x7f2cd00cd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:21.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.233+0000 7f2cd5b17640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cd015e4d0 0x7f2cd00cd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42440/0 (socket says 172.21.15.73:42440) 2024-03-29T04:08:21.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.233+0000 7f2cd5b17640 1 -- 172.21.15.73:0/3447314113 learned_addr learned my addr 172.21.15.73:0/3447314113 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:21.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.233+0000 7f2cd6318640 1 --2- 172.21.15.73:0/3447314113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cd00d0e70 0x7f2cd015b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:21.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.233+0000 7f2cd6b19640 1 --2- 172.21.15.73:0/3447314113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cd015e8b0 0x7f2cd00cdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:21.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.233+0000 7f2cd5b17640 1 -- 172.21.15.73:0/3447314113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cd00d0e70 msgr2=0x7f2cd015b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:21.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.233+0000 7f2cd5b17640 1 --2- 172.21.15.73:0/3447314113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cd00d0e70 0x7f2cd015b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:21.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.233+0000 7f2cd5b17640 1 -- 172.21.15.73:0/3447314113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cd015e8b0 msgr2=0x7f2cd00cdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:21.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.233+0000 7f2cd5b17640 1 --2- 172.21.15.73:0/3447314113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cd015e8b0 0x7f2cd00cdc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:21.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.233+0000 7f2cd5b17640 1 -- 172.21.15.73:0/3447314113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cd00ce540 con 0x7f2cd015e4d0 2024-03-29T04:08:21.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.234+0000 7f2cd5b17640 1 --2- 172.21.15.73:0/3447314113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cd015e4d0 0x7f2cd00cd6f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2cc000c390 tx=0x7f2cc0001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:21.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.234+0000 7f2cc6ffd640 1 -- 172.21.15.73:0/3447314113 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc00074e0 con 0x7f2cd015e4d0 2024-03-29T04:08:21.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.234+0000 7f2cc6ffd640 1 -- 172.21.15.73:0/3447314113 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cc0007680 con 0x7f2cd015e4d0 2024-03-29T04:08:21.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.234+0000 7f2cc6ffd640 1 -- 172.21.15.73:0/3447314113 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc0004a20 con 0x7f2cd015e4d0 2024-03-29T04:08:21.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.234+0000 7f2cd857c640 1 -- 172.21.15.73:0/3447314113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cd015bda0 con 0x7f2cd015e4d0 2024-03-29T04:08:21.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.234+0000 7f2cd857c640 1 -- 172.21.15.73:0/3447314113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cd01f82d0 con 0x7f2cd015e4d0 2024-03-29T04:08:21.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.235+0000 7f2cd857c640 1 -- 172.21.15.73:0/3447314113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cd00a2500 con 0x7f2cd015e4d0 2024-03-29T04:08:21.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.235+0000 7f2cc6ffd640 1 -- 172.21.15.73:0/3447314113 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f2cc001a020 con 0x7f2cd015e4d0 2024-03-29T04:08:21.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.235+0000 7f2cc6ffd640 1 --2- 172.21.15.73:0/3447314113 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2cb406c530 0x7f2cb406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:21.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.236+0000 7f2cc6ffd640 1 -- 172.21.15.73:0/3447314113 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2cc008ac50 con 0x7f2cd015e4d0 2024-03-29T04:08:21.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.236+0000 7f2cd6318640 1 --2- 172.21.15.73:0/3447314113 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2cb406c530 0x7f2cb406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:21.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.236+0000 7f2cd6318640 1 --2- 172.21.15.73:0/3447314113 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2cb406c530 0x7f2cb406e9f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc035000 tx=0x7f2ccc030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:21.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.240+0000 7f2cc6ffd640 1 -- 172.21.15.73:0/3447314113 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f2cc0090020 con 0x7f2cd015e4d0 2024-03-29T04:08:21.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.414+0000 7f2cd857c640 1 -- 172.21.15.73:0/3447314113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2cd004f9d0 con 0x7f2cd015e4d0 2024-03-29T04:08:21.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.414+0000 7f2cc6ffd640 1 -- 172.21.15.73:0/3447314113 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f2cc0058cb0 con 0x7f2cd015e4d0 2024-03-29T04:08:21.394 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-03-29T04:08:21.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.416+0000 7f2cd857c640 1 -- 172.21.15.73:0/3447314113 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2cb406c530 msgr2=0x7f2cb406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:21.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.416+0000 7f2cd857c640 1 --2- 172.21.15.73:0/3447314113 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2cb406c530 0x7f2cb406e9f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc035000 tx=0x7f2ccc030000 comp rx=0 tx=0).stop 2024-03-29T04:08:21.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.416+0000 7f2cd857c640 1 -- 172.21.15.73:0/3447314113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cd015e4d0 msgr2=0x7f2cd00cd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:21.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.416+0000 7f2cd857c640 1 --2- 172.21.15.73:0/3447314113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cd015e4d0 0x7f2cd00cd6f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2cc000c390 tx=0x7f2cc0001e70 comp rx=0 tx=0).stop 2024-03-29T04:08:21.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.416+0000 7f2cd857c640 1 -- 172.21.15.73:0/3447314113 shutdown_connections 2024-03-29T04:08:21.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.416+0000 7f2cd857c640 1 --2- 172.21.15.73:0/3447314113 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2cb406c530 0x7f2cb406e9f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:21.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.416+0000 7f2cd857c640 1 --2- 172.21.15.73:0/3447314113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2cd015e8b0 0x7f2cd00cdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:21.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.416+0000 7f2cd857c640 1 --2- 172.21.15.73:0/3447314113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cd015e4d0 0x7f2cd00cd6f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:21.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.416+0000 7f2cd857c640 1 --2- 172.21.15.73:0/3447314113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2cd00d0e70 0x7f2cd015b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:21.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.416+0000 7f2cd857c640 1 -- 172.21.15.73:0/3447314113 >> 172.21.15.73:0/3447314113 conn(0x7f2cd008bfc0 msgr2=0x7f2cd015fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:21.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.416+0000 7f2cd857c640 1 -- 172.21.15.73:0/3447314113 shutdown_connections 2024-03-29T04:08:21.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.417+0000 7f2cd857c640 1 -- 172.21.15.73:0/3447314113 wait complete. 2024-03-29T04:08:21.407 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-29T04:08:21.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.530+0000 7f4f050c8640 1 Processor -- start 2024-03-29T04:08:21.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.530+0000 7f4f050c8640 1 -- start start 2024-03-29T04:08:21.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.531+0000 7f4f050c8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f00072dc0 0x7f4f000cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:21.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.531+0000 7f4f050c8640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f000d01e0 con 0x7f4f0006c520 2024-03-29T04:08:21.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.531+0000 7f4f050c8640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f000d04c0 con 0x7f4f0015c760 2024-03-29T04:08:21.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.531+0000 7f4f050c8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f4f000b6050 con 0x7f4f00072dc0 2024-03-29T04:08:21.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.531+0000 7f4eff59e640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f4f0006c520 0x7f4f0015cb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52262/0 (socket says 172.21.15.73:52262) 2024-03-29T04:08:21.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.531+0000 7f4eff59e640 1 -- 172.21.15.73:0/3622343394 learned_addr learned my addr 172.21.15.73:0/3622343394 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:21.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.531+0000 7f4efe59c640 1 --2- 172.21.15.73:0/3622343394 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f00072dc0 0x7f4f000cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:21.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.532+0000 7f4efdd9b640 1 -- 172.21.15.73:0/3622343394 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1638180301 0 0) 0x7f4f000d01e0 con 0x7f4f0006c520 2024-03-29T04:08:21.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.532+0000 7f4efdd9b640 1 -- 172.21.15.73:0/3622343394 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ee8003520 con 0x7f4f0006c520 2024-03-29T04:08:21.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.532+0000 7f4efdd9b640 1 -- 172.21.15.73:0/3622343394 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4258160078 0 0) 0x7f4f000d04c0 con 0x7f4f0015c760 2024-03-29T04:08:21.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.532+0000 7f4efdd9b640 1 -- 172.21.15.73:0/3622343394 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f000d01e0 con 0x7f4f0015c760 2024-03-29T04:08:21.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.532+0000 7f4efe59c640 1 -- 172.21.15.73:0/3622343394 >> v1:172.21.15.142:6789/0 conn(0x7f4f0015c760 legacy=0x7f4f0006f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:21.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.532+0000 7f4efe59c640 1 -- 172.21.15.73:0/3622343394 >> v1:172.21.15.73:6789/0 conn(0x7f4f0006c520 legacy=0x7f4f0015cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:21.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.532+0000 7f4efe59c640 1 -- 172.21.15.73:0/3622343394 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f0006f1a0 con 0x7f4f00072dc0 2024-03-29T04:08:21.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.532+0000 7f4efe59c640 1 --2- 172.21.15.73:0/3622343394 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f00072dc0 0x7f4f000cf970 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4ef40097d0 tx=0x7f4ef402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7888e663e57988ca server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:21.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.533+0000 7f4efdd9b640 1 -- 172.21.15.73:0/3622343394 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef4035020 con 0x7f4f00072dc0 2024-03-29T04:08:21.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.533+0000 7f4efdd9b640 1 -- 172.21.15.73:0/3622343394 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ef4031890 con 0x7f4f00072dc0 2024-03-29T04:08:21.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.533+0000 7f4efdd9b640 1 -- 172.21.15.73:0/3622343394 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef4031c40 con 0x7f4f00072dc0 2024-03-29T04:08:21.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.533+0000 7f4f050c8640 1 -- 172.21.15.73:0/3622343394 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f00072dc0 msgr2=0x7f4f000cf970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:21.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.533+0000 7f4f050c8640 1 --2- 172.21.15.73:0/3622343394 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f00072dc0 0x7f4f000cf970 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4ef40097d0 tx=0x7f4ef402b930 comp rx=0 tx=0).stop 2024-03-29T04:08:21.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.533+0000 7f4f050c8640 1 -- 172.21.15.73:0/3622343394 shutdown_connections 2024-03-29T04:08:21.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.533+0000 7f4f050c8640 1 --2- 172.21.15.73:0/3622343394 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f00072dc0 0x7f4f000cf970 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:21.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.533+0000 7f4f050c8640 1 -- 172.21.15.73:0/3622343394 >> 172.21.15.73:0/3622343394 conn(0x7f4f00072090 msgr2=0x7f4f000724a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:21.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.533+0000 7f4f050c8640 1 -- 172.21.15.73:0/3622343394 shutdown_connections 2024-03-29T04:08:21.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.533+0000 7f4f050c8640 1 -- 172.21.15.73:0/3622343394 wait complete. 2024-03-29T04:08:21.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.535+0000 7f4f050c8640 1 Processor -- start 2024-03-29T04:08:21.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.535+0000 7f4f050c8640 1 -- start start 2024-03-29T04:08:21.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.535+0000 7f4f050c8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f0006c520 0x7f4f0014f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:21.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.535+0000 7f4f050c8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f00072dc0 0x7f4f0013d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:21.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.535+0000 7f4f050c8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f0015c760 0x7f4f001515d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:21.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.535+0000 7f4f050c8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4f000d07a0 con 0x7f4f0015c760 2024-03-29T04:08:21.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.535+0000 7f4f050c8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4f000cfeb0 con 0x7f4f00072dc0 2024-03-29T04:08:21.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.535+0000 7f4f050c8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f4f0006c970 con 0x7f4f0006c520 2024-03-29T04:08:21.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.535+0000 7f4eff59e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f0015c760 0x7f4f001515d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:21.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.535+0000 7f4eff59e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f0015c760 0x7f4f001515d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42446/0 (socket says 172.21.15.73:42446) 2024-03-29T04:08:21.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.535+0000 7f4eff59e640 1 -- 172.21.15.73:0/255896786 learned_addr learned my addr 172.21.15.73:0/255896786 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:21.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.535+0000 7f4efed9d640 1 --2- 172.21.15.73:0/255896786 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f0006c520 0x7f4f0014f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:21.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.536+0000 7f4efe59c640 1 --2- 172.21.15.73:0/255896786 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f00072dc0 0x7f4f0013d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:21.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.536+0000 7f4eff59e640 1 -- 172.21.15.73:0/255896786 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f0006c520 msgr2=0x7f4f0014f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:21.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.536+0000 7f4eff59e640 1 --2- 172.21.15.73:0/255896786 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f0006c520 0x7f4f0014f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:21.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.536+0000 7f4eff59e640 1 -- 172.21.15.73:0/255896786 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f00072dc0 msgr2=0x7f4f0013d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:21.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.536+0000 7f4eff59e640 1 --2- 172.21.15.73:0/255896786 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f00072dc0 0x7f4f0013d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:21.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.536+0000 7f4eff59e640 1 -- 172.21.15.73:0/255896786 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f0013d830 con 0x7f4f0015c760 2024-03-29T04:08:21.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.536+0000 7f4eff59e640 1 --2- 172.21.15.73:0/255896786 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f0015c760 0x7f4f001515d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4ef800c430 tx=0x7f4ef800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:21.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.536+0000 7f4ee77fe640 1 -- 172.21.15.73:0/255896786 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef8017070 con 0x7f4f0015c760 2024-03-29T04:08:21.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.536+0000 7f4ee77fe640 1 -- 172.21.15.73:0/255896786 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ef8005d00 con 0x7f4f0015c760 2024-03-29T04:08:21.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.536+0000 7f4ee77fe640 1 -- 172.21.15.73:0/255896786 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef8007310 con 0x7f4f0015c760 2024-03-29T04:08:21.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.536+0000 7f4f050c8640 1 -- 172.21.15.73:0/255896786 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f00151e60 con 0x7f4f0015c760 2024-03-29T04:08:21.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.536+0000 7f4f050c8640 1 -- 172.21.15.73:0/255896786 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f001553a0 con 0x7f4f0015c760 2024-03-29T04:08:21.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.537+0000 7f4f050c8640 1 -- 172.21.15.73:0/255896786 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f000b3a60 con 0x7f4f0015c760 2024-03-29T04:08:21.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.537+0000 7f4ee77fe640 1 -- 172.21.15.73:0/255896786 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f4ef801a070 con 0x7f4f0015c760 2024-03-29T04:08:21.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.538+0000 7f4ee77fe640 1 --2- 172.21.15.73:0/255896786 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f4eec06c530 0x7f4eec06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:21.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.538+0000 7f4ee77fe640 1 -- 172.21.15.73:0/255896786 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4ef808aa70 con 0x7f4f0015c760 2024-03-29T04:08:21.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.538+0000 7f4efed9d640 1 --2- 172.21.15.73:0/255896786 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f4eec06c530 0x7f4eec06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:21.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.538+0000 7f4efed9d640 1 --2- 172.21.15.73:0/255896786 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f4eec06c530 0x7f4eec06e9f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0001e00 tx=0x7f4ef0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:21.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.542+0000 7f4ee77fe640 1 -- 172.21.15.73:0/255896786 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f4f000b3a60 con 0x7f4f0015c760 2024-03-29T04:08:21.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.717+0000 7f4f050c8640 1 -- 172.21.15.73:0/255896786 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4f0006f6c0 con 0x7f4f0015c760 2024-03-29T04:08:21.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.718+0000 7f4ee77fe640 1 -- 172.21.15.73:0/255896786 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f4f0006f6c0 con 0x7f4f0015c760 2024-03-29T04:08:21.698 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-29T04:08:21.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.720+0000 7f4f050c8640 1 -- 172.21.15.73:0/255896786 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f4eec06c530 msgr2=0x7f4eec06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:21.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.720+0000 7f4f050c8640 1 --2- 172.21.15.73:0/255896786 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f4eec06c530 0x7f4eec06e9f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0001e00 tx=0x7f4ef0009040 comp rx=0 tx=0).stop 2024-03-29T04:08:21.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.720+0000 7f4f050c8640 1 -- 172.21.15.73:0/255896786 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f0015c760 msgr2=0x7f4f001515d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:21.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.720+0000 7f4f050c8640 1 --2- 172.21.15.73:0/255896786 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f0015c760 0x7f4f001515d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4ef800c430 tx=0x7f4ef800c8f0 comp rx=0 tx=0).stop 2024-03-29T04:08:21.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.720+0000 7f4f050c8640 1 -- 172.21.15.73:0/255896786 shutdown_connections 2024-03-29T04:08:21.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.720+0000 7f4f050c8640 1 --2- 172.21.15.73:0/255896786 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4f0015c760 0x7f4f001515d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:21.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.720+0000 7f4f050c8640 1 --2- 172.21.15.73:0/255896786 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f4eec06c530 0x7f4eec06e9f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:21.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.720+0000 7f4f050c8640 1 --2- 172.21.15.73:0/255896786 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f00072dc0 0x7f4f0013d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:21.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.720+0000 7f4f050c8640 1 --2- 172.21.15.73:0/255896786 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4f0006c520 0x7f4f0014f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:21.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.720+0000 7f4f050c8640 1 -- 172.21.15.73:0/255896786 >> 172.21.15.73:0/255896786 conn(0x7f4f00072090 msgr2=0x7f4f0015b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:21.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.720+0000 7f4f050c8640 1 -- 172.21.15.73:0/255896786 shutdown_connections 2024-03-29T04:08:21.701 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.720+0000 7f4f050c8640 1 -- 172.21.15.73:0/255896786 wait complete. 2024-03-29T04:08:21.710 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-29T04:08:21.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.831+0000 7f3535d96640 1 Processor -- start 2024-03-29T04:08:21.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.831+0000 7f3535d96640 1 -- start start 2024-03-29T04:08:21.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.832+0000 7f3535d96640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f353006e0f0 0x7f353006f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:21.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.832+0000 7f3535d96640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f353006fc90 0x7f353006c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:21.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.832+0000 7f3535d96640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f353006e6b0 con 0x7f353015e9a0 2024-03-29T04:08:21.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.832+0000 7f3535d96640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f353006f2c0 con 0x7f353006e0f0 2024-03-29T04:08:21.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.832+0000 7f3535d96640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f353006e990 con 0x7f353006fc90 2024-03-29T04:08:21.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.832+0000 7f352effd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f353006e0f0 0x7f353006f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:21.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.832+0000 7f352effd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f353006e0f0 0x7f353006f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42450/0 (socket says 172.21.15.73:42450) 2024-03-29T04:08:21.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.832+0000 7f352effd640 1 -- 172.21.15.73:0/3750880120 learned_addr learned my addr 172.21.15.73:0/3750880120 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:21.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.832+0000 7f352ffff640 1 --2- 172.21.15.73:0/3750880120 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f353006fc90 0x7f353006c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:21.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.832+0000 7f352effd640 1 -- 172.21.15.73:0/3750880120 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f353006fc90 msgr2=0x7f353006c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:21.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.832+0000 7f352effd640 1 --2- 172.21.15.73:0/3750880120 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f353006fc90 0x7f353006c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:21.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.832+0000 7f352effd640 1 -- 172.21.15.73:0/3750880120 >> v1:172.21.15.142:6789/0 conn(0x7f353015e9a0 legacy=0x7f3530072d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:21.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.832+0000 7f352effd640 1 -- 172.21.15.73:0/3750880120 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f353006ec70 con 0x7f353006e0f0 2024-03-29T04:08:21.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.833+0000 7f352effd640 1 --2- 172.21.15.73:0/3750880120 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f353006e0f0 0x7f353006f750 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3520009870 tx=0x7f352002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f806d27b331b4a server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:21.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.833+0000 7f352e7fc640 1 -- 172.21.15.73:0/3750880120 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3520035020 con 0x7f353006e0f0 2024-03-29T04:08:21.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.833+0000 7f352e7fc640 1 -- 172.21.15.73:0/3750880120 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3520031640 con 0x7f353006e0f0 2024-03-29T04:08:21.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.833+0000 7f352e7fc640 1 -- 172.21.15.73:0/3750880120 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352002d040 con 0x7f353006e0f0 2024-03-29T04:08:21.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.833+0000 7f3535d96640 1 -- 172.21.15.73:0/3750880120 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f353006e0f0 msgr2=0x7f353006f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:21.814 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.833+0000 7f3535d96640 1 --2- 172.21.15.73:0/3750880120 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f353006e0f0 0x7f353006f750 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3520009870 tx=0x7f352002b8f0 comp rx=0 tx=0).stop 2024-03-29T04:08:21.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.833+0000 7f3535d96640 1 -- 172.21.15.73:0/3750880120 shutdown_connections 2024-03-29T04:08:21.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.833+0000 7f3535d96640 1 --2- 172.21.15.73:0/3750880120 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f353006fc90 0x7f353006c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:21.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.833+0000 7f3535d96640 1 --2- 172.21.15.73:0/3750880120 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f353006e0f0 0x7f353006f750 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:21.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.833+0000 7f3535d96640 1 -- 172.21.15.73:0/3750880120 >> 172.21.15.73:0/3750880120 conn(0x7f3530072090 msgr2=0x7f35300724a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:21.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.833+0000 7f3535d96640 1 -- 172.21.15.73:0/3750880120 shutdown_connections 2024-03-29T04:08:21.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.833+0000 7f3535d96640 1 -- 172.21.15.73:0/3750880120 wait complete. 2024-03-29T04:08:21.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.835+0000 7f3535d96640 1 Processor -- start 2024-03-29T04:08:21.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.835+0000 7f3535d96640 1 -- start start 2024-03-29T04:08:21.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.835+0000 7f3535d96640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f353006e0f0 0x7f35301e9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:21.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.835+0000 7f3535d96640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f353006fc90 0x7f35301592c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:21.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.835+0000 7f3535d96640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f353015e9a0 0x7f3530159800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:21.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.835+0000 7f3535d96640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f353006cbe0 con 0x7f353006fc90 2024-03-29T04:08:21.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.835+0000 7f3535d96640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f353006ca60 con 0x7f353015e9a0 2024-03-29T04:08:21.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.835+0000 7f3535d96640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f353006cd60 con 0x7f353006e0f0 2024-03-29T04:08:21.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.836+0000 7f352effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f353006fc90 0x7f35301592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:21.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.836+0000 7f352effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f353006fc90 0x7f35301592c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42456/0 (socket says 172.21.15.73:42456) 2024-03-29T04:08:21.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.836+0000 7f352effd640 1 -- 172.21.15.73:0/163926563 learned_addr learned my addr 172.21.15.73:0/163926563 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:21.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.836+0000 7f352f7fe640 1 --2- 172.21.15.73:0/163926563 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f353006e0f0 0x7f35301e9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:21.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.836+0000 7f352ffff640 1 --2- 172.21.15.73:0/163926563 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f353015e9a0 0x7f3530159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:21.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.836+0000 7f352effd640 1 -- 172.21.15.73:0/163926563 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f353006e0f0 msgr2=0x7f35301e9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:21.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.836+0000 7f352effd640 1 --2- 172.21.15.73:0/163926563 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f353006e0f0 0x7f35301e9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:21.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.836+0000 7f352effd640 1 -- 172.21.15.73:0/163926563 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f353015e9a0 msgr2=0x7f3530159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:21.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.836+0000 7f352effd640 1 --2- 172.21.15.73:0/163926563 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f353015e9a0 0x7f3530159800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:21.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.836+0000 7f352effd640 1 -- 172.21.15.73:0/163926563 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f353015cfe0 con 0x7f353006fc90 2024-03-29T04:08:21.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.836+0000 7f352effd640 1 --2- 172.21.15.73:0/163926563 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f353006fc90 0x7f35301592c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3520000c00 tx=0x7f35200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:21.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.836+0000 7f3517fff640 1 -- 172.21.15.73:0/163926563 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3520040070 con 0x7f353006fc90 2024-03-29T04:08:21.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.836+0000 7f3517fff640 1 -- 172.21.15.73:0/163926563 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35200399f0 con 0x7f353006fc90 2024-03-29T04:08:21.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.836+0000 7f3535d96640 1 -- 172.21.15.73:0/163926563 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f353015d2c0 con 0x7f353006fc90 2024-03-29T04:08:21.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.836+0000 7f3517fff640 1 -- 172.21.15.73:0/163926563 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3520035040 con 0x7f353006fc90 2024-03-29T04:08:21.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.836+0000 7f3535d96640 1 -- 172.21.15.73:0/163926563 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f353015d880 con 0x7f353006fc90 2024-03-29T04:08:21.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.837+0000 7f3535d96640 1 -- 172.21.15.73:0/163926563 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3530068640 con 0x7f353006fc90 2024-03-29T04:08:21.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.838+0000 7f3517fff640 1 -- 172.21.15.73:0/163926563 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f352004b060 con 0x7f353006fc90 2024-03-29T04:08:21.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.838+0000 7f3517fff640 1 --2- 172.21.15.73:0/163926563 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f351c06c530 0x7f351c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:21.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.838+0000 7f352f7fe640 1 --2- 172.21.15.73:0/163926563 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f351c06c530 0x7f351c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:21.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.838+0000 7f3517fff640 1 -- 172.21.15.73:0/163926563 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f35200ace00 con 0x7f353006fc90 2024-03-29T04:08:21.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.838+0000 7f352f7fe640 1 --2- 172.21.15.73:0/163926563 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f351c06c530 0x7f351c06e9f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3524001780 tx=0x7f3524009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:21.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:21.843+0000 7f3517fff640 1 -- 172.21.15.73:0/163926563 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f352007add0 con 0x7f353006fc90 2024-03-29T04:08:22.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.052+0000 7f3535d96640 1 -- 172.21.15.73:0/163926563 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f35300b2660 con 0x7f353006fc90 2024-03-29T04:08:22.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.052+0000 7f3517fff640 1 -- 172.21.15.73:0/163926563 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5178 (secure 0 0 0) 0x7f352007f0d0 con 0x7f353006fc90 2024-03-29T04:08:22.032 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:22.033 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2101608781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2101608781},{"type":"v1","addr":"172.21.15.142:6834","nonce":2101608781}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3626787216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":3626787216},{"type":"v1","addr":"172.21.15.73:6837","nonce":3626787216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1987252283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1987252283},{"type":"v1","addr":"172.21.15.73:6836","nonce":1987252283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-29T04:08:11.922090+0000","modified":"2024-03-29T04:08:13.918938+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6835/569863112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":569863112},{"type":"v1","addr":"172.21.15.142:6835","nonce":569863112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-03-29T04:08:22.033 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 6 2024-03-29T04:08:22.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.055+0000 7f3535d96640 1 -- 172.21.15.73:0/163926563 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f351c06c530 msgr2=0x7f351c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:22.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.055+0000 7f3535d96640 1 --2- 172.21.15.73:0/163926563 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f351c06c530 0x7f351c06e9f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3524001780 tx=0x7f3524009040 comp rx=0 tx=0).stop 2024-03-29T04:08:22.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.055+0000 7f3535d96640 1 -- 172.21.15.73:0/163926563 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f353006fc90 msgr2=0x7f35301592c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:22.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.055+0000 7f3535d96640 1 --2- 172.21.15.73:0/163926563 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f353006fc90 0x7f35301592c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3520000c00 tx=0x7f35200046c0 comp rx=0 tx=0).stop 2024-03-29T04:08:22.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.055+0000 7f3535d96640 1 -- 172.21.15.73:0/163926563 shutdown_connections 2024-03-29T04:08:22.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.055+0000 7f3535d96640 1 --2- 172.21.15.73:0/163926563 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f351c06c530 0x7f351c06e9f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:22.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.055+0000 7f3535d96640 1 --2- 172.21.15.73:0/163926563 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f353015e9a0 0x7f3530159800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:22.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.055+0000 7f3535d96640 1 --2- 172.21.15.73:0/163926563 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f353006fc90 0x7f35301592c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:22.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.055+0000 7f3535d96640 1 --2- 172.21.15.73:0/163926563 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f353006e0f0 0x7f35301e9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:22.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.055+0000 7f3535d96640 1 -- 172.21.15.73:0/163926563 >> 172.21.15.73:0/163926563 conn(0x7f3530072090 msgr2=0x7f35300cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:22.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.055+0000 7f3535d96640 1 -- 172.21.15.73:0/163926563 shutdown_connections 2024-03-29T04:08:22.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.055+0000 7f3535d96640 1 -- 172.21.15.73:0/163926563 wait complete. 2024-03-29T04:08:22.045 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-29T04:08:22.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.166+0000 7f8e8b1db640 1 Processor -- start 2024-03-29T04:08:22.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.166+0000 7f8e8b1db640 1 -- start start 2024-03-29T04:08:22.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.167+0000 7f8e8b1db640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8e840d4f30 0x7f8e840d0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:22.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.167+0000 7f8e8b1db640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e840d54f0 con 0x7f8e840d3300 2024-03-29T04:08:22.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.167+0000 7f8e8b1db640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e840cf3c0 con 0x7f8e8415e9b0 2024-03-29T04:08:22.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.167+0000 7f8e8b1db640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f8e840cfcf0 con 0x7f8e840d4f30 2024-03-29T04:08:22.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.167+0000 7f8e83fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8e840d3300 0x7f8e8406c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52264/0 (socket says 172.21.15.73:52264) 2024-03-29T04:08:22.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.167+0000 7f8e83fff640 1 -- 172.21.15.73:0/1512482982 learned_addr learned my addr 172.21.15.73:0/1512482982 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:22.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.167+0000 7f8e89778640 1 --2- 172.21.15.73:0/1512482982 >> v2:172.21.15.142:3300/0 conn(0x7f8e840d4f30 0x7f8e840d0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:22.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.167+0000 7f8e837fe640 1 -- 172.21.15.73:0/1512482982 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1565341662 0 0) 0x7f8e840d54f0 con 0x7f8e840d3300 2024-03-29T04:08:22.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.167+0000 7f8e837fe640 1 -- 172.21.15.73:0/1512482982 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e74003520 con 0x7f8e840d3300 2024-03-29T04:08:22.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.167+0000 7f8e89778640 1 -- 172.21.15.73:0/1512482982 >> v1:172.21.15.142:6789/0 conn(0x7f8e8415e9b0 legacy=0x7f8e840d2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:22.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.167+0000 7f8e89778640 1 -- 172.21.15.73:0/1512482982 >> v1:172.21.15.73:6789/0 conn(0x7f8e840d3300 legacy=0x7f8e8406c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:22.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.167+0000 7f8e837fe640 1 -- 172.21.15.73:0/1512482982 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4280138942 0 0) 0x7f8e840cf3c0 con 0x7f8e8415e9b0 2024-03-29T04:08:22.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.167+0000 7f8e89778640 1 -- 172.21.15.73:0/1512482982 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e840cf6a0 con 0x7f8e840d4f30 2024-03-29T04:08:22.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.168+0000 7f8e89778640 1 --2- 172.21.15.73:0/1512482982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e840d4f30 0x7f8e840d0180 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c009d90 tx=0x7f8e7c02bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=793ab32914a78972 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:22.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.168+0000 7f8e837fe640 1 -- 172.21.15.73:0/1512482982 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c039070 con 0x7f8e840d4f30 2024-03-29T04:08:22.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.168+0000 7f8e837fe640 1 -- 172.21.15.73:0/1512482982 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e7c02cd00 con 0x7f8e840d4f30 2024-03-29T04:08:22.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.168+0000 7f8e837fe640 1 -- 172.21.15.73:0/1512482982 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c034660 con 0x7f8e840d4f30 2024-03-29T04:08:22.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.169+0000 7f8e8b1db640 1 -- 172.21.15.73:0/1512482982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e840d4f30 msgr2=0x7f8e840d0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:22.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.169+0000 7f8e8b1db640 1 --2- 172.21.15.73:0/1512482982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e840d4f30 0x7f8e840d0180 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c009d90 tx=0x7f8e7c02bf50 comp rx=0 tx=0).stop 2024-03-29T04:08:22.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.169+0000 7f8e8b1db640 1 -- 172.21.15.73:0/1512482982 shutdown_connections 2024-03-29T04:08:22.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.169+0000 7f8e8b1db640 1 --2- 172.21.15.73:0/1512482982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e840d4f30 0x7f8e840d0180 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:22.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.169+0000 7f8e8b1db640 1 -- 172.21.15.73:0/1512482982 >> 172.21.15.73:0/1512482982 conn(0x7f8e8408bfc0 msgr2=0x7f8e840d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:22.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.169+0000 7f8e8b1db640 1 -- 172.21.15.73:0/1512482982 shutdown_connections 2024-03-29T04:08:22.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.169+0000 7f8e8b1db640 1 -- 172.21.15.73:0/1512482982 wait complete. 2024-03-29T04:08:22.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.170+0000 7f8e8b1db640 1 Processor -- start 2024-03-29T04:08:22.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.170+0000 7f8e8b1db640 1 -- start start 2024-03-29T04:08:22.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.171+0000 7f8e8b1db640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e840d3300 0x7f8e8415fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:22.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.171+0000 7f8e8b1db640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e840d4f30 0x7f8e8414d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:22.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.171+0000 7f8e8b1db640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e8415e9b0 0x7f8e840b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:22.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.171+0000 7f8e8b1db640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8e84162f70 con 0x7f8e840d4f30 2024-03-29T04:08:22.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.171+0000 7f8e8b1db640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8415ed90 con 0x7f8e8415e9b0 2024-03-29T04:08:22.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.171+0000 7f8e8b1db640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f8e841630f0 con 0x7f8e840d3300 2024-03-29T04:08:22.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.171+0000 7f8e83fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e840d4f30 0x7f8e8414d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:22.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.171+0000 7f8e83fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e840d4f30 0x7f8e8414d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42464/0 (socket says 172.21.15.73:42464) 2024-03-29T04:08:22.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.171+0000 7f8e83fff640 1 -- 172.21.15.73:0/2627852127 learned_addr learned my addr 172.21.15.73:0/2627852127 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:22.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.171+0000 7f8e88f77640 1 --2- 172.21.15.73:0/2627852127 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e840d3300 0x7f8e8415fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:22.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.171+0000 7f8e89778640 1 --2- 172.21.15.73:0/2627852127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e8415e9b0 0x7f8e840b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:22.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.171+0000 7f8e83fff640 1 -- 172.21.15.73:0/2627852127 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e840d3300 msgr2=0x7f8e8415fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:22.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.171+0000 7f8e83fff640 1 --2- 172.21.15.73:0/2627852127 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e840d3300 0x7f8e8415fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:22.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.171+0000 7f8e83fff640 1 -- 172.21.15.73:0/2627852127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e8415e9b0 msgr2=0x7f8e840b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:22.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.171+0000 7f8e83fff640 1 --2- 172.21.15.73:0/2627852127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e8415e9b0 0x7f8e840b5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:22.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.171+0000 7f8e83fff640 1 -- 172.21.15.73:0/2627852127 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e840ce4d0 con 0x7f8e840d4f30 2024-03-29T04:08:22.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.171+0000 7f8e88f77640 1 --2- 172.21.15.73:0/2627852127 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e840d3300 0x7f8e8415fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:08:22.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.171+0000 7f8e83fff640 1 --2- 172.21.15.73:0/2627852127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e840d4f30 0x7f8e8414d9d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8e7000c460 tx=0x7f8e7000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:22.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.172+0000 7f8e817fa640 1 -- 172.21.15.73:0/2627852127 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e70017070 con 0x7f8e840d4f30 2024-03-29T04:08:22.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.172+0000 7f8e817fa640 1 -- 172.21.15.73:0/2627852127 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e70005ce0 con 0x7f8e840d4f30 2024-03-29T04:08:22.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.172+0000 7f8e8b1db640 1 -- 172.21.15.73:0/2627852127 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e8415efb0 con 0x7f8e840d4f30 2024-03-29T04:08:22.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.172+0000 7f8e817fa640 1 -- 172.21.15.73:0/2627852127 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e70007290 con 0x7f8e840d4f30 2024-03-29T04:08:22.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.172+0000 7f8e8b1db640 1 -- 172.21.15.73:0/2627852127 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e8415f570 con 0x7f8e840d4f30 2024-03-29T04:08:22.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.173+0000 7f8e8b1db640 1 -- 172.21.15.73:0/2627852127 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e8406bf60 con 0x7f8e840d4f30 2024-03-29T04:08:22.155 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.173+0000 7f8e817fa640 1 -- 172.21.15.73:0/2627852127 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f8e7001a070 con 0x7f8e840d4f30 2024-03-29T04:08:22.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.173+0000 7f8e817fa640 1 --2- 172.21.15.73:0/2627852127 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f8e6806c530 0x7f8e6806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:22.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.173+0000 7f8e817fa640 1 -- 172.21.15.73:0/2627852127 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8e7008aaa0 con 0x7f8e840d4f30 2024-03-29T04:08:22.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.173+0000 7f8e88f77640 1 --2- 172.21.15.73:0/2627852127 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f8e6806c530 0x7f8e6806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:22.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.174+0000 7f8e88f77640 1 --2- 172.21.15.73:0/2627852127 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f8e6806c530 0x7f8e6806e9f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8e78000f60 tx=0x7f8e78009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:22.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.178+0000 7f8e817fa640 1 -- 172.21.15.73:0/2627852127 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f8e70058960 con 0x7f8e840d4f30 2024-03-29T04:08:22.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.353+0000 7f8e8b1db640 1 -- 172.21.15.73:0/2627852127 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8e84068640 con 0x7f8e840d4f30 2024-03-29T04:08:22.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.354+0000 7f8e817fa640 1 -- 172.21.15.73:0/2627852127 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16605 (secure 0 0 0) 0x7f8e7005cc60 con 0x7f8e840d4f30 2024-03-29T04:08:22.334 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:22.334 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"6bff1617-b138-4517-acca-3ecaae3f2bb3","created":"2024-03-29T04:07:47.346864+0000","modified":"2024-03-29T04:08:13.577603+0000","last_up_change":"2024-03-29T04:07:58.507139+0000","last_in_change":"2024-03-29T04:07:49.637816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-29T04:07:59.537301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-29T04:08:09.570906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-29T04:08:10.882349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"925d7de1-14ab-48c0-aebd-7bded108f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6820","nonce":2387335359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6824","nonce":2387335359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6831","nonce":2387335359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6828","nonce":2387335359}]},"public_addr":"172.21.15.73:6820/2387335359","cluster_addr":"172.21.15.73:6824/2387335359","heartbeat_back_addr":"172.21.15.73:6831/2387335359","heartbeat_front_addr":"172.21.15.73:6828/2387335359","state":["exists","up"]},{"osd":1,"uuid":"6b182102-882a-4e0c-99db-0afae5cfb38b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6801","nonce":2431315515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6803","nonce":2431315515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6807","nonce":2431315515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6805","nonce":2431315515}]},"public_addr":"172.21.15.73:6801/2431315515","cluster_addr":"172.21.15.73:6803/2431315515","heartbeat_back_addr":"172.21.15.73:6807/2431315515","heartbeat_front_addr":"172.21.15.73:6805/2431315515","state":["exists","up"]},{"osd":2,"uuid":"8040902e-b0b8-4a21-bf64-ce1c222115ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6809","nonce":407236597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6811","nonce":407236597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6815","nonce":407236597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6813","nonce":407236597}]},"public_addr":"172.21.15.73:6809/407236597","cluster_addr":"172.21.15.73:6811/407236597","heartbeat_back_addr":"172.21.15.73:6815/407236597","heartbeat_front_addr":"172.21.15.73:6813/407236597","state":["exists","up"]},{"osd":3,"uuid":"1bab19ee-3775-4ce1-a4ce-cf7cda3bbbf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6817","nonce":4291100709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6821","nonce":4291100709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6829","nonce":4291100709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6825","nonce":4291100709}]},"public_addr":"172.21.15.73:6817/4291100709","cluster_addr":"172.21.15.73:6821/4291100709","heartbeat_back_addr":"172.21.15.73:6829/4291100709","heartbeat_front_addr":"172.21.15.73:6825/4291100709","state":["exists","up"]},{"osd":4,"uuid":"b0c74337-8fe4-47dc-b3da-2d07591b1f6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6817","nonce":3703256194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6819","nonce":3703256194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6823","nonce":3703256194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6821","nonce":3703256194}]},"public_addr":"172.21.15.142:6817/3703256194","cluster_addr":"172.21.15.142:6819/3703256194","heartbeat_back_addr":"172.21.15.142:6823/3703256194","heartbeat_front_addr":"172.21.15.142:6821/3703256194","state":["exists","up"]},{"osd":5,"uuid":"9ce36410-a29a-42c6-99f4-f95d4afdd7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6825","nonce":4271575803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6827","nonce":4271575803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6831","nonce":4271575803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6829","nonce":4271575803}]},"public_addr":"172.21.15.142:6825/4271575803","cluster_addr":"172.21.15.142:6827/4271575803","heartbeat_back_addr":"172.21.15.142:6831/4271575803","heartbeat_front_addr":"172.21.15.142:6829/4271575803","state":["exists","up"]},{"osd":6,"uuid":"aec4264a-64ac-428e-a860-d2920a304019","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6801","nonce":1772722570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6803","nonce":1772722570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6807","nonce":1772722570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6805","nonce":1772722570}]},"public_addr":"172.21.15.142:6801/1772722570","cluster_addr":"172.21.15.142:6803/1772722570","heartbeat_back_addr":"172.21.15.142:6807/1772722570","heartbeat_front_addr":"172.21.15.142:6805/1772722570","state":["exists","up"]},{"osd":7,"uuid":"fe599052-8e5a-4c7a-91e7-52d1bae24a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6809","nonce":3910589675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6811","nonce":3910589675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6815","nonce":3910589675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6813","nonce":3910589675}]},"public_addr":"172.21.15.142:6809/3910589675","cluster_addr":"172.21.15.142:6811/3910589675","heartbeat_back_addr":"172.21.15.142:6815/3910589675","heartbeat_front_addr":"172.21.15.142:6813/3910589675","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.835096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.587210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.786547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.778004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.843740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.791160+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.837992+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.718722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:08:22.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.356+0000 7f8e8b1db640 1 -- 172.21.15.73:0/2627852127 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f8e6806c530 msgr2=0x7f8e6806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:22.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.356+0000 7f8e8b1db640 1 --2- 172.21.15.73:0/2627852127 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f8e6806c530 0x7f8e6806e9f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8e78000f60 tx=0x7f8e78009040 comp rx=0 tx=0).stop 2024-03-29T04:08:22.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.356+0000 7f8e8b1db640 1 -- 172.21.15.73:0/2627852127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e840d4f30 msgr2=0x7f8e8414d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:22.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.356+0000 7f8e8b1db640 1 --2- 172.21.15.73:0/2627852127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e840d4f30 0x7f8e8414d9d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8e7000c460 tx=0x7f8e7000c920 comp rx=0 tx=0).stop 2024-03-29T04:08:22.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.356+0000 7f8e8b1db640 1 -- 172.21.15.73:0/2627852127 shutdown_connections 2024-03-29T04:08:22.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.356+0000 7f8e8b1db640 1 --2- 172.21.15.73:0/2627852127 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f8e6806c530 0x7f8e6806e9f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:22.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.356+0000 7f8e8b1db640 1 --2- 172.21.15.73:0/2627852127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e8415e9b0 0x7f8e840b5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:22.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.356+0000 7f8e8b1db640 1 --2- 172.21.15.73:0/2627852127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e840d4f30 0x7f8e8414d9d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:22.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.356+0000 7f8e8b1db640 1 --2- 172.21.15.73:0/2627852127 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e840d3300 0x7f8e8415fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:22.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.356+0000 7f8e8b1db640 1 -- 172.21.15.73:0/2627852127 >> 172.21.15.73:0/2627852127 conn(0x7f8e8408bfc0 msgr2=0x7f8e840d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:22.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.356+0000 7f8e8b1db640 1 -- 172.21.15.73:0/2627852127 shutdown_connections 2024-03-29T04:08:22.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.356+0000 7f8e8b1db640 1 -- 172.21.15.73:0/2627852127 wait complete. 2024-03-29T04:08:22.347 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-29T04:08:22.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.466+0000 7f3e03e22640 1 Processor -- start 2024-03-29T04:08:22.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.467+0000 7f3e03e22640 1 -- start start 2024-03-29T04:08:22.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.467+0000 7f3e03e22640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dfc06d030 0x7f3dfc09b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:22.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.467+0000 7f3e03e22640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3dfc0ccd00 0x7f3dfc0cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:22.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.467+0000 7f3e03e22640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dfc0d0f20 con 0x7f3dfc06d410 2024-03-29T04:08:22.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.467+0000 7f3e03e22640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f3dfc162250 con 0x7f3dfc0ccd00 2024-03-29T04:08:22.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.467+0000 7f3e03e22640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f3dfc0d1200 con 0x7f3dfc06d030 2024-03-29T04:08:22.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.467+0000 7f3e023bf640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3dfc0ccd00 0x7f3dfc0cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:22.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.467+0000 7f3e013bd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3dfc06d410 0x7f3dfc0d0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52272/0 (socket says 172.21.15.73:52272) 2024-03-29T04:08:22.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.467+0000 7f3e023bf640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3dfc0ccd00 0x7f3dfc0cd170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42472/0 (socket says 172.21.15.73:42472) 2024-03-29T04:08:22.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.467+0000 7f3e013bd640 1 -- 172.21.15.73:0/1628336232 learned_addr learned my addr 172.21.15.73:0/1628336232 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:22.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.468+0000 7f3e01bbe640 1 --2- 172.21.15.73:0/1628336232 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dfc06d030 0x7f3dfc09b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:22.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.468+0000 7f3e023bf640 1 -- 172.21.15.73:0/1628336232 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dfc06d030 msgr2=0x7f3dfc09b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:22.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.468+0000 7f3e023bf640 1 --2- 172.21.15.73:0/1628336232 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dfc06d030 0x7f3dfc09b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:22.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.468+0000 7f3e023bf640 1 -- 172.21.15.73:0/1628336232 >> v1:172.21.15.73:6789/0 conn(0x7f3dfc06d410 legacy=0x7f3dfc0d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:22.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.468+0000 7f3e023bf640 1 -- 172.21.15.73:0/1628336232 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dfc0d14e0 con 0x7f3dfc0ccd00 2024-03-29T04:08:22.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.468+0000 7f3e023bf640 1 --2- 172.21.15.73:0/1628336232 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3dfc0ccd00 0x7f3dfc0cd170 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3df40097a0 tx=0x7f3df402b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6083746aaa93d187 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:22.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.469+0000 7f3e00bbc640 1 -- 172.21.15.73:0/1628336232 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df4037070 con 0x7f3dfc0ccd00 2024-03-29T04:08:22.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.469+0000 7f3e00bbc640 1 -- 172.21.15.73:0/1628336232 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3df4030710 con 0x7f3dfc0ccd00 2024-03-29T04:08:22.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.469+0000 7f3e00bbc640 1 -- 172.21.15.73:0/1628336232 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df4030ae0 con 0x7f3dfc0ccd00 2024-03-29T04:08:22.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.469+0000 7f3e03e22640 1 -- 172.21.15.73:0/1628336232 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3dfc0ccd00 msgr2=0x7f3dfc0cd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:22.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.469+0000 7f3e03e22640 1 --2- 172.21.15.73:0/1628336232 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3dfc0ccd00 0x7f3dfc0cd170 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3df40097a0 tx=0x7f3df402b710 comp rx=0 tx=0).stop 2024-03-29T04:08:22.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.469+0000 7f3e03e22640 1 -- 172.21.15.73:0/1628336232 shutdown_connections 2024-03-29T04:08:22.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.469+0000 7f3e03e22640 1 --2- 172.21.15.73:0/1628336232 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3dfc0ccd00 0x7f3dfc0cd170 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:22.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.469+0000 7f3e03e22640 1 --2- 172.21.15.73:0/1628336232 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dfc06d030 0x7f3dfc09b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:22.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.469+0000 7f3e03e22640 1 -- 172.21.15.73:0/1628336232 >> 172.21.15.73:0/1628336232 conn(0x7f3dfc0b3f00 msgr2=0x7f3dfc0b4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:22.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.469+0000 7f3e03e22640 1 -- 172.21.15.73:0/1628336232 shutdown_connections 2024-03-29T04:08:22.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.469+0000 7f3e03e22640 1 -- 172.21.15.73:0/1628336232 wait complete. 2024-03-29T04:08:22.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.470+0000 7f3e03e22640 1 Processor -- start 2024-03-29T04:08:22.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.470+0000 7f3e03e22640 1 -- start start 2024-03-29T04:08:22.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.471+0000 7f3e03e22640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3dfc06d030 0x7f3dfc0cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:22.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.471+0000 7f3e03e22640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dfc06d410 0x7f3dfc0b7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:22.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.471+0000 7f3e03e22640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dfc0ccd00 0x7f3dfc14d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:22.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.471+0000 7f3e03e22640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc06d870 con 0x7f3dfc06d030 2024-03-29T04:08:22.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.471+0000 7f3e03e22640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3dfc0d1aa0 con 0x7f3dfc06d410 2024-03-29T04:08:22.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.471+0000 7f3e03e22640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f3dfc06d9f0 con 0x7f3dfc0ccd00 2024-03-29T04:08:22.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.471+0000 7f3e01bbe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3dfc06d030 0x7f3dfc0cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:22.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.471+0000 7f3e01bbe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3dfc06d030 0x7f3dfc0cbc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42488/0 (socket says 172.21.15.73:42488) 2024-03-29T04:08:22.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.471+0000 7f3e01bbe640 1 -- 172.21.15.73:0/1907237231 learned_addr learned my addr 172.21.15.73:0/1907237231 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:22.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.471+0000 7f3e023bf640 1 --2- 172.21.15.73:0/1907237231 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dfc0ccd00 0x7f3dfc14d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:22.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.471+0000 7f3e013bd640 1 --2- 172.21.15.73:0/1907237231 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dfc06d410 0x7f3dfc0b7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:22.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.471+0000 7f3e01bbe640 1 -- 172.21.15.73:0/1907237231 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dfc0ccd00 msgr2=0x7f3dfc14d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:22.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.471+0000 7f3e01bbe640 1 --2- 172.21.15.73:0/1907237231 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dfc0ccd00 0x7f3dfc14d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:22.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.471+0000 7f3e01bbe640 1 -- 172.21.15.73:0/1907237231 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dfc06d410 msgr2=0x7f3dfc0b7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:22.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.471+0000 7f3e01bbe640 1 --2- 172.21.15.73:0/1907237231 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dfc06d410 0x7f3dfc0b7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:22.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.471+0000 7f3e01bbe640 1 -- 172.21.15.73:0/1907237231 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dfc0caee0 con 0x7f3dfc06d030 2024-03-29T04:08:22.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.471+0000 7f3e01bbe640 1 --2- 172.21.15.73:0/1907237231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3dfc06d030 0x7f3dfc0cbc60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3dec009d10 tx=0x7f3dec00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:22.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.472+0000 7f3dfa7fc640 1 -- 172.21.15.73:0/1907237231 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dec018020 con 0x7f3dfc06d030 2024-03-29T04:08:22.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.472+0000 7f3dfa7fc640 1 -- 172.21.15.73:0/1907237231 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dec014480 con 0x7f3dfc06d030 2024-03-29T04:08:22.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.472+0000 7f3dfa7fc640 1 -- 172.21.15.73:0/1907237231 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dec014830 con 0x7f3dfc06d030 2024-03-29T04:08:22.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.472+0000 7f3e03e22640 1 -- 172.21.15.73:0/1907237231 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dfc151270 con 0x7f3dfc06d030 2024-03-29T04:08:22.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.472+0000 7f3e03e22640 1 -- 172.21.15.73:0/1907237231 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dfc0cb740 con 0x7f3dfc06d030 2024-03-29T04:08:22.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.473+0000 7f3e03e22640 1 -- 172.21.15.73:0/1907237231 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dfc0cb290 con 0x7f3dfc06d030 2024-03-29T04:08:22.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.473+0000 7f3dfa7fc640 1 -- 172.21.15.73:0/1907237231 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f3dec005d10 con 0x7f3dfc06d030 2024-03-29T04:08:22.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.473+0000 7f3dfa7fc640 1 --2- 172.21.15.73:0/1907237231 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3de806c530 0x7f3de806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:22.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.473+0000 7f3dfa7fc640 1 -- 172.21.15.73:0/1907237231 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3dec08c030 con 0x7f3dfc06d030 2024-03-29T04:08:22.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.473+0000 7f3e013bd640 1 --2- 172.21.15.73:0/1907237231 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3de806c530 0x7f3de806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:22.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.474+0000 7f3e013bd640 1 --2- 172.21.15.73:0/1907237231 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3de806c530 0x7f3de806e9f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc0b7c00 tx=0x7f3df0007e20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:22.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.478+0000 7f3dfa7fc640 1 -- 172.21.15.73:0/1907237231 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f3dec022070 con 0x7f3dfc06d030 2024-03-29T04:08:22.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.692+0000 7f3e03e22640 1 -- 172.21.15.73:0/1907237231 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3dfc068d50 con 0x7f3dfc06d030 2024-03-29T04:08:22.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.692+0000 7f3dfa7fc640 1 -- 172.21.15.73:0/1907237231 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5178 (secure 0 0 0) 0x7f3dec010040 con 0x7f3dfc06d030 2024-03-29T04:08:22.672 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:22.672 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2101608781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2101608781},{"type":"v1","addr":"172.21.15.142:6834","nonce":2101608781}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3626787216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":3626787216},{"type":"v1","addr":"172.21.15.73:6837","nonce":3626787216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1987252283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1987252283},{"type":"v1","addr":"172.21.15.73:6836","nonce":1987252283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-29T04:08:11.922090+0000","modified":"2024-03-29T04:08:13.918938+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6835/569863112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":569863112},{"type":"v1","addr":"172.21.15.142:6835","nonce":569863112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-03-29T04:08:22.672 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 6 2024-03-29T04:08:22.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.694+0000 7f3e03e22640 1 -- 172.21.15.73:0/1907237231 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3de806c530 msgr2=0x7f3de806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:22.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.694+0000 7f3e03e22640 1 --2- 172.21.15.73:0/1907237231 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3de806c530 0x7f3de806e9f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc0b7c00 tx=0x7f3df0007e20 comp rx=0 tx=0).stop 2024-03-29T04:08:22.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.694+0000 7f3e03e22640 1 -- 172.21.15.73:0/1907237231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3dfc06d030 msgr2=0x7f3dfc0cbc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:22.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.694+0000 7f3e03e22640 1 --2- 172.21.15.73:0/1907237231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3dfc06d030 0x7f3dfc0cbc60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3dec009d10 tx=0x7f3dec00c490 comp rx=0 tx=0).stop 2024-03-29T04:08:22.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.694+0000 7f3e03e22640 1 -- 172.21.15.73:0/1907237231 shutdown_connections 2024-03-29T04:08:22.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.694+0000 7f3e03e22640 1 --2- 172.21.15.73:0/1907237231 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3dfc0ccd00 0x7f3dfc14d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:22.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.694+0000 7f3e03e22640 1 --2- 172.21.15.73:0/1907237231 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3de806c530 0x7f3de806e9f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:22.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.694+0000 7f3e03e22640 1 --2- 172.21.15.73:0/1907237231 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3dfc06d410 0x7f3dfc0b7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:22.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.694+0000 7f3e03e22640 1 --2- 172.21.15.73:0/1907237231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3dfc06d030 0x7f3dfc0cbc60 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:22.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.694+0000 7f3e03e22640 1 -- 172.21.15.73:0/1907237231 >> 172.21.15.73:0/1907237231 conn(0x7f3dfc0b3f00 msgr2=0x7f3dfc06faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:22.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.694+0000 7f3e03e22640 1 -- 172.21.15.73:0/1907237231 shutdown_connections 2024-03-29T04:08:22.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:22.694+0000 7f3e03e22640 1 -- 172.21.15.73:0/1907237231 wait complete. 2024-03-29T04:08:23.088 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-29T04:08:11.922090+0000', 'modified': '2024-03-29T04:08:13.918938+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4294}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4294': {'gid': 4294, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.142:6835/569863112', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6833', 'nonce': 569863112}, {'type': 'v1', 'addr': '172.21.15.142:6835', 'nonce': 569863112}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4294, 'qdb_cluster': [4294]} 2024-03-29T04:08:23.088 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-29T04:08:23.088 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-03-29T04:08:23.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.212+0000 7f42c59e8640 1 Processor -- start 2024-03-29T04:08:23.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.212+0000 7f42c59e8640 1 -- start start 2024-03-29T04:08:23.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.213+0000 7f42c59e8640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f42c00ba000 0x7f42c00d3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:23.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.213+0000 7f42c59e8640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42c00cf9e0 con 0x7f42c015eb60 2024-03-29T04:08:23.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.213+0000 7f42c59e8640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42c00cfe70 con 0x7f42c015e780 2024-03-29T04:08:23.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.213+0000 7f42c59e8640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f42c00b7f50 con 0x7f42c00ba000 2024-03-29T04:08:23.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.213+0000 7f42be7fc640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f42c015eb60 0x7f42c00cf2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52278/0 (socket says 172.21.15.73:52278) 2024-03-29T04:08:23.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.213+0000 7f42be7fc640 1 -- 172.21.15.73:0/3832153036 learned_addr learned my addr 172.21.15.73:0/3832153036 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:23.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.213+0000 7f42bdffb640 1 -- 172.21.15.73:0/3832153036 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4142259510 0 0) 0x7f42c00cf9e0 con 0x7f42c015eb60 2024-03-29T04:08:23.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.213+0000 7f42bdffb640 1 -- 172.21.15.73:0/3832153036 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42a8003520 con 0x7f42c015eb60 2024-03-29T04:08:23.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.213+0000 7f42bdffb640 1 -- 172.21.15.73:0/3832153036 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 48689139 0 0) 0x7f42c00cfe70 con 0x7f42c015e780 2024-03-29T04:08:23.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.213+0000 7f42bdffb640 1 -- 172.21.15.73:0/3832153036 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42c00cf9e0 con 0x7f42c015e780 2024-03-29T04:08:23.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.213+0000 7f42bdffb640 1 -- 172.21.15.73:0/3832153036 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 793637008 0 0) 0x7f42a8003520 con 0x7f42c015eb60 2024-03-29T04:08:23.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.213+0000 7f42bf7fe640 1 --2- 172.21.15.73:0/3832153036 >> v2:172.21.15.142:3300/0 conn(0x7f42c00ba000 0x7f42c00d3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:23.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.213+0000 7f42bdffb640 1 -- 172.21.15.73:0/3832153036 >> v2:172.21.15.142:3300/0 conn(0x7f42c00ba000 msgr2=0x7f42c00d3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:23.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.213+0000 7f42bdffb640 1 --2- 172.21.15.73:0/3832153036 >> v2:172.21.15.142:3300/0 conn(0x7f42c00ba000 0x7f42c00d3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:23.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.213+0000 7f42bdffb640 1 -- 172.21.15.73:0/3832153036 >> v1:172.21.15.142:6789/0 conn(0x7f42c015e780 legacy=0x7f42c00cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:23.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.213+0000 7f42bdffb640 1 -- 172.21.15.73:0/3832153036 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c00b8230 con 0x7f42c015eb60 2024-03-29T04:08:23.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.213+0000 7f42bdffb640 1 -- 172.21.15.73:0/3832153036 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1290421750 0 0) 0x7f42b4001670 con 0x7f42c015eb60 2024-03-29T04:08:23.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.213+0000 7f42bf7fe640 1 --2- 172.21.15.73:0/3832153036 >> v2:172.21.15.142:3300/0 conn(0x7f42c00ba000 0x7f42c00d3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:08:23.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.213+0000 7f42bdffb640 1 -- 172.21.15.73:0/3832153036 >> v1:172.21.15.73:6789/0 conn(0x7f42c015eb60 legacy=0x7f42c00cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:23.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.214+0000 7f42bdffb640 1 --2- 172.21.15.73:0/3832153036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42a8003b40 0x7f42a8003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:23.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.214+0000 7f42bdffb640 1 --2- 172.21.15.73:0/3832153036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42a8004800 0x7f42a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:23.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.214+0000 7f42bdffb640 1 --2- 172.21.15.73:0/3832153036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42a80052e0 0x7f42a800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:23.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.214+0000 7f42bdffb640 1 -- 172.21.15.73:0/3832153036 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f42c00b7f50 con 0x7f42a8003b40 2024-03-29T04:08:23.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.214+0000 7f42bdffb640 1 -- 172.21.15.73:0/3832153036 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f42a800c1e0 con 0x7f42a8004800 2024-03-29T04:08:23.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.214+0000 7f42bdffb640 1 -- 172.21.15.73:0/3832153036 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f42a800c3e0 con 0x7f42a80052e0 2024-03-29T04:08:23.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.214+0000 7f42beffd640 1 --2- 172.21.15.73:0/3832153036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42a8003b40 0x7f42a8003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:23.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.214+0000 7f42be7fc640 1 --2- 172.21.15.73:0/3832153036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42a8004800 0x7f42a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:23.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.214+0000 7f42bf7fe640 1 --2- 172.21.15.73:0/3832153036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42a80052e0 0x7f42a800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:23.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.214+0000 7f42beffd640 1 -- 172.21.15.73:0/3832153036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42a80052e0 msgr2=0x7f42a800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:23.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.214+0000 7f42beffd640 1 --2- 172.21.15.73:0/3832153036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42a80052e0 0x7f42a800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:23.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.214+0000 7f42beffd640 1 -- 172.21.15.73:0/3832153036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42a8004800 msgr2=0x7f42a8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:23.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.214+0000 7f42beffd640 1 --2- 172.21.15.73:0/3832153036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42a8004800 0x7f42a8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:23.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.214+0000 7f42beffd640 1 -- 172.21.15.73:0/3832153036 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a8003520 con 0x7f42a8003b40 2024-03-29T04:08:23.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.214+0000 7f42bf7fe640 1 -- 172.21.15.73:0/3832153036 reap_dead start 2024-03-29T04:08:23.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.215+0000 7f42beffd640 1 --2- 172.21.15.73:0/3832153036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42a8003b40 0x7f42a8003f40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f42b00018a0 tx=0x7f42a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=400302ca8b4db64b server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:23.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.215+0000 7f42bdffb640 1 -- 172.21.15.73:0/3832153036 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b00014f0 con 0x7f42a8003b40 2024-03-29T04:08:23.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.215+0000 7f42bdffb640 1 -- 172.21.15.73:0/3832153036 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42b00052d0 con 0x7f42a8003b40 2024-03-29T04:08:23.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.215+0000 7f42bdffb640 1 -- 172.21.15.73:0/3832153036 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b0003810 con 0x7f42a8003b40 2024-03-29T04:08:23.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.215+0000 7f42c59e8640 1 -- 172.21.15.73:0/3832153036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42a8003b40 msgr2=0x7f42a8003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:23.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.215+0000 7f42c59e8640 1 --2- 172.21.15.73:0/3832153036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42a8003b40 0x7f42a8003f40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f42b00018a0 tx=0x7f42a8005830 comp rx=0 tx=0).stop 2024-03-29T04:08:23.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.215+0000 7f42c59e8640 1 -- 172.21.15.73:0/3832153036 shutdown_connections 2024-03-29T04:08:23.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.215+0000 7f42c59e8640 1 --2- 172.21.15.73:0/3832153036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42a8003b40 0x7f42a8003f40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:23.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.215+0000 7f42c59e8640 1 -- 172.21.15.73:0/3832153036 >> 172.21.15.73:0/3832153036 conn(0x7f42c008bfc0 msgr2=0x7f42c00d4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:23.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.215+0000 7f42c59e8640 1 -- 172.21.15.73:0/3832153036 shutdown_connections 2024-03-29T04:08:23.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.215+0000 7f42c59e8640 1 -- 172.21.15.73:0/3832153036 wait complete. 2024-03-29T04:08:23.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.216+0000 7f42c59e8640 1 Processor -- start 2024-03-29T04:08:23.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.217+0000 7f42c59e8640 1 -- start start 2024-03-29T04:08:23.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.217+0000 7f42c59e8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42a8003b40 0x7f42c01499c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:23.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.217+0000 7f42c59e8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42c015bbd0 0x7f42c01e7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:23.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.217+0000 7f42c59e8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42c0146370 0x7f42c0146820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:23.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.217+0000 7f42c59e8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f42c00b8ad0 con 0x7f42c0146370 2024-03-29T04:08:23.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.217+0000 7f42c59e8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f42c00b87f0 con 0x7f42a8003b40 2024-03-29T04:08:23.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.217+0000 7f42c59e8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f42c00cebc0 con 0x7f42c015bbd0 2024-03-29T04:08:23.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.217+0000 7f42bf7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42c0146370 0x7f42c0146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:23.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.217+0000 7f42bf7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42c0146370 0x7f42c0146820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42498/0 (socket says 172.21.15.73:42498) 2024-03-29T04:08:23.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.217+0000 7f42bf7fe640 1 -- 172.21.15.73:0/428010922 learned_addr learned my addr 172.21.15.73:0/428010922 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:23.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.217+0000 7f42be7fc640 1 --2- 172.21.15.73:0/428010922 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42c015bbd0 0x7f42c01e7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:23.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.218+0000 7f42beffd640 1 --2- 172.21.15.73:0/428010922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42a8003b40 0x7f42c01499c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:23.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.218+0000 7f42bf7fe640 1 -- 172.21.15.73:0/428010922 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42c015bbd0 msgr2=0x7f42c01e7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:23.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.218+0000 7f42bf7fe640 1 --2- 172.21.15.73:0/428010922 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42c015bbd0 0x7f42c01e7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:23.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.218+0000 7f42bf7fe640 1 -- 172.21.15.73:0/428010922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42a8003b40 msgr2=0x7f42c01499c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:23.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.218+0000 7f42bf7fe640 1 --2- 172.21.15.73:0/428010922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42a8003b40 0x7f42c01499c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:23.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.218+0000 7f42bf7fe640 1 -- 172.21.15.73:0/428010922 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c01e9310 con 0x7f42c0146370 2024-03-29T04:08:23.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.218+0000 7f42beffd640 1 --2- 172.21.15.73:0/428010922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42a8003b40 0x7f42c01499c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:08:23.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.218+0000 7f42bf7fe640 1 --2- 172.21.15.73:0/428010922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42c0146370 0x7f42c0146820 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f42c00d4280 tx=0x7f42b800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:23.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.218+0000 7f42a7fff640 1 -- 172.21.15.73:0/428010922 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b800a670 con 0x7f42c0146370 2024-03-29T04:08:23.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.218+0000 7f42a7fff640 1 -- 172.21.15.73:0/428010922 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42b800a810 con 0x7f42c0146370 2024-03-29T04:08:23.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.218+0000 7f42a7fff640 1 -- 172.21.15.73:0/428010922 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b800ac00 con 0x7f42c0146370 2024-03-29T04:08:23.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.218+0000 7f42c59e8640 1 -- 172.21.15.73:0/428010922 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42c01e95f0 con 0x7f42c0146370 2024-03-29T04:08:23.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.218+0000 7f42c59e8640 1 -- 172.21.15.73:0/428010922 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42c01e9bb0 con 0x7f42c0146370 2024-03-29T04:08:23.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.219+0000 7f42a7fff640 1 -- 172.21.15.73:0/428010922 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f42b8005d10 con 0x7f42c0146370 2024-03-29T04:08:23.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.220+0000 7f42a7fff640 1 --2- 172.21.15.73:0/428010922 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f42ac06c560 0x7f42ac06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:23.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.220+0000 7f42a7fff640 1 -- 172.21.15.73:0/428010922 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f42b808c5e0 con 0x7f42c0146370 2024-03-29T04:08:23.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.220+0000 7f42beffd640 1 --2- 172.21.15.73:0/428010922 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f42ac06c560 0x7f42ac06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:23.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.220+0000 7f42beffd640 1 --2- 172.21.15.73:0/428010922 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f42ac06c560 0x7f42ac06ea20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f42b0034000 tx=0x7f42b0031000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:23.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.221+0000 7f42c85cb740 1 Processor -- start 2024-03-29T04:08:23.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.221+0000 7f42c85cb740 1 -- start start 2024-03-29T04:08:23.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.221+0000 7f42c85cb740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bccea11860 0x55bcce9e4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:23.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.221+0000 7f42c85cb740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bccea11c40 0x55bccea145f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:23.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.221+0000 7f42c85cb740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bcce9e4d40 0x55bccea14b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:23.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.221+0000 7f42c85cb740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55bcce94e020 con 0x55bccea11860 2024-03-29T04:08:23.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.221+0000 7f42c85cb740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55bcce8f65f0 con 0x55bccea11c40 2024-03-29T04:08:23.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.221+0000 7f42c85cb740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x55bcce949fd0 con 0x55bcce9e4d40 2024-03-29T04:08:23.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.222+0000 7f42beffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bccea11860 0x55bcce9e4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:23.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.222+0000 7f42beffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bccea11860 0x55bcce9e4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42510/0 (socket says 172.21.15.73:42510) 2024-03-29T04:08:23.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.222+0000 7f42beffd640 1 -- 172.21.15.73:0/1836991400 learned_addr learned my addr 172.21.15.73:0/1836991400 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:23.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.222+0000 7f42be7fc640 1 --2- 172.21.15.73:0/1836991400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bccea11c40 0x55bccea145f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:23.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.222+0000 7f42bf7fe640 1 --2- 172.21.15.73:0/1836991400 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bcce9e4d40 0x55bccea14b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:23.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.222+0000 7f42beffd640 1 -- 172.21.15.73:0/1836991400 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bcce9e4d40 msgr2=0x55bccea14b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:23.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.222+0000 7f42beffd640 1 --2- 172.21.15.73:0/1836991400 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bcce9e4d40 0x55bccea14b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:23.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.222+0000 7f42beffd640 1 -- 172.21.15.73:0/1836991400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bccea11c40 msgr2=0x55bccea145f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:23.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.222+0000 7f42beffd640 1 --2- 172.21.15.73:0/1836991400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bccea11c40 0x55bccea145f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:23.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.222+0000 7f42beffd640 1 -- 172.21.15.73:0/1836991400 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcce6622d0 con 0x55bccea11860 2024-03-29T04:08:23.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.222+0000 7f42beffd640 1 --2- 172.21.15.73:0/1836991400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bccea11860 0x55bcce9e4800 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f42b002bdb0 tx=0x7f42b0009030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f8b6ae95604c2c8 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:23.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.222+0000 7f42a57fa640 1 -- 172.21.15.73:0/1836991400 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b0050070 con 0x55bccea11860 2024-03-29T04:08:23.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.222+0000 7f42a57fa640 1 -- 172.21.15.73:0/1836991400 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42b0006c60 con 0x55bccea11860 2024-03-29T04:08:23.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.222+0000 7f42a57fa640 1 -- 172.21.15.73:0/1836991400 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b0039040 con 0x55bccea11860 2024-03-29T04:08:23.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.223+0000 7f42c85cb740 1 -- 172.21.15.73:0/1836991400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bccea11860 msgr2=0x55bcce9e4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:23.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.223+0000 7f42c85cb740 1 --2- 172.21.15.73:0/1836991400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bccea11860 0x55bcce9e4800 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f42b002bdb0 tx=0x7f42b0009030 comp rx=0 tx=0).stop 2024-03-29T04:08:23.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.223+0000 7f42c85cb740 1 -- 172.21.15.73:0/1836991400 shutdown_connections 2024-03-29T04:08:23.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.223+0000 7f42c85cb740 1 --2- 172.21.15.73:0/1836991400 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bcce9e4d40 0x55bccea14b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:23.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.223+0000 7f42c85cb740 1 --2- 172.21.15.73:0/1836991400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bccea11c40 0x55bccea145f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:23.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.223+0000 7f42c85cb740 1 --2- 172.21.15.73:0/1836991400 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bccea11860 0x55bcce9e4800 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:23.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.223+0000 7f42c85cb740 1 -- 172.21.15.73:0/1836991400 >> 172.21.15.73:0/1836991400 conn(0x55bcce9e6a70 msgr2=0x55bccea2f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:23.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.223+0000 7f42c85cb740 1 -- 172.21.15.73:0/1836991400 shutdown_connections 2024-03-29T04:08:23.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.223+0000 7f42c85cb740 1 -- 172.21.15.73:0/1836991400 wait complete. 2024-03-29T04:08:23.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.223+0000 7f42c85cb740 1 -- start start 2024-03-29T04:08:23.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.224+0000 7f42c85cb740 1 Processor -- start 2024-03-29T04:08:23.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.224+0000 7f42c85cb740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bccea11860 0x55bccea2fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:23.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.224+0000 7f42c85cb740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bccea11c40 0x55bccea16010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:23.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.224+0000 7f42c85cb740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bccea13ab0 0x55bccea17c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:23.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.224+0000 7f42c85cb740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55bcce9e9110 con 0x55bccea11c40 2024-03-29T04:08:23.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.224+0000 7f42c85cb740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55bcce9099c0 con 0x55bccea13ab0 2024-03-29T04:08:23.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.224+0000 7f42c85cb740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x55bcce9eb950 con 0x55bccea11860 2024-03-29T04:08:23.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.224+0000 7f42c85cb740 10 client.0 _ll_register_callbacks cb 0x55bcce8edfc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-29T04:08:23.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.224+0000 7f42be7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bccea11c40 0x55bccea16010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:23.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.224+0000 7f42be7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bccea11c40 0x55bccea16010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42526/0 (socket says 172.21.15.73:42526) 2024-03-29T04:08:23.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.224+0000 7f42be7fc640 1 -- 172.21.15.73:0/810176661 learned_addr learned my addr 172.21.15.73:0/810176661 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:23.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.224+0000 7f42beffd640 1 --2- 172.21.15.73:0/810176661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bccea11860 0x55bccea2fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:23.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.224+0000 7f42bf7fe640 1 --2- 172.21.15.73:0/810176661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bccea13ab0 0x55bccea17c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:23.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.225+0000 7f42be7fc640 1 -- 172.21.15.73:0/810176661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bccea11860 msgr2=0x55bccea2fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:23.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.225+0000 7f42be7fc640 1 --2- 172.21.15.73:0/810176661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bccea11860 0x55bccea2fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:23.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.225+0000 7f42be7fc640 1 -- 172.21.15.73:0/810176661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bccea13ab0 msgr2=0x55bccea17c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:23.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.225+0000 7f42be7fc640 1 --2- 172.21.15.73:0/810176661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bccea13ab0 0x55bccea17c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:23.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.225+0000 7f42be7fc640 1 -- 172.21.15.73:0/810176661 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcce72c6b0 con 0x55bccea11c40 2024-03-29T04:08:23.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.225+0000 7f42be7fc640 1 --2- 172.21.15.73:0/810176661 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bccea11c40 0x55bccea16010 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f42b40011e0 tx=0x7f42b4007490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c81005e607a9c430 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:23.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.225+0000 7f429e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-03-29T04:08:23.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.225+0000 7f429e7fc640 1 -- 172.21.15.73:0/810176661 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b4015910 con 0x55bccea11c40 2024-03-29T04:08:23.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.225+0000 7f429e7fc640 1 -- 172.21.15.73:0/810176661 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f42b4015ab0 con 0x55bccea11c40 2024-03-29T04:08:23.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.225+0000 7f42c85cb740 1 -- 172.21.15.73:0/810176661 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42b0006c60 con 0x55bccea11c40 2024-03-29T04:08:23.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.225+0000 7f429e7fc640 1 -- 172.21.15.73:0/810176661 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f42b4026050 con 0x55bccea11c40 2024-03-29T04:08:23.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.225+0000 7f42c85cb740 10 client.4629 fetch_fsmap learned FSMap version 6 2024-03-29T04:08:23.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.225+0000 7f42c85cb740 1 -- 172.21.15.73:0/810176661 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55bccea2f2e0 con 0x55bccea11c40 2024-03-29T04:08:23.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.225+0000 7f429e7fc640 1 -- 172.21.15.73:0/810176661 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42b0006c60 con 0x55bccea11c40 2024-03-29T04:08:23.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.225+0000 7f429e7fc640 1 -- 172.21.15.73:0/810176661 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 6) ==== 3494+0+0 (secure 0 0 0) 0x7f42b4029020 con 0x55bccea11c40 2024-03-29T04:08:23.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.225+0000 7f42c85cb740 10 client.4629 fetch_fsmap finished waiting for FSMap version 6 2024-03-29T04:08:23.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.225+0000 7f42c85cb740 10 client.4629 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-29T04:08:23.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.225+0000 7f42c85cb740 20 client.4629 populate_metadata read hostname 'smithi073' 2024-03-29T04:08:23.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.225+0000 7f42c85cb740 1 --2- 172.21.15.73:0/810176661 >> [v2:172.21.15.142:6833/569863112,v1:172.21.15.142:6835/569863112] conn(0x55bcce9fb820 0x55bccea2e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:23.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.225+0000 7f42c85cb740 4 client.4629 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-29T04:08:23.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.225+0000 7f42c85cb740 1 -- 172.21.15.73:0/810176661 --> [v2:172.21.15.142:6833/569863112,v1:172.21.15.142:6835/569863112] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bcce9224e0 con 0x55bcce9fb820 2024-03-29T04:08:23.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.225+0000 7f42beffd640 1 --2- 172.21.15.73:0/810176661 >> [v2:172.21.15.142:6833/569863112,v1:172.21.15.142:6835/569863112] conn(0x55bcce9fb820 0x55bccea2e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:23.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.226+0000 7f429e7fc640 10 client.4629 ms_handle_connect on v2:172.21.15.142:6833/569863112 2024-03-29T04:08:23.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.226+0000 7f42beffd640 1 --2- 172.21.15.73:0/810176661 >> [v2:172.21.15.142:6833/569863112,v1:172.21.15.142:6835/569863112] conn(0x55bcce9fb820 0x55bccea2e850 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b889f29a6f07faa4 server_cookie=3412968f906bacb1 in_seq=0 out_seq=0 2024-03-29T04:08:23.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.226+0000 7f429e7fc640 1 -- 172.21.15.73:0/810176661 <== mds.0 v2:172.21.15.142:6833/569863112 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55bcce9224e0 con 0x55bcce9fb820 2024-03-29T04:08:23.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.226+0000 7f429e7fc640 10 client.4629 handle_command_reply: tid=0 2024-03-29T04:08:23.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.226+0000 7f42c85cb740 1 client.4629 shutdown 2024-03-29T04:08:23.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.227+0000 7f42c85cb740 1 -- 172.21.15.73:0/810176661 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bccea11c40 msgr2=0x55bccea16010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:23.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.227+0000 7f42c85cb740 1 --2- 172.21.15.73:0/810176661 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bccea11c40 0x55bccea16010 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f42b40011e0 tx=0x7f42b4007490 comp rx=0 tx=0).stop 2024-03-29T04:08:23.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.227+0000 7f42c85cb740 1 -- 172.21.15.73:0/810176661 shutdown_connections 2024-03-29T04:08:23.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.227+0000 7f42c85cb740 1 --2- 172.21.15.73:0/810176661 >> [v2:172.21.15.142:6833/569863112,v1:172.21.15.142:6835/569863112] conn(0x55bcce9fb820 0x55bccea2e850 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:23.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.227+0000 7f42c85cb740 1 --2- 172.21.15.73:0/810176661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bccea13ab0 0x55bccea17c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:23.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.227+0000 7f42c85cb740 1 --2- 172.21.15.73:0/810176661 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bccea11c40 0x55bccea16010 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:23.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.227+0000 7f429e7fc640 0 client.4629 ms_handle_reset on v2:172.21.15.142:6833/569863112 2024-03-29T04:08:23.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.227+0000 7f42c85cb740 1 --2- 172.21.15.73:0/810176661 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bccea11860 0x55bccea2fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:23.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.227+0000 7f42c85cb740 1 -- 172.21.15.73:0/810176661 >> 172.21.15.73:0/810176661 conn(0x55bcce9e4d40 msgr2=0x55bccea0fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:23.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.227+0000 7f42c85cb740 1 -- 172.21.15.73:0/810176661 shutdown_connections 2024-03-29T04:08:23.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.227+0000 7f42c85cb740 1 -- 172.21.15.73:0/810176661 wait complete. 2024-03-29T04:08:23.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.227+0000 7f42c85cb740 20 client.4629 trim_cache size 0 max 16384 2024-03-29T04:08:23.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.245+0000 7f42c85cb740 1 Processor -- start 2024-03-29T04:08:23.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.245+0000 7f42c85cb740 1 -- start start 2024-03-29T04:08:23.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.246+0000 7f42c85cb740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bccea11860 0x55bcce9fa0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:23.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.246+0000 7f42c85cb740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bccea11c40 0x55bcce9fa5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:23.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.246+0000 7f42c85cb740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bccea13ab0 0x55bccea492b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:23.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.246+0000 7f42c85cb740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f42c0200430 con 0x55bccea13ab0 2024-03-29T04:08:23.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.246+0000 7f42c85cb740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f42c0148090 con 0x55bccea11c40 2024-03-29T04:08:23.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.246+0000 7f42c85cb740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f42c01ffe30 con 0x55bccea11860 2024-03-29T04:08:23.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.246+0000 7f42bf7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bccea13ab0 0x55bccea492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:23.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.246+0000 7f42bf7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bccea13ab0 0x55bccea492b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42530/0 (socket says 172.21.15.73:42530) 2024-03-29T04:08:23.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.246+0000 7f42bf7fe640 1 -- 172.21.15.73:0/1509649329 learned_addr learned my addr 172.21.15.73:0/1509649329 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:23.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.246+0000 7f42beffd640 1 --2- 172.21.15.73:0/1509649329 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bccea11860 0x55bcce9fa0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:23.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.246+0000 7f42be7fc640 1 --2- 172.21.15.73:0/1509649329 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bccea11c40 0x55bcce9fa5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:23.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.246+0000 7f42bf7fe640 1 -- 172.21.15.73:0/1509649329 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bccea11860 msgr2=0x55bcce9fa0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:23.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.246+0000 7f42bf7fe640 1 --2- 172.21.15.73:0/1509649329 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bccea11860 0x55bcce9fa0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:23.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.246+0000 7f42bf7fe640 1 -- 172.21.15.73:0/1509649329 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bccea11c40 msgr2=0x55bcce9fa5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:23.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.246+0000 7f42bf7fe640 1 --2- 172.21.15.73:0/1509649329 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bccea11c40 0x55bcce9fa5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:23.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.246+0000 7f42bf7fe640 1 -- 172.21.15.73:0/1509649329 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcce9e6310 con 0x55bccea13ab0 2024-03-29T04:08:23.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.246+0000 7f42bf7fe640 1 --2- 172.21.15.73:0/1509649329 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bccea13ab0 0x55bccea492b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f42b805a1f0 tx=0x7f42b805a030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcc1cc9f7bbe3789 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:23.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.246+0000 7f42a4ff9640 1 -- 172.21.15.73:0/1509649329 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b805e8a0 con 0x55bccea13ab0 2024-03-29T04:08:23.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.246+0000 7f42a4ff9640 1 -- 172.21.15.73:0/1509649329 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42b80630d0 con 0x55bccea13ab0 2024-03-29T04:08:23.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.246+0000 7f42a4ff9640 1 -- 172.21.15.73:0/1509649329 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b808ab80 con 0x55bccea13ab0 2024-03-29T04:08:23.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.247+0000 7f42c85cb740 1 -- 172.21.15.73:0/1509649329 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bccea13ab0 msgr2=0x55bccea492b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:23.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.247+0000 7f42c85cb740 1 --2- 172.21.15.73:0/1509649329 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bccea13ab0 0x55bccea492b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f42b805a1f0 tx=0x7f42b805a030 comp rx=0 tx=0).stop 2024-03-29T04:08:23.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.247+0000 7f42c85cb740 1 -- 172.21.15.73:0/1509649329 shutdown_connections 2024-03-29T04:08:23.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.247+0000 7f42c85cb740 1 --2- 172.21.15.73:0/1509649329 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bccea13ab0 0x55bccea492b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:23.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.247+0000 7f42c85cb740 1 --2- 172.21.15.73:0/1509649329 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bccea11c40 0x55bcce9fa5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:23.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.247+0000 7f42c85cb740 1 --2- 172.21.15.73:0/1509649329 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bccea11860 0x55bcce9fa0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:23.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.247+0000 7f42c85cb740 1 -- 172.21.15.73:0/1509649329 >> 172.21.15.73:0/1509649329 conn(0x55bcce9e4d40 msgr2=0x55bccea2fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:23.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.247+0000 7f42c85cb740 1 -- 172.21.15.73:0/1509649329 shutdown_connections 2024-03-29T04:08:23.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.247+0000 7f42c85cb740 1 -- 172.21.15.73:0/1509649329 wait complete. 2024-03-29T04:08:23.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.247+0000 7f42c85cb740 1 -- start start 2024-03-29T04:08:23.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.248+0000 7f42c85cb740 1 Processor -- start 2024-03-29T04:08:23.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.248+0000 7f42c85cb740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bccea11860 0x55bcceaaba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:23.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.248+0000 7f42c85cb740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bccea11c40 0x55bcceaaaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:23.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.248+0000 7f42c85cb740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bccea13ab0 0x55bcceaae510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:23.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.248+0000 7f42c85cb740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55bcce9fb6a0 con 0x55bccea11c40 2024-03-29T04:08:23.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.248+0000 7f42c85cb740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55bccea16670 con 0x55bccea13ab0 2024-03-29T04:08:23.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.248+0000 7f42c85cb740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x55bcce9fbcc0 con 0x55bccea11860 2024-03-29T04:08:23.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.248+0000 7f42c85cb740 10 client.0 _ll_register_callbacks cb 0x7f42b4001630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-29T04:08:23.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.248+0000 7f42be7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bccea11c40 0x55bcceaaaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:23.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.248+0000 7f42be7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bccea11c40 0x55bcceaaaa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42540/0 (socket says 172.21.15.73:42540) 2024-03-29T04:08:23.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.248+0000 7f42be7fc640 1 -- 172.21.15.73:0/1173580217 learned_addr learned my addr 172.21.15.73:0/1173580217 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:23.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.248+0000 7f42beffd640 1 --2- 172.21.15.73:0/1173580217 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bccea11860 0x55bcceaaba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:23.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.248+0000 7f42bf7fe640 1 --2- 172.21.15.73:0/1173580217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bccea13ab0 0x55bcceaae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:23.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.249+0000 7f42be7fc640 1 -- 172.21.15.73:0/1173580217 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bccea11860 msgr2=0x55bcceaaba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:23.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.249+0000 7f42be7fc640 1 --2- 172.21.15.73:0/1173580217 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bccea11860 0x55bcceaaba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:23.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.249+0000 7f42be7fc640 1 -- 172.21.15.73:0/1173580217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bccea13ab0 msgr2=0x55bcceaae510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:23.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.249+0000 7f42be7fc640 1 --2- 172.21.15.73:0/1173580217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bccea13ab0 0x55bcceaae510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:23.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.249+0000 7f42be7fc640 1 -- 172.21.15.73:0/1173580217 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bccea2d7a0 con 0x55bccea11c40 2024-03-29T04:08:23.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.249+0000 7f42bf7fe640 1 --2- 172.21.15.73:0/1173580217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bccea13ab0 0x55bcceaae510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:08:23.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.249+0000 7f42be7fc640 1 --2- 172.21.15.73:0/1173580217 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bccea11c40 0x55bcceaaaa80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f42b4001e00 tx=0x7f42b4018070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6f27f07391cfba4 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:23.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.249+0000 7f429e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-03-29T04:08:23.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.249+0000 7f429e7fc640 1 -- 172.21.15.73:0/1173580217 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b4016420 con 0x55bccea11c40 2024-03-29T04:08:23.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.249+0000 7f429e7fc640 1 -- 172.21.15.73:0/1173580217 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f42b40165c0 con 0x55bccea11c40 2024-03-29T04:08:23.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.249+0000 7f42c85cb740 1 -- 172.21.15.73:0/1173580217 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42b80630d0 con 0x55bccea11c40 2024-03-29T04:08:23.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.249+0000 7f429e7fc640 1 -- 172.21.15.73:0/1173580217 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f42b403a050 con 0x55bccea11c40 2024-03-29T04:08:23.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.249+0000 7f42c85cb740 10 client.4635 fetch_fsmap learned FSMap version 6 2024-03-29T04:08:23.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.249+0000 7f42c85cb740 1 -- 172.21.15.73:0/1173580217 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55bcceaaef70 con 0x55bccea11c40 2024-03-29T04:08:23.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.249+0000 7f429e7fc640 1 -- 172.21.15.73:0/1173580217 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42b80630d0 con 0x55bccea11c40 2024-03-29T04:08:23.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.249+0000 7f429e7fc640 1 -- 172.21.15.73:0/1173580217 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 6) ==== 3494+0+0 (secure 0 0 0) 0x7f42b403d020 con 0x55bccea11c40 2024-03-29T04:08:23.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.249+0000 7f42c85cb740 10 client.4635 fetch_fsmap finished waiting for FSMap version 6 2024-03-29T04:08:23.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.249+0000 7f42c85cb740 10 client.4635 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-29T04:08:23.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.249+0000 7f42c85cb740 20 client.4635 populate_metadata read hostname 'smithi073' 2024-03-29T04:08:23.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.249+0000 7f42c85cb740 1 --2- 172.21.15.73:0/1173580217 >> [v2:172.21.15.142:6833/569863112,v1:172.21.15.142:6835/569863112] conn(0x55bcce9e36f0 0x55bcce9e3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:23.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.249+0000 7f42c85cb740 4 client.4635 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-29T04:08:23.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.249+0000 7f42c85cb740 1 -- 172.21.15.73:0/1173580217 --> [v2:172.21.15.142:6833/569863112,v1:172.21.15.142:6835/569863112] -- command(tid 0: {"prefix": "status"}) -- 0x55bcce95b560 con 0x55bcce9e36f0 2024-03-29T04:08:23.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.249+0000 7f42beffd640 1 --2- 172.21.15.73:0/1173580217 >> [v2:172.21.15.142:6833/569863112,v1:172.21.15.142:6835/569863112] conn(0x55bcce9e36f0 0x55bcce9e3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:23.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.250+0000 7f42beffd640 1 --2- 172.21.15.73:0/1173580217 >> [v2:172.21.15.142:6833/569863112,v1:172.21.15.142:6835/569863112] conn(0x55bcce9e36f0 0x55bcce9e3ad0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc6cbf8c1d771295 server_cookie=d98ee0470014992c in_seq=0 out_seq=0 2024-03-29T04:08:23.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.250+0000 7f429e7fc640 10 client.4635 ms_handle_connect on v2:172.21.15.142:6833/569863112 2024-03-29T04:08:23.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.250+0000 7f429e7fc640 1 -- 172.21.15.73:0/1173580217 <== mds.0 v2:172.21.15.142:6833/569863112 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55bcce95b560 con 0x55bcce9e36f0 2024-03-29T04:08:23.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.250+0000 7f429e7fc640 10 client.4635 handle_command_reply: tid=0 2024-03-29T04:08:23.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.250+0000 7f42c85cb740 1 client.4635 shutdown 2024-03-29T04:08:23.236 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.250+0000 7f42c85cb740 1 -- 172.21.15.73:0/1173580217 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bccea11c40 msgr2=0x55bcceaaaa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:23.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.250+0000 7f42c85cb740 1 --2- 172.21.15.73:0/1173580217 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bccea11c40 0x55bcceaaaa80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f42b4001e00 tx=0x7f42b4018070 comp rx=0 tx=0).stop 2024-03-29T04:08:23.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.250+0000 7f42c85cb740 1 -- 172.21.15.73:0/1173580217 shutdown_connections 2024-03-29T04:08:23.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.250+0000 7f42c85cb740 1 --2- 172.21.15.73:0/1173580217 >> [v2:172.21.15.142:6833/569863112,v1:172.21.15.142:6835/569863112] conn(0x55bcce9e36f0 0x55bcce9e3ad0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:23.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.250+0000 7f42c85cb740 1 --2- 172.21.15.73:0/1173580217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bccea13ab0 0x55bcceaae510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:23.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.250+0000 7f42c85cb740 1 --2- 172.21.15.73:0/1173580217 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bccea11c40 0x55bcceaaaa80 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:23.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.250+0000 7f42c85cb740 1 --2- 172.21.15.73:0/1173580217 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55bccea11860 0x55bcceaaba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:23.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.250+0000 7f429e7fc640 0 client.4635 ms_handle_reset on v2:172.21.15.142:6833/569863112 2024-03-29T04:08:23.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.250+0000 7f42c85cb740 1 -- 172.21.15.73:0/1173580217 >> 172.21.15.73:0/1173580217 conn(0x55bcce9e4d40 msgr2=0x55bccea14900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:23.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.250+0000 7f42c85cb740 1 -- 172.21.15.73:0/1173580217 shutdown_connections 2024-03-29T04:08:23.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.250+0000 7f42c85cb740 1 -- 172.21.15.73:0/1173580217 wait complete. 2024-03-29T04:08:23.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.250+0000 7f42c85cb740 20 client.4635 trim_cache size 0 max 16384 2024-03-29T04:08:23.238 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-29T04:08:23.238 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "6bff1617-b138-4517-acca-3ecaae3f2bb3", 2024-03-29T04:08:23.238 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 0, 2024-03-29T04:08:23.238 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 4294, 2024-03-29T04:08:23.238 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2024-03-29T04:08:23.238 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2024-03-29T04:08:23.238 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2024-03-29T04:08:23.238 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 10.683994533, 2024-03-29T04:08:23.238 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 6, 2024-03-29T04:08:23.238 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 21, 2024-03-29T04:08:23.238 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 21, 2024-03-29T04:08:23.238 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 18.091696884000001 2024-03-29T04:08:23.239 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-29T04:08:23.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.251+0000 7f42c59e8640 1 -- 172.21.15.73:0/428010922 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f42ac06c560 msgr2=0x7f42ac06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:23.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.251+0000 7f42c59e8640 1 --2- 172.21.15.73:0/428010922 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f42ac06c560 0x7f42ac06ea20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f42b0034000 tx=0x7f42b0031000 comp rx=0 tx=0).stop 2024-03-29T04:08:23.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.251+0000 7f42c59e8640 1 -- 172.21.15.73:0/428010922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42c0146370 msgr2=0x7f42c0146820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:23.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.251+0000 7f42c59e8640 1 --2- 172.21.15.73:0/428010922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42c0146370 0x7f42c0146820 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f42c00d4280 tx=0x7f42b800c810 comp rx=0 tx=0).stop 2024-03-29T04:08:23.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.251+0000 7f42c59e8640 1 -- 172.21.15.73:0/428010922 shutdown_connections 2024-03-29T04:08:23.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.251+0000 7f42c59e8640 1 --2- 172.21.15.73:0/428010922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42c0146370 0x7f42c0146820 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:23.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.251+0000 7f42c59e8640 1 --2- 172.21.15.73:0/428010922 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42c015bbd0 0x7f42c01e7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:23.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.251+0000 7f42c59e8640 1 --2- 172.21.15.73:0/428010922 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f42ac06c560 0x7f42ac06ea20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:23.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.251+0000 7f42c59e8640 1 --2- 172.21.15.73:0/428010922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42a8003b40 0x7f42c01499c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:23.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.251+0000 7f42c59e8640 1 -- 172.21.15.73:0/428010922 >> 172.21.15.73:0/428010922 conn(0x7f42c008bfc0 msgr2=0x7f42c015c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:23.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.251+0000 7f42c59e8640 1 -- 172.21.15.73:0/428010922 shutdown_connections 2024-03-29T04:08:23.240 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.251+0000 7f42c59e8640 1 -- 172.21.15.73:0/428010922 wait complete. 2024-03-29T04:08:23.241 INFO:teuthology.run_tasks:Running task sequential... 2024-03-29T04:08:23.251 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-03-29T04:08:23.252 INFO:teuthology.task.sequential:In sequential, running task print... 2024-03-29T04:08:23.252 INFO:teuthology.task.print:Enabling mgr modules 2024-03-29T04:08:23.252 INFO:teuthology.run_tasks:Running task kclient... 2024-03-29T04:08:23.276 INFO:tasks.kclient:Mounting kernel clients... 2024-03-29T04:08:23.276 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-03-29T04:08:23.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:23.276 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-03-29T04:08:23.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:23.292 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2024-03-29T04:08:23.360 INFO:teuthology.orchestra.run.smithi073.stderr:Cannot find device "ceph-brx" 2024-03-29T04:08:23.361 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-29T04:08:23.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:23.362 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-03-29T04:08:23.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:23.416 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2024-03-29T04:08:23.484 INFO:teuthology.orchestra.run.smithi073.stderr:Cannot find device "ceph-brx" 2024-03-29T04:08:23.485 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-29T04:08:23.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:23.486 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-03-29T04:08:23.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:23.501 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2024-03-29T04:08:23.574 INFO:teuthology.orchestra.run.smithi142.stderr:Cannot find device "ceph-brx" 2024-03-29T04:08:23.575 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-29T04:08:23.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:23.576 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-03-29T04:08:23.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:23.631 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2024-03-29T04:08:23.698 INFO:teuthology.orchestra.run.smithi142.stderr:Cannot find device "ceph-brx" 2024-03-29T04:08:23.699 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-29T04:08:23.700 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-03-29T04:08:23.700 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-29T04:08:23.700 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-29T04:08:23.700 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-29T04:08:23.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.820+0000 7f4967e28640 1 Processor -- start 2024-03-29T04:08:23.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.821+0000 7f4967e28640 1 -- start start 2024-03-29T04:08:23.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.821+0000 7f4967e28640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f496015b370 0x7f49600b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:23.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.821+0000 7f4967e28640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f496006f3f0 0x7f4960072b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:23.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.821+0000 7f4967e28640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f49600730c0 0x7f49600ae020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:23.802 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.821+0000 7f4967e28640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f4960071ae0 con 0x7f49600730c0 2024-03-29T04:08:23.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.821+0000 7f4967e28640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f4960071dc0 con 0x7f496006f3f0 2024-03-29T04:08:23.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.821+0000 7f4967e28640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f49600720a0 con 0x7f496015b370 2024-03-29T04:08:23.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.822+0000 7f49663c5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f49600730c0 0x7f49600ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:23.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.822+0000 7f49663c5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f49600730c0 0x7f49600ae020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42554/0 (socket says 172.21.15.73:42554) 2024-03-29T04:08:23.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.822+0000 7f49663c5640 1 -- 172.21.15.73:0/3570262619 learned_addr learned my addr 172.21.15.73:0/3570262619 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:23.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.822+0000 7f4965bc4640 1 --2- 172.21.15.73:0/3570262619 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f496015b370 0x7f49600b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:23.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.822+0000 7f49653c3640 1 --2- 172.21.15.73:0/3570262619 >> v2:172.21.15.142:3300/0 conn(0x7f496006f3f0 0x7f4960072b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:23.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.822+0000 7f49663c5640 1 -- 172.21.15.73:0/3570262619 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f496015b370 msgr2=0x7f49600b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:23.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.822+0000 7f49663c5640 1 --2- 172.21.15.73:0/3570262619 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f496015b370 0x7f49600b32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:23.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.822+0000 7f49663c5640 1 -- 172.21.15.73:0/3570262619 >> v2:172.21.15.142:3300/0 conn(0x7f496006f3f0 msgr2=0x7f4960072b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:23.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.822+0000 7f49663c5640 1 --2- 172.21.15.73:0/3570262619 >> v2:172.21.15.142:3300/0 conn(0x7f496006f3f0 0x7f4960072b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:23.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.822+0000 7f49663c5640 1 -- 172.21.15.73:0/3570262619 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4960072380 con 0x7f49600730c0 2024-03-29T04:08:23.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.823+0000 7f49663c5640 1 --2- 172.21.15.73:0/3570262619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49600730c0 0x7f49600ae020 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f49600b3080 tx=0x7f495c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5b8b439eba1848a server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:23.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.823+0000 7f4964bc2640 1 -- 172.21.15.73:0/3570262619 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f495c035020 con 0x7f49600730c0 2024-03-29T04:08:23.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.823+0000 7f4964bc2640 1 -- 172.21.15.73:0/3570262619 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f495c031870 con 0x7f49600730c0 2024-03-29T04:08:23.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.823+0000 7f4964bc2640 1 -- 172.21.15.73:0/3570262619 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f495c031c40 con 0x7f49600730c0 2024-03-29T04:08:23.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.823+0000 7f4967e28640 1 -- 172.21.15.73:0/3570262619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49600730c0 msgr2=0x7f49600ae020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:23.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.823+0000 7f4967e28640 1 --2- 172.21.15.73:0/3570262619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49600730c0 0x7f49600ae020 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f49600b3080 tx=0x7f495c02b910 comp rx=0 tx=0).stop 2024-03-29T04:08:23.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.823+0000 7f4967e28640 1 -- 172.21.15.73:0/3570262619 shutdown_connections 2024-03-29T04:08:23.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.823+0000 7f4967e28640 1 --2- 172.21.15.73:0/3570262619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49600730c0 0x7f49600ae020 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:23.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.823+0000 7f4967e28640 1 --2- 172.21.15.73:0/3570262619 >> v2:172.21.15.142:3300/0 conn(0x7f496006f3f0 0x7f4960072b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:23.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.823+0000 7f4967e28640 1 --2- 172.21.15.73:0/3570262619 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f496015b370 0x7f49600b32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:23.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.823+0000 7f4967e28640 1 -- 172.21.15.73:0/3570262619 >> 172.21.15.73:0/3570262619 conn(0x7f496006b510 msgr2=0x7f496006b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:23.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.823+0000 7f4967e28640 1 -- 172.21.15.73:0/3570262619 shutdown_connections 2024-03-29T04:08:23.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.823+0000 7f4967e28640 1 -- 172.21.15.73:0/3570262619 wait complete. 2024-03-29T04:08:23.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.824+0000 7f4967e28640 1 Processor -- start 2024-03-29T04:08:23.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.825+0000 7f4967e28640 1 -- start start 2024-03-29T04:08:23.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.825+0000 7f4967e28640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f496006f3f0 0x7f49600cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:23.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.825+0000 7f4967e28640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49600730c0 0x7f49600c9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:23.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.825+0000 7f4967e28640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f496015b370 0x7f49601f40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:23.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.825+0000 7f4967e28640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f49600b3800 con 0x7f496015b370 2024-03-29T04:08:23.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.825+0000 7f4967e28640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4960073550 con 0x7f496006f3f0 2024-03-29T04:08:23.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.825+0000 7f4967e28640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f49600b3980 con 0x7f49600730c0 2024-03-29T04:08:23.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.825+0000 7f49663c5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f496015b370 0x7f49601f40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:23.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.825+0000 7f49663c5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f496015b370 0x7f49601f40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42560/0 (socket says 172.21.15.73:42560) 2024-03-29T04:08:23.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.825+0000 7f49663c5640 1 -- 172.21.15.73:0/512646470 learned_addr learned my addr 172.21.15.73:0/512646470 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:23.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.825+0000 7f49653c3640 1 --2- 172.21.15.73:0/512646470 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49600730c0 0x7f49600c9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:23.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.825+0000 7f4965bc4640 1 --2- 172.21.15.73:0/512646470 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f496006f3f0 0x7f49600cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:23.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.826+0000 7f49663c5640 1 -- 172.21.15.73:0/512646470 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49600730c0 msgr2=0x7f49600c9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:23.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.826+0000 7f49663c5640 1 --2- 172.21.15.73:0/512646470 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49600730c0 0x7f49600c9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:23.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.826+0000 7f49663c5640 1 -- 172.21.15.73:0/512646470 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f496006f3f0 msgr2=0x7f49600cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:23.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.826+0000 7f49663c5640 1 --2- 172.21.15.73:0/512646470 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f496006f3f0 0x7f49600cf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:23.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.826+0000 7f49663c5640 1 -- 172.21.15.73:0/512646470 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49601577c0 con 0x7f496015b370 2024-03-29T04:08:23.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.826+0000 7f49663c5640 1 --2- 172.21.15.73:0/512646470 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f496015b370 0x7f49601f40b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f495c009960 tx=0x7f495c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:23.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.826+0000 7f49567fc640 1 -- 172.21.15.73:0/512646470 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f495c040070 con 0x7f496015b370 2024-03-29T04:08:23.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.826+0000 7f49567fc640 1 -- 172.21.15.73:0/512646470 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f495c030c20 con 0x7f496015b370 2024-03-29T04:08:23.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.826+0000 7f4967e28640 1 -- 172.21.15.73:0/512646470 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49600ca130 con 0x7f496015b370 2024-03-29T04:08:23.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.826+0000 7f49567fc640 1 -- 172.21.15.73:0/512646470 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f495c035040 con 0x7f496015b370 2024-03-29T04:08:23.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.826+0000 7f4967e28640 1 -- 172.21.15.73:0/512646470 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49600ca6f0 con 0x7f496015b370 2024-03-29T04:08:23.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.827+0000 7f4967e28640 1 -- 172.21.15.73:0/512646470 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4960068640 con 0x7f496015b370 2024-03-29T04:08:23.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.827+0000 7f49567fc640 1 -- 172.21.15.73:0/512646470 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f495c038020 con 0x7f496015b370 2024-03-29T04:08:23.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.828+0000 7f49567fc640 1 --2- 172.21.15.73:0/512646470 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f494406c530 0x7f494406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:23.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.828+0000 7f49567fc640 1 -- 172.21.15.73:0/512646470 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f495c0ad2a0 con 0x7f496015b370 2024-03-29T04:08:23.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.828+0000 7f4965bc4640 1 --2- 172.21.15.73:0/512646470 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f494406c530 0x7f494406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:23.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.828+0000 7f4965bc4640 1 --2- 172.21.15.73:0/512646470 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f494406c530 0x7f494406e9f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f49580113e0 tx=0x7f495800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:23.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:23.832+0000 7f49567fc640 1 -- 172.21.15.73:0/512646470 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f495c07b300 con 0x7f496015b370 2024-03-29T04:08:24.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:24.047+0000 7f4967e28640 1 -- 172.21.15.73:0/512646470 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f49600d0000 con 0x7f496015b370 2024-03-29T04:08:24.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:24.047+0000 7f49567fc640 1 -- 172.21.15.73:0/512646470 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f495c0ad0c0 con 0x7f496015b370 2024-03-29T04:08:24.027 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-29T04:08:24.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:24.049+0000 7f4967e28640 1 -- 172.21.15.73:0/512646470 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f494406c530 msgr2=0x7f494406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:24.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:24.050+0000 7f4967e28640 1 --2- 172.21.15.73:0/512646470 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f494406c530 0x7f494406e9f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f49580113e0 tx=0x7f495800b040 comp rx=0 tx=0).stop 2024-03-29T04:08:24.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:24.050+0000 7f4967e28640 1 -- 172.21.15.73:0/512646470 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f496015b370 msgr2=0x7f49601f40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:24.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:24.050+0000 7f4967e28640 1 --2- 172.21.15.73:0/512646470 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f496015b370 0x7f49601f40b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f495c009960 tx=0x7f495c0046c0 comp rx=0 tx=0).stop 2024-03-29T04:08:24.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:24.050+0000 7f4967e28640 1 -- 172.21.15.73:0/512646470 shutdown_connections 2024-03-29T04:08:24.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:24.050+0000 7f4967e28640 1 --2- 172.21.15.73:0/512646470 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f496015b370 0x7f49601f40b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:24.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:24.050+0000 7f4967e28640 1 --2- 172.21.15.73:0/512646470 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49600730c0 0x7f49600c9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:24.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:24.050+0000 7f4967e28640 1 --2- 172.21.15.73:0/512646470 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f494406c530 0x7f494406e9f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:24.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:24.050+0000 7f4967e28640 1 --2- 172.21.15.73:0/512646470 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f496006f3f0 0x7f49600cf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:24.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:24.050+0000 7f4967e28640 1 -- 172.21.15.73:0/512646470 >> 172.21.15.73:0/512646470 conn(0x7f496006b510 msgr2=0x7f49600aff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:24.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:24.050+0000 7f4967e28640 1 -- 172.21.15.73:0/512646470 shutdown_connections 2024-03-29T04:08:24.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:24.050+0000 7f4967e28640 1 -- 172.21.15.73:0/512646470 wait complete. 2024-03-29T04:08:24.040 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-29T04:08:24.040 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-29T04:08:24.040 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2024-03-29T04:08:24.040 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-29T04:08:24.041 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-29T04:08:24.041 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-29T04:08:24.041 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-29T04:08:24.041 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-29T04:08:24.041 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-29T04:08:24.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:24.041 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2024-03-29T04:08:24.056 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-29T04:08:24.056 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-29T04:08:24.056 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2024-03-29T04:08:24.057 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:08:24.057 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2024-03-29T04:08:24.057 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:08:24.057 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-29T04:08:24.057 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2024-03-29T04:08:24.057 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2024-03-29T04:08:24.057 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-29T04:08:24.057 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2024-03-29T04:08:24.057 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2024-03-29T04:08:24.057 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-29T04:08:24.057 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2024-03-29T04:08:24.057 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-29T04:08:24.057 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2024-03-29T04:08:24.057 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-29T04:08:24.057 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42730sec preferred_lft 42730sec 2024-03-29T04:08:24.057 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link 2024-03-29T04:08:24.058 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:08:24.058 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-29T04:08:24.058 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-29T04:08:24.058 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-03-29T04:08:24.058 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add name ceph-brx type bridge 2024-03-29T04:08:24.058 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr flush dev ceph-brx 2024-03-29T04:08:24.058 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set ceph-brx up 2024-03-29T04:08:24.058 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-29T04:08:24.059 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-03-29T04:08:24.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-29T04:08:24.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-29T04:08:24.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:24.273 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-29T04:08:24.301 INFO:teuthology.orchestra.run.smithi073.stdout:1 2024-03-29T04:08:24.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:24.303 DEBUG:teuthology.orchestra.run.smithi073:> route 2024-03-29T04:08:24.374 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2024-03-29T04:08:24.374 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-29T04:08:24.374 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-29T04:08:24.374 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-29T04:08:24.375 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-29T04:08:24.375 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-29T04:08:24.375 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-03-29T04:08:24.375 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-29T04:08:24.375 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-29T04:08:24.376 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-29T04:08:24.376 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-03-29T04:08:24.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-29T04:08:24.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-29T04:08:24.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:24.673 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-03-29T04:08:24.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:24.692 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list-id 2024-03-29T04:08:24.746 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-29T04:08:24.746 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-03-29T04:08:24.747 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-29T04:08:24.747 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-29T04:08:24.747 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-03-29T04:08:24.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-29T04:08:24.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-29T04:08:24.868 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-29T04:08:24.868 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-29T04:08:24.869 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-03-29T04:08:24.869 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-29T04:08:24.869 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-29T04:08:24.869 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-29T04:08:24.869 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-29T04:08:24.869 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-29T04:08:24.869 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-03-29T04:08:24.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-29T04:08:25.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-29T04:08:25.008 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-29T04:08:25.008 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-03-29T04:08:25.008 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.0 up 2024-03-29T04:08:25.008 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set dev brx.0 master ceph-brx 2024-03-29T04:08:25.008 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-03-29T04:08:25.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-29T04:08:25.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-29T04:08:25.089 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-29T04:08:25.089 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-29T04:08:25.103 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-29T04:08:25.103 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-29T04:08:25.103 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-29T04:08:25.157 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-29T04:08:25.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:25.157 DEBUG:teuthology.orchestra.run.smithi073:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-29T04:08:25.242 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-29T04:08:25.242 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-29T04:08:25.242 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2024-03-29T04:08:25.359 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-29T04:08:25.359 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-29T04:08:25.359 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2024-03-29T04:08:25.359 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.142:3300,172.21.15.142:3301" 2024-03-29T04:08:25.359 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-29T04:08:25.364 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-29T04:08:25.364 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-29T04:08:25.364 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2024-03-29T04:08:25.364 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.142:3300,172.21.15.142:3301" 2024-03-29T04:08:25.364 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-29T04:08:25.364 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:6789,172.21.15.142:6789,172.21.15.142:6790" 2024-03-29T04:08:25.364 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.73:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2024-03-29T04:08:25.364 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=6bff1617-b138-4517-acca-3ecaae3f2bb3" will pass to kernel 2024-03-29T04:08:25.365 INFO:teuthology.orchestra.run.smithi073.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-03-29T04:08:25.365 INFO:teuthology.orchestra.run.smithi073.stdout: You just mounted a file system that supports labels which does not 2024-03-29T04:08:25.365 INFO:teuthology.orchestra.run.smithi073.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-29T04:08:25.365 INFO:teuthology.orchestra.run.smithi073.stdout: applications will generate AVC messages and not be allowed access to 2024-03-29T04:08:25.365 INFO:teuthology.orchestra.run.smithi073.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-29T04:08:25.366 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-29T04:08:25.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:25.367 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-29T04:08:25.401 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-29T04:08:25.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-29T04:08:25.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-29T04:08:25.502 INFO:teuthology.orchestra.run.smithi073.stdout:client4644 2024-03-29T04:08:25.502 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-29T04:08:25.502 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-29T04:08:25.517 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-29T04:08:25.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-29T04:08:25.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-29T04:08:25.621 INFO:teuthology.orchestra.run.smithi073.stdout:client4644 2024-03-29T04:08:25.621 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-29T04:08:25.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-29T04:08:25.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-29T04:08:25.684 INFO:teuthology.orchestra.run.smithi073.stdout:client4644 2024-03-29T04:08:25.685 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/6bff1617-b138-4517-acca-3ecaae3f2bb3.client4644/status') 2024-03-29T04:08:25.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-29T04:08:25.749 INFO:teuthology.orchestra.run.smithi073.stdout:instance: client.4644 (3)192.168.0.1:0/53125712 2024-03-29T04:08:25.749 INFO:teuthology.orchestra.run.smithi073.stdout:blocklisted: false 2024-03-29T04:08:25.749 INFO:teuthology.orchestra.run.smithi073.stderr:0+1 records in 2024-03-29T04:08:25.749 INFO:teuthology.orchestra.run.smithi073.stderr:0+1 records out 2024-03-29T04:08:25.750 INFO:teuthology.orchestra.run.smithi073.stderr:67 bytes copied, 2.076e-05 s, 3.2 MB/s 2024-03-29T04:08:25.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-29T04:08:25.756 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-03-29T04:08:25.756 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-29T04:08:25.756 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-03-29T04:08:25.757 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-29T04:08:25.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.876+0000 7f549ebd6640 1 Processor -- start 2024-03-29T04:08:25.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.876+0000 7f549ebd6640 1 -- start start 2024-03-29T04:08:25.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.877+0000 7f549ebd6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f549806c520 0x7f549806c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:25.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.877+0000 7f549ebd6640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f549806e6b0 con 0x7f549815e9a0 2024-03-29T04:08:25.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.877+0000 7f549ebd6640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f549806e990 con 0x7f549806e0f0 2024-03-29T04:08:25.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.877+0000 7f549ebd6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f549806f2c0 con 0x7f549806c520 2024-03-29T04:08:25.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.877+0000 7f549c972640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f549815e9a0 0x7f5498072d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52292/0 (socket says 172.21.15.73:52292) 2024-03-29T04:08:25.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.877+0000 7f549c972640 1 -- 172.21.15.73:0/2412305330 learned_addr learned my addr 172.21.15.73:0/2412305330 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:25.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.877+0000 7f549d173640 1 --2- 172.21.15.73:0/2412305330 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f549806c520 0x7f549806c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:25.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.878+0000 7f54977fe640 1 -- 172.21.15.73:0/2412305330 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1695347741 0 0) 0x7f549806e6b0 con 0x7f549815e9a0 2024-03-29T04:08:25.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.878+0000 7f54977fe640 1 -- 172.21.15.73:0/2412305330 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5480003520 con 0x7f549815e9a0 2024-03-29T04:08:25.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.878+0000 7f54977fe640 1 -- 172.21.15.73:0/2412305330 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1762950933 0 0) 0x7f549806e990 con 0x7f549806e0f0 2024-03-29T04:08:25.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.878+0000 7f54977fe640 1 -- 172.21.15.73:0/2412305330 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f549806e6b0 con 0x7f549806e0f0 2024-03-29T04:08:25.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.878+0000 7f549d173640 1 -- 172.21.15.73:0/2412305330 >> v1:172.21.15.142:6789/0 conn(0x7f549806e0f0 legacy=0x7f549806f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:25.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.878+0000 7f549d173640 1 -- 172.21.15.73:0/2412305330 >> v1:172.21.15.73:6789/0 conn(0x7f549815e9a0 legacy=0x7f5498072d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:25.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.878+0000 7f549d173640 1 -- 172.21.15.73:0/2412305330 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f549806ec70 con 0x7f549806c520 2024-03-29T04:08:25.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.878+0000 7f549d173640 1 --2- 172.21.15.73:0/2412305330 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f549806c520 0x7f549806c9b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5490009dc0 tx=0x7f549002be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db90093fac61de35 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:25.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.879+0000 7f54977fe640 1 -- 172.21.15.73:0/2412305330 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5490039070 con 0x7f549806c520 2024-03-29T04:08:25.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.879+0000 7f54977fe640 1 -- 172.21.15.73:0/2412305330 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f549002cc40 con 0x7f549806c520 2024-03-29T04:08:25.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.879+0000 7f54977fe640 1 -- 172.21.15.73:0/2412305330 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5490034440 con 0x7f549806c520 2024-03-29T04:08:25.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.879+0000 7f549ebd6640 1 -- 172.21.15.73:0/2412305330 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f549806c520 msgr2=0x7f549806c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:25.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.879+0000 7f549ebd6640 1 --2- 172.21.15.73:0/2412305330 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f549806c520 0x7f549806c9b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5490009dc0 tx=0x7f549002be90 comp rx=0 tx=0).stop 2024-03-29T04:08:25.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.879+0000 7f549ebd6640 1 -- 172.21.15.73:0/2412305330 shutdown_connections 2024-03-29T04:08:25.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.879+0000 7f549ebd6640 1 --2- 172.21.15.73:0/2412305330 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f549806c520 0x7f549806c9b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:25.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.879+0000 7f549ebd6640 1 -- 172.21.15.73:0/2412305330 >> 172.21.15.73:0/2412305330 conn(0x7f5498072090 msgr2=0x7f54980724a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:25.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.879+0000 7f549ebd6640 1 -- 172.21.15.73:0/2412305330 shutdown_connections 2024-03-29T04:08:25.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.879+0000 7f549ebd6640 1 -- 172.21.15.73:0/2412305330 wait complete. 2024-03-29T04:08:25.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.880+0000 7f549ebd6640 1 Processor -- start 2024-03-29T04:08:25.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.880+0000 7f549ebd6640 1 -- start start 2024-03-29T04:08:25.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.881+0000 7f549ebd6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f549806c520 0x7f54981581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:25.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.881+0000 7f549ebd6640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f549806e0f0 0x7f54980cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:25.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.881+0000 7f549ebd6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f549815e9a0 0x7f54980ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:25.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.881+0000 7f549ebd6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f54980ada80 con 0x7f549815e9a0 2024-03-29T04:08:25.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.881+0000 7f549ebd6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f549806fe60 con 0x7f549806c520 2024-03-29T04:08:25.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.881+0000 7f549ebd6640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f54980adc00 con 0x7f549806e0f0 2024-03-29T04:08:25.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.881+0000 7f549d173640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f549815e9a0 0x7f54980ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:25.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.881+0000 7f549d173640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f549815e9a0 0x7f54980ce4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:42568/0 (socket says 172.21.15.73:42568) 2024-03-29T04:08:25.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.881+0000 7f549c972640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f549806c520 0x7f54981581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:25.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.881+0000 7f549d173640 1 -- 172.21.15.73:0/3808274752 learned_addr learned my addr 172.21.15.73:0/3808274752 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:25.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.881+0000 7f5497fff640 1 --2- 172.21.15.73:0/3808274752 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f549806e0f0 0x7f54980cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:25.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.882+0000 7f549d173640 1 -- 172.21.15.73:0/3808274752 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f549806e0f0 msgr2=0x7f54980cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:25.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.882+0000 7f549d173640 1 --2- 172.21.15.73:0/3808274752 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f549806e0f0 0x7f54980cdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:25.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.882+0000 7f549d173640 1 -- 172.21.15.73:0/3808274752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f549806c520 msgr2=0x7f54981581d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:25.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.882+0000 7f549d173640 1 --2- 172.21.15.73:0/3808274752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f549806c520 0x7f54981581d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:25.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.882+0000 7f549d173640 1 -- 172.21.15.73:0/3808274752 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54981e9a10 con 0x7f549815e9a0 2024-03-29T04:08:25.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.882+0000 7f549c972640 1 --2- 172.21.15.73:0/3808274752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f549806c520 0x7f54981581d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:08:25.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.882+0000 7f549d173640 1 --2- 172.21.15.73:0/3808274752 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f549815e9a0 0x7f54980ce4d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5490037040 tx=0x7f5490004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:25.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.882+0000 7f54957fa640 1 -- 172.21.15.73:0/3808274752 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5490039050 con 0x7f549815e9a0 2024-03-29T04:08:25.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.882+0000 7f54957fa640 1 -- 172.21.15.73:0/3808274752 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5490045070 con 0x7f549815e9a0 2024-03-29T04:08:25.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.882+0000 7f549ebd6640 1 -- 172.21.15.73:0/3808274752 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54981e9cf0 con 0x7f549815e9a0 2024-03-29T04:08:25.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.882+0000 7f54957fa640 1 -- 172.21.15.73:0/3808274752 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5490040690 con 0x7f549815e9a0 2024-03-29T04:08:25.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.882+0000 7f549ebd6640 1 -- 172.21.15.73:0/3808274752 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54980afac0 con 0x7f549815e9a0 2024-03-29T04:08:25.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.883+0000 7f549ebd6640 1 -- 172.21.15.73:0/3808274752 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54980b5ae0 con 0x7f549815e9a0 2024-03-29T04:08:25.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.884+0000 7f54957fa640 1 -- 172.21.15.73:0/3808274752 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f5490040830 con 0x7f549815e9a0 2024-03-29T04:08:25.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.884+0000 7f54957fa640 1 --2- 172.21.15.73:0/3808274752 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f548406c530 0x7f548406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:25.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.884+0000 7f54957fa640 1 -- 172.21.15.73:0/3808274752 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f54900adf10 con 0x7f549815e9a0 2024-03-29T04:08:25.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.884+0000 7f549c972640 1 --2- 172.21.15.73:0/3808274752 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f548406c530 0x7f548406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:25.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.884+0000 7f549c972640 1 --2- 172.21.15.73:0/3808274752 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f548406c530 0x7f548406e9f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5488000f60 tx=0x7f5488009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:25.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:25.888+0000 7f54957fa640 1 -- 172.21.15.73:0/3808274752 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f54980b5ae0 con 0x7f549815e9a0 2024-03-29T04:08:26.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:26.101+0000 7f549ebd6640 1 -- 172.21.15.73:0/3808274752 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5498068640 con 0x7f549815e9a0 2024-03-29T04:08:26.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:26.101+0000 7f54957fa640 1 -- 172.21.15.73:0/3808274752 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f549007bf70 con 0x7f549815e9a0 2024-03-29T04:08:26.081 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-29T04:08:26.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:26.103+0000 7f549ebd6640 1 -- 172.21.15.73:0/3808274752 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f548406c530 msgr2=0x7f548406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:26.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:26.103+0000 7f549ebd6640 1 --2- 172.21.15.73:0/3808274752 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f548406c530 0x7f548406e9f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5488000f60 tx=0x7f5488009040 comp rx=0 tx=0).stop 2024-03-29T04:08:26.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:26.103+0000 7f549ebd6640 1 -- 172.21.15.73:0/3808274752 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f549815e9a0 msgr2=0x7f54980ce4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:26.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:26.103+0000 7f549ebd6640 1 --2- 172.21.15.73:0/3808274752 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f549815e9a0 0x7f54980ce4d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5490037040 tx=0x7f5490004a40 comp rx=0 tx=0).stop 2024-03-29T04:08:26.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:26.103+0000 7f549ebd6640 1 -- 172.21.15.73:0/3808274752 shutdown_connections 2024-03-29T04:08:26.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:26.103+0000 7f549ebd6640 1 --2- 172.21.15.73:0/3808274752 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f549815e9a0 0x7f54980ce4d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:26.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:26.103+0000 7f549ebd6640 1 --2- 172.21.15.73:0/3808274752 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f549806e0f0 0x7f54980cdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:26.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:26.103+0000 7f549ebd6640 1 --2- 172.21.15.73:0/3808274752 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f548406c530 0x7f548406e9f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:26.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:26.103+0000 7f549ebd6640 1 --2- 172.21.15.73:0/3808274752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f549806c520 0x7f54981581d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:26.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:26.103+0000 7f549ebd6640 1 -- 172.21.15.73:0/3808274752 >> 172.21.15.73:0/3808274752 conn(0x7f5498072090 msgr2=0x7f549806f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:26.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:26.103+0000 7f549ebd6640 1 -- 172.21.15.73:0/3808274752 shutdown_connections 2024-03-29T04:08:26.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:26.103+0000 7f549ebd6640 1 -- 172.21.15.73:0/3808274752 wait complete. 2024-03-29T04:08:26.094 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-29T04:08:26.094 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-29T04:08:26.094 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2024-03-29T04:08:26.094 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-03-29T04:08:26.094 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-03-29T04:08:26.094 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-29T04:08:26.094 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-29T04:08:26.094 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-29T04:08:26.094 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-03-29T04:08:26.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:26.094 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2024-03-29T04:08:26.109 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-29T04:08:26.110 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-29T04:08:26.110 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2024-03-29T04:08:26.110 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:08:26.110 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2024-03-29T04:08:26.110 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:08:26.110 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-29T04:08:26.110 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2024-03-29T04:08:26.110 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2024-03-29T04:08:26.110 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-29T04:08:26.110 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2024-03-29T04:08:26.110 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2024-03-29T04:08:26.110 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-29T04:08:26.110 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2024-03-29T04:08:26.111 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-29T04:08:26.111 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2024-03-29T04:08:26.111 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-29T04:08:26.111 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42728sec preferred_lft 42728sec 2024-03-29T04:08:26.111 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link 2024-03-29T04:08:26.111 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:08:26.111 INFO:teuthology.orchestra.run.smithi073.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-29T04:08:26.111 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether da:3c:54:9c:c9:61 brd ff:ff:ff:ff:ff:ff 2024-03-29T04:08:26.111 INFO:teuthology.orchestra.run.smithi073.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-29T04:08:26.111 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:08:26.111 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::c80a:b7ff:feb5:8e8e/64 scope link 2024-03-29T04:08:26.111 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:08:26.111 INFO:teuthology.orchestra.run.smithi073.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-29T04:08:26.111 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether da:3c:54:9c:c9:61 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-29T04:08:26.111 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::d83c:54ff:fe9c:c961/64 scope link tentative 2024-03-29T04:08:26.112 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:08:26.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:26.112 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-29T04:08:26.175 INFO:teuthology.orchestra.run.smithi073.stdout:1 2024-03-29T04:08:26.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:26.176 DEBUG:teuthology.orchestra.run.smithi073:> route 2024-03-29T04:08:26.232 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2024-03-29T04:08:26.232 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-29T04:08:26.232 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-29T04:08:26.232 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-29T04:08:26.232 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-29T04:08:26.233 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-29T04:08:26.233 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-03-29T04:08:26.233 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-29T04:08:26.233 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-29T04:08:26.233 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-29T04:08:26.233 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-03-29T04:08:26.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-29T04:08:26.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-29T04:08:26.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:26.367 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-03-29T04:08:26.381 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-29T04:08:26.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:26.382 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list-id 2024-03-29T04:08:26.435 INFO:teuthology.orchestra.run.smithi073.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-03-29T04:08:26.436 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-29T04:08:26.436 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-03-29T04:08:26.436 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-29T04:08:26.436 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-03-29T04:08:26.436 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-03-29T04:08:26.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-29T04:08:26.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-29T04:08:26.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:26.558 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-03-29T04:08:26.584 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-29T04:08:26.584 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-29T04:08:26.584 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2024-03-29T04:08:26.584 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:08:26.584 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2024-03-29T04:08:26.584 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:08:26.584 INFO:teuthology.orchestra.run.smithi073.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-29T04:08:26.585 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 12:02:70:18:9a:42 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-29T04:08:26.585 INFO:teuthology.orchestra.run.smithi073.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-29T04:08:26.585 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:08:26.585 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::1002:70ff:fe18:9a42/64 scope link tentative 2024-03-29T04:08:26.585 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:08:26.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:26.586 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-03-29T04:08:26.653 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-29T04:08:26.653 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-29T04:08:26.653 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2024-03-29T04:08:26.654 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:08:26.654 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2024-03-29T04:08:26.654 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:08:26.654 INFO:teuthology.orchestra.run.smithi073.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-29T04:08:26.654 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 12:02:70:18:9a:42 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-29T04:08:26.654 INFO:teuthology.orchestra.run.smithi073.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-29T04:08:26.654 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:08:26.654 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::1002:70ff:fe18:9a42/64 scope link tentative 2024-03-29T04:08:26.654 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:08:26.655 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-03-29T04:08:26.655 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-29T04:08:26.656 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-03-29T04:08:26.656 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-03-29T04:08:26.656 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-03-29T04:08:26.656 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-03-29T04:08:26.656 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-03-29T04:08:26.656 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-03-29T04:08:26.656 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-03-29T04:08:26.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-29T04:08:26.813 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-29T04:08:26.819 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-29T04:08:26.820 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-03-29T04:08:26.820 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.1 up 2024-03-29T04:08:26.820 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set dev brx.1 master ceph-brx 2024-03-29T04:08:26.820 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-03-29T04:08:26.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-29T04:08:26.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-29T04:08:26.902 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-29T04:08:26.902 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-03-29T04:08:26.917 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-03-29T04:08:26.917 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-29T04:08:26.917 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-03-29T04:08:26.972 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-29T04:08:26.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:26.973 DEBUG:teuthology.orchestra.run.smithi073:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-03-29T04:08:27.057 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-03-29T04:08:27.057 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-03-29T04:08:27.057 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2024-03-29T04:08:27.065 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-03-29T04:08:27.066 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-03-29T04:08:27.066 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2024-03-29T04:08:27.066 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.142:3300,172.21.15.142:3301" 2024-03-29T04:08:27.066 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-29T04:08:27.083 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-03-29T04:08:27.083 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-03-29T04:08:27.083 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2024-03-29T04:08:27.083 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.142:3300,172.21.15.142:3301" 2024-03-29T04:08:27.083 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-29T04:08:27.083 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:6789,172.21.15.142:6789,172.21.15.142:6790" 2024-03-29T04:08:27.083 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.73:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2024-03-29T04:08:27.083 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=6bff1617-b138-4517-acca-3ecaae3f2bb3" will pass to kernel 2024-03-29T04:08:27.084 INFO:teuthology.orchestra.run.smithi073.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-03-29T04:08:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: You just mounted a file system that supports labels which does not 2024-03-29T04:08:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-29T04:08:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: applications will generate AVC messages and not be allowed access to 2024-03-29T04:08:27.084 INFO:teuthology.orchestra.run.smithi073.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-29T04:08:27.085 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-29T04:08:27.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:27.086 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-03-29T04:08:27.112 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-29T04:08:27.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-29T04:08:27.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-29T04:08:27.208 INFO:teuthology.orchestra.run.smithi073.stdout:client4612 2024-03-29T04:08:27.208 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-29T04:08:27.208 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-29T04:08:27.224 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-29T04:08:27.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-29T04:08:27.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-29T04:08:27.318 INFO:teuthology.orchestra.run.smithi073.stdout:client4612 2024-03-29T04:08:27.318 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-29T04:08:27.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-29T04:08:27.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-29T04:08:27.373 INFO:teuthology.orchestra.run.smithi073.stdout:client4612 2024-03-29T04:08:27.374 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/6bff1617-b138-4517-acca-3ecaae3f2bb3.client4612/status') 2024-03-29T04:08:27.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-29T04:08:27.434 INFO:teuthology.orchestra.run.smithi073.stdout:instance: client.4612 (3)172.21.15.73:0/3079253933 2024-03-29T04:08:27.434 INFO:teuthology.orchestra.run.smithi073.stdout:blocklisted: false 2024-03-29T04:08:27.434 INFO:teuthology.orchestra.run.smithi073.stderr:0+1 records in 2024-03-29T04:08:27.435 INFO:teuthology.orchestra.run.smithi073.stderr:0+1 records out 2024-03-29T04:08:27.435 INFO:teuthology.orchestra.run.smithi073.stderr:70 bytes copied, 2.1375e-05 s, 3.3 MB/s 2024-03-29T04:08:27.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-29T04:08:27.442 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-03-29T04:08:27.442 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-29T04:08:27.442 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-29T04:08:27.442 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-29T04:08:27.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.564+0000 7f56daa4e640 1 Processor -- start 2024-03-29T04:08:27.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.564+0000 7f56daa4e640 1 -- start start 2024-03-29T04:08:27.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.565+0000 7f56daa4e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56d4161e00 0x7f56d406e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:27.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.565+0000 7f56daa4e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f56d4071fe0 0x7f56d40adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:27.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.565+0000 7f56daa4e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56d406eee0 con 0x7f56d406d930 2024-03-29T04:08:27.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.565+0000 7f56daa4e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f56d41621e0 con 0x7f56d4071fe0 2024-03-29T04:08:27.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.565+0000 7f56daa4e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f56d406f1c0 con 0x7f56d4161e00 2024-03-29T04:08:27.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.565+0000 7f56d37fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f56d406d930 0x7f56d40718d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:34334/0 (socket says 172.21.15.73:34334) 2024-03-29T04:08:27.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.565+0000 7f56d37fe640 1 -- 172.21.15.73:0/2953191059 learned_addr learned my addr 172.21.15.73:0/2953191059 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:27.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.565+0000 7f56d8feb640 1 --2- 172.21.15.73:0/2953191059 >> v2:172.21.15.142:3300/0 conn(0x7f56d4071fe0 0x7f56d40adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:27.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.565+0000 7f56d3fff640 1 --2- 172.21.15.73:0/2953191059 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56d4161e00 0x7f56d406e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:27.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.565+0000 7f56d2ffd640 1 -- 172.21.15.73:0/2953191059 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2566375510 0 0) 0x7f56d406eee0 con 0x7f56d406d930 2024-03-29T04:08:27.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.565+0000 7f56d2ffd640 1 -- 172.21.15.73:0/2953191059 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56bc003520 con 0x7f56d406d930 2024-03-29T04:08:27.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.565+0000 7f56d8feb640 1 -- 172.21.15.73:0/2953191059 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56d4161e00 msgr2=0x7f56d406e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:27.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.565+0000 7f56d8feb640 1 --2- 172.21.15.73:0/2953191059 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56d4161e00 0x7f56d406e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:27.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.565+0000 7f56d8feb640 1 -- 172.21.15.73:0/2953191059 >> v1:172.21.15.73:6789/0 conn(0x7f56d406d930 legacy=0x7f56d40718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:27.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.565+0000 7f56d8feb640 1 -- 172.21.15.73:0/2953191059 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56d40ad3b0 con 0x7f56d4071fe0 2024-03-29T04:08:27.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.566+0000 7f56d8feb640 1 --2- 172.21.15.73:0/2953191059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56d4071fe0 0x7f56d40adbb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f56cc009d90 tx=0x7f56cc02bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1c9604d708397f server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:27.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.566+0000 7f56d2ffd640 1 -- 172.21.15.73:0/2953191059 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56cc039070 con 0x7f56d4071fe0 2024-03-29T04:08:27.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.566+0000 7f56d2ffd640 1 -- 172.21.15.73:0/2953191059 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56cc02cc50 con 0x7f56d4071fe0 2024-03-29T04:08:27.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.566+0000 7f56d2ffd640 1 -- 172.21.15.73:0/2953191059 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56cc034440 con 0x7f56d4071fe0 2024-03-29T04:08:27.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.567+0000 7f56daa4e640 1 -- 172.21.15.73:0/2953191059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56d4071fe0 msgr2=0x7f56d40adbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:27.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.567+0000 7f56daa4e640 1 --2- 172.21.15.73:0/2953191059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56d4071fe0 0x7f56d40adbb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f56cc009d90 tx=0x7f56cc02bea0 comp rx=0 tx=0).stop 2024-03-29T04:08:27.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.567+0000 7f56daa4e640 1 -- 172.21.15.73:0/2953191059 shutdown_connections 2024-03-29T04:08:27.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.567+0000 7f56daa4e640 1 --2- 172.21.15.73:0/2953191059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56d4071fe0 0x7f56d40adbb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:27.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.567+0000 7f56daa4e640 1 --2- 172.21.15.73:0/2953191059 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56d4161e00 0x7f56d406e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:27.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.567+0000 7f56daa4e640 1 -- 172.21.15.73:0/2953191059 >> 172.21.15.73:0/2953191059 conn(0x7f56d406b510 msgr2=0x7f56d406b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:27.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.567+0000 7f56daa4e640 1 -- 172.21.15.73:0/2953191059 shutdown_connections 2024-03-29T04:08:27.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.567+0000 7f56daa4e640 1 -- 172.21.15.73:0/2953191059 wait complete. 2024-03-29T04:08:27.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.568+0000 7f56daa4e640 1 Processor -- start 2024-03-29T04:08:27.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.568+0000 7f56daa4e640 1 -- start start 2024-03-29T04:08:27.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.569+0000 7f56daa4e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56d406d930 0x7f56d41580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:27.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.569+0000 7f56daa4e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56d4071fe0 0x7f56d4158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:27.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.569+0000 7f56daa4e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56d4161e00 0x7f56d4145ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:27.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.569+0000 7f56daa4e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f56d40ae0f0 con 0x7f56d406d930 2024-03-29T04:08:27.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.569+0000 7f56daa4e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f56d40b5270 con 0x7f56d4071fe0 2024-03-29T04:08:27.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.569+0000 7f56daa4e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f56d40ae270 con 0x7f56d4161e00 2024-03-29T04:08:27.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.569+0000 7f56d3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56d406d930 0x7f56d41580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:27.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.569+0000 7f56d3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56d406d930 0x7f56d41580a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45584/0 (socket says 172.21.15.73:45584) 2024-03-29T04:08:27.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.569+0000 7f56d3fff640 1 -- 172.21.15.73:0/2898993685 learned_addr learned my addr 172.21.15.73:0/2898993685 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:27.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.569+0000 7f56d37fe640 1 --2- 172.21.15.73:0/2898993685 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56d4071fe0 0x7f56d4158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:27.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.569+0000 7f56d8feb640 1 --2- 172.21.15.73:0/2898993685 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56d4161e00 0x7f56d4145ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:27.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.569+0000 7f56d3fff640 1 -- 172.21.15.73:0/2898993685 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56d4161e00 msgr2=0x7f56d4145ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:27.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.569+0000 7f56d3fff640 1 --2- 172.21.15.73:0/2898993685 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56d4161e00 0x7f56d4145ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:27.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.569+0000 7f56d3fff640 1 -- 172.21.15.73:0/2898993685 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56d4071fe0 msgr2=0x7f56d4158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:27.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.569+0000 7f56d3fff640 1 --2- 172.21.15.73:0/2898993685 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56d4071fe0 0x7f56d4158920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:27.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.569+0000 7f56d3fff640 1 -- 172.21.15.73:0/2898993685 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56d415bc50 con 0x7f56d406d930 2024-03-29T04:08:27.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.569+0000 7f56d3fff640 1 --2- 172.21.15.73:0/2898993685 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56d406d930 0x7f56d41580a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f56c400e870 tx=0x7f56c400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:27.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.569+0000 7f56d0ff9640 1 -- 172.21.15.73:0/2898993685 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c4017070 con 0x7f56d406d930 2024-03-29T04:08:27.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.569+0000 7f56d0ff9640 1 -- 172.21.15.73:0/2898993685 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56c400c940 con 0x7f56d406d930 2024-03-29T04:08:27.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.569+0000 7f56daa4e640 1 -- 172.21.15.73:0/2898993685 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56d415b0d0 con 0x7f56d406d930 2024-03-29T04:08:27.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.569+0000 7f56d0ff9640 1 -- 172.21.15.73:0/2898993685 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c400cd30 con 0x7f56d406d930 2024-03-29T04:08:27.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.569+0000 7f56daa4e640 1 -- 172.21.15.73:0/2898993685 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56d415b690 con 0x7f56d406d930 2024-03-29T04:08:27.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.570+0000 7f56daa4e640 1 -- 172.21.15.73:0/2898993685 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56d4068640 con 0x7f56d406d930 2024-03-29T04:08:27.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.571+0000 7f56d0ff9640 1 -- 172.21.15.73:0/2898993685 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f56c401a070 con 0x7f56d406d930 2024-03-29T04:08:27.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.571+0000 7f56d0ff9640 1 --2- 172.21.15.73:0/2898993685 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f56c006c530 0x7f56c006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:27.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.571+0000 7f56d0ff9640 1 -- 172.21.15.73:0/2898993685 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f56c408b500 con 0x7f56d406d930 2024-03-29T04:08:27.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.571+0000 7f56d37fe640 1 --2- 172.21.15.73:0/2898993685 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f56c006c530 0x7f56c006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:27.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.572+0000 7f56d37fe640 1 --2- 172.21.15.73:0/2898993685 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f56c006c530 0x7f56c006e9f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f56d415e550 tx=0x7f56c8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:27.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.576+0000 7f56d0ff9640 1 -- 172.21.15.73:0/2898993685 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f56c40594d0 con 0x7f56d406d930 2024-03-29T04:08:27.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.789+0000 7f56daa4e640 1 -- 172.21.15.73:0/2898993685 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f56d415ba30 con 0x7f56d406d930 2024-03-29T04:08:27.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.789+0000 7f56d0ff9640 1 -- 172.21.15.73:0/2898993685 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f56c405d7d0 con 0x7f56d406d930 2024-03-29T04:08:27.769 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-29T04:08:27.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.791+0000 7f56daa4e640 1 -- 172.21.15.73:0/2898993685 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f56c006c530 msgr2=0x7f56c006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:27.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.791+0000 7f56daa4e640 1 --2- 172.21.15.73:0/2898993685 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f56c006c530 0x7f56c006e9f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f56d415e550 tx=0x7f56c8009040 comp rx=0 tx=0).stop 2024-03-29T04:08:27.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.791+0000 7f56daa4e640 1 -- 172.21.15.73:0/2898993685 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56d406d930 msgr2=0x7f56d41580a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:27.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.791+0000 7f56daa4e640 1 --2- 172.21.15.73:0/2898993685 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56d406d930 0x7f56d41580a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f56c400e870 tx=0x7f56c400ed30 comp rx=0 tx=0).stop 2024-03-29T04:08:27.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.791+0000 7f56daa4e640 1 -- 172.21.15.73:0/2898993685 shutdown_connections 2024-03-29T04:08:27.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.791+0000 7f56daa4e640 1 --2- 172.21.15.73:0/2898993685 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f56d4161e00 0x7f56d4145ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:27.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.791+0000 7f56daa4e640 1 --2- 172.21.15.73:0/2898993685 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f56c006c530 0x7f56c006e9f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:27.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.791+0000 7f56daa4e640 1 --2- 172.21.15.73:0/2898993685 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f56d4071fe0 0x7f56d4158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:27.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.791+0000 7f56daa4e640 1 --2- 172.21.15.73:0/2898993685 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56d406d930 0x7f56d41580a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:27.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.791+0000 7f56daa4e640 1 -- 172.21.15.73:0/2898993685 >> 172.21.15.73:0/2898993685 conn(0x7f56d406b510 msgr2=0x7f56d40ae650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:27.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.792+0000 7f56daa4e640 1 -- 172.21.15.73:0/2898993685 shutdown_connections 2024-03-29T04:08:27.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:27.792+0000 7f56daa4e640 1 -- 172.21.15.73:0/2898993685 wait complete. 2024-03-29T04:08:27.782 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-29T04:08:27.782 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-29T04:08:27.782 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2024-03-29T04:08:27.782 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-03-29T04:08:27.782 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-29T04:08:27.782 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-29T04:08:27.782 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-29T04:08:27.783 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-29T04:08:27.783 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-29T04:08:27.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:27.783 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2024-03-29T04:08:27.798 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-29T04:08:27.798 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-29T04:08:27.798 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2024-03-29T04:08:27.798 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:08:27.799 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2024-03-29T04:08:27.799 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:08:27.799 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-29T04:08:27.799 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2024-03-29T04:08:27.799 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2024-03-29T04:08:27.799 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-29T04:08:27.799 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2024-03-29T04:08:27.799 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2024-03-29T04:08:27.799 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-29T04:08:27.799 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2024-03-29T04:08:27.799 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-29T04:08:27.799 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2024-03-29T04:08:27.799 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-29T04:08:27.799 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42732sec preferred_lft 42732sec 2024-03-29T04:08:27.799 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2024-03-29T04:08:27.800 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:08:27.800 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-29T04:08:27.800 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-29T04:08:27.800 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-03-29T04:08:27.800 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add name ceph-brx type bridge 2024-03-29T04:08:27.800 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip addr flush dev ceph-brx 2024-03-29T04:08:27.800 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set ceph-brx up 2024-03-29T04:08:27.800 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-29T04:08:27.800 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-03-29T04:08:27.885 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:08:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-29T04:08:28.016 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:08:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-29T04:08:28.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:28.024 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-29T04:08:28.051 INFO:teuthology.orchestra.run.smithi142.stdout:1 2024-03-29T04:08:28.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:28.052 DEBUG:teuthology.orchestra.run.smithi142:> route 2024-03-29T04:08:28.121 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2024-03-29T04:08:28.121 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-29T04:08:28.121 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-29T04:08:28.121 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-29T04:08:28.121 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-29T04:08:28.121 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-29T04:08:28.121 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-03-29T04:08:28.122 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-29T04:08:28.122 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-29T04:08:28.122 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-29T04:08:28.122 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-03-29T04:08:28.218 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:08:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-29T04:08:28.451 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:08:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-29T04:08:28.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:28.457 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-03-29T04:08:28.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:28.473 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list-id 2024-03-29T04:08:28.528 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-29T04:08:28.528 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-03-29T04:08:28.528 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-29T04:08:28.528 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-03-29T04:08:28.528 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-03-29T04:08:28.628 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:08:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-29T04:08:28.658 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:08:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-29T04:08:28.664 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-03-29T04:08:28.665 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-29T04:08:28.665 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-03-29T04:08:28.665 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-03-29T04:08:28.665 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-29T04:08:28.665 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-03-29T04:08:28.665 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-03-29T04:08:28.665 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-03-29T04:08:28.665 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-03-29T04:08:28.714 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:08:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-29T04:08:28.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:08:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-29T04:08:28.803 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-29T04:08:28.803 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-03-29T04:08:28.803 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2024-03-29T04:08:28.803 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set dev brx.0 master ceph-brx 2024-03-29T04:08:28.803 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-03-29T04:08:28.852 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:08:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-29T04:08:28.879 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:08:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-29T04:08:28.885 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-29T04:08:28.885 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-03-29T04:08:28.899 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-03-29T04:08:28.899 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-29T04:08:28.900 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-03-29T04:08:28.954 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-29T04:08:28.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:28.954 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-29T04:08:29.043 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-29T04:08:29.043 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-03-29T04:08:29.043 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2024-03-29T04:08:29.147 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-29T04:08:29.147 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-03-29T04:08:29.147 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2024-03-29T04:08:29.148 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.142:3300,172.21.15.142:3301" 2024-03-29T04:08:29.148 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-29T04:08:29.153 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-29T04:08:29.153 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-03-29T04:08:29.153 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2024-03-29T04:08:29.153 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.142:3300,172.21.15.142:3301" 2024-03-29T04:08:29.153 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-29T04:08:29.153 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.73:6789,172.21.15.142:6789,172.21.15.142:6790" 2024-03-29T04:08:29.153 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.73:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2024-03-29T04:08:29.153 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=6bff1617-b138-4517-acca-3ecaae3f2bb3" will pass to kernel 2024-03-29T04:08:29.155 INFO:teuthology.orchestra.run.smithi142.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-03-29T04:08:29.155 INFO:teuthology.orchestra.run.smithi142.stdout: You just mounted a file system that supports labels which does not 2024-03-29T04:08:29.155 INFO:teuthology.orchestra.run.smithi142.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-29T04:08:29.155 INFO:teuthology.orchestra.run.smithi142.stdout: applications will generate AVC messages and not be allowed access to 2024-03-29T04:08:29.155 INFO:teuthology.orchestra.run.smithi142.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-29T04:08:29.157 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-29T04:08:29.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:29.157 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-03-29T04:08:29.184 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-29T04:08:29.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:08:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-29T04:08:29.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:08:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-29T04:08:29.280 INFO:teuthology.orchestra.run.smithi142.stdout:client4659 2024-03-29T04:08:29.280 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-03-29T04:08:29.280 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-29T04:08:29.295 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-29T04:08:29.386 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:08:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-29T04:08:29.387 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:08:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-29T04:08:29.391 INFO:teuthology.orchestra.run.smithi142.stdout:client4659 2024-03-29T04:08:29.391 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-29T04:08:29.440 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:08:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-29T04:08:29.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:08:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-29T04:08:29.447 INFO:teuthology.orchestra.run.smithi142.stdout:client4659 2024-03-29T04:08:29.447 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/6bff1617-b138-4517-acca-3ecaae3f2bb3.client4659/status') 2024-03-29T04:08:29.494 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:08:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-29T04:08:29.507 INFO:teuthology.orchestra.run.smithi142.stdout:instance: client.4659 (3)172.21.15.142:0/4021160521 2024-03-29T04:08:29.507 INFO:teuthology.orchestra.run.smithi142.stdout:blocklisted: false 2024-03-29T04:08:29.507 INFO:teuthology.orchestra.run.smithi142.stderr:0+1 records in 2024-03-29T04:08:29.507 INFO:teuthology.orchestra.run.smithi142.stderr:0+1 records out 2024-03-29T04:08:29.507 INFO:teuthology.orchestra.run.smithi142.stderr:71 bytes copied, 2.1579e-05 s, 3.3 MB/s 2024-03-29T04:08:29.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:08:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-29T04:08:29.514 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-03-29T04:08:29.514 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-29T04:08:29.514 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-03-29T04:08:29.515 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-29T04:08:29.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.648+0000 7f0da207b640 1 Processor -- start 2024-03-29T04:08:29.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.648+0000 7f0da207b640 1 -- start start 2024-03-29T04:08:29.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.648+0000 7f0da207b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0d9c0d1100 0x7f0d9c09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:29.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.648+0000 7f0da207b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0d9c0ce120 0x7f0d9c09af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:29.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.648+0000 7f0da207b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d9c15cb70 con 0x7f0d9c15c790 2024-03-29T04:08:29.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.648+0000 7f0da207b640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f0d9c09ba70 con 0x7f0d9c0ce120 2024-03-29T04:08:29.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.648+0000 7f0da207b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f0d9c0cdc90 con 0x7f0d9c0d1100 2024-03-29T04:08:29.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.649+0000 7f0d9bfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0d9c0ce120 0x7f0d9c09af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:29.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.649+0000 7f0d9bfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0d9c0ce120 0x7f0d9c09af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45592/0 (socket says 172.21.15.73:45592) 2024-03-29T04:08:29.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.649+0000 7f0d9bfff640 1 -- 172.21.15.73:0/1988499272 learned_addr learned my addr 172.21.15.73:0/1988499272 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:29.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.649+0000 7f0d9affd640 1 --2- 172.21.15.73:0/1988499272 >> v2:172.21.15.142:3300/0 conn(0x7f0d9c0d1100 0x7f0d9c09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:29.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.649+0000 7f0d9bfff640 1 -- 172.21.15.73:0/1988499272 >> v2:172.21.15.142:3300/0 conn(0x7f0d9c0d1100 msgr2=0x7f0d9c09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:29.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.649+0000 7f0d9bfff640 1 --2- 172.21.15.73:0/1988499272 >> v2:172.21.15.142:3300/0 conn(0x7f0d9c0d1100 0x7f0d9c09aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:29.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.649+0000 7f0d9bfff640 1 -- 172.21.15.73:0/1988499272 >> v1:172.21.15.142:6789/0 conn(0x7f0d9c15c790 legacy=0x7f0d9c0d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:29.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.649+0000 7f0d9bfff640 1 -- 172.21.15.73:0/1988499272 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d9c0cd080 con 0x7f0d9c0ce120 2024-03-29T04:08:29.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.649+0000 7f0d9a7fc640 1 -- 172.21.15.73:0/1988499272 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 90152879 0 0) 0x7f0d9c15cb70 con 0x7f0d9c15c790 2024-03-29T04:08:29.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.650+0000 7f0d9bfff640 1 --2- 172.21.15.73:0/1988499272 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d9c0ce120 0x7f0d9c09af70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c06f380 tx=0x7f0d9402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eb74737ca70ca3 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:29.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.650+0000 7f0d9a7fc640 1 -- 172.21.15.73:0/1988499272 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d9402cb20 con 0x7f0d9c0ce120 2024-03-29T04:08:29.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.650+0000 7f0d9a7fc640 1 -- 172.21.15.73:0/1988499272 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d9402ccc0 con 0x7f0d9c0ce120 2024-03-29T04:08:29.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.650+0000 7f0d9a7fc640 1 -- 172.21.15.73:0/1988499272 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d94034610 con 0x7f0d9c0ce120 2024-03-29T04:08:29.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.650+0000 7f0da207b640 1 -- 172.21.15.73:0/1988499272 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d9c0ce120 msgr2=0x7f0d9c09af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:29.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.650+0000 7f0da207b640 1 --2- 172.21.15.73:0/1988499272 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d9c0ce120 0x7f0d9c09af70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c06f380 tx=0x7f0d9402bf80 comp rx=0 tx=0).stop 2024-03-29T04:08:29.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.650+0000 7f0da207b640 1 -- 172.21.15.73:0/1988499272 shutdown_connections 2024-03-29T04:08:29.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.650+0000 7f0da207b640 1 --2- 172.21.15.73:0/1988499272 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d9c0ce120 0x7f0d9c09af70 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:29.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.650+0000 7f0da207b640 1 --2- 172.21.15.73:0/1988499272 >> v2:172.21.15.142:3300/0 conn(0x7f0d9c0d1100 0x7f0d9c09aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:29.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.650+0000 7f0da207b640 1 -- 172.21.15.73:0/1988499272 >> 172.21.15.73:0/1988499272 conn(0x7f0d9c0b3f00 msgr2=0x7f0d9c0b4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:29.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.651+0000 7f0da207b640 1 -- 172.21.15.73:0/1988499272 shutdown_connections 2024-03-29T04:08:29.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.651+0000 7f0da207b640 1 -- 172.21.15.73:0/1988499272 wait complete. 2024-03-29T04:08:29.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.652+0000 7f0da207b640 1 Processor -- start 2024-03-29T04:08:29.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.652+0000 7f0da207b640 1 -- start start 2024-03-29T04:08:29.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.652+0000 7f0da207b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d9c0ce120 0x7f0d9c15f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:29.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.653+0000 7f0da207b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d9c15c790 0x7f0d9c0b5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:29.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.653+0000 7f0da207b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d9c156a90 0x7f0d9c14d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:29.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.653+0000 7f0da207b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c0cd920 con 0x7f0d9c156a90 2024-03-29T04:08:29.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.653+0000 7f0da207b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c0cd640 con 0x7f0d9c15c790 2024-03-29T04:08:29.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.653+0000 7f0da207b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f0d9c0b1d00 con 0x7f0d9c0ce120 2024-03-29T04:08:29.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.653+0000 7f0d9bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d9c156a90 0x7f0d9c14d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:29.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.653+0000 7f0d9bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d9c156a90 0x7f0d9c14d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45596/0 (socket says 172.21.15.73:45596) 2024-03-29T04:08:29.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.653+0000 7f0d9bfff640 1 -- 172.21.15.73:0/303327666 learned_addr learned my addr 172.21.15.73:0/303327666 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:29.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.653+0000 7f0d9b7fe640 1 --2- 172.21.15.73:0/303327666 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d9c0ce120 0x7f0d9c15f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:29.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.653+0000 7f0d9affd640 1 --2- 172.21.15.73:0/303327666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d9c15c790 0x7f0d9c0b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:29.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.653+0000 7f0d9bfff640 1 -- 172.21.15.73:0/303327666 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d9c0ce120 msgr2=0x7f0d9c15f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:29.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.653+0000 7f0d9bfff640 1 --2- 172.21.15.73:0/303327666 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d9c0ce120 0x7f0d9c15f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:29.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.653+0000 7f0d9bfff640 1 -- 172.21.15.73:0/303327666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d9c15c790 msgr2=0x7f0d9c0b5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:29.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.653+0000 7f0d9bfff640 1 --2- 172.21.15.73:0/303327666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d9c15c790 0x7f0d9c0b5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:29.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.653+0000 7f0d9bfff640 1 -- 172.21.15.73:0/303327666 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d9c15fc00 con 0x7f0d9c156a90 2024-03-29T04:08:29.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.653+0000 7f0d9bfff640 1 --2- 172.21.15.73:0/303327666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d9c156a90 0x7f0d9c14d6f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0d94036040 tx=0x7f0d94004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:29.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.653+0000 7f0d83fff640 1 -- 172.21.15.73:0/303327666 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d94043030 con 0x7f0d9c156a90 2024-03-29T04:08:29.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.653+0000 7f0d83fff640 1 -- 172.21.15.73:0/303327666 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d9403e450 con 0x7f0d9c156a90 2024-03-29T04:08:29.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.653+0000 7f0d83fff640 1 -- 172.21.15.73:0/303327666 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d94009510 con 0x7f0d9c156a90 2024-03-29T04:08:29.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.653+0000 7f0da207b640 1 -- 172.21.15.73:0/303327666 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d9c0caac0 con 0x7f0d9c156a90 2024-03-29T04:08:29.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.653+0000 7f0da207b640 1 -- 172.21.15.73:0/303327666 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d9c0cb300 con 0x7f0d9c156a90 2024-03-29T04:08:29.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.654+0000 7f0da207b640 1 -- 172.21.15.73:0/303327666 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d9c068d50 con 0x7f0d9c156a90 2024-03-29T04:08:29.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.655+0000 7f0d83fff640 1 -- 172.21.15.73:0/303327666 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f0d94046070 con 0x7f0d9c156a90 2024-03-29T04:08:29.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.655+0000 7f0d83fff640 1 --2- 172.21.15.73:0/303327666 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f0d8806c530 0x7f0d8806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:29.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.655+0000 7f0d83fff640 1 -- 172.21.15.73:0/303327666 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0d940ad9a0 con 0x7f0d9c156a90 2024-03-29T04:08:29.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.655+0000 7f0d9b7fe640 1 --2- 172.21.15.73:0/303327666 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f0d8806c530 0x7f0d8806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:29.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.656+0000 7f0d9b7fe640 1 --2- 172.21.15.73:0/303327666 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f0d8806c530 0x7f0d8806e9f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c000f60 tx=0x7f0d8c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:29.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.660+0000 7f0d83fff640 1 -- 172.21.15.73:0/303327666 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f0d9404d070 con 0x7f0d9c156a90 2024-03-29T04:08:29.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.873+0000 7f0da207b640 1 -- 172.21.15.73:0/303327666 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0d9c0b4ab0 con 0x7f0d9c156a90 2024-03-29T04:08:29.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.873+0000 7f0d83fff640 1 -- 172.21.15.73:0/303327666 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f0d9c0caac0 con 0x7f0d9c156a90 2024-03-29T04:08:29.853 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-29T04:08:29.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.875+0000 7f0da207b640 1 -- 172.21.15.73:0/303327666 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f0d8806c530 msgr2=0x7f0d8806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:29.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.875+0000 7f0da207b640 1 --2- 172.21.15.73:0/303327666 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f0d8806c530 0x7f0d8806e9f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c000f60 tx=0x7f0d8c009040 comp rx=0 tx=0).stop 2024-03-29T04:08:29.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.875+0000 7f0da207b640 1 -- 172.21.15.73:0/303327666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d9c156a90 msgr2=0x7f0d9c14d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:29.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.875+0000 7f0da207b640 1 --2- 172.21.15.73:0/303327666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d9c156a90 0x7f0d9c14d6f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0d94036040 tx=0x7f0d94004a40 comp rx=0 tx=0).stop 2024-03-29T04:08:29.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.875+0000 7f0da207b640 1 -- 172.21.15.73:0/303327666 shutdown_connections 2024-03-29T04:08:29.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.875+0000 7f0da207b640 1 --2- 172.21.15.73:0/303327666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d9c156a90 0x7f0d9c14d6f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:29.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.875+0000 7f0da207b640 1 --2- 172.21.15.73:0/303327666 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f0d8806c530 0x7f0d8806e9f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:29.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.875+0000 7f0da207b640 1 --2- 172.21.15.73:0/303327666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0d9c15c790 0x7f0d9c0b5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:29.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.875+0000 7f0da207b640 1 --2- 172.21.15.73:0/303327666 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0d9c0ce120 0x7f0d9c15f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:29.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.875+0000 7f0da207b640 1 -- 172.21.15.73:0/303327666 >> 172.21.15.73:0/303327666 conn(0x7f0d9c0b3f00 msgr2=0x7f0d9c09aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:29.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.875+0000 7f0da207b640 1 -- 172.21.15.73:0/303327666 shutdown_connections 2024-03-29T04:08:29.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:29.875+0000 7f0da207b640 1 -- 172.21.15.73:0/303327666 wait complete. 2024-03-29T04:08:29.866 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-29T04:08:29.866 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-29T04:08:29.866 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2024-03-29T04:08:29.866 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-03-29T04:08:29.866 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-03-29T04:08:29.866 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-29T04:08:29.866 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-29T04:08:29.866 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-29T04:08:29.866 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-03-29T04:08:29.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:29.867 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2024-03-29T04:08:29.882 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-29T04:08:29.882 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-29T04:08:29.882 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2024-03-29T04:08:29.882 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:08:29.883 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2024-03-29T04:08:29.883 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:08:29.883 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-29T04:08:29.883 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2024-03-29T04:08:29.883 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2024-03-29T04:08:29.883 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-29T04:08:29.883 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2024-03-29T04:08:29.883 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2024-03-29T04:08:29.883 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-29T04:08:29.883 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2024-03-29T04:08:29.883 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-29T04:08:29.883 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2024-03-29T04:08:29.883 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-29T04:08:29.884 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42730sec preferred_lft 42730sec 2024-03-29T04:08:29.884 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2024-03-29T04:08:29.884 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:08:29.884 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-29T04:08:29.884 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether f6:59:ef:56:aa:24 brd ff:ff:ff:ff:ff:ff 2024-03-29T04:08:29.884 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-29T04:08:29.884 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:08:29.884 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::9c88:7cff:fe6e:2370/64 scope link tentative 2024-03-29T04:08:29.884 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:08:29.884 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-29T04:08:29.884 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether f6:59:ef:56:aa:24 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-29T04:08:29.884 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::f459:efff:fe56:aa24/64 scope link tentative 2024-03-29T04:08:29.884 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:08:29.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:29.885 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-29T04:08:29.947 INFO:teuthology.orchestra.run.smithi142.stdout:1 2024-03-29T04:08:29.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:29.949 DEBUG:teuthology.orchestra.run.smithi142:> route 2024-03-29T04:08:30.005 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2024-03-29T04:08:30.005 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-29T04:08:30.005 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-29T04:08:30.005 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-29T04:08:30.005 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-29T04:08:30.006 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-29T04:08:30.006 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-03-29T04:08:30.006 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-29T04:08:30.006 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-29T04:08:30.006 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-29T04:08:30.006 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-03-29T04:08:30.099 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:08:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-29T04:08:30.140 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:08:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-29T04:08:30.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:30.146 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-03-29T04:08:30.162 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-29T04:08:30.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:30.162 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list-id 2024-03-29T04:08:30.219 INFO:teuthology.orchestra.run.smithi142.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-03-29T04:08:30.219 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-29T04:08:30.220 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-03-29T04:08:30.220 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-29T04:08:30.220 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-03-29T04:08:30.220 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-03-29T04:08:30.312 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:08:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-29T04:08:30.340 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:08:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-29T04:08:30.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:30.347 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-03-29T04:08:30.376 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-29T04:08:30.376 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-29T04:08:30.377 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2024-03-29T04:08:30.377 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:08:30.377 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2024-03-29T04:08:30.377 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:08:30.377 INFO:teuthology.orchestra.run.smithi142.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-29T04:08:30.377 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether ea:c2:35:cb:12:ee brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-29T04:08:30.377 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-29T04:08:30.377 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:08:30.377 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::e8c2:35ff:fecb:12ee/64 scope link 2024-03-29T04:08:30.377 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:08:30.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:30.378 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-03-29T04:08:30.444 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-29T04:08:30.444 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-29T04:08:30.445 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2024-03-29T04:08:30.445 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:08:30.445 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2024-03-29T04:08:30.445 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:08:30.445 INFO:teuthology.orchestra.run.smithi142.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-29T04:08:30.445 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether ea:c2:35:cb:12:ee brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-29T04:08:30.445 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-29T04:08:30.445 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:08:30.445 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::e8c2:35ff:fecb:12ee/64 scope link 2024-03-29T04:08:30.445 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:08:30.446 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-03-29T04:08:30.446 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-29T04:08:30.446 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-03-29T04:08:30.446 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-03-29T04:08:30.447 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-03-29T04:08:30.447 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-03-29T04:08:30.447 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-03-29T04:08:30.447 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-03-29T04:08:30.447 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-03-29T04:08:30.534 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:08:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-29T04:08:30.610 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:08:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-29T04:08:30.614 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-29T04:08:30.614 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-03-29T04:08:30.614 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.1 up 2024-03-29T04:08:30.615 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set dev brx.1 master ceph-brx 2024-03-29T04:08:30.615 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-03-29T04:08:30.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:08:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-29T04:08:30.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:08:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-29T04:08:30.695 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-29T04:08:30.695 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-03-29T04:08:30.710 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-03-29T04:08:30.710 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-29T04:08:30.710 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-03-29T04:08:30.765 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-29T04:08:30.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:30.765 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-03-29T04:08:30.849 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-03-29T04:08:30.850 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-03-29T04:08:30.850 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2024-03-29T04:08:30.858 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-03-29T04:08:30.858 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-03-29T04:08:30.858 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2024-03-29T04:08:30.858 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.142:3300,172.21.15.142:3301" 2024-03-29T04:08:30.858 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-29T04:08:30.863 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-03-29T04:08:30.863 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-03-29T04:08:30.863 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2024-03-29T04:08:30.863 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.142:3300,172.21.15.142:3301" 2024-03-29T04:08:30.863 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-29T04:08:30.863 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.73:6789,172.21.15.142:6789,172.21.15.142:6790" 2024-03-29T04:08:30.863 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.73:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2024-03-29T04:08:30.863 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=6bff1617-b138-4517-acca-3ecaae3f2bb3" will pass to kernel 2024-03-29T04:08:30.865 INFO:teuthology.orchestra.run.smithi142.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-03-29T04:08:30.865 INFO:teuthology.orchestra.run.smithi142.stdout: You just mounted a file system that supports labels which does not 2024-03-29T04:08:30.865 INFO:teuthology.orchestra.run.smithi142.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-29T04:08:30.865 INFO:teuthology.orchestra.run.smithi142.stdout: applications will generate AVC messages and not be allowed access to 2024-03-29T04:08:30.865 INFO:teuthology.orchestra.run.smithi142.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-29T04:08:30.866 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-29T04:08:30.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:30.866 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-03-29T04:08:30.892 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-29T04:08:30.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:08:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-29T04:08:30.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:08:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-29T04:08:30.987 INFO:teuthology.orchestra.run.smithi142.stdout:client4457 2024-03-29T04:08:30.987 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-03-29T04:08:30.987 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-29T04:08:31.002 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-29T04:08:31.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:08:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-29T04:08:31.092 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:08:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-29T04:08:31.097 INFO:teuthology.orchestra.run.smithi142.stdout:client4457 2024-03-29T04:08:31.098 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-29T04:08:31.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:08:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-29T04:08:31.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:08:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-29T04:08:31.153 INFO:teuthology.orchestra.run.smithi142.stdout:client4457 2024-03-29T04:08:31.153 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/6bff1617-b138-4517-acca-3ecaae3f2bb3.client4457/status') 2024-03-29T04:08:31.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:08:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-29T04:08:31.213 INFO:teuthology.orchestra.run.smithi142.stdout:instance: client.4457 (3)192.168.0.2:0/2174576808 2024-03-29T04:08:31.213 INFO:teuthology.orchestra.run.smithi142.stdout:blocklisted: false 2024-03-29T04:08:31.213 INFO:teuthology.orchestra.run.smithi142.stderr:0+1 records in 2024-03-29T04:08:31.214 INFO:teuthology.orchestra.run.smithi142.stderr:0+1 records out 2024-03-29T04:08:31.214 INFO:teuthology.orchestra.run.smithi142.stderr:69 bytes copied, 2.1944e-05 s, 3.1 MB/s 2024-03-29T04:08:31.214 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:08:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-29T04:08:31.220 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-03-29T04:08:31.238 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-29T04:08:31.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.371+0000 7fcab27bd640 1 Processor -- start 2024-03-29T04:08:31.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.371+0000 7fcab27bd640 1 -- start start 2024-03-29T04:08:31.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.372+0000 7fcab27bd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcaac15e880 0x7fcaac0cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:31.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.372+0000 7fcab27bd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcaac15ec60 0x7fcaac0ce280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:31.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.372+0000 7fcab27bd640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaac0cf7f0 con 0x7fcaac0b4340 2024-03-29T04:08:31.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.372+0000 7fcab27bd640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fcaac0cfe00 con 0x7fcaac15ec60 2024-03-29T04:08:31.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.372+0000 7fcab27bd640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fcaac0ce7c0 con 0x7fcaac15e880 2024-03-29T04:08:31.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.372+0000 7fcaab7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcaac15ec60 0x7fcaac0ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:31.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.372+0000 7fcaab7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcaac15ec60 0x7fcaac0ce280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45606/0 (socket says 172.21.15.73:45606) 2024-03-29T04:08:31.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.372+0000 7fcaab7fe640 1 -- 172.21.15.73:0/180336849 learned_addr learned my addr 172.21.15.73:0/180336849 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:31.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.372+0000 7fcaabfff640 1 --2- 172.21.15.73:0/180336849 >> v2:172.21.15.142:3300/0 conn(0x7fcaac15e880 0x7fcaac0cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:31.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.372+0000 7fcaab7fe640 1 -- 172.21.15.73:0/180336849 >> v2:172.21.15.142:3300/0 conn(0x7fcaac15e880 msgr2=0x7fcaac0cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:31.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.372+0000 7fcaab7fe640 1 --2- 172.21.15.73:0/180336849 >> v2:172.21.15.142:3300/0 conn(0x7fcaac15e880 0x7fcaac0cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:31.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.372+0000 7fcaab7fe640 1 -- 172.21.15.73:0/180336849 >> v1:172.21.15.142:6789/0 conn(0x7fcaac0b4340 legacy=0x7fcaac06b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:31.353 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.372+0000 7fcaab7fe640 1 -- 172.21.15.73:0/180336849 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaac0cea70 con 0x7fcaac15ec60 2024-03-29T04:08:31.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.373+0000 7fcaab7fe640 1 --2- 172.21.15.73:0/180336849 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcaac15ec60 0x7fcaac0ce280 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcaac071390 tx=0x7fca9402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9672dde844c48493 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:31.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.373+0000 7fcaaaffd640 1 -- 172.21.15.73:0/180336849 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca94035020 con 0x7fcaac15ec60 2024-03-29T04:08:31.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.373+0000 7fcaaaffd640 1 -- 172.21.15.73:0/180336849 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca94031870 con 0x7fcaac15ec60 2024-03-29T04:08:31.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.373+0000 7fcaaaffd640 1 -- 172.21.15.73:0/180336849 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca94031c40 con 0x7fcaac15ec60 2024-03-29T04:08:31.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.374+0000 7fcab27bd640 1 -- 172.21.15.73:0/180336849 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcaac15ec60 msgr2=0x7fcaac0ce280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:31.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.374+0000 7fcab27bd640 1 --2- 172.21.15.73:0/180336849 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcaac15ec60 0x7fcaac0ce280 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcaac071390 tx=0x7fca9402b910 comp rx=0 tx=0).stop 2024-03-29T04:08:31.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.374+0000 7fcab27bd640 1 -- 172.21.15.73:0/180336849 shutdown_connections 2024-03-29T04:08:31.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.374+0000 7fcab27bd640 1 --2- 172.21.15.73:0/180336849 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcaac15ec60 0x7fcaac0ce280 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:31.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.374+0000 7fcab27bd640 1 --2- 172.21.15.73:0/180336849 >> v2:172.21.15.142:3300/0 conn(0x7fcaac15e880 0x7fcaac0cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:31.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.374+0000 7fcab27bd640 1 -- 172.21.15.73:0/180336849 >> 172.21.15.73:0/180336849 conn(0x7fcaac0b6860 msgr2=0x7fcaac0b6c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:31.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.374+0000 7fcab27bd640 1 -- 172.21.15.73:0/180336849 shutdown_connections 2024-03-29T04:08:31.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.374+0000 7fcab27bd640 1 -- 172.21.15.73:0/180336849 wait complete. 2024-03-29T04:08:31.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.375+0000 7fcab27bd640 1 Processor -- start 2024-03-29T04:08:31.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.375+0000 7fcab27bd640 1 -- start start 2024-03-29T04:08:31.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.376+0000 7fcab27bd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcaac0b4340 0x7fcaac149e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:31.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.376+0000 7fcab27bd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcaac15e880 0x7fcaac0ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:31.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.376+0000 7fcab27bd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcaac15ec60 0x7fcaac15bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:31.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.376+0000 7fcab27bd640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fcaac06bc20 con 0x7fcaac0b4340 2024-03-29T04:08:31.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.376+0000 7fcab27bd640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fcaac0cfa90 con 0x7fcaac15ec60 2024-03-29T04:08:31.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.376+0000 7fcab27bd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fcaac06bda0 con 0x7fcaac15e880 2024-03-29T04:08:31.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.376+0000 7fcaabfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcaac0b4340 0x7fcaac149e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:31.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.376+0000 7fcaabfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcaac0b4340 0x7fcaac149e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45622/0 (socket says 172.21.15.73:45622) 2024-03-29T04:08:31.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.376+0000 7fcaabfff640 1 -- 172.21.15.73:0/1393163037 learned_addr learned my addr 172.21.15.73:0/1393163037 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:31.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.376+0000 7fcaab7fe640 1 --2- 172.21.15.73:0/1393163037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcaac15e880 0x7fcaac0ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:31.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.376+0000 7fcab0d5a640 1 --2- 172.21.15.73:0/1393163037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcaac15ec60 0x7fcaac15bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:31.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.376+0000 7fcaabfff640 1 -- 172.21.15.73:0/1393163037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcaac15e880 msgr2=0x7fcaac0ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:31.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.376+0000 7fcaabfff640 1 --2- 172.21.15.73:0/1393163037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcaac15e880 0x7fcaac0ca6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:31.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.376+0000 7fcaabfff640 1 -- 172.21.15.73:0/1393163037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcaac15ec60 msgr2=0x7fcaac15bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:31.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.376+0000 7fcaabfff640 1 --2- 172.21.15.73:0/1393163037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcaac15ec60 0x7fcaac15bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:31.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.376+0000 7fcaabfff640 1 -- 172.21.15.73:0/1393163037 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaac160ba0 con 0x7fcaac0b4340 2024-03-29T04:08:31.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.377+0000 7fcaabfff640 1 --2- 172.21.15.73:0/1393163037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcaac0b4340 0x7fcaac149e40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fca9c00e9b0 tx=0x7fca9c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:31.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.377+0000 7fcaa8ff9640 1 -- 172.21.15.73:0/1393163037 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9c017070 con 0x7fcaac0b4340 2024-03-29T04:08:31.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.377+0000 7fcaa8ff9640 1 -- 172.21.15.73:0/1393163037 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca9c00c9a0 con 0x7fcaac0b4340 2024-03-29T04:08:31.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.377+0000 7fcab27bd640 1 -- 172.21.15.73:0/1393163037 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaac161120 con 0x7fcaac0b4340 2024-03-29T04:08:31.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.377+0000 7fcaa8ff9640 1 -- 172.21.15.73:0/1393163037 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9c00cd90 con 0x7fcaac0b4340 2024-03-29T04:08:31.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.377+0000 7fcab27bd640 1 -- 172.21.15.73:0/1393163037 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaac15f200 con 0x7fcaac0b4340 2024-03-29T04:08:31.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.378+0000 7fcab27bd640 1 -- 172.21.15.73:0/1393163037 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaac06ba40 con 0x7fcaac0b4340 2024-03-29T04:08:31.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.378+0000 7fcaa8ff9640 1 -- 172.21.15.73:0/1393163037 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fca9c01a070 con 0x7fcaac0b4340 2024-03-29T04:08:31.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.379+0000 7fcaa8ff9640 1 --2- 172.21.15.73:0/1393163037 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fca8c06c530 0x7fca8c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:31.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.379+0000 7fcaab7fe640 1 --2- 172.21.15.73:0/1393163037 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fca8c06c530 0x7fca8c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:31.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.379+0000 7fcaa8ff9640 1 -- 172.21.15.73:0/1393163037 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fca9c08b6d0 con 0x7fcaac0b4340 2024-03-29T04:08:31.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.379+0000 7fcaab7fe640 1 --2- 172.21.15.73:0/1393163037 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fca8c06c530 0x7fca8c06e9f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fca94036000 tx=0x7fca9403c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:31.363 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.383+0000 7fcaa8ff9640 1 -- 172.21.15.73:0/1393163037 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fcaac06ba40 con 0x7fcaac0b4340 2024-03-29T04:08:31.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.560+0000 7fcab27bd640 1 -- 172.21.15.73:0/1393163037 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcaac068640 con 0x7fcaac0b4340 2024-03-29T04:08:31.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.561+0000 7fcaa8ff9640 1 -- 172.21.15.73:0/1393163037 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16605 (secure 0 0 0) 0x7fca9c059610 con 0x7fcaac0b4340 2024-03-29T04:08:31.541 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:31.541 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"6bff1617-b138-4517-acca-3ecaae3f2bb3","created":"2024-03-29T04:07:47.346864+0000","modified":"2024-03-29T04:08:13.577603+0000","last_up_change":"2024-03-29T04:07:58.507139+0000","last_in_change":"2024-03-29T04:07:49.637816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-29T04:07:59.537301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-29T04:08:09.570906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-29T04:08:10.882349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"925d7de1-14ab-48c0-aebd-7bded108f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6820","nonce":2387335359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6824","nonce":2387335359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6831","nonce":2387335359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6828","nonce":2387335359}]},"public_addr":"172.21.15.73:6820/2387335359","cluster_addr":"172.21.15.73:6824/2387335359","heartbeat_back_addr":"172.21.15.73:6831/2387335359","heartbeat_front_addr":"172.21.15.73:6828/2387335359","state":["exists","up"]},{"osd":1,"uuid":"6b182102-882a-4e0c-99db-0afae5cfb38b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6801","nonce":2431315515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6803","nonce":2431315515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6807","nonce":2431315515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6805","nonce":2431315515}]},"public_addr":"172.21.15.73:6801/2431315515","cluster_addr":"172.21.15.73:6803/2431315515","heartbeat_back_addr":"172.21.15.73:6807/2431315515","heartbeat_front_addr":"172.21.15.73:6805/2431315515","state":["exists","up"]},{"osd":2,"uuid":"8040902e-b0b8-4a21-bf64-ce1c222115ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6809","nonce":407236597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6811","nonce":407236597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6815","nonce":407236597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6813","nonce":407236597}]},"public_addr":"172.21.15.73:6809/407236597","cluster_addr":"172.21.15.73:6811/407236597","heartbeat_back_addr":"172.21.15.73:6815/407236597","heartbeat_front_addr":"172.21.15.73:6813/407236597","state":["exists","up"]},{"osd":3,"uuid":"1bab19ee-3775-4ce1-a4ce-cf7cda3bbbf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6817","nonce":4291100709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6821","nonce":4291100709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6829","nonce":4291100709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6825","nonce":4291100709}]},"public_addr":"172.21.15.73:6817/4291100709","cluster_addr":"172.21.15.73:6821/4291100709","heartbeat_back_addr":"172.21.15.73:6829/4291100709","heartbeat_front_addr":"172.21.15.73:6825/4291100709","state":["exists","up"]},{"osd":4,"uuid":"b0c74337-8fe4-47dc-b3da-2d07591b1f6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6817","nonce":3703256194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6819","nonce":3703256194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6823","nonce":3703256194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6821","nonce":3703256194}]},"public_addr":"172.21.15.142:6817/3703256194","cluster_addr":"172.21.15.142:6819/3703256194","heartbeat_back_addr":"172.21.15.142:6823/3703256194","heartbeat_front_addr":"172.21.15.142:6821/3703256194","state":["exists","up"]},{"osd":5,"uuid":"9ce36410-a29a-42c6-99f4-f95d4afdd7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6825","nonce":4271575803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6827","nonce":4271575803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6831","nonce":4271575803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6829","nonce":4271575803}]},"public_addr":"172.21.15.142:6825/4271575803","cluster_addr":"172.21.15.142:6827/4271575803","heartbeat_back_addr":"172.21.15.142:6831/4271575803","heartbeat_front_addr":"172.21.15.142:6829/4271575803","state":["exists","up"]},{"osd":6,"uuid":"aec4264a-64ac-428e-a860-d2920a304019","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6801","nonce":1772722570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6803","nonce":1772722570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6807","nonce":1772722570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6805","nonce":1772722570}]},"public_addr":"172.21.15.142:6801/1772722570","cluster_addr":"172.21.15.142:6803/1772722570","heartbeat_back_addr":"172.21.15.142:6807/1772722570","heartbeat_front_addr":"172.21.15.142:6805/1772722570","state":["exists","up"]},{"osd":7,"uuid":"fe599052-8e5a-4c7a-91e7-52d1bae24a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6809","nonce":3910589675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6811","nonce":3910589675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6815","nonce":3910589675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6813","nonce":3910589675}]},"public_addr":"172.21.15.142:6809/3910589675","cluster_addr":"172.21.15.142:6811/3910589675","heartbeat_back_addr":"172.21.15.142:6815/3910589675","heartbeat_front_addr":"172.21.15.142:6813/3910589675","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.835096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.587210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.786547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.778004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.843740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.791160+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.837992+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.718722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:08:31.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.563+0000 7fcab27bd640 1 -- 172.21.15.73:0/1393163037 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fca8c06c530 msgr2=0x7fca8c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:31.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.563+0000 7fcab27bd640 1 --2- 172.21.15.73:0/1393163037 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fca8c06c530 0x7fca8c06e9f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fca94036000 tx=0x7fca9403c040 comp rx=0 tx=0).stop 2024-03-29T04:08:31.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.563+0000 7fcab27bd640 1 -- 172.21.15.73:0/1393163037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcaac0b4340 msgr2=0x7fcaac149e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:31.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.563+0000 7fcab27bd640 1 --2- 172.21.15.73:0/1393163037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcaac0b4340 0x7fcaac149e40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fca9c00e9b0 tx=0x7fca9c00ee70 comp rx=0 tx=0).stop 2024-03-29T04:08:31.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.563+0000 7fcab27bd640 1 -- 172.21.15.73:0/1393163037 shutdown_connections 2024-03-29T04:08:31.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.563+0000 7fcab27bd640 1 --2- 172.21.15.73:0/1393163037 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fca8c06c530 0x7fca8c06e9f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:31.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.563+0000 7fcab27bd640 1 --2- 172.21.15.73:0/1393163037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcaac15ec60 0x7fcaac15bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:31.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.563+0000 7fcab27bd640 1 --2- 172.21.15.73:0/1393163037 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcaac15e880 0x7fcaac0ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:31.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.563+0000 7fcab27bd640 1 --2- 172.21.15.73:0/1393163037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcaac0b4340 0x7fcaac149e40 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:31.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.563+0000 7fcab27bd640 1 -- 172.21.15.73:0/1393163037 >> 172.21.15.73:0/1393163037 conn(0x7fcaac0b6860 msgr2=0x7fcaac0d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:31.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.563+0000 7fcab27bd640 1 -- 172.21.15.73:0/1393163037 shutdown_connections 2024-03-29T04:08:31.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.563+0000 7fcab27bd640 1 -- 172.21.15.73:0/1393163037 wait complete. 2024-03-29T04:08:31.554 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-29T04:07:59.537301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-29T04:08:09.570906+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-29T04:08:10.882349+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-29T04:08:31.554 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-29T04:08:31.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.679+0000 7fe5246b7640 1 Processor -- start 2024-03-29T04:08:31.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.679+0000 7fe5246b7640 1 -- start start 2024-03-29T04:08:31.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.680+0000 7fe5246b7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe51c0cea60 0x7fe51c09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:31.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.680+0000 7fe5246b7640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe51c070ee0 0x7fe51c09af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:31.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.680+0000 7fe5246b7640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe51c0d0c80 con 0x7fe51c0ce680 2024-03-29T04:08:31.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.680+0000 7fe5246b7640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fe51c0d0a30 con 0x7fe51c070ee0 2024-03-29T04:08:31.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.680+0000 7fe5246b7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe51c070650 con 0x7fe51c0cea60 2024-03-29T04:08:31.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.680+0000 7fe522453640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe51c0ce680 0x7fe51c09b770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:34348/0 (socket says 172.21.15.73:34348) 2024-03-29T04:08:31.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.680+0000 7fe522453640 1 -- 172.21.15.73:0/1046381450 learned_addr learned my addr 172.21.15.73:0/1046381450 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:31.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.680+0000 7fe521c52640 1 --2- 172.21.15.73:0/1046381450 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe51c0cea60 0x7fe51c09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:31.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.680+0000 7fe522c54640 1 --2- 172.21.15.73:0/1046381450 >> v2:172.21.15.142:3300/0 conn(0x7fe51c070ee0 0x7fe51c09af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:31.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.681+0000 7fe521451640 1 -- 172.21.15.73:0/1046381450 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 539664541 0 0) 0x7fe51c0d0c80 con 0x7fe51c0ce680 2024-03-29T04:08:31.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.681+0000 7fe521451640 1 -- 172.21.15.73:0/1046381450 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe508003520 con 0x7fe51c0ce680 2024-03-29T04:08:31.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.681+0000 7fe521c52640 1 -- 172.21.15.73:0/1046381450 >> v2:172.21.15.142:3300/0 conn(0x7fe51c070ee0 msgr2=0x7fe51c09af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:31.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.681+0000 7fe521c52640 1 --2- 172.21.15.73:0/1046381450 >> v2:172.21.15.142:3300/0 conn(0x7fe51c070ee0 0x7fe51c09af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:31.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.681+0000 7fe521c52640 1 -- 172.21.15.73:0/1046381450 >> v1:172.21.15.73:6789/0 conn(0x7fe51c0ce680 legacy=0x7fe51c09b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:31.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.681+0000 7fe521c52640 1 -- 172.21.15.73:0/1046381450 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe51c0cde40 con 0x7fe51c0cea60 2024-03-29T04:08:31.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.681+0000 7fe521c52640 1 --2- 172.21.15.73:0/1046381450 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe51c0cea60 0x7fe51c09aa30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe50c0097a0 tx=0x7fe50c02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39498619aee0cf94 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:31.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.682+0000 7fe521451640 1 -- 172.21.15.73:0/1046381450 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe50c0315a0 con 0x7fe51c0cea60 2024-03-29T04:08:31.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.682+0000 7fe521451640 1 -- 172.21.15.73:0/1046381450 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe50c037070 con 0x7fe51c0cea60 2024-03-29T04:08:31.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.682+0000 7fe521451640 1 -- 172.21.15.73:0/1046381450 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe50c031960 con 0x7fe51c0cea60 2024-03-29T04:08:31.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.682+0000 7fe5246b7640 1 -- 172.21.15.73:0/1046381450 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe51c0cea60 msgr2=0x7fe51c09aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:31.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.682+0000 7fe5246b7640 1 --2- 172.21.15.73:0/1046381450 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe51c0cea60 0x7fe51c09aa30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe50c0097a0 tx=0x7fe50c02b840 comp rx=0 tx=0).stop 2024-03-29T04:08:31.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.682+0000 7fe5246b7640 1 -- 172.21.15.73:0/1046381450 shutdown_connections 2024-03-29T04:08:31.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.682+0000 7fe5246b7640 1 --2- 172.21.15.73:0/1046381450 >> v2:172.21.15.142:3300/0 conn(0x7fe51c070ee0 0x7fe51c09af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:31.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.682+0000 7fe5246b7640 1 --2- 172.21.15.73:0/1046381450 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe51c0cea60 0x7fe51c09aa30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:31.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.682+0000 7fe5246b7640 1 -- 172.21.15.73:0/1046381450 >> 172.21.15.73:0/1046381450 conn(0x7fe51c0b3f40 msgr2=0x7fe51c0b4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:31.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.682+0000 7fe5246b7640 1 -- 172.21.15.73:0/1046381450 shutdown_connections 2024-03-29T04:08:31.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.682+0000 7fe5246b7640 1 -- 172.21.15.73:0/1046381450 wait complete. 2024-03-29T04:08:31.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.683+0000 7fe5246b7640 1 Processor -- start 2024-03-29T04:08:31.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.683+0000 7fe5246b7640 1 -- start start 2024-03-29T04:08:31.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.684+0000 7fe5246b7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe51c070ee0 0x7fe51c155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:31.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.684+0000 7fe5246b7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe51c0ce680 0x7fe51c1f3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:31.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.684+0000 7fe5246b7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe51c0cea60 0x7fe51c156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:31.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.684+0000 7fe5246b7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe51c070ae0 con 0x7fe51c0ce680 2024-03-29T04:08:31.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.684+0000 7fe5246b7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe51c0d1240 con 0x7fe51c0cea60 2024-03-29T04:08:31.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.684+0000 7fe5246b7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe51c070c60 con 0x7fe51c070ee0 2024-03-29T04:08:31.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.684+0000 7fe521c52640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe51c0ce680 0x7fe51c1f3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:31.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.684+0000 7fe521c52640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe51c0ce680 0x7fe51c1f3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45634/0 (socket says 172.21.15.73:45634) 2024-03-29T04:08:31.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.684+0000 7fe521c52640 1 -- 172.21.15.73:0/3958428398 learned_addr learned my addr 172.21.15.73:0/3958428398 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:31.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.684+0000 7fe522453640 1 --2- 172.21.15.73:0/3958428398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe51c070ee0 0x7fe51c155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:31.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.684+0000 7fe522c54640 1 --2- 172.21.15.73:0/3958428398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe51c0cea60 0x7fe51c156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:31.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.685+0000 7fe521c52640 1 -- 172.21.15.73:0/3958428398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe51c070ee0 msgr2=0x7fe51c155a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:31.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.685+0000 7fe521c52640 1 --2- 172.21.15.73:0/3958428398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe51c070ee0 0x7fe51c155a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:31.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.685+0000 7fe521c52640 1 -- 172.21.15.73:0/3958428398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe51c0cea60 msgr2=0x7fe51c156c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:31.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.685+0000 7fe521c52640 1 --2- 172.21.15.73:0/3958428398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe51c0cea60 0x7fe51c156c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:31.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.685+0000 7fe521c52640 1 -- 172.21.15.73:0/3958428398 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe51c157510 con 0x7fe51c0ce680 2024-03-29T04:08:31.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.685+0000 7fe521c52640 1 --2- 172.21.15.73:0/3958428398 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe51c0ce680 0x7fe51c1f3610 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe50c034040 tx=0x7fe50c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:31.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.685+0000 7fe512ffd640 1 -- 172.21.15.73:0/3958428398 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe50c032630 con 0x7fe51c0ce680 2024-03-29T04:08:31.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.685+0000 7fe512ffd640 1 -- 172.21.15.73:0/3958428398 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe50c0327d0 con 0x7fe51c0ce680 2024-03-29T04:08:31.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.685+0000 7fe512ffd640 1 -- 172.21.15.73:0/3958428398 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe50c032bc0 con 0x7fe51c0ce680 2024-03-29T04:08:31.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.685+0000 7fe5246b7640 1 -- 172.21.15.73:0/3958428398 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe51c1f2b30 con 0x7fe51c0ce680 2024-03-29T04:08:31.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.685+0000 7fe5246b7640 1 -- 172.21.15.73:0/3958428398 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe51c1577f0 con 0x7fe51c0ce680 2024-03-29T04:08:31.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.686+0000 7fe5246b7640 1 -- 172.21.15.73:0/3958428398 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe51c0a0520 con 0x7fe51c0ce680 2024-03-29T04:08:31.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.686+0000 7fe512ffd640 1 -- 172.21.15.73:0/3958428398 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fe50c04e430 con 0x7fe51c0ce680 2024-03-29T04:08:31.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.687+0000 7fe512ffd640 1 --2- 172.21.15.73:0/3958428398 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fe50006c530 0x7fe50006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:31.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.687+0000 7fe512ffd640 1 -- 172.21.15.73:0/3958428398 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe50c02f030 con 0x7fe51c0ce680 2024-03-29T04:08:31.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.687+0000 7fe522453640 1 --2- 172.21.15.73:0/3958428398 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fe50006c530 0x7fe50006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:31.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.687+0000 7fe522453640 1 --2- 172.21.15.73:0/3958428398 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fe50006c530 0x7fe50006e9f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe518005c00 tx=0x7fe518009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:31.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.691+0000 7fe512ffd640 1 -- 172.21.15.73:0/3958428398 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fe50c040070 con 0x7fe51c0ce680 2024-03-29T04:08:31.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.864+0000 7fe5246b7640 1 -- 172.21.15.73:0/3958428398 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe51c0cfd30 con 0x7fe51c0ce680 2024-03-29T04:08:31.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.865+0000 7fe512ffd640 1 -- 172.21.15.73:0/3958428398 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7fe50c07b460 con 0x7fe51c0ce680 2024-03-29T04:08:31.845 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-03-29T04:08:31.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.867+0000 7fe5246b7640 1 -- 172.21.15.73:0/3958428398 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fe50006c530 msgr2=0x7fe50006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:31.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.867+0000 7fe5246b7640 1 --2- 172.21.15.73:0/3958428398 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fe50006c530 0x7fe50006e9f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe518005c00 tx=0x7fe518009040 comp rx=0 tx=0).stop 2024-03-29T04:08:31.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.867+0000 7fe5246b7640 1 -- 172.21.15.73:0/3958428398 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe51c0ce680 msgr2=0x7fe51c1f3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:31.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.867+0000 7fe5246b7640 1 --2- 172.21.15.73:0/3958428398 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe51c0ce680 0x7fe51c1f3610 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe50c034040 tx=0x7fe50c0046c0 comp rx=0 tx=0).stop 2024-03-29T04:08:31.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.867+0000 7fe5246b7640 1 -- 172.21.15.73:0/3958428398 shutdown_connections 2024-03-29T04:08:31.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.867+0000 7fe5246b7640 1 --2- 172.21.15.73:0/3958428398 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fe50006c530 0x7fe50006e9f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:31.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.867+0000 7fe5246b7640 1 --2- 172.21.15.73:0/3958428398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe51c0cea60 0x7fe51c156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:31.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.867+0000 7fe5246b7640 1 --2- 172.21.15.73:0/3958428398 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe51c0ce680 0x7fe51c1f3610 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:31.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.867+0000 7fe5246b7640 1 --2- 172.21.15.73:0/3958428398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe51c070ee0 0x7fe51c155a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:31.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.867+0000 7fe5246b7640 1 -- 172.21.15.73:0/3958428398 >> 172.21.15.73:0/3958428398 conn(0x7fe51c0b3f40 msgr2=0x7fe51c0cee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:31.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.867+0000 7fe5246b7640 1 -- 172.21.15.73:0/3958428398 shutdown_connections 2024-03-29T04:08:31.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.867+0000 7fe5246b7640 1 -- 172.21.15.73:0/3958428398 wait complete. 2024-03-29T04:08:31.858 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-29T04:08:31.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.981+0000 7fb95a367640 1 Processor -- start 2024-03-29T04:08:31.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.981+0000 7fb95a367640 1 -- start start 2024-03-29T04:08:31.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.982+0000 7fb95a367640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb95415b540 0x7fb9540cf460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:31.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.982+0000 7fb95a367640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb9540cf9a0 0x7fb95406f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:31.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.982+0000 7fb95a367640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb95406ff30 con 0x7fb95415b920 2024-03-29T04:08:31.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.982+0000 7fb95a367640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fb95406fc50 con 0x7fb9540cf9a0 2024-03-29T04:08:31.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.982+0000 7fb95a367640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fb9540ce980 con 0x7fb95415b540 2024-03-29T04:08:31.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.982+0000 7fb958904640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb95415b920 0x7fb95406c520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:34358/0 (socket says 172.21.15.73:34358) 2024-03-29T04:08:31.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.982+0000 7fb958904640 1 -- 172.21.15.73:0/2741696885 learned_addr learned my addr 172.21.15.73:0/2741696885 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:31.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.982+0000 7fb953fff640 1 --2- 172.21.15.73:0/2741696885 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb95415b540 0x7fb9540cf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:31.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.982+0000 7fb9537fe640 1 --2- 172.21.15.73:0/2741696885 >> v2:172.21.15.142:3300/0 conn(0x7fb9540cf9a0 0x7fb95406f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:31.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.982+0000 7fb952ffd640 1 -- 172.21.15.73:0/2741696885 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2384587771 0 0) 0x7fb95406ff30 con 0x7fb95415b920 2024-03-29T04:08:31.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.982+0000 7fb952ffd640 1 -- 172.21.15.73:0/2741696885 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb93c003520 con 0x7fb95415b920 2024-03-29T04:08:31.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.982+0000 7fb953fff640 1 -- 172.21.15.73:0/2741696885 >> v2:172.21.15.142:3300/0 conn(0x7fb9540cf9a0 msgr2=0x7fb95406f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:31.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.982+0000 7fb953fff640 1 --2- 172.21.15.73:0/2741696885 >> v2:172.21.15.142:3300/0 conn(0x7fb9540cf9a0 0x7fb95406f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:31.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.982+0000 7fb953fff640 1 -- 172.21.15.73:0/2741696885 >> v1:172.21.15.73:6789/0 conn(0x7fb95415b920 legacy=0x7fb95406c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:31.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.983+0000 7fb953fff640 1 -- 172.21.15.73:0/2741696885 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9540cec60 con 0x7fb95415b540 2024-03-29T04:08:31.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.983+0000 7fb953fff640 1 --2- 172.21.15.73:0/2741696885 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb95415b540 0x7fb9540cf460 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb9440097a0 tx=0x7fb94402b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85ab5f55d554a3de server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:31.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.983+0000 7fb952ffd640 1 -- 172.21.15.73:0/2741696885 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb944038070 con 0x7fb95415b540 2024-03-29T04:08:31.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.983+0000 7fb952ffd640 1 -- 172.21.15.73:0/2741696885 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb944031700 con 0x7fb95415b540 2024-03-29T04:08:31.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.983+0000 7fb952ffd640 1 -- 172.21.15.73:0/2741696885 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb944031ad0 con 0x7fb95415b540 2024-03-29T04:08:31.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.984+0000 7fb95a367640 1 -- 172.21.15.73:0/2741696885 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb95415b540 msgr2=0x7fb9540cf460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:31.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.984+0000 7fb95a367640 1 --2- 172.21.15.73:0/2741696885 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb95415b540 0x7fb9540cf460 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb9440097a0 tx=0x7fb94402b7a0 comp rx=0 tx=0).stop 2024-03-29T04:08:31.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.984+0000 7fb95a367640 1 -- 172.21.15.73:0/2741696885 shutdown_connections 2024-03-29T04:08:31.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.984+0000 7fb95a367640 1 --2- 172.21.15.73:0/2741696885 >> v2:172.21.15.142:3300/0 conn(0x7fb9540cf9a0 0x7fb95406f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:31.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.984+0000 7fb95a367640 1 --2- 172.21.15.73:0/2741696885 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb95415b540 0x7fb9540cf460 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:31.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.984+0000 7fb95a367640 1 -- 172.21.15.73:0/2741696885 >> 172.21.15.73:0/2741696885 conn(0x7fb954072090 msgr2=0x7fb9540724a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:31.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.984+0000 7fb95a367640 1 -- 172.21.15.73:0/2741696885 shutdown_connections 2024-03-29T04:08:31.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.984+0000 7fb95a367640 1 -- 172.21.15.73:0/2741696885 wait complete. 2024-03-29T04:08:31.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.985+0000 7fb95a367640 1 Processor -- start 2024-03-29T04:08:31.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.985+0000 7fb95a367640 1 -- start start 2024-03-29T04:08:31.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.986+0000 7fb95a367640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9540cf9a0 0x7fb954146620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:31.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.986+0000 7fb95a367640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb95415b540 0x7fb9540ae220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:31.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.986+0000 7fb95a367640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb95415b920 0x7fb954146dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:31.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.986+0000 7fb95a367640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb95406cdb0 con 0x7fb9540cf9a0 2024-03-29T04:08:31.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.986+0000 7fb95a367640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb95406cc30 con 0x7fb95415b540 2024-03-29T04:08:31.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.986+0000 7fb95a367640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fb95406f740 con 0x7fb95415b920 2024-03-29T04:08:31.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.986+0000 7fb953fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9540cf9a0 0x7fb954146620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:31.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.986+0000 7fb953fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9540cf9a0 0x7fb954146620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45648/0 (socket says 172.21.15.73:45648) 2024-03-29T04:08:31.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.986+0000 7fb953fff640 1 -- 172.21.15.73:0/3378140928 learned_addr learned my addr 172.21.15.73:0/3378140928 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:31.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.986+0000 7fb9537fe640 1 --2- 172.21.15.73:0/3378140928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb95415b540 0x7fb9540ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:31.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.986+0000 7fb958904640 1 --2- 172.21.15.73:0/3378140928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb95415b920 0x7fb954146dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:31.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.986+0000 7fb953fff640 1 -- 172.21.15.73:0/3378140928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb95415b920 msgr2=0x7fb954146dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:31.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.986+0000 7fb953fff640 1 --2- 172.21.15.73:0/3378140928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb95415b920 0x7fb954146dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:31.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.986+0000 7fb953fff640 1 -- 172.21.15.73:0/3378140928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb95415b540 msgr2=0x7fb9540ae220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:31.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.986+0000 7fb953fff640 1 --2- 172.21.15.73:0/3378140928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb95415b540 0x7fb9540ae220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:31.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.986+0000 7fb953fff640 1 -- 172.21.15.73:0/3378140928 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb95415c9c0 con 0x7fb9540cf9a0 2024-03-29T04:08:31.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.987+0000 7fb953fff640 1 --2- 172.21.15.73:0/3378140928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9540cf9a0 0x7fb954146620 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb944036040 tx=0x7fb9440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:31.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.987+0000 7fb950ff9640 1 -- 172.21.15.73:0/3378140928 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb944042070 con 0x7fb9540cf9a0 2024-03-29T04:08:31.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.987+0000 7fb950ff9640 1 -- 172.21.15.73:0/3378140928 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb94403d890 con 0x7fb9540cf9a0 2024-03-29T04:08:31.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.987+0000 7fb95a367640 1 -- 172.21.15.73:0/3378140928 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb95415cca0 con 0x7fb9540cf9a0 2024-03-29T04:08:31.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.987+0000 7fb950ff9640 1 -- 172.21.15.73:0/3378140928 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb944038040 con 0x7fb9540cf9a0 2024-03-29T04:08:31.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.987+0000 7fb95a367640 1 -- 172.21.15.73:0/3378140928 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb95415d260 con 0x7fb9540cf9a0 2024-03-29T04:08:31.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.988+0000 7fb95a367640 1 -- 172.21.15.73:0/3378140928 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb95404f9d0 con 0x7fb9540cf9a0 2024-03-29T04:08:31.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.988+0000 7fb950ff9640 1 -- 172.21.15.73:0/3378140928 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fb94403b070 con 0x7fb9540cf9a0 2024-03-29T04:08:31.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.989+0000 7fb950ff9640 1 --2- 172.21.15.73:0/3378140928 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fb94006c530 0x7fb94006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:31.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.989+0000 7fb950ff9640 1 -- 172.21.15.73:0/3378140928 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb9440acd50 con 0x7fb9540cf9a0 2024-03-29T04:08:31.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.989+0000 7fb9537fe640 1 --2- 172.21.15.73:0/3378140928 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fb94006c530 0x7fb94006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:31.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.989+0000 7fb9537fe640 1 --2- 172.21.15.73:0/3378140928 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fb94006c530 0x7fb94006e9f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb9540add50 tx=0x7fb948009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:31.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:31.993+0000 7fb950ff9640 1 -- 172.21.15.73:0/3378140928 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fb9440b0030 con 0x7fb9540cf9a0 2024-03-29T04:08:32.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.166+0000 7fb95a367640 1 -- 172.21.15.73:0/3378140928 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb954067550 con 0x7fb9540cf9a0 2024-03-29T04:08:32.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.167+0000 7fb950ff9640 1 -- 172.21.15.73:0/3378140928 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7fb944081030 con 0x7fb9540cf9a0 2024-03-29T04:08:32.146 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-03-29T04:08:32.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.168+0000 7fb95a367640 1 -- 172.21.15.73:0/3378140928 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fb94006c530 msgr2=0x7fb94006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:32.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.168+0000 7fb95a367640 1 --2- 172.21.15.73:0/3378140928 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fb94006c530 0x7fb94006e9f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb9540add50 tx=0x7fb948009190 comp rx=0 tx=0).stop 2024-03-29T04:08:32.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.168+0000 7fb95a367640 1 -- 172.21.15.73:0/3378140928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9540cf9a0 msgr2=0x7fb954146620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:32.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.168+0000 7fb95a367640 1 --2- 172.21.15.73:0/3378140928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9540cf9a0 0x7fb954146620 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb944036040 tx=0x7fb9440046c0 comp rx=0 tx=0).stop 2024-03-29T04:08:32.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.168+0000 7fb95a367640 1 -- 172.21.15.73:0/3378140928 shutdown_connections 2024-03-29T04:08:32.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.168+0000 7fb95a367640 1 --2- 172.21.15.73:0/3378140928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb95415b920 0x7fb954146dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:32.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.168+0000 7fb95a367640 1 --2- 172.21.15.73:0/3378140928 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fb94006c530 0x7fb94006e9f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:32.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.168+0000 7fb95a367640 1 --2- 172.21.15.73:0/3378140928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb95415b540 0x7fb9540ae220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:32.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.168+0000 7fb95a367640 1 --2- 172.21.15.73:0/3378140928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9540cf9a0 0x7fb954146620 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:32.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.168+0000 7fb95a367640 1 -- 172.21.15.73:0/3378140928 >> 172.21.15.73:0/3378140928 conn(0x7fb954072090 msgr2=0x7fb95415df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:32.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.169+0000 7fb95a367640 1 -- 172.21.15.73:0/3378140928 shutdown_connections 2024-03-29T04:08:32.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.169+0000 7fb95a367640 1 -- 172.21.15.73:0/3378140928 wait complete. 2024-03-29T04:08:32.159 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-29T04:08:32.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.284+0000 7f9560d0e640 1 Processor -- start 2024-03-29T04:08:32.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.284+0000 7f9560d0e640 1 -- start start 2024-03-29T04:08:32.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.286+0000 7f9560d0e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f955c0cfde0 0x7f955c0d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:32.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.286+0000 7f9560d0e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f955c15ed00 con 0x7f955c15e920 2024-03-29T04:08:32.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.286+0000 7f9560d0e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f955c0d21e0 con 0x7f955c0d0f90 2024-03-29T04:08:32.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.286+0000 7f9560d0e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f955c0d2480 con 0x7f955c0cfde0 2024-03-29T04:08:32.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.286+0000 7f955a59c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f955c15e920 0x7f955c0d3240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:34364/0 (socket says 172.21.15.73:34364) 2024-03-29T04:08:32.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.286+0000 7f955a59c640 1 -- 172.21.15.73:0/696813619 learned_addr learned my addr 172.21.15.73:0/696813619 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:32.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.286+0000 7f9553fff640 1 --2- 172.21.15.73:0/696813619 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f955c0cfde0 0x7f955c0d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:32.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.286+0000 7f9559d9b640 1 -- 172.21.15.73:0/696813619 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3193874555 0 0) 0x7f955c15ed00 con 0x7f955c15e920 2024-03-29T04:08:32.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.286+0000 7f9559d9b640 1 -- 172.21.15.73:0/696813619 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9548003520 con 0x7f955c15e920 2024-03-29T04:08:32.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.286+0000 7f9559d9b640 1 -- 172.21.15.73:0/696813619 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1201216937 0 0) 0x7f955c0d21e0 con 0x7f955c0d0f90 2024-03-29T04:08:32.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.286+0000 7f9553fff640 1 -- 172.21.15.73:0/696813619 >> v1:172.21.15.142:6789/0 conn(0x7f955c0d0f90 legacy=0x7f955c06c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:32.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.286+0000 7f9553fff640 1 -- 172.21.15.73:0/696813619 >> v1:172.21.15.73:6789/0 conn(0x7f955c15e920 legacy=0x7f955c0d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:32.267 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.286+0000 7f9553fff640 1 -- 172.21.15.73:0/696813619 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f955c0d2760 con 0x7f955c0cfde0 2024-03-29T04:08:32.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.287+0000 7f9553fff640 1 --2- 172.21.15.73:0/696813619 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f955c0cfde0 0x7f955c0d0240 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9544009800 tx=0x7f954402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=431aa9fc8ab2a3eb server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:32.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.288+0000 7f9559d9b640 1 -- 172.21.15.73:0/696813619 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9544035020 con 0x7f955c0cfde0 2024-03-29T04:08:32.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.288+0000 7f9559d9b640 1 -- 172.21.15.73:0/696813619 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9544031890 con 0x7f955c0cfde0 2024-03-29T04:08:32.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.288+0000 7f9559d9b640 1 -- 172.21.15.73:0/696813619 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9544031c60 con 0x7f955c0cfde0 2024-03-29T04:08:32.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.288+0000 7f9560d0e640 1 -- 172.21.15.73:0/696813619 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f955c0cfde0 msgr2=0x7f955c0d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:32.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.288+0000 7f9560d0e640 1 --2- 172.21.15.73:0/696813619 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f955c0cfde0 0x7f955c0d0240 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9544009800 tx=0x7f954402b930 comp rx=0 tx=0).stop 2024-03-29T04:08:32.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.288+0000 7f9560d0e640 1 -- 172.21.15.73:0/696813619 shutdown_connections 2024-03-29T04:08:32.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.288+0000 7f9560d0e640 1 --2- 172.21.15.73:0/696813619 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f955c0cfde0 0x7f955c0d0240 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:32.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.288+0000 7f9560d0e640 1 -- 172.21.15.73:0/696813619 >> 172.21.15.73:0/696813619 conn(0x7f955c08bfc0 msgr2=0x7f955c0d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:32.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.289+0000 7f9560d0e640 1 -- 172.21.15.73:0/696813619 shutdown_connections 2024-03-29T04:08:32.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.289+0000 7f9560d0e640 1 -- 172.21.15.73:0/696813619 wait complete. 2024-03-29T04:08:32.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.291+0000 7f9560d0e640 1 Processor -- start 2024-03-29T04:08:32.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.291+0000 7f9560d0e640 1 -- start start 2024-03-29T04:08:32.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.292+0000 7f9560d0e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f955c0cfde0 0x7f955c15cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:32.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.292+0000 7f9560d0e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f955c0d0f90 0x7f955c0cc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:32.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.292+0000 7f9560d0e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f955c15e920 0x7f955c0cc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:32.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.292+0000 7f9560d0e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f955c0d4ef0 con 0x7f955c0d0f90 2024-03-29T04:08:32.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.292+0000 7f9560d0e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f955c0d2d20 con 0x7f955c15e920 2024-03-29T04:08:32.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.292+0000 7f9560d0e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f955c0d5070 con 0x7f955c0cfde0 2024-03-29T04:08:32.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.292+0000 7f9553fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f955c0d0f90 0x7f955c0cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:32.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.292+0000 7f9553fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f955c0d0f90 0x7f955c0cc100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45654/0 (socket says 172.21.15.73:45654) 2024-03-29T04:08:32.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.292+0000 7f9553fff640 1 -- 172.21.15.73:0/3828369745 learned_addr learned my addr 172.21.15.73:0/3828369745 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:32.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.292+0000 7f955a59c640 1 --2- 172.21.15.73:0/3828369745 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f955c0cfde0 0x7f955c15cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:32.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.292+0000 7f955ad9d640 1 --2- 172.21.15.73:0/3828369745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f955c15e920 0x7f955c0cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:32.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.292+0000 7f9553fff640 1 -- 172.21.15.73:0/3828369745 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f955c0cfde0 msgr2=0x7f955c15cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:32.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.292+0000 7f9553fff640 1 --2- 172.21.15.73:0/3828369745 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f955c0cfde0 0x7f955c15cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:32.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.292+0000 7f9553fff640 1 -- 172.21.15.73:0/3828369745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f955c15e920 msgr2=0x7f955c0cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:32.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.292+0000 7f9553fff640 1 --2- 172.21.15.73:0/3828369745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f955c15e920 0x7f955c0cc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:32.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.292+0000 7f9553fff640 1 -- 172.21.15.73:0/3828369745 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f955c1f4520 con 0x7f955c0d0f90 2024-03-29T04:08:32.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.292+0000 7f9553fff640 1 --2- 172.21.15.73:0/3828369745 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f955c0d0f90 0x7f955c0cc100 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9544000c00 tx=0x7f95440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:32.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.293+0000 7f9552ffd640 1 -- 172.21.15.73:0/3828369745 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9544035040 con 0x7f955c0d0f90 2024-03-29T04:08:32.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.293+0000 7f9552ffd640 1 -- 172.21.15.73:0/3828369745 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9544030d20 con 0x7f955c0d0f90 2024-03-29T04:08:32.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.293+0000 7f9552ffd640 1 -- 172.21.15.73:0/3828369745 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95440466c0 con 0x7f955c0d0f90 2024-03-29T04:08:32.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.293+0000 7f9560d0e640 1 -- 172.21.15.73:0/3828369745 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f955c1f47e0 con 0x7f955c0d0f90 2024-03-29T04:08:32.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.293+0000 7f9560d0e640 1 -- 172.21.15.73:0/3828369745 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f955c1f4da0 con 0x7f955c0d0f90 2024-03-29T04:08:32.275 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.294+0000 7f9560d0e640 1 -- 172.21.15.73:0/3828369745 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f955c0a2560 con 0x7f955c0d0f90 2024-03-29T04:08:32.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.294+0000 7f9552ffd640 1 -- 172.21.15.73:0/3828369745 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f9544038020 con 0x7f955c0d0f90 2024-03-29T04:08:32.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.294+0000 7f9552ffd640 1 --2- 172.21.15.73:0/3828369745 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f953c06c530 0x7f953c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:32.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.295+0000 7f9552ffd640 1 -- 172.21.15.73:0/3828369745 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f95440add10 con 0x7f955c0d0f90 2024-03-29T04:08:32.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.295+0000 7f955a59c640 1 --2- 172.21.15.73:0/3828369745 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f953c06c530 0x7f953c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:32.276 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.295+0000 7f955a59c640 1 --2- 172.21.15.73:0/3828369745 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f953c06c530 0x7f953c06e9f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f954c005880 tx=0x7f954c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:32.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.299+0000 7f9552ffd640 1 -- 172.21.15.73:0/3828369745 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f954402d040 con 0x7f955c0d0f90 2024-03-29T04:08:32.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.482+0000 7f9560d0e640 1 -- 172.21.15.73:0/3828369745 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f955c04f9d0 con 0x7f955c0d0f90 2024-03-29T04:08:32.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.482+0000 7f9552ffd640 1 -- 172.21.15.73:0/3828369745 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f954407bce0 con 0x7f955c0d0f90 2024-03-29T04:08:32.462 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-29T04:08:32.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.484+0000 7f9560d0e640 1 -- 172.21.15.73:0/3828369745 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f953c06c530 msgr2=0x7f953c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:32.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.484+0000 7f9560d0e640 1 --2- 172.21.15.73:0/3828369745 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f953c06c530 0x7f953c06e9f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f954c005880 tx=0x7f954c009040 comp rx=0 tx=0).stop 2024-03-29T04:08:32.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.484+0000 7f9560d0e640 1 -- 172.21.15.73:0/3828369745 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f955c0d0f90 msgr2=0x7f955c0cc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:32.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.484+0000 7f9560d0e640 1 --2- 172.21.15.73:0/3828369745 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f955c0d0f90 0x7f955c0cc100 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9544000c00 tx=0x7f95440046c0 comp rx=0 tx=0).stop 2024-03-29T04:08:32.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.484+0000 7f9560d0e640 1 -- 172.21.15.73:0/3828369745 shutdown_connections 2024-03-29T04:08:32.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.484+0000 7f9560d0e640 1 --2- 172.21.15.73:0/3828369745 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f953c06c530 0x7f953c06e9f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:32.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.484+0000 7f9560d0e640 1 --2- 172.21.15.73:0/3828369745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f955c15e920 0x7f955c0cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:32.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.484+0000 7f9560d0e640 1 --2- 172.21.15.73:0/3828369745 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f955c0d0f90 0x7f955c0cc100 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:32.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.484+0000 7f9560d0e640 1 --2- 172.21.15.73:0/3828369745 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f955c0cfde0 0x7f955c15cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:32.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.484+0000 7f9560d0e640 1 -- 172.21.15.73:0/3828369745 >> 172.21.15.73:0/3828369745 conn(0x7f955c08bfc0 msgr2=0x7f955c0d1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:32.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.484+0000 7f9560d0e640 1 -- 172.21.15.73:0/3828369745 shutdown_connections 2024-03-29T04:08:32.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.484+0000 7f9560d0e640 1 -- 172.21.15.73:0/3828369745 wait complete. 2024-03-29T04:08:32.475 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-29T04:08:32.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.600+0000 7ff0080a5640 1 Processor -- start 2024-03-29T04:08:32.580 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.600+0000 7ff0080a5640 1 -- start start 2024-03-29T04:08:32.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.601+0000 7ff0080a5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff00015e870 0x7ff0000b26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:32.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.601+0000 7ff0080a5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff00006bc20 0x7ff0000b16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:32.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.601+0000 7ff0080a5640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0000b41d0 con 0x7ff0000ae1b0 2024-03-29T04:08:32.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.601+0000 7ff0080a5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7ff0000b6510 con 0x7ff00006bc20 2024-03-29T04:08:32.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.601+0000 7ff0080a5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff0000b4470 con 0x7ff00015e870 2024-03-29T04:08:32.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.601+0000 7ff005640640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff0000ae1b0 0x7ff00006b510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:34374/0 (socket says 172.21.15.73:34374) 2024-03-29T04:08:32.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.601+0000 7ff005640640 1 -- 172.21.15.73:0/1599785555 learned_addr learned my addr 172.21.15.73:0/1599785555 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:32.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.601+0000 7ff005e41640 1 --2- 172.21.15.73:0/1599785555 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff00015e870 0x7ff0000b26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:32.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.601+0000 7ff006642640 1 --2- 172.21.15.73:0/1599785555 >> v2:172.21.15.142:3300/0 conn(0x7ff00006bc20 0x7ff0000b16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:32.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.601+0000 7ff004e3f640 1 -- 172.21.15.73:0/1599785555 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 860950499 0 0) 0x7ff0000b41d0 con 0x7ff0000ae1b0 2024-03-29T04:08:32.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.601+0000 7ff004e3f640 1 -- 172.21.15.73:0/1599785555 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefec003520 con 0x7ff0000ae1b0 2024-03-29T04:08:32.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.601+0000 7ff006642640 1 -- 172.21.15.73:0/1599785555 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff00015e870 msgr2=0x7ff0000b26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:32.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.601+0000 7ff006642640 1 --2- 172.21.15.73:0/1599785555 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff00015e870 0x7ff0000b26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:32.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.601+0000 7ff006642640 1 -- 172.21.15.73:0/1599785555 >> v1:172.21.15.73:6789/0 conn(0x7ff0000ae1b0 legacy=0x7ff00006b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:32.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.601+0000 7ff006642640 1 -- 172.21.15.73:0/1599785555 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0000b4750 con 0x7ff00006bc20 2024-03-29T04:08:32.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.601+0000 7ff005e41640 1 --2- 172.21.15.73:0/1599785555 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff00015e870 0x7ff0000b26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:08:32.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.602+0000 7ff006642640 1 --2- 172.21.15.73:0/1599785555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff00006bc20 0x7ff0000b16d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7feff8009d90 tx=0x7feff802be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e591905fd91072b server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:32.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.602+0000 7ff004e3f640 1 -- 172.21.15.73:0/1599785555 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff8039070 con 0x7ff00006bc20 2024-03-29T04:08:32.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.602+0000 7ff004e3f640 1 -- 172.21.15.73:0/1599785555 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feff802cbd0 con 0x7ff00006bc20 2024-03-29T04:08:32.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.602+0000 7ff004e3f640 1 -- 172.21.15.73:0/1599785555 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff8034440 con 0x7ff00006bc20 2024-03-29T04:08:32.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.603+0000 7ff0080a5640 1 -- 172.21.15.73:0/1599785555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff00006bc20 msgr2=0x7ff0000b16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:32.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.603+0000 7ff0080a5640 1 --2- 172.21.15.73:0/1599785555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff00006bc20 0x7ff0000b16d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7feff8009d90 tx=0x7feff802be20 comp rx=0 tx=0).stop 2024-03-29T04:08:32.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.603+0000 7ff0080a5640 1 -- 172.21.15.73:0/1599785555 shutdown_connections 2024-03-29T04:08:32.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.603+0000 7ff0080a5640 1 --2- 172.21.15.73:0/1599785555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff00006bc20 0x7ff0000b16d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:32.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.603+0000 7ff0080a5640 1 --2- 172.21.15.73:0/1599785555 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff00015e870 0x7ff0000b26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:32.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.603+0000 7ff0080a5640 1 -- 172.21.15.73:0/1599785555 >> 172.21.15.73:0/1599785555 conn(0x7ff0000b66f0 msgr2=0x7ff0000b6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:32.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.603+0000 7ff0080a5640 1 -- 172.21.15.73:0/1599785555 shutdown_connections 2024-03-29T04:08:32.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.603+0000 7ff0080a5640 1 -- 172.21.15.73:0/1599785555 wait complete. 2024-03-29T04:08:32.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.604+0000 7ff0080a5640 1 Processor -- start 2024-03-29T04:08:32.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.604+0000 7ff0080a5640 1 -- start start 2024-03-29T04:08:32.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.605+0000 7ff0080a5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff00006bc20 0x7ff0001544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:32.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.605+0000 7ff0080a5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0000ae1b0 0x7ff0001f8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:32.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.605+0000 7ff0080a5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff00015e870 0x7ff00015a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:32.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.605+0000 7ff0080a5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff0000b04c0 con 0x7ff0000ae1b0 2024-03-29T04:08:32.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.605+0000 7ff0080a5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff00015ec50 con 0x7ff00015e870 2024-03-29T04:08:32.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.605+0000 7ff0080a5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff0000b2c10 con 0x7ff00006bc20 2024-03-29T04:08:32.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.605+0000 7ff005640640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0000ae1b0 0x7ff0001f8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:32.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.605+0000 7ff005640640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0000ae1b0 0x7ff0001f8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45666/0 (socket says 172.21.15.73:45666) 2024-03-29T04:08:32.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.605+0000 7ff005640640 1 -- 172.21.15.73:0/2518315055 learned_addr learned my addr 172.21.15.73:0/2518315055 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:32.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.605+0000 7ff006642640 1 --2- 172.21.15.73:0/2518315055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff00015e870 0x7ff00015a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:32.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.605+0000 7ff005e41640 1 --2- 172.21.15.73:0/2518315055 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff00006bc20 0x7ff0001544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:32.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.605+0000 7ff005640640 1 -- 172.21.15.73:0/2518315055 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff00006bc20 msgr2=0x7ff0001544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:32.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.605+0000 7ff005640640 1 --2- 172.21.15.73:0/2518315055 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff00006bc20 0x7ff0001544f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:32.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.605+0000 7ff005640640 1 -- 172.21.15.73:0/2518315055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff00015e870 msgr2=0x7ff00015a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:32.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.605+0000 7ff005640640 1 --2- 172.21.15.73:0/2518315055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff00015e870 0x7ff00015a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:32.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.605+0000 7ff005640640 1 -- 172.21.15.73:0/2518315055 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0001f8550 con 0x7ff0000ae1b0 2024-03-29T04:08:32.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.606+0000 7ff005640640 1 --2- 172.21.15.73:0/2518315055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0000ae1b0 0x7ff0001f8010 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7feff00010e0 tx=0x7feff000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:32.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.606+0000 7feff67fc640 1 -- 172.21.15.73:0/2518315055 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff0017070 con 0x7ff0000ae1b0 2024-03-29T04:08:32.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.606+0000 7feff67fc640 1 -- 172.21.15.73:0/2518315055 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feff0005d00 con 0x7ff0000ae1b0 2024-03-29T04:08:32.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.606+0000 7ff0080a5640 1 -- 172.21.15.73:0/2518315055 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff000154bf0 con 0x7ff0000ae1b0 2024-03-29T04:08:32.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.606+0000 7feff67fc640 1 -- 172.21.15.73:0/2518315055 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff0007310 con 0x7ff0000ae1b0 2024-03-29T04:08:32.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.606+0000 7ff0080a5640 1 -- 172.21.15.73:0/2518315055 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0001551b0 con 0x7ff0000ae1b0 2024-03-29T04:08:32.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.607+0000 7ff0080a5640 1 -- 172.21.15.73:0/2518315055 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff000068d50 con 0x7ff0000ae1b0 2024-03-29T04:08:32.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.607+0000 7feff67fc640 1 -- 172.21.15.73:0/2518315055 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7feff001a070 con 0x7ff0000ae1b0 2024-03-29T04:08:32.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.608+0000 7feff67fc640 1 --2- 172.21.15.73:0/2518315055 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fefe406c530 0x7fefe406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:32.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.608+0000 7feff67fc640 1 -- 172.21.15.73:0/2518315055 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7feff008a980 con 0x7ff0000ae1b0 2024-03-29T04:08:32.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.608+0000 7ff005e41640 1 --2- 172.21.15.73:0/2518315055 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fefe406c530 0x7fefe406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:32.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.608+0000 7ff005e41640 1 --2- 172.21.15.73:0/2518315055 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fefe406c530 0x7fefe406e9f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7feffc009560 tx=0x7feffc009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:32.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.612+0000 7feff67fc640 1 -- 172.21.15.73:0/2518315055 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7feff0058950 con 0x7ff0000ae1b0 2024-03-29T04:08:32.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.798+0000 7ff0080a5640 1 -- 172.21.15.73:0/2518315055 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff00015a7e0 con 0x7ff0000ae1b0 2024-03-29T04:08:32.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.799+0000 7feff67fc640 1 -- 172.21.15.73:0/2518315055 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16605 (secure 0 0 0) 0x7feff005cc50 con 0x7ff0000ae1b0 2024-03-29T04:08:32.779 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:32.779 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"6bff1617-b138-4517-acca-3ecaae3f2bb3","created":"2024-03-29T04:07:47.346864+0000","modified":"2024-03-29T04:08:13.577603+0000","last_up_change":"2024-03-29T04:07:58.507139+0000","last_in_change":"2024-03-29T04:07:49.637816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-29T04:07:59.537301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-29T04:08:09.570906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-29T04:08:10.882349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"925d7de1-14ab-48c0-aebd-7bded108f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6820","nonce":2387335359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6824","nonce":2387335359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6831","nonce":2387335359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6828","nonce":2387335359}]},"public_addr":"172.21.15.73:6820/2387335359","cluster_addr":"172.21.15.73:6824/2387335359","heartbeat_back_addr":"172.21.15.73:6831/2387335359","heartbeat_front_addr":"172.21.15.73:6828/2387335359","state":["exists","up"]},{"osd":1,"uuid":"6b182102-882a-4e0c-99db-0afae5cfb38b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6801","nonce":2431315515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6803","nonce":2431315515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6807","nonce":2431315515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6805","nonce":2431315515}]},"public_addr":"172.21.15.73:6801/2431315515","cluster_addr":"172.21.15.73:6803/2431315515","heartbeat_back_addr":"172.21.15.73:6807/2431315515","heartbeat_front_addr":"172.21.15.73:6805/2431315515","state":["exists","up"]},{"osd":2,"uuid":"8040902e-b0b8-4a21-bf64-ce1c222115ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6809","nonce":407236597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6811","nonce":407236597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6815","nonce":407236597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6813","nonce":407236597}]},"public_addr":"172.21.15.73:6809/407236597","cluster_addr":"172.21.15.73:6811/407236597","heartbeat_back_addr":"172.21.15.73:6815/407236597","heartbeat_front_addr":"172.21.15.73:6813/407236597","state":["exists","up"]},{"osd":3,"uuid":"1bab19ee-3775-4ce1-a4ce-cf7cda3bbbf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6817","nonce":4291100709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6821","nonce":4291100709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6829","nonce":4291100709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6825","nonce":4291100709}]},"public_addr":"172.21.15.73:6817/4291100709","cluster_addr":"172.21.15.73:6821/4291100709","heartbeat_back_addr":"172.21.15.73:6829/4291100709","heartbeat_front_addr":"172.21.15.73:6825/4291100709","state":["exists","up"]},{"osd":4,"uuid":"b0c74337-8fe4-47dc-b3da-2d07591b1f6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6817","nonce":3703256194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6819","nonce":3703256194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6823","nonce":3703256194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6821","nonce":3703256194}]},"public_addr":"172.21.15.142:6817/3703256194","cluster_addr":"172.21.15.142:6819/3703256194","heartbeat_back_addr":"172.21.15.142:6823/3703256194","heartbeat_front_addr":"172.21.15.142:6821/3703256194","state":["exists","up"]},{"osd":5,"uuid":"9ce36410-a29a-42c6-99f4-f95d4afdd7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6825","nonce":4271575803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6827","nonce":4271575803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6831","nonce":4271575803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6829","nonce":4271575803}]},"public_addr":"172.21.15.142:6825/4271575803","cluster_addr":"172.21.15.142:6827/4271575803","heartbeat_back_addr":"172.21.15.142:6831/4271575803","heartbeat_front_addr":"172.21.15.142:6829/4271575803","state":["exists","up"]},{"osd":6,"uuid":"aec4264a-64ac-428e-a860-d2920a304019","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6801","nonce":1772722570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6803","nonce":1772722570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6807","nonce":1772722570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6805","nonce":1772722570}]},"public_addr":"172.21.15.142:6801/1772722570","cluster_addr":"172.21.15.142:6803/1772722570","heartbeat_back_addr":"172.21.15.142:6807/1772722570","heartbeat_front_addr":"172.21.15.142:6805/1772722570","state":["exists","up"]},{"osd":7,"uuid":"fe599052-8e5a-4c7a-91e7-52d1bae24a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6809","nonce":3910589675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6811","nonce":3910589675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6815","nonce":3910589675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6813","nonce":3910589675}]},"public_addr":"172.21.15.142:6809/3910589675","cluster_addr":"172.21.15.142:6811/3910589675","heartbeat_back_addr":"172.21.15.142:6815/3910589675","heartbeat_front_addr":"172.21.15.142:6813/3910589675","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.835096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.587210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.786547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.778004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.843740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.791160+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.837992+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.718722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:08:32.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.801+0000 7ff0080a5640 1 -- 172.21.15.73:0/2518315055 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fefe406c530 msgr2=0x7fefe406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:32.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.801+0000 7ff0080a5640 1 --2- 172.21.15.73:0/2518315055 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fefe406c530 0x7fefe406e9f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7feffc009560 tx=0x7feffc009190 comp rx=0 tx=0).stop 2024-03-29T04:08:32.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.801+0000 7ff0080a5640 1 -- 172.21.15.73:0/2518315055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0000ae1b0 msgr2=0x7ff0001f8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:32.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.801+0000 7ff0080a5640 1 --2- 172.21.15.73:0/2518315055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0000ae1b0 0x7ff0001f8010 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7feff00010e0 tx=0x7feff000c890 comp rx=0 tx=0).stop 2024-03-29T04:08:32.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.801+0000 7ff0080a5640 1 -- 172.21.15.73:0/2518315055 shutdown_connections 2024-03-29T04:08:32.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.801+0000 7ff0080a5640 1 --2- 172.21.15.73:0/2518315055 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fefe406c530 0x7fefe406e9f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:32.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.801+0000 7ff0080a5640 1 --2- 172.21.15.73:0/2518315055 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff00015e870 0x7ff00015a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:32.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.801+0000 7ff0080a5640 1 --2- 172.21.15.73:0/2518315055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0000ae1b0 0x7ff0001f8010 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:32.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.801+0000 7ff0080a5640 1 --2- 172.21.15.73:0/2518315055 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff00006bc20 0x7ff0001544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:32.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.801+0000 7ff0080a5640 1 -- 172.21.15.73:0/2518315055 >> 172.21.15.73:0/2518315055 conn(0x7ff0000b66f0 msgr2=0x7ff0000b0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:32.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.801+0000 7ff0080a5640 1 -- 172.21.15.73:0/2518315055 shutdown_connections 2024-03-29T04:08:32.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.801+0000 7ff0080a5640 1 -- 172.21.15.73:0/2518315055 wait complete. 2024-03-29T04:08:32.792 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-29T04:07:59.537301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-29T04:08:09.570906+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-29T04:08:10.882349+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-29T04:08:32.792 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-29T04:08:32.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.918+0000 7f1bf698d640 1 Processor -- start 2024-03-29T04:08:32.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.918+0000 7f1bf698d640 1 -- start start 2024-03-29T04:08:32.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.919+0000 7f1bf698d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1bf015ad60 0x7f1bf00ce120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:32.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.919+0000 7f1bf698d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bf00b4460 0x7f1bf00b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:32.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.919+0000 7f1bf698d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bf00c70a0 con 0x7f1bf00b49b0 2024-03-29T04:08:32.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.919+0000 7f1bf698d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f1bf00c5ce0 con 0x7f1bf015ad60 2024-03-29T04:08:32.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.919+0000 7f1bf698d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f1bf00c5fc0 con 0x7f1bf00b4460 2024-03-29T04:08:32.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.919+0000 7f1beffff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1bf015ad60 0x7f1bf00ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:32.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.919+0000 7f1bef7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bf00b4460 0x7f1bf00b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:32.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.919+0000 7f1beffff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1bf015ad60 0x7f1bf00ce120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:34076/0 (socket says 172.21.15.73:34076) 2024-03-29T04:08:32.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.919+0000 7f1beffff640 1 -- 172.21.15.73:0/2875799576 learned_addr learned my addr 172.21.15.73:0/2875799576 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:32.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.919+0000 7f1bf4f2a640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f1bf00b49b0 0x7f1bf00c6990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.73:40296/0 (socket says 172.21.15.73:40296) 2024-03-29T04:08:32.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.919+0000 7f1bef7fe640 1 --2- 172.21.15.73:0/2875799576 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bf00b4460 0x7f1bf00b31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:40658/0 (socket says 172.21.15.73:40658) 2024-03-29T04:08:32.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.919+0000 7f1beffff640 1 -- 172.21.15.73:0/2875799576 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bf00b4460 msgr2=0x7f1bf00b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:32.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.919+0000 7f1beffff640 1 --2- 172.21.15.73:0/2875799576 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bf00b4460 0x7f1bf00b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:32.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.919+0000 7f1beffff640 1 -- 172.21.15.73:0/2875799576 >> v1:172.21.15.142:6789/0 conn(0x7f1bf00b49b0 legacy=0x7f1bf00c6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:32.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.919+0000 7f1beeffd640 1 -- 172.21.15.73:0/2875799576 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2255415459 0 0) 0x7f1bf00c70a0 con 0x7f1bf00b49b0 2024-03-29T04:08:32.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.919+0000 7f1beffff640 1 -- 172.21.15.73:0/2875799576 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bf00cfd90 con 0x7f1bf015ad60 2024-03-29T04:08:32.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.920+0000 7f1beffff640 1 --2- 172.21.15.73:0/2875799576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bf015ad60 0x7f1bf00ce120 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1be400bb10 tx=0x7f1be402e0c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a28f541fd57d238a server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:32.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.920+0000 7f1beeffd640 1 -- 172.21.15.73:0/2875799576 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be403b070 con 0x7f1bf015ad60 2024-03-29T04:08:32.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.920+0000 7f1beeffd640 1 -- 172.21.15.73:0/2875799576 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1be4036440 con 0x7f1bf015ad60 2024-03-29T04:08:32.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.920+0000 7f1beeffd640 1 -- 172.21.15.73:0/2875799576 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be4036810 con 0x7f1bf015ad60 2024-03-29T04:08:32.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.921+0000 7f1bf698d640 1 -- 172.21.15.73:0/2875799576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bf015ad60 msgr2=0x7f1bf00ce120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:32.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.921+0000 7f1bf698d640 1 --2- 172.21.15.73:0/2875799576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bf015ad60 0x7f1bf00ce120 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1be400bb10 tx=0x7f1be402e0c0 comp rx=0 tx=0).stop 2024-03-29T04:08:32.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.921+0000 7f1bf698d640 1 -- 172.21.15.73:0/2875799576 shutdown_connections 2024-03-29T04:08:32.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.921+0000 7f1bf698d640 1 --2- 172.21.15.73:0/2875799576 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bf00b4460 0x7f1bf00b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:32.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.921+0000 7f1bf698d640 1 --2- 172.21.15.73:0/2875799576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bf015ad60 0x7f1bf00ce120 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:32.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.921+0000 7f1bf698d640 1 -- 172.21.15.73:0/2875799576 >> 172.21.15.73:0/2875799576 conn(0x7f1bf00d0450 msgr2=0x7f1bf00d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:32.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.921+0000 7f1bf698d640 1 -- 172.21.15.73:0/2875799576 shutdown_connections 2024-03-29T04:08:32.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.921+0000 7f1bf698d640 1 -- 172.21.15.73:0/2875799576 wait complete. 2024-03-29T04:08:32.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.922+0000 7f1bf698d640 1 Processor -- start 2024-03-29T04:08:32.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.922+0000 7f1bf698d640 1 -- start start 2024-03-29T04:08:32.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.923+0000 7f1bf698d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bf00b4460 0x7f1bf0153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:32.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.923+0000 7f1bf698d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bf00b49b0 0x7f1bf00ad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:32.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.923+0000 7f1bf698d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bf015ad60 0x7f1bf0152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:32.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.923+0000 7f1bf698d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf00cfb30 con 0x7f1bf015ad60 2024-03-29T04:08:32.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.923+0000 7f1bf698d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf00cf9b0 con 0x7f1bf00b49b0 2024-03-29T04:08:32.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.923+0000 7f1bf698d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f1bf00b2100 con 0x7f1bf00b4460 2024-03-29T04:08:32.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.923+0000 7f1bf4f2a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bf015ad60 0x7f1bf0152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:32.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.923+0000 7f1bef7fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bf00b49b0 0x7f1bf00ad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:32.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.923+0000 7f1bf4f2a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bf015ad60 0x7f1bf0152ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45674/0 (socket says 172.21.15.73:45674) 2024-03-29T04:08:32.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.923+0000 7f1bf4f2a640 1 -- 172.21.15.73:0/1410966945 learned_addr learned my addr 172.21.15.73:0/1410966945 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:32.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.923+0000 7f1beffff640 1 --2- 172.21.15.73:0/1410966945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bf00b4460 0x7f1bf0153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:32.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.924+0000 7f1bef7fe640 1 -- 172.21.15.73:0/1410966945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bf00b4460 msgr2=0x7f1bf0153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:32.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.924+0000 7f1bef7fe640 1 --2- 172.21.15.73:0/1410966945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bf00b4460 0x7f1bf0153ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:32.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.924+0000 7f1bef7fe640 1 -- 172.21.15.73:0/1410966945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bf015ad60 msgr2=0x7f1bf0152ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:32.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.924+0000 7f1bef7fe640 1 --2- 172.21.15.73:0/1410966945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bf015ad60 0x7f1bf0152ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:32.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.924+0000 7f1bef7fe640 1 -- 172.21.15.73:0/1410966945 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bf00ad8f0 con 0x7f1bf00b49b0 2024-03-29T04:08:32.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.924+0000 7f1bf4f2a640 1 --2- 172.21.15.73:0/1410966945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bf015ad60 0x7f1bf0152ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:08:32.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.924+0000 7f1bef7fe640 1 --2- 172.21.15.73:0/1410966945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bf00b49b0 0x7f1bf00ad1a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1be000e850 tx=0x7f1be000ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:32.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.924+0000 7f1becff9640 1 -- 172.21.15.73:0/1410966945 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be0017070 con 0x7f1bf00b49b0 2024-03-29T04:08:32.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.924+0000 7f1becff9640 1 -- 172.21.15.73:0/1410966945 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1be000c940 con 0x7f1bf00b49b0 2024-03-29T04:08:32.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.924+0000 7f1becff9640 1 -- 172.21.15.73:0/1410966945 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be000cd10 con 0x7f1bf00b49b0 2024-03-29T04:08:32.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.924+0000 7f1bf698d640 1 -- 172.21.15.73:0/1410966945 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bf00adbd0 con 0x7f1bf00b49b0 2024-03-29T04:08:32.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.924+0000 7f1bf698d640 1 -- 172.21.15.73:0/1410966945 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bf00ae190 con 0x7f1bf00b49b0 2024-03-29T04:08:32.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.925+0000 7f1bf698d640 1 -- 172.21.15.73:0/1410966945 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bf009e520 con 0x7f1bf00b49b0 2024-03-29T04:08:32.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.925+0000 7f1becff9640 1 -- 172.21.15.73:0/1410966945 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f1be001a070 con 0x7f1bf00b49b0 2024-03-29T04:08:32.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.926+0000 7f1becff9640 1 --2- 172.21.15.73:0/1410966945 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f1bdc06c530 0x7f1bdc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:32.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.926+0000 7f1becff9640 1 -- 172.21.15.73:0/1410966945 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1be008b570 con 0x7f1bf00b49b0 2024-03-29T04:08:32.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.926+0000 7f1beffff640 1 --2- 172.21.15.73:0/1410966945 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f1bdc06c530 0x7f1bdc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:32.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.926+0000 7f1beffff640 1 --2- 172.21.15.73:0/1410966945 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f1bdc06c530 0x7f1bdc06e9f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1be4038000 tx=0x7f1be4032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:32.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:32.930+0000 7f1becff9640 1 -- 172.21.15.73:0/1410966945 <== mon.1 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f1be0059520 con 0x7f1bf00b49b0 2024-03-29T04:08:33.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.111+0000 7f1bf698d640 1 -- 172.21.15.73:0/1410966945 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1bf004f9d0 con 0x7f1bf00b49b0 2024-03-29T04:08:33.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.112+0000 7f1becff9640 1 -- 172.21.15.73:0/1410966945 <== mon.1 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f1be005d820 con 0x7f1bf00b49b0 2024-03-29T04:08:33.092 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-03-29T04:08:33.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.114+0000 7f1bf698d640 1 -- 172.21.15.73:0/1410966945 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f1bdc06c530 msgr2=0x7f1bdc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:33.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.114+0000 7f1bf698d640 1 --2- 172.21.15.73:0/1410966945 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f1bdc06c530 0x7f1bdc06e9f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1be4038000 tx=0x7f1be4032000 comp rx=0 tx=0).stop 2024-03-29T04:08:33.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.114+0000 7f1bf698d640 1 -- 172.21.15.73:0/1410966945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bf00b49b0 msgr2=0x7f1bf00ad1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:33.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.114+0000 7f1bf698d640 1 --2- 172.21.15.73:0/1410966945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bf00b49b0 0x7f1bf00ad1a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1be000e850 tx=0x7f1be000ed10 comp rx=0 tx=0).stop 2024-03-29T04:08:33.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.114+0000 7f1bf698d640 1 -- 172.21.15.73:0/1410966945 shutdown_connections 2024-03-29T04:08:33.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.114+0000 7f1bf698d640 1 --2- 172.21.15.73:0/1410966945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bf015ad60 0x7f1bf0152ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:33.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.114+0000 7f1bf698d640 1 --2- 172.21.15.73:0/1410966945 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f1bdc06c530 0x7f1bdc06e9f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:33.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.114+0000 7f1bf698d640 1 --2- 172.21.15.73:0/1410966945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1bf00b49b0 0x7f1bf00ad1a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:33.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.114+0000 7f1bf698d640 1 --2- 172.21.15.73:0/1410966945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1bf00b4460 0x7f1bf0153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:33.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.114+0000 7f1bf698d640 1 -- 172.21.15.73:0/1410966945 >> 172.21.15.73:0/1410966945 conn(0x7f1bf00d0450 msgr2=0x7f1bf0072200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:33.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.114+0000 7f1bf698d640 1 -- 172.21.15.73:0/1410966945 shutdown_connections 2024-03-29T04:08:33.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.114+0000 7f1bf698d640 1 -- 172.21.15.73:0/1410966945 wait complete. 2024-03-29T04:08:33.104 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-29T04:08:33.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.229+0000 7f9e4dbf4640 1 Processor -- start 2024-03-29T04:08:33.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.230+0000 7f9e4dbf4640 1 -- start start 2024-03-29T04:08:33.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.230+0000 7f9e4dbf4640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9e4815e920 0x7f9e480d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:33.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.230+0000 7f9e4dbf4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e480cfde0 0x7f9e480d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:33.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.230+0000 7f9e4dbf4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9e480d0f90 0x7f9e480d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:33.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.230+0000 7f9e4dbf4640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f9e480d3780 con 0x7f9e4815e920 2024-03-29T04:08:33.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.230+0000 7f9e4dbf4640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f9e4815ed00 con 0x7f9e480d0f90 2024-03-29T04:08:33.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.230+0000 7f9e4dbf4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9e480d21e0 con 0x7f9e480cfde0 2024-03-29T04:08:33.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.230+0000 7f9e477fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9e4815e920 0x7f9e480d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:33.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.230+0000 7f9e477fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9e4815e920 0x7f9e480d3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45690/0 (socket says 172.21.15.73:45690) 2024-03-29T04:08:33.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.230+0000 7f9e477fe640 1 -- 172.21.15.73:0/3088503799 learned_addr learned my addr 172.21.15.73:0/3088503799 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:33.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.231+0000 7f9e3effd640 1 --2- 172.21.15.73:0/3088503799 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e480cfde0 0x7f9e480d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:33.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.231+0000 7f9e47fff640 1 --2- 172.21.15.73:0/3088503799 >> v2:172.21.15.142:3300/0 conn(0x7f9e480d0f90 0x7f9e480d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:33.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.231+0000 7f9e477fe640 1 -- 172.21.15.73:0/3088503799 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e480cfde0 msgr2=0x7f9e480d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:33.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.231+0000 7f9e477fe640 1 --2- 172.21.15.73:0/3088503799 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e480cfde0 0x7f9e480d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:33.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.231+0000 7f9e477fe640 1 -- 172.21.15.73:0/3088503799 >> v2:172.21.15.142:3300/0 conn(0x7f9e480d0f90 msgr2=0x7f9e480d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:33.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.231+0000 7f9e477fe640 1 --2- 172.21.15.73:0/3088503799 >> v2:172.21.15.142:3300/0 conn(0x7f9e480d0f90 0x7f9e480d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:33.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.231+0000 7f9e477fe640 1 -- 172.21.15.73:0/3088503799 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e480d2480 con 0x7f9e4815e920 2024-03-29T04:08:33.212 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.231+0000 7f9e477fe640 1 --2- 172.21.15.73:0/3088503799 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e4815e920 0x7f9e480d3240 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9e38009870 tx=0x7f9e3802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a41b2d9458309e4d server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:33.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.232+0000 7f9e46ffd640 1 -- 172.21.15.73:0/3088503799 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e38035020 con 0x7f9e4815e920 2024-03-29T04:08:33.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.232+0000 7f9e46ffd640 1 -- 172.21.15.73:0/3088503799 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e38031640 con 0x7f9e4815e920 2024-03-29T04:08:33.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.232+0000 7f9e46ffd640 1 -- 172.21.15.73:0/3088503799 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3802d040 con 0x7f9e4815e920 2024-03-29T04:08:33.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.232+0000 7f9e4dbf4640 1 -- 172.21.15.73:0/3088503799 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e4815e920 msgr2=0x7f9e480d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:33.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.232+0000 7f9e4dbf4640 1 --2- 172.21.15.73:0/3088503799 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e4815e920 0x7f9e480d3240 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9e38009870 tx=0x7f9e3802b8f0 comp rx=0 tx=0).stop 2024-03-29T04:08:33.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.232+0000 7f9e4dbf4640 1 -- 172.21.15.73:0/3088503799 shutdown_connections 2024-03-29T04:08:33.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.232+0000 7f9e4dbf4640 1 --2- 172.21.15.73:0/3088503799 >> v2:172.21.15.142:3300/0 conn(0x7f9e480d0f90 0x7f9e480d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:33.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.232+0000 7f9e4dbf4640 1 --2- 172.21.15.73:0/3088503799 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e480cfde0 0x7f9e480d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:33.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.232+0000 7f9e4dbf4640 1 --2- 172.21.15.73:0/3088503799 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e4815e920 0x7f9e480d3240 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:33.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.232+0000 7f9e4dbf4640 1 -- 172.21.15.73:0/3088503799 >> 172.21.15.73:0/3088503799 conn(0x7f9e4808bfc0 msgr2=0x7f9e480d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:33.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.232+0000 7f9e4dbf4640 1 -- 172.21.15.73:0/3088503799 shutdown_connections 2024-03-29T04:08:33.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.232+0000 7f9e4dbf4640 1 -- 172.21.15.73:0/3088503799 wait complete. 2024-03-29T04:08:33.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.233+0000 7f9e4dbf4640 1 Processor -- start 2024-03-29T04:08:33.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.234+0000 7f9e4dbf4640 1 -- start start 2024-03-29T04:08:33.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.234+0000 7f9e4dbf4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e480cfde0 0x7f9e4814cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:33.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.234+0000 7f9e4dbf4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e480d0f90 0x7f9e480cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:33.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.234+0000 7f9e4dbf4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e4815e920 0x7f9e4815ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:33.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.234+0000 7f9e4dbf4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9e480d2d20 con 0x7f9e4815e920 2024-03-29T04:08:33.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.234+0000 7f9e4dbf4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9e480d2a40 con 0x7f9e480d0f90 2024-03-29T04:08:33.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.234+0000 7f9e4dbf4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9e480d4ef0 con 0x7f9e480cfde0 2024-03-29T04:08:33.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.234+0000 7f9e47fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e4815e920 0x7f9e4815ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:33.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.234+0000 7f9e47fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e4815e920 0x7f9e4815ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45704/0 (socket says 172.21.15.73:45704) 2024-03-29T04:08:33.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.234+0000 7f9e47fff640 1 -- 172.21.15.73:0/3983027885 learned_addr learned my addr 172.21.15.73:0/3983027885 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:33.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.235+0000 7f9e3effd640 1 --2- 172.21.15.73:0/3983027885 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e480d0f90 0x7f9e480cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:33.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.235+0000 7f9e477fe640 1 --2- 172.21.15.73:0/3983027885 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e480cfde0 0x7f9e4814cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:33.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.235+0000 7f9e47fff640 1 -- 172.21.15.73:0/3983027885 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e480cfde0 msgr2=0x7f9e4814cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:33.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.235+0000 7f9e47fff640 1 --2- 172.21.15.73:0/3983027885 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e480cfde0 0x7f9e4814cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:33.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.235+0000 7f9e47fff640 1 -- 172.21.15.73:0/3983027885 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e480d0f90 msgr2=0x7f9e480cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:33.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.235+0000 7f9e47fff640 1 --2- 172.21.15.73:0/3983027885 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e480d0f90 0x7f9e480cc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:33.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.235+0000 7f9e47fff640 1 -- 172.21.15.73:0/3983027885 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e480cd200 con 0x7f9e4815e920 2024-03-29T04:08:33.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.235+0000 7f9e47fff640 1 --2- 172.21.15.73:0/3983027885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e4815e920 0x7f9e4815ff00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9e4000efc0 tx=0x7f9e4000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:33.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.235+0000 7f9e44ff9640 1 -- 172.21.15.73:0/3983027885 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e40018020 con 0x7f9e4815e920 2024-03-29T04:08:33.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.235+0000 7f9e44ff9640 1 -- 172.21.15.73:0/3983027885 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e40014480 con 0x7f9e4815e920 2024-03-29T04:08:33.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.235+0000 7f9e4dbf4640 1 -- 172.21.15.73:0/3983027885 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e480cd4e0 con 0x7f9e4815e920 2024-03-29T04:08:33.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.235+0000 7f9e44ff9640 1 -- 172.21.15.73:0/3983027885 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e40014870 con 0x7f9e4815e920 2024-03-29T04:08:33.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.235+0000 7f9e4dbf4640 1 -- 172.21.15.73:0/3983027885 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e480cdaa0 con 0x7f9e4815e920 2024-03-29T04:08:33.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.236+0000 7f9e4dbf4640 1 -- 172.21.15.73:0/3983027885 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e480a2560 con 0x7f9e4815e920 2024-03-29T04:08:33.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.237+0000 7f9e44ff9640 1 -- 172.21.15.73:0/3983027885 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f9e40005d10 con 0x7f9e4815e920 2024-03-29T04:08:33.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.237+0000 7f9e44ff9640 1 --2- 172.21.15.73:0/3983027885 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9e2806c530 0x7f9e2806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:33.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.237+0000 7f9e44ff9640 1 -- 172.21.15.73:0/3983027885 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9e4008bfa0 con 0x7f9e4815e920 2024-03-29T04:08:33.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.237+0000 7f9e477fe640 1 --2- 172.21.15.73:0/3983027885 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9e2806c530 0x7f9e2806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:33.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.238+0000 7f9e477fe640 1 --2- 172.21.15.73:0/3983027885 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9e2806c530 0x7f9e2806e9f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9e38036000 tx=0x7f9e3803c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:33.221 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.242+0000 7f9e44ff9640 1 -- 172.21.15.73:0/3983027885 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f9e40022070 con 0x7f9e4815e920 2024-03-29T04:08:33.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.431+0000 7f9e4dbf4640 1 -- 172.21.15.73:0/3983027885 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f9e4804f9d0 con 0x7f9e4815e920 2024-03-29T04:08:33.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.432+0000 7f9e44ff9640 1 -- 172.21.15.73:0/3983027885 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f9e40010040 con 0x7f9e4815e920 2024-03-29T04:08:33.413 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-03-29T04:08:33.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.434+0000 7f9e4dbf4640 1 -- 172.21.15.73:0/3983027885 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9e2806c530 msgr2=0x7f9e2806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:33.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.434+0000 7f9e4dbf4640 1 --2- 172.21.15.73:0/3983027885 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9e2806c530 0x7f9e2806e9f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9e38036000 tx=0x7f9e3803c040 comp rx=0 tx=0).stop 2024-03-29T04:08:33.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.434+0000 7f9e4dbf4640 1 -- 172.21.15.73:0/3983027885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e4815e920 msgr2=0x7f9e4815ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:33.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.434+0000 7f9e4dbf4640 1 --2- 172.21.15.73:0/3983027885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e4815e920 0x7f9e4815ff00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9e4000efc0 tx=0x7f9e4000c490 comp rx=0 tx=0).stop 2024-03-29T04:08:33.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.434+0000 7f9e4dbf4640 1 -- 172.21.15.73:0/3983027885 shutdown_connections 2024-03-29T04:08:33.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.434+0000 7f9e4dbf4640 1 --2- 172.21.15.73:0/3983027885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e4815e920 0x7f9e4815ff00 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:33.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.434+0000 7f9e4dbf4640 1 --2- 172.21.15.73:0/3983027885 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9e2806c530 0x7f9e2806e9f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:33.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.434+0000 7f9e4dbf4640 1 --2- 172.21.15.73:0/3983027885 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9e480d0f90 0x7f9e480cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:33.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.434+0000 7f9e4dbf4640 1 --2- 172.21.15.73:0/3983027885 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9e480cfde0 0x7f9e4814cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:33.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.434+0000 7f9e4dbf4640 1 -- 172.21.15.73:0/3983027885 >> 172.21.15.73:0/3983027885 conn(0x7f9e4808bfc0 msgr2=0x7f9e480cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:33.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.434+0000 7f9e4dbf4640 1 -- 172.21.15.73:0/3983027885 shutdown_connections 2024-03-29T04:08:33.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.434+0000 7f9e4dbf4640 1 -- 172.21.15.73:0/3983027885 wait complete. 2024-03-29T04:08:33.425 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-29T04:08:33.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.549+0000 7f3d736c3640 1 Processor -- start 2024-03-29T04:08:33.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.549+0000 7f3d736c3640 1 -- start start 2024-03-29T04:08:33.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.550+0000 7f3d736c3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3d6c161f50 0x7f3d6c06fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:33.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.550+0000 7f3d736c3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d6c09aa30 0x7f3d6c09ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:33.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.550+0000 7f3d736c3640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d6c0d06f0 con 0x7f3d6c162420 2024-03-29T04:08:33.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.550+0000 7f3d736c3640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f3d6c09b3d0 con 0x7f3d6c161f50 2024-03-29T04:08:33.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.550+0000 7f3d736c3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f3d6c15f300 con 0x7f3d6c09aa30 2024-03-29T04:08:33.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.550+0000 7f3d70c5e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d6c09aa30 0x7f3d6c09ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:33.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.550+0000 7f3d7145f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3d6c161f50 0x7f3d6c06fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:33.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.550+0000 7f3d71c60640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f3d6c162420 0x7f3d6c162850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.73:40302/0 (socket says 172.21.15.73:40302) 2024-03-29T04:08:33.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.550+0000 7f3d70c5e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d6c09aa30 0x7f3d6c09ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:40688/0 (socket says 172.21.15.73:40688) 2024-03-29T04:08:33.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.550+0000 7f3d71c60640 1 -- 172.21.15.73:0/3619476826 learned_addr learned my addr 172.21.15.73:0/3619476826 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:33.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.550+0000 7f3d63fff640 1 -- 172.21.15.73:0/3619476826 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 935405818 0 0) 0x7f3d6c0d06f0 con 0x7f3d6c162420 2024-03-29T04:08:33.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.550+0000 7f3d63fff640 1 -- 172.21.15.73:0/3619476826 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d58003520 con 0x7f3d6c162420 2024-03-29T04:08:33.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.550+0000 7f3d70c5e640 1 -- 172.21.15.73:0/3619476826 >> v2:172.21.15.142:3300/0 conn(0x7f3d6c161f50 msgr2=0x7f3d6c06fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:33.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.550+0000 7f3d70c5e640 1 --2- 172.21.15.73:0/3619476826 >> v2:172.21.15.142:3300/0 conn(0x7f3d6c161f50 0x7f3d6c06fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:33.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.550+0000 7f3d70c5e640 1 -- 172.21.15.73:0/3619476826 >> v1:172.21.15.142:6789/0 conn(0x7f3d6c162420 legacy=0x7f3d6c162850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:33.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.550+0000 7f3d70c5e640 1 -- 172.21.15.73:0/3619476826 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d6c15f5e0 con 0x7f3d6c09aa30 2024-03-29T04:08:33.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.550+0000 7f3d7145f640 1 --2- 172.21.15.73:0/3619476826 >> v2:172.21.15.142:3300/0 conn(0x7f3d6c161f50 0x7f3d6c06fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:08:33.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.551+0000 7f3d70c5e640 1 --2- 172.21.15.73:0/3619476826 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d6c09aa30 0x7f3d6c09ae90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c0097a0 tx=0x7f3d5c02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ecb7433e3478a74 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:33.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.551+0000 7f3d63fff640 1 -- 172.21.15.73:0/3619476826 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c0315a0 con 0x7f3d6c09aa30 2024-03-29T04:08:33.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.551+0000 7f3d63fff640 1 -- 172.21.15.73:0/3619476826 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d5c037070 con 0x7f3d6c09aa30 2024-03-29T04:08:33.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.551+0000 7f3d63fff640 1 -- 172.21.15.73:0/3619476826 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c031960 con 0x7f3d6c09aa30 2024-03-29T04:08:33.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.552+0000 7f3d736c3640 1 -- 172.21.15.73:0/3619476826 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d6c09aa30 msgr2=0x7f3d6c09ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:33.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.552+0000 7f3d736c3640 1 --2- 172.21.15.73:0/3619476826 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d6c09aa30 0x7f3d6c09ae90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c0097a0 tx=0x7f3d5c02b840 comp rx=0 tx=0).stop 2024-03-29T04:08:33.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.552+0000 7f3d736c3640 1 -- 172.21.15.73:0/3619476826 shutdown_connections 2024-03-29T04:08:33.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.552+0000 7f3d736c3640 1 --2- 172.21.15.73:0/3619476826 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d6c09aa30 0x7f3d6c09ae90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:33.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.552+0000 7f3d736c3640 1 --2- 172.21.15.73:0/3619476826 >> v2:172.21.15.142:3300/0 conn(0x7f3d6c161f50 0x7f3d6c06fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:33.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.552+0000 7f3d736c3640 1 -- 172.21.15.73:0/3619476826 >> 172.21.15.73:0/3619476826 conn(0x7f3d6c0b3fa0 msgr2=0x7f3d6c0b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:33.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.552+0000 7f3d736c3640 1 -- 172.21.15.73:0/3619476826 shutdown_connections 2024-03-29T04:08:33.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.552+0000 7f3d736c3640 1 -- 172.21.15.73:0/3619476826 wait complete. 2024-03-29T04:08:33.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.553+0000 7f3d736c3640 1 Processor -- start 2024-03-29T04:08:33.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.553+0000 7f3d736c3640 1 -- start start 2024-03-29T04:08:33.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.554+0000 7f3d736c3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d6c09aa30 0x7f3d6c06ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:33.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.554+0000 7f3d736c3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d6c161f50 0x7f3d6c1f3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:33.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.554+0000 7f3d736c3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d6c162420 0x7f3d6c0c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:33.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.554+0000 7f3d736c3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3d6c160220 con 0x7f3d6c161f50 2024-03-29T04:08:33.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.554+0000 7f3d736c3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3d6c15fba0 con 0x7f3d6c162420 2024-03-29T04:08:33.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.554+0000 7f3d736c3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f3d6c1603a0 con 0x7f3d6c09aa30 2024-03-29T04:08:33.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.554+0000 7f3d70c5e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d6c161f50 0x7f3d6c1f3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:33.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.554+0000 7f3d7145f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d6c09aa30 0x7f3d6c06ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:33.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.554+0000 7f3d70c5e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d6c161f50 0x7f3d6c1f3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45712/0 (socket says 172.21.15.73:45712) 2024-03-29T04:08:33.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.554+0000 7f3d70c5e640 1 -- 172.21.15.73:0/2046780390 learned_addr learned my addr 172.21.15.73:0/2046780390 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:33.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.554+0000 7f3d71c60640 1 --2- 172.21.15.73:0/2046780390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d6c162420 0x7f3d6c0c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:33.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.554+0000 7f3d70c5e640 1 -- 172.21.15.73:0/2046780390 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d6c09aa30 msgr2=0x7f3d6c06ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:33.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.554+0000 7f3d70c5e640 1 --2- 172.21.15.73:0/2046780390 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d6c09aa30 0x7f3d6c06ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:33.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.554+0000 7f3d70c5e640 1 -- 172.21.15.73:0/2046780390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d6c162420 msgr2=0x7f3d6c0c81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:33.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.554+0000 7f3d70c5e640 1 --2- 172.21.15.73:0/2046780390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d6c162420 0x7f3d6c0c81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:33.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.554+0000 7f3d70c5e640 1 -- 172.21.15.73:0/2046780390 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d6c154f60 con 0x7f3d6c161f50 2024-03-29T04:08:33.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.554+0000 7f3d70c5e640 1 --2- 172.21.15.73:0/2046780390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d6c161f50 0x7f3d6c1f3fa0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c034040 tx=0x7f3d5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:33.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.554+0000 7f3d61ffb640 1 -- 172.21.15.73:0/2046780390 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c032630 con 0x7f3d6c161f50 2024-03-29T04:08:33.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.554+0000 7f3d61ffb640 1 -- 172.21.15.73:0/2046780390 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d5c0327d0 con 0x7f3d6c161f50 2024-03-29T04:08:33.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.554+0000 7f3d736c3640 1 -- 172.21.15.73:0/2046780390 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d6c0b7bd0 con 0x7f3d6c161f50 2024-03-29T04:08:33.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.554+0000 7f3d61ffb640 1 -- 172.21.15.73:0/2046780390 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c032bc0 con 0x7f3d6c161f50 2024-03-29T04:08:33.538 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.555+0000 7f3d736c3640 1 -- 172.21.15.73:0/2046780390 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d6c0b8190 con 0x7f3d6c161f50 2024-03-29T04:08:33.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.556+0000 7f3d736c3640 1 -- 172.21.15.73:0/2046780390 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d6c0a05c0 con 0x7f3d6c161f50 2024-03-29T04:08:33.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.556+0000 7f3d61ffb640 1 -- 172.21.15.73:0/2046780390 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f3d5c03b3f0 con 0x7f3d6c161f50 2024-03-29T04:08:33.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.556+0000 7f3d61ffb640 1 --2- 172.21.15.73:0/2046780390 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3d5006c530 0x7f3d5006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:33.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.556+0000 7f3d61ffb640 1 -- 172.21.15.73:0/2046780390 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3d5c02f030 con 0x7f3d6c161f50 2024-03-29T04:08:33.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.556+0000 7f3d7145f640 1 --2- 172.21.15.73:0/2046780390 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3d5006c530 0x7f3d5006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:33.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.557+0000 7f3d7145f640 1 --2- 172.21.15.73:0/2046780390 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3d5006c530 0x7f3d5006e9f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3d68009560 tx=0x7f3d68009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:33.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.561+0000 7f3d61ffb640 1 -- 172.21.15.73:0/2046780390 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f3d5c040070 con 0x7f3d6c161f50 2024-03-29T04:08:33.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.736+0000 7f3d736c3640 1 -- 172.21.15.73:0/2046780390 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f3d6c04f9d0 con 0x7f3d6c161f50 2024-03-29T04:08:33.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.737+0000 7f3d61ffb640 1 -- 172.21.15.73:0/2046780390 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f3d5c07b4f0 con 0x7f3d6c161f50 2024-03-29T04:08:33.718 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-29T04:08:33.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.739+0000 7f3d736c3640 1 -- 172.21.15.73:0/2046780390 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3d5006c530 msgr2=0x7f3d5006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:33.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.739+0000 7f3d736c3640 1 --2- 172.21.15.73:0/2046780390 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3d5006c530 0x7f3d5006e9f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3d68009560 tx=0x7f3d68009190 comp rx=0 tx=0).stop 2024-03-29T04:08:33.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.739+0000 7f3d736c3640 1 -- 172.21.15.73:0/2046780390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d6c161f50 msgr2=0x7f3d6c1f3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:33.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.739+0000 7f3d736c3640 1 --2- 172.21.15.73:0/2046780390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d6c161f50 0x7f3d6c1f3fa0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c034040 tx=0x7f3d5c0046c0 comp rx=0 tx=0).stop 2024-03-29T04:08:33.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.739+0000 7f3d736c3640 1 -- 172.21.15.73:0/2046780390 shutdown_connections 2024-03-29T04:08:33.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.739+0000 7f3d736c3640 1 --2- 172.21.15.73:0/2046780390 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3d5006c530 0x7f3d5006e9f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:33.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.739+0000 7f3d736c3640 1 --2- 172.21.15.73:0/2046780390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d6c162420 0x7f3d6c0c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:33.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.739+0000 7f3d736c3640 1 --2- 172.21.15.73:0/2046780390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3d6c161f50 0x7f3d6c1f3fa0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:33.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.739+0000 7f3d736c3640 1 --2- 172.21.15.73:0/2046780390 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3d6c09aa30 0x7f3d6c06ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:33.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.739+0000 7f3d736c3640 1 -- 172.21.15.73:0/2046780390 >> 172.21.15.73:0/2046780390 conn(0x7f3d6c0b3fa0 msgr2=0x7f3d6c0b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:33.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.739+0000 7f3d736c3640 1 -- 172.21.15.73:0/2046780390 shutdown_connections 2024-03-29T04:08:33.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.739+0000 7f3d736c3640 1 -- 172.21.15.73:0/2046780390 wait complete. 2024-03-29T04:08:33.730 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-29T04:08:33.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.849+0000 7f71d1b85640 1 Processor -- start 2024-03-29T04:08:33.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.849+0000 7f71d1b85640 1 -- start start 2024-03-29T04:08:33.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.850+0000 7f71d1b85640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f71cc06e0f0 0x7f71cc06f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:33.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.850+0000 7f71d1b85640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71cc06e6b0 con 0x7f71cc15e9a0 2024-03-29T04:08:33.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.850+0000 7f71d1b85640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71cc06e990 con 0x7f71cc06fc90 2024-03-29T04:08:33.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.850+0000 7f71d1b85640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f71cc06f2c0 con 0x7f71cc06e0f0 2024-03-29T04:08:33.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.850+0000 7f71cb7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f71cc15e9a0 0x7f71cc072d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:34388/0 (socket says 172.21.15.73:34388) 2024-03-29T04:08:33.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.850+0000 7f71cb7fe640 1 -- 172.21.15.73:0/2615059378 learned_addr learned my addr 172.21.15.73:0/2615059378 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:33.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.850+0000 7f71caffd640 1 --2- 172.21.15.73:0/2615059378 >> v2:172.21.15.142:3300/0 conn(0x7f71cc06e0f0 0x7f71cc06f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:33.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.850+0000 7f71ca7fc640 1 -- 172.21.15.73:0/2615059378 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3473592967 0 0) 0x7f71cc06e6b0 con 0x7f71cc15e9a0 2024-03-29T04:08:33.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.850+0000 7f71ca7fc640 1 -- 172.21.15.73:0/2615059378 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71b4003520 con 0x7f71cc15e9a0 2024-03-29T04:08:33.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.850+0000 7f71ca7fc640 1 -- 172.21.15.73:0/2615059378 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4235223656 0 0) 0x7f71cc06e990 con 0x7f71cc06fc90 2024-03-29T04:08:33.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.850+0000 7f71ca7fc640 1 -- 172.21.15.73:0/2615059378 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71cc06e6b0 con 0x7f71cc06fc90 2024-03-29T04:08:33.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.851+0000 7f71caffd640 1 -- 172.21.15.73:0/2615059378 >> v1:172.21.15.142:6789/0 conn(0x7f71cc06fc90 legacy=0x7f71cc06c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:33.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.851+0000 7f71caffd640 1 -- 172.21.15.73:0/2615059378 >> v1:172.21.15.73:6789/0 conn(0x7f71cc15e9a0 legacy=0x7f71cc072d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:33.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.851+0000 7f71ca7fc640 1 -- 172.21.15.73:0/2615059378 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2022986186 0 0) 0x7f71b4003520 con 0x7f71cc15e9a0 2024-03-29T04:08:33.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.851+0000 7f71caffd640 1 -- 172.21.15.73:0/2615059378 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71cc06ec70 con 0x7f71cc06e0f0 2024-03-29T04:08:33.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.851+0000 7f71caffd640 1 --2- 172.21.15.73:0/2615059378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71cc06e0f0 0x7f71cc06f750 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f71c00097a0 tx=0x7f71c002b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f005f59f6e6d66f2 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:33.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.851+0000 7f71ca7fc640 1 -- 172.21.15.73:0/2615059378 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c0037070 con 0x7f71cc06e0f0 2024-03-29T04:08:33.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.852+0000 7f71ca7fc640 1 -- 172.21.15.73:0/2615059378 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71c0030510 con 0x7f71cc06e0f0 2024-03-29T04:08:33.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.852+0000 7f71ca7fc640 1 -- 172.21.15.73:0/2615059378 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71bc001670 con 0x7f71cc06e0f0 2024-03-29T04:08:33.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.852+0000 7f71d1b85640 1 -- 172.21.15.73:0/2615059378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71cc06e0f0 msgr2=0x7f71cc06f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:33.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.852+0000 7f71d1b85640 1 --2- 172.21.15.73:0/2615059378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71cc06e0f0 0x7f71cc06f750 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f71c00097a0 tx=0x7f71c002b790 comp rx=0 tx=0).stop 2024-03-29T04:08:33.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.852+0000 7f71d1b85640 1 -- 172.21.15.73:0/2615059378 shutdown_connections 2024-03-29T04:08:33.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.852+0000 7f71d1b85640 1 --2- 172.21.15.73:0/2615059378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71cc06e0f0 0x7f71cc06f750 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:33.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.852+0000 7f71d1b85640 1 -- 172.21.15.73:0/2615059378 >> 172.21.15.73:0/2615059378 conn(0x7f71cc072090 msgr2=0x7f71cc0724a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:33.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.852+0000 7f71d1b85640 1 -- 172.21.15.73:0/2615059378 shutdown_connections 2024-03-29T04:08:33.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.852+0000 7f71d1b85640 1 -- 172.21.15.73:0/2615059378 wait complete. 2024-03-29T04:08:33.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.853+0000 7f71d1b85640 1 Processor -- start 2024-03-29T04:08:33.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.853+0000 7f71d1b85640 1 -- start start 2024-03-29T04:08:33.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.854+0000 7f71d1b85640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71cc06e0f0 0x7f71cc1567b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:33.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.854+0000 7f71d1b85640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71cc06fc90 0x7f71cc0b1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:33.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.854+0000 7f71d1b85640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71cc15e9a0 0x7f71cc160880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:33.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.854+0000 7f71d1b85640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f71cc06cdb0 con 0x7f71cc15e9a0 2024-03-29T04:08:33.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.854+0000 7f71d1b85640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f71cc06cc30 con 0x7f71cc06e0f0 2024-03-29T04:08:33.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.854+0000 7f71d1b85640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f71cc0ada80 con 0x7f71cc06fc90 2024-03-29T04:08:33.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.854+0000 7f71cbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71cc15e9a0 0x7f71cc160880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:33.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.854+0000 7f71cbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71cc15e9a0 0x7f71cc160880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45728/0 (socket says 172.21.15.73:45728) 2024-03-29T04:08:33.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.854+0000 7f71cbfff640 1 -- 172.21.15.73:0/680279806 learned_addr learned my addr 172.21.15.73:0/680279806 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:33.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.854+0000 7f71cb7fe640 1 --2- 172.21.15.73:0/680279806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71cc06e0f0 0x7f71cc1567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:33.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.854+0000 7f71caffd640 1 --2- 172.21.15.73:0/680279806 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71cc06fc90 0x7f71cc0b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:33.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.854+0000 7f71cbfff640 1 -- 172.21.15.73:0/680279806 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71cc06fc90 msgr2=0x7f71cc0b1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:33.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.854+0000 7f71cbfff640 1 --2- 172.21.15.73:0/680279806 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71cc06fc90 0x7f71cc0b1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:33.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.855+0000 7f71cbfff640 1 -- 172.21.15.73:0/680279806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71cc06e0f0 msgr2=0x7f71cc1567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:33.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.855+0000 7f71cbfff640 1 --2- 172.21.15.73:0/680279806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71cc06e0f0 0x7f71cc1567b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:33.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.855+0000 7f71cbfff640 1 -- 172.21.15.73:0/680279806 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71cc15b8f0 con 0x7f71cc15e9a0 2024-03-29T04:08:33.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.855+0000 7f71cbfff640 1 --2- 172.21.15.73:0/680279806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71cc15e9a0 0x7f71cc160880 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f71c400c790 tx=0x7f71c400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:33.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.855+0000 7f71b3fff640 1 -- 172.21.15.73:0/680279806 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c4003b70 con 0x7f71cc15e9a0 2024-03-29T04:08:33.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.855+0000 7f71b3fff640 1 -- 172.21.15.73:0/680279806 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71c4003d10 con 0x7f71cc15e9a0 2024-03-29T04:08:33.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.855+0000 7f71d1b85640 1 -- 172.21.15.73:0/680279806 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71cc0b0990 con 0x7f71cc15e9a0 2024-03-29T04:08:33.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.855+0000 7f71b3fff640 1 -- 172.21.15.73:0/680279806 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c400aa50 con 0x7f71cc15e9a0 2024-03-29T04:08:33.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.855+0000 7f71d1b85640 1 -- 172.21.15.73:0/680279806 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71cc156cf0 con 0x7f71cc15e9a0 2024-03-29T04:08:33.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.856+0000 7f71d1b85640 1 -- 172.21.15.73:0/680279806 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71cc068640 con 0x7f71cc15e9a0 2024-03-29T04:08:33.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.856+0000 7f71b3fff640 1 -- 172.21.15.73:0/680279806 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f71c400abf0 con 0x7f71cc15e9a0 2024-03-29T04:08:33.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.856+0000 7f71b3fff640 1 --2- 172.21.15.73:0/680279806 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f71b806c530 0x7f71b806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:33.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.857+0000 7f71b3fff640 1 -- 172.21.15.73:0/680279806 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f71c408b530 con 0x7f71cc15e9a0 2024-03-29T04:08:33.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.857+0000 7f71cb7fe640 1 --2- 172.21.15.73:0/680279806 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f71b806c530 0x7f71b806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:33.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.857+0000 7f71cb7fe640 1 --2- 172.21.15.73:0/680279806 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f71b806c530 0x7f71b806e9f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f71bc0011e0 tx=0x7f71bc001690 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:33.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:33.861+0000 7f71b3fff640 1 -- 172.21.15.73:0/680279806 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f71c4059500 con 0x7f71cc15e9a0 2024-03-29T04:08:34.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.037+0000 7f71d1b85640 1 -- 172.21.15.73:0/680279806 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f71cc0b3fb0 con 0x7f71cc15e9a0 2024-03-29T04:08:34.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.038+0000 7f71b3fff640 1 -- 172.21.15.73:0/680279806 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16605 (secure 0 0 0) 0x7f71c405d800 con 0x7f71cc15e9a0 2024-03-29T04:08:34.019 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:34.019 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"6bff1617-b138-4517-acca-3ecaae3f2bb3","created":"2024-03-29T04:07:47.346864+0000","modified":"2024-03-29T04:08:13.577603+0000","last_up_change":"2024-03-29T04:07:58.507139+0000","last_in_change":"2024-03-29T04:07:49.637816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-29T04:07:59.537301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-29T04:08:09.570906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-29T04:08:10.882349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"925d7de1-14ab-48c0-aebd-7bded108f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6820","nonce":2387335359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6824","nonce":2387335359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6831","nonce":2387335359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6828","nonce":2387335359}]},"public_addr":"172.21.15.73:6820/2387335359","cluster_addr":"172.21.15.73:6824/2387335359","heartbeat_back_addr":"172.21.15.73:6831/2387335359","heartbeat_front_addr":"172.21.15.73:6828/2387335359","state":["exists","up"]},{"osd":1,"uuid":"6b182102-882a-4e0c-99db-0afae5cfb38b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6801","nonce":2431315515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6803","nonce":2431315515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6807","nonce":2431315515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6805","nonce":2431315515}]},"public_addr":"172.21.15.73:6801/2431315515","cluster_addr":"172.21.15.73:6803/2431315515","heartbeat_back_addr":"172.21.15.73:6807/2431315515","heartbeat_front_addr":"172.21.15.73:6805/2431315515","state":["exists","up"]},{"osd":2,"uuid":"8040902e-b0b8-4a21-bf64-ce1c222115ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6809","nonce":407236597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6811","nonce":407236597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6815","nonce":407236597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6813","nonce":407236597}]},"public_addr":"172.21.15.73:6809/407236597","cluster_addr":"172.21.15.73:6811/407236597","heartbeat_back_addr":"172.21.15.73:6815/407236597","heartbeat_front_addr":"172.21.15.73:6813/407236597","state":["exists","up"]},{"osd":3,"uuid":"1bab19ee-3775-4ce1-a4ce-cf7cda3bbbf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6817","nonce":4291100709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6821","nonce":4291100709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6829","nonce":4291100709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6825","nonce":4291100709}]},"public_addr":"172.21.15.73:6817/4291100709","cluster_addr":"172.21.15.73:6821/4291100709","heartbeat_back_addr":"172.21.15.73:6829/4291100709","heartbeat_front_addr":"172.21.15.73:6825/4291100709","state":["exists","up"]},{"osd":4,"uuid":"b0c74337-8fe4-47dc-b3da-2d07591b1f6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6817","nonce":3703256194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6819","nonce":3703256194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6823","nonce":3703256194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6821","nonce":3703256194}]},"public_addr":"172.21.15.142:6817/3703256194","cluster_addr":"172.21.15.142:6819/3703256194","heartbeat_back_addr":"172.21.15.142:6823/3703256194","heartbeat_front_addr":"172.21.15.142:6821/3703256194","state":["exists","up"]},{"osd":5,"uuid":"9ce36410-a29a-42c6-99f4-f95d4afdd7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6825","nonce":4271575803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6827","nonce":4271575803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6831","nonce":4271575803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6829","nonce":4271575803}]},"public_addr":"172.21.15.142:6825/4271575803","cluster_addr":"172.21.15.142:6827/4271575803","heartbeat_back_addr":"172.21.15.142:6831/4271575803","heartbeat_front_addr":"172.21.15.142:6829/4271575803","state":["exists","up"]},{"osd":6,"uuid":"aec4264a-64ac-428e-a860-d2920a304019","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6801","nonce":1772722570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6803","nonce":1772722570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6807","nonce":1772722570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6805","nonce":1772722570}]},"public_addr":"172.21.15.142:6801/1772722570","cluster_addr":"172.21.15.142:6803/1772722570","heartbeat_back_addr":"172.21.15.142:6807/1772722570","heartbeat_front_addr":"172.21.15.142:6805/1772722570","state":["exists","up"]},{"osd":7,"uuid":"fe599052-8e5a-4c7a-91e7-52d1bae24a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6809","nonce":3910589675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6811","nonce":3910589675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6815","nonce":3910589675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6813","nonce":3910589675}]},"public_addr":"172.21.15.142:6809/3910589675","cluster_addr":"172.21.15.142:6811/3910589675","heartbeat_back_addr":"172.21.15.142:6815/3910589675","heartbeat_front_addr":"172.21.15.142:6813/3910589675","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.835096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.587210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.786547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.778004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.843740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.791160+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.837992+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.718722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:08:34.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.041+0000 7f71d1b85640 1 -- 172.21.15.73:0/680279806 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f71b806c530 msgr2=0x7f71b806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:34.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.041+0000 7f71d1b85640 1 --2- 172.21.15.73:0/680279806 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f71b806c530 0x7f71b806e9f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f71bc0011e0 tx=0x7f71bc001690 comp rx=0 tx=0).stop 2024-03-29T04:08:34.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.041+0000 7f71d1b85640 1 -- 172.21.15.73:0/680279806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71cc15e9a0 msgr2=0x7f71cc160880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:34.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.041+0000 7f71d1b85640 1 --2- 172.21.15.73:0/680279806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71cc15e9a0 0x7f71cc160880 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f71c400c790 tx=0x7f71c400cc50 comp rx=0 tx=0).stop 2024-03-29T04:08:34.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.041+0000 7f71d1b85640 1 -- 172.21.15.73:0/680279806 shutdown_connections 2024-03-29T04:08:34.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.041+0000 7f71d1b85640 1 --2- 172.21.15.73:0/680279806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71cc15e9a0 0x7f71cc160880 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:34.021 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.041+0000 7f71d1b85640 1 --2- 172.21.15.73:0/680279806 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f71cc06fc90 0x7f71cc0b1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:34.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.041+0000 7f71d1b85640 1 --2- 172.21.15.73:0/680279806 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f71b806c530 0x7f71b806e9f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:34.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.041+0000 7f71d1b85640 1 --2- 172.21.15.73:0/680279806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71cc06e0f0 0x7f71cc1567b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:34.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.041+0000 7f71d1b85640 1 -- 172.21.15.73:0/680279806 >> 172.21.15.73:0/680279806 conn(0x7f71cc072090 msgr2=0x7f71cc0cf250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:34.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.041+0000 7f71d1b85640 1 -- 172.21.15.73:0/680279806 shutdown_connections 2024-03-29T04:08:34.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.041+0000 7f71d1b85640 1 -- 172.21.15.73:0/680279806 wait complete. 2024-03-29T04:08:34.032 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-29T04:07:59.537301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-29T04:08:09.570906+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-29T04:08:10.882349+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-29T04:08:34.032 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-29T04:08:34.135 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.155+0000 7f1950300640 1 Processor -- start 2024-03-29T04:08:34.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.155+0000 7f1950300640 1 -- start start 2024-03-29T04:08:34.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.156+0000 7f1950300640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f19480c6c50 0x7f194815b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:34.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.156+0000 7f1950300640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f194815bfa0 con 0x7f194815b4f0 2024-03-29T04:08:34.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.156+0000 7f1950300640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f194815c280 con 0x7f19480b2100 2024-03-29T04:08:34.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.156+0000 7f1950300640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f19480c70b0 con 0x7f19480c6c50 2024-03-29T04:08:34.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.156+0000 7f194d89b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f19480c6c50 0x7f194815b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:34.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.156+0000 7f194e09c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f194815b4f0 0x7f19480ca950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:34404/0 (socket says 172.21.15.73:34404) 2024-03-29T04:08:34.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.156+0000 7f194e09c640 1 -- 172.21.15.73:0/3071464888 learned_addr learned my addr 172.21.15.73:0/3071464888 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:34.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.156+0000 7f194d89b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f19480c6c50 0x7f194815b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45732/0 (socket says 172.21.15.73:45732) 2024-03-29T04:08:34.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.156+0000 7f194d89b640 1 -- 172.21.15.73:0/3071464888 >> v1:172.21.15.142:6789/0 conn(0x7f19480b2100 legacy=0x7f19480ce170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:34.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.156+0000 7f194d89b640 1 -- 172.21.15.73:0/3071464888 >> v1:172.21.15.73:6789/0 conn(0x7f194815b4f0 legacy=0x7f19480ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:34.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.156+0000 7f194d89b640 1 -- 172.21.15.73:0/3071464888 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f194815c560 con 0x7f19480c6c50 2024-03-29T04:08:34.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.156+0000 7f194d09a640 1 -- 172.21.15.73:0/3071464888 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2061213387 0 0) 0x7f194815bfa0 con 0x7f194815b4f0 2024-03-29T04:08:34.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.157+0000 7f194d89b640 1 --2- 172.21.15.73:0/3071464888 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19480c6c50 0x7f194815b8d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f19380097a0 tx=0x7f193802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da01989dd59267c8 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:34.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.157+0000 7f194d09a640 1 -- 172.21.15.73:0/3071464888 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1938035020 con 0x7f19480c6c50 2024-03-29T04:08:34.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.157+0000 7f194d09a640 1 -- 172.21.15.73:0/3071464888 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1938031830 con 0x7f19480c6c50 2024-03-29T04:08:34.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.157+0000 7f194d09a640 1 -- 172.21.15.73:0/3071464888 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1938031c00 con 0x7f19480c6c50 2024-03-29T04:08:34.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.157+0000 7f1950300640 1 -- 172.21.15.73:0/3071464888 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19480c6c50 msgr2=0x7f194815b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:34.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.157+0000 7f1950300640 1 --2- 172.21.15.73:0/3071464888 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19480c6c50 0x7f194815b8d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f19380097a0 tx=0x7f193802b8d0 comp rx=0 tx=0).stop 2024-03-29T04:08:34.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.158+0000 7f1950300640 1 -- 172.21.15.73:0/3071464888 shutdown_connections 2024-03-29T04:08:34.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.158+0000 7f1950300640 1 --2- 172.21.15.73:0/3071464888 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19480c6c50 0x7f194815b8d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:34.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.158+0000 7f1950300640 1 -- 172.21.15.73:0/3071464888 >> 172.21.15.73:0/3071464888 conn(0x7f19480d0450 msgr2=0x7f19480d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:34.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.158+0000 7f1950300640 1 -- 172.21.15.73:0/3071464888 shutdown_connections 2024-03-29T04:08:34.139 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.158+0000 7f1950300640 1 -- 172.21.15.73:0/3071464888 wait complete. 2024-03-29T04:08:34.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.159+0000 7f1950300640 1 Processor -- start 2024-03-29T04:08:34.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.159+0000 7f1950300640 1 -- start start 2024-03-29T04:08:34.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.159+0000 7f1950300640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19480b2100 0x7f19481485c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:34.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.159+0000 7f1950300640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19480c6c50 0x7f194815e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:34.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.159+0000 7f1950300640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f194815b4f0 0x7f19480cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:34.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.159+0000 7f1950300640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f19480b4d50 con 0x7f194815b4f0 2024-03-29T04:08:34.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.159+0000 7f1950300640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f19480b4bd0 con 0x7f19480b2100 2024-03-29T04:08:34.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.159+0000 7f1950300640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f19480ce880 con 0x7f19480c6c50 2024-03-29T04:08:34.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.160+0000 7f194e89d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f194815b4f0 0x7f19480cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:34.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.160+0000 7f194e89d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f194815b4f0 0x7f19480cb0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45742/0 (socket says 172.21.15.73:45742) 2024-03-29T04:08:34.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.160+0000 7f194e89d640 1 -- 172.21.15.73:0/1848050067 learned_addr learned my addr 172.21.15.73:0/1848050067 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:34.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.160+0000 7f194d89b640 1 --2- 172.21.15.73:0/1848050067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19480c6c50 0x7f194815e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:34.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.160+0000 7f194e09c640 1 --2- 172.21.15.73:0/1848050067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19480b2100 0x7f19481485c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:34.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.160+0000 7f194e89d640 1 -- 172.21.15.73:0/1848050067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19480c6c50 msgr2=0x7f194815e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:34.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.160+0000 7f194e89d640 1 --2- 172.21.15.73:0/1848050067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19480c6c50 0x7f194815e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:34.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.160+0000 7f194e89d640 1 -- 172.21.15.73:0/1848050067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19480b2100 msgr2=0x7f19481485c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:34.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.160+0000 7f194e89d640 1 --2- 172.21.15.73:0/1848050067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19480b2100 0x7f19481485c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:34.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.160+0000 7f194e89d640 1 -- 172.21.15.73:0/1848050067 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1948148b00 con 0x7f194815b4f0 2024-03-29T04:08:34.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.160+0000 7f194e89d640 1 --2- 172.21.15.73:0/1848050067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f194815b4f0 0x7f19480cb0f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f194000c7d0 tx=0x7f194000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:34.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.160+0000 7f193effd640 1 -- 172.21.15.73:0/1848050067 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1940003b70 con 0x7f194815b4f0 2024-03-29T04:08:34.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.160+0000 7f193effd640 1 -- 172.21.15.73:0/1848050067 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1940003d30 con 0x7f194815b4f0 2024-03-29T04:08:34.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.160+0000 7f1950300640 1 -- 172.21.15.73:0/1848050067 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19480c7da0 con 0x7f194815b4f0 2024-03-29T04:08:34.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.160+0000 7f193effd640 1 -- 172.21.15.73:0/1848050067 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f194000aa90 con 0x7f194815b4f0 2024-03-29T04:08:34.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.160+0000 7f1950300640 1 -- 172.21.15.73:0/1848050067 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19480c8360 con 0x7f194815b4f0 2024-03-29T04:08:34.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.161+0000 7f1950300640 1 -- 172.21.15.73:0/1848050067 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f194809e520 con 0x7f194815b4f0 2024-03-29T04:08:34.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.162+0000 7f193effd640 1 -- 172.21.15.73:0/1848050067 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f194000ac30 con 0x7f194815b4f0 2024-03-29T04:08:34.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.162+0000 7f193effd640 1 --2- 172.21.15.73:0/1848050067 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f192c06c530 0x7f192c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:34.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.162+0000 7f193effd640 1 -- 172.21.15.73:0/1848050067 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f194008b4f0 con 0x7f194815b4f0 2024-03-29T04:08:34.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.162+0000 7f194e09c640 1 --2- 172.21.15.73:0/1848050067 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f192c06c530 0x7f192c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:34.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.162+0000 7f194e09c640 1 --2- 172.21.15.73:0/1848050067 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f192c06c530 0x7f192c06e9f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1944000f60 tx=0x7f1944007e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:34.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.167+0000 7f193effd640 1 -- 172.21.15.73:0/1848050067 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f19400594c0 con 0x7f194815b4f0 2024-03-29T04:08:34.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.341+0000 7f1950300640 1 -- 172.21.15.73:0/1848050067 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f19480b1ac0 con 0x7f194815b4f0 2024-03-29T04:08:34.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.341+0000 7f193effd640 1 -- 172.21.15.73:0/1848050067 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f194005d7c0 con 0x7f194815b4f0 2024-03-29T04:08:34.322 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-03-29T04:08:34.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.344+0000 7f1950300640 1 -- 172.21.15.73:0/1848050067 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f192c06c530 msgr2=0x7f192c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:34.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.344+0000 7f1950300640 1 --2- 172.21.15.73:0/1848050067 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f192c06c530 0x7f192c06e9f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1944000f60 tx=0x7f1944007e40 comp rx=0 tx=0).stop 2024-03-29T04:08:34.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.344+0000 7f1950300640 1 -- 172.21.15.73:0/1848050067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f194815b4f0 msgr2=0x7f19480cb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:34.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.344+0000 7f1950300640 1 --2- 172.21.15.73:0/1848050067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f194815b4f0 0x7f19480cb0f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f194000c7d0 tx=0x7f194000cc90 comp rx=0 tx=0).stop 2024-03-29T04:08:34.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.344+0000 7f1950300640 1 -- 172.21.15.73:0/1848050067 shutdown_connections 2024-03-29T04:08:34.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.344+0000 7f1950300640 1 --2- 172.21.15.73:0/1848050067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f194815b4f0 0x7f19480cb0f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:34.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.344+0000 7f1950300640 1 --2- 172.21.15.73:0/1848050067 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19480c6c50 0x7f194815e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:34.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.344+0000 7f1950300640 1 --2- 172.21.15.73:0/1848050067 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f192c06c530 0x7f192c06e9f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:34.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.344+0000 7f1950300640 1 --2- 172.21.15.73:0/1848050067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19480b2100 0x7f19481485c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:34.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.344+0000 7f1950300640 1 -- 172.21.15.73:0/1848050067 >> 172.21.15.73:0/1848050067 conn(0x7f19480d0450 msgr2=0x7f19480d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:34.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.344+0000 7f1950300640 1 -- 172.21.15.73:0/1848050067 shutdown_connections 2024-03-29T04:08:34.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.344+0000 7f1950300640 1 -- 172.21.15.73:0/1848050067 wait complete. 2024-03-29T04:08:34.335 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-29T04:08:34.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.458+0000 7f5bb90eb640 1 Processor -- start 2024-03-29T04:08:34.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.458+0000 7f5bb90eb640 1 -- start start 2024-03-29T04:08:34.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.458+0000 7f5bb90eb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bb40b1980 0x7f5bb40d12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:34.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.458+0000 7f5bb90eb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5bb409aa30 0x7f5bb4162610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:34.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.458+0000 7f5bb90eb640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5bb4162b50 0x7f5bb406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:34.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.458+0000 7f5bb90eb640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f5bb409aec0 con 0x7f5bb4162b50 2024-03-29T04:08:34.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.458+0000 7f5bb90eb640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f5bb409b1a0 con 0x7f5bb409aa30 2024-03-29T04:08:34.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.458+0000 7f5bb90eb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f5bb409b480 con 0x7f5bb40b1980 2024-03-29T04:08:34.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.458+0000 7f5bb359e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5bb4162b50 0x7f5bb406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:34.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.459+0000 7f5bb359e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5bb4162b50 0x7f5bb406fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45744/0 (socket says 172.21.15.73:45744) 2024-03-29T04:08:34.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.459+0000 7f5bb359e640 1 -- 172.21.15.73:0/2225509060 learned_addr learned my addr 172.21.15.73:0/2225509060 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:34.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.459+0000 7f5bb2d9d640 1 --2- 172.21.15.73:0/2225509060 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bb40b1980 0x7f5bb40d12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:34.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.459+0000 7f5babfff640 1 --2- 172.21.15.73:0/2225509060 >> v2:172.21.15.142:3300/0 conn(0x7f5bb409aa30 0x7f5bb4162610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:34.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.459+0000 7f5bb359e640 1 -- 172.21.15.73:0/2225509060 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bb40b1980 msgr2=0x7f5bb40d12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:34.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.459+0000 7f5bb359e640 1 --2- 172.21.15.73:0/2225509060 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bb40b1980 0x7f5bb40d12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:34.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.459+0000 7f5bb359e640 1 -- 172.21.15.73:0/2225509060 >> v2:172.21.15.142:3300/0 conn(0x7f5bb409aa30 msgr2=0x7f5bb4162610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:34.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.459+0000 7f5bb359e640 1 --2- 172.21.15.73:0/2225509060 >> v2:172.21.15.142:3300/0 conn(0x7f5bb409aa30 0x7f5bb4162610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:34.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.459+0000 7f5bb359e640 1 -- 172.21.15.73:0/2225509060 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bb409b760 con 0x7f5bb4162b50 2024-03-29T04:08:34.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.459+0000 7f5bb359e640 1 --2- 172.21.15.73:0/2225509060 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb4162b50 0x7f5bb406fc90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4072dc0 tx=0x7f5bac02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0ff6fef20210ef4 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:34.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.460+0000 7f5bb259c640 1 -- 172.21.15.73:0/2225509060 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bac02ca70 con 0x7f5bb4162b50 2024-03-29T04:08:34.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.460+0000 7f5bb259c640 1 -- 172.21.15.73:0/2225509060 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bac02cc10 con 0x7f5bb4162b50 2024-03-29T04:08:34.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.460+0000 7f5bb259c640 1 -- 172.21.15.73:0/2225509060 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bac0343f0 con 0x7f5bb4162b50 2024-03-29T04:08:34.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.460+0000 7f5bb90eb640 1 -- 172.21.15.73:0/2225509060 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb4162b50 msgr2=0x7f5bb406fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:34.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.460+0000 7f5bb90eb640 1 --2- 172.21.15.73:0/2225509060 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb4162b50 0x7f5bb406fc90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4072dc0 tx=0x7f5bac02bed0 comp rx=0 tx=0).stop 2024-03-29T04:08:34.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.460+0000 7f5bb90eb640 1 -- 172.21.15.73:0/2225509060 shutdown_connections 2024-03-29T04:08:34.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.460+0000 7f5bb90eb640 1 --2- 172.21.15.73:0/2225509060 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb4162b50 0x7f5bb406fc90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:34.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.460+0000 7f5bb90eb640 1 --2- 172.21.15.73:0/2225509060 >> v2:172.21.15.142:3300/0 conn(0x7f5bb409aa30 0x7f5bb4162610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:34.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.460+0000 7f5bb90eb640 1 --2- 172.21.15.73:0/2225509060 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bb40b1980 0x7f5bb40d12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:34.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.460+0000 7f5bb90eb640 1 -- 172.21.15.73:0/2225509060 >> 172.21.15.73:0/2225509060 conn(0x7f5bb40b3f40 msgr2=0x7f5bb40b4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:34.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.460+0000 7f5bb90eb640 1 -- 172.21.15.73:0/2225509060 shutdown_connections 2024-03-29T04:08:34.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.460+0000 7f5bb90eb640 1 -- 172.21.15.73:0/2225509060 wait complete. 2024-03-29T04:08:34.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.462+0000 7f5bb90eb640 1 Processor -- start 2024-03-29T04:08:34.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.462+0000 7f5bb90eb640 1 -- start start 2024-03-29T04:08:34.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.462+0000 7f5bb90eb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb40b1980 0x7f5bb40c8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:34.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.462+0000 7f5bb90eb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bb4162b50 0x7f5bb41574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:34.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.462+0000 7f5bb90eb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bb40c9520 0x7f5bb406d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:34.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.462+0000 7f5bb90eb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb40d1970 con 0x7f5bb40b1980 2024-03-29T04:08:34.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.462+0000 7f5bb90eb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb40d17f0 con 0x7f5bb40c9520 2024-03-29T04:08:34.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.462+0000 7f5bb90eb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f5bb40701d0 con 0x7f5bb4162b50 2024-03-29T04:08:34.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.462+0000 7f5bb2d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb40b1980 0x7f5bb40c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:34.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.462+0000 7f5bb2d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb40b1980 0x7f5bb40c8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45754/0 (socket says 172.21.15.73:45754) 2024-03-29T04:08:34.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.462+0000 7f5bb2d9d640 1 -- 172.21.15.73:0/2185294384 learned_addr learned my addr 172.21.15.73:0/2185294384 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:34.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.463+0000 7f5bb359e640 1 --2- 172.21.15.73:0/2185294384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bb40c9520 0x7f5bb406d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:34.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.463+0000 7f5babfff640 1 --2- 172.21.15.73:0/2185294384 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bb4162b50 0x7f5bb41574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:34.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.463+0000 7f5bb2d9d640 1 -- 172.21.15.73:0/2185294384 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bb4162b50 msgr2=0x7f5bb41574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:34.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.463+0000 7f5bb2d9d640 1 --2- 172.21.15.73:0/2185294384 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bb4162b50 0x7f5bb41574f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:34.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.463+0000 7f5bb2d9d640 1 -- 172.21.15.73:0/2185294384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bb40c9520 msgr2=0x7f5bb406d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:34.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.463+0000 7f5bb2d9d640 1 --2- 172.21.15.73:0/2185294384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bb40c9520 0x7f5bb406d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:34.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.463+0000 7f5bb2d9d640 1 -- 172.21.15.73:0/2185294384 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bb4157a30 con 0x7f5bb40b1980 2024-03-29T04:08:34.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.463+0000 7f5bb2d9d640 1 --2- 172.21.15.73:0/2185294384 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb40b1980 0x7f5bb40c8770 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5ba400e9e0 tx=0x7f5ba400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:34.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.463+0000 7f5bab7fe640 1 -- 172.21.15.73:0/2185294384 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4017070 con 0x7f5bb40b1980 2024-03-29T04:08:34.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.463+0000 7f5bab7fe640 1 -- 172.21.15.73:0/2185294384 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba400c9d0 con 0x7f5bb40b1980 2024-03-29T04:08:34.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.463+0000 7f5bb90eb640 1 -- 172.21.15.73:0/2185294384 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bb415b8a0 con 0x7f5bb40b1980 2024-03-29T04:08:34.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.463+0000 7f5bab7fe640 1 -- 172.21.15.73:0/2185294384 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba400cdc0 con 0x7f5bb40b1980 2024-03-29T04:08:34.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.463+0000 7f5bb90eb640 1 -- 172.21.15.73:0/2185294384 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bb40c6400 con 0x7f5bb40b1980 2024-03-29T04:08:34.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.464+0000 7f5bb90eb640 1 -- 172.21.15.73:0/2185294384 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bb40a0520 con 0x7f5bb40b1980 2024-03-29T04:08:34.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.465+0000 7f5bab7fe640 1 -- 172.21.15.73:0/2185294384 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f5ba401a070 con 0x7f5bb40b1980 2024-03-29T04:08:34.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.465+0000 7f5bab7fe640 1 --2- 172.21.15.73:0/2185294384 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f5b9406c530 0x7f5b9406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:34.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.465+0000 7f5bab7fe640 1 -- 172.21.15.73:0/2185294384 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5ba408b6e0 con 0x7f5bb40b1980 2024-03-29T04:08:34.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.465+0000 7f5babfff640 1 --2- 172.21.15.73:0/2185294384 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f5b9406c530 0x7f5b9406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:34.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.466+0000 7f5babfff640 1 --2- 172.21.15.73:0/2185294384 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f5b9406c530 0x7f5b9406e9f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5bb406e780 tx=0x7f5b9c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:34.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.470+0000 7f5bab7fe640 1 -- 172.21.15.73:0/2185294384 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f5bb4157a30 con 0x7f5bb40b1980 2024-03-29T04:08:34.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.644+0000 7f5bb90eb640 1 -- 172.21.15.73:0/2185294384 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f5bb40b44e0 con 0x7f5bb40b1980 2024-03-29T04:08:34.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.645+0000 7f5bab7fe640 1 -- 172.21.15.73:0/2185294384 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f5ba40596b0 con 0x7f5bb40b1980 2024-03-29T04:08:34.626 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-03-29T04:08:34.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.648+0000 7f5bb90eb640 1 -- 172.21.15.73:0/2185294384 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f5b9406c530 msgr2=0x7f5b9406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:34.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.648+0000 7f5bb90eb640 1 --2- 172.21.15.73:0/2185294384 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f5b9406c530 0x7f5b9406e9f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5bb406e780 tx=0x7f5b9c009190 comp rx=0 tx=0).stop 2024-03-29T04:08:34.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.648+0000 7f5bb90eb640 1 -- 172.21.15.73:0/2185294384 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb40b1980 msgr2=0x7f5bb40c8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:34.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.648+0000 7f5bb90eb640 1 --2- 172.21.15.73:0/2185294384 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb40b1980 0x7f5bb40c8770 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5ba400e9e0 tx=0x7f5ba400eea0 comp rx=0 tx=0).stop 2024-03-29T04:08:34.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.648+0000 7f5bb90eb640 1 -- 172.21.15.73:0/2185294384 shutdown_connections 2024-03-29T04:08:34.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.648+0000 7f5bb90eb640 1 --2- 172.21.15.73:0/2185294384 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f5b9406c530 0x7f5b9406e9f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:34.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.648+0000 7f5bb90eb640 1 --2- 172.21.15.73:0/2185294384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5bb40c9520 0x7f5bb406d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:34.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.648+0000 7f5bb90eb640 1 --2- 172.21.15.73:0/2185294384 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5bb4162b50 0x7f5bb41574f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:34.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.648+0000 7f5bb90eb640 1 --2- 172.21.15.73:0/2185294384 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bb40b1980 0x7f5bb40c8770 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:34.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.648+0000 7f5bb90eb640 1 -- 172.21.15.73:0/2185294384 >> 172.21.15.73:0/2185294384 conn(0x7f5bb40b3f40 msgr2=0x7f5bb40af1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:34.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.648+0000 7f5bb90eb640 1 -- 172.21.15.73:0/2185294384 shutdown_connections 2024-03-29T04:08:34.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.648+0000 7f5bb90eb640 1 -- 172.21.15.73:0/2185294384 wait complete. 2024-03-29T04:08:34.638 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-29T04:08:34.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.761+0000 7f4689dba640 1 Processor -- start 2024-03-29T04:08:34.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.761+0000 7f4689dba640 1 -- start start 2024-03-29T04:08:34.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.762+0000 7f4689dba640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f46840b4e40 0x7f46840c6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:34.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.762+0000 7f4689dba640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46840b2810 0x7f46840cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:34.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.762+0000 7f4689dba640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46841604d0 con 0x7f46840b31c0 2024-03-29T04:08:34.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.762+0000 7f4689dba640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f46840c6d60 con 0x7f46840b4e40 2024-03-29T04:08:34.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.762+0000 7f4689dba640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f46840cba20 con 0x7f46840b2810 2024-03-29T04:08:34.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.762+0000 7f4683fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46840b2810 0x7f46840cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:34.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.762+0000 7f46837fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f46840b4e40 0x7f46840c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:34.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.762+0000 7f4683fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46840b2810 0x7f46840cbec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:40728/0 (socket says 172.21.15.73:40728) 2024-03-29T04:08:34.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.762+0000 7f4683fff640 1 -- 172.21.15.73:0/3399070410 learned_addr learned my addr 172.21.15.73:0/3399070410 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:34.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.762+0000 7f4682ffd640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f46840b31c0 0x7f46840b2100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.73:40328/0 (socket says 172.21.15.73:40328) 2024-03-29T04:08:34.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.762+0000 7f46837fe640 1 -- 172.21.15.73:0/3399070410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46840b2810 msgr2=0x7f46840cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:34.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.762+0000 7f46837fe640 1 --2- 172.21.15.73:0/3399070410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46840b2810 0x7f46840cbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:34.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.762+0000 7f46837fe640 1 -- 172.21.15.73:0/3399070410 >> v1:172.21.15.142:6789/0 conn(0x7f46840b31c0 legacy=0x7f46840b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:34.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.762+0000 7f46837fe640 1 -- 172.21.15.73:0/3399070410 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46841607b0 con 0x7f46840b4e40 2024-03-29T04:08:34.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.762+0000 7f4683fff640 1 --2- 172.21.15.73:0/3399070410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46840b2810 0x7f46840cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:08:34.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.763+0000 7f46837fe640 1 --2- 172.21.15.73:0/3399070410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46840b4e40 0x7f46840c6820 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f46740097a0 tx=0x7f467402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23415ddba3ed1b69 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:34.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.763+0000 7f46827fc640 1 -- 172.21.15.73:0/3399070410 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46740315a0 con 0x7f46840b4e40 2024-03-29T04:08:34.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.763+0000 7f46827fc640 1 -- 172.21.15.73:0/3399070410 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4674037070 con 0x7f46840b4e40 2024-03-29T04:08:34.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.763+0000 7f46827fc640 1 -- 172.21.15.73:0/3399070410 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4674031960 con 0x7f46840b4e40 2024-03-29T04:08:34.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.764+0000 7f4689dba640 1 -- 172.21.15.73:0/3399070410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46840b4e40 msgr2=0x7f46840c6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:34.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.764+0000 7f4689dba640 1 --2- 172.21.15.73:0/3399070410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46840b4e40 0x7f46840c6820 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f46740097a0 tx=0x7f467402b840 comp rx=0 tx=0).stop 2024-03-29T04:08:34.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.764+0000 7f4689dba640 1 -- 172.21.15.73:0/3399070410 shutdown_connections 2024-03-29T04:08:34.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.764+0000 7f4689dba640 1 --2- 172.21.15.73:0/3399070410 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46840b2810 0x7f46840cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:34.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.764+0000 7f4689dba640 1 --2- 172.21.15.73:0/3399070410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46840b4e40 0x7f46840c6820 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:34.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.764+0000 7f4689dba640 1 -- 172.21.15.73:0/3399070410 >> 172.21.15.73:0/3399070410 conn(0x7f46840d0450 msgr2=0x7f46840d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:34.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.764+0000 7f4689dba640 1 -- 172.21.15.73:0/3399070410 shutdown_connections 2024-03-29T04:08:34.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.764+0000 7f4689dba640 1 -- 172.21.15.73:0/3399070410 wait complete. 2024-03-29T04:08:34.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.765+0000 7f4689dba640 1 Processor -- start 2024-03-29T04:08:34.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.765+0000 7f4689dba640 1 -- start start 2024-03-29T04:08:34.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.766+0000 7f4689dba640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46840b2810 0x7f46840b1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:34.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.766+0000 7f4689dba640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46840b31c0 0x7f468414f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:34.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.766+0000 7f4689dba640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46840b4e40 0x7f46840ad280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:34.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.766+0000 7f4689dba640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f46840b3650 con 0x7f46840b2810 2024-03-29T04:08:34.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.766+0000 7f4689dba640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4684160d70 con 0x7f46840b31c0 2024-03-29T04:08:34.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.766+0000 7f4689dba640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f46840c60f0 con 0x7f46840b4e40 2024-03-29T04:08:34.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.766+0000 7f46837fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46840b2810 0x7f46840b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:34.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.766+0000 7f46837fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46840b2810 0x7f46840b1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45762/0 (socket says 172.21.15.73:45762) 2024-03-29T04:08:34.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.766+0000 7f46837fe640 1 -- 172.21.15.73:0/572972509 learned_addr learned my addr 172.21.15.73:0/572972509 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:34.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.766+0000 7f4683fff640 1 --2- 172.21.15.73:0/572972509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46840b4e40 0x7f46840ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:34.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.766+0000 7f4682ffd640 1 --2- 172.21.15.73:0/572972509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46840b31c0 0x7f468414f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:34.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.766+0000 7f46837fe640 1 -- 172.21.15.73:0/572972509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46840b4e40 msgr2=0x7f46840ad280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:34.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.766+0000 7f46837fe640 1 --2- 172.21.15.73:0/572972509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46840b4e40 0x7f46840ad280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:34.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.766+0000 7f46837fe640 1 -- 172.21.15.73:0/572972509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46840b31c0 msgr2=0x7f468414f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:34.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.766+0000 7f46837fe640 1 --2- 172.21.15.73:0/572972509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46840b31c0 0x7f468414f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:34.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.766+0000 7f46837fe640 1 -- 172.21.15.73:0/572972509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4684071e00 con 0x7f46840b2810 2024-03-29T04:08:34.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.766+0000 7f46837fe640 1 --2- 172.21.15.73:0/572972509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46840b2810 0x7f46840b1750 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f46740098c0 tx=0x7f46740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:34.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.767+0000 7f466bfff640 1 -- 172.21.15.73:0/572972509 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4674032630 con 0x7f46840b2810 2024-03-29T04:08:34.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.767+0000 7f466bfff640 1 -- 172.21.15.73:0/572972509 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46740327d0 con 0x7f46840b2810 2024-03-29T04:08:34.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.767+0000 7f4689dba640 1 -- 172.21.15.73:0/572972509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46840720e0 con 0x7f46840b2810 2024-03-29T04:08:34.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.767+0000 7f466bfff640 1 -- 172.21.15.73:0/572972509 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4674032bc0 con 0x7f46840b2810 2024-03-29T04:08:34.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.767+0000 7f4689dba640 1 -- 172.21.15.73:0/572972509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f468415aea0 con 0x7f46840b2810 2024-03-29T04:08:34.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.768+0000 7f4689dba640 1 -- 172.21.15.73:0/572972509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f468404f9d0 con 0x7f46840b2810 2024-03-29T04:08:34.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.768+0000 7f466bfff640 1 -- 172.21.15.73:0/572972509 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f467404e430 con 0x7f46840b2810 2024-03-29T04:08:34.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.768+0000 7f466bfff640 1 --2- 172.21.15.73:0/572972509 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f467006c530 0x7f467006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:34.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.769+0000 7f466bfff640 1 -- 172.21.15.73:0/572972509 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f467402f030 con 0x7f46840b2810 2024-03-29T04:08:34.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.769+0000 7f4682ffd640 1 --2- 172.21.15.73:0/572972509 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f467006c530 0x7f467006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:34.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.769+0000 7f4682ffd640 1 --2- 172.21.15.73:0/572972509 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f467006c530 0x7f467006e9f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f46840b4100 tx=0x7f4678007e80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:34.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.773+0000 7f466bfff640 1 -- 172.21.15.73:0/572972509 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f4674040070 con 0x7f46840b2810 2024-03-29T04:08:34.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.949+0000 7f4689dba640 1 -- 172.21.15.73:0/572972509 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f46840ad7c0 con 0x7f46840b2810 2024-03-29T04:08:34.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.950+0000 7f466bfff640 1 -- 172.21.15.73:0/572972509 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f467407b3f0 con 0x7f46840b2810 2024-03-29T04:08:34.929 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-29T04:08:34.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.951+0000 7f4689dba640 1 -- 172.21.15.73:0/572972509 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f467006c530 msgr2=0x7f467006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:34.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.951+0000 7f4689dba640 1 --2- 172.21.15.73:0/572972509 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f467006c530 0x7f467006e9f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f46840b4100 tx=0x7f4678007e80 comp rx=0 tx=0).stop 2024-03-29T04:08:34.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.951+0000 7f4689dba640 1 -- 172.21.15.73:0/572972509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46840b2810 msgr2=0x7f46840b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:34.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.951+0000 7f4689dba640 1 --2- 172.21.15.73:0/572972509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46840b2810 0x7f46840b1750 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f46740098c0 tx=0x7f46740046c0 comp rx=0 tx=0).stop 2024-03-29T04:08:34.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.951+0000 7f4689dba640 1 -- 172.21.15.73:0/572972509 shutdown_connections 2024-03-29T04:08:34.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.952+0000 7f4689dba640 1 --2- 172.21.15.73:0/572972509 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f46840b4e40 0x7f46840ad280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:34.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.952+0000 7f4689dba640 1 --2- 172.21.15.73:0/572972509 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f467006c530 0x7f467006e9f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:34.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.952+0000 7f4689dba640 1 --2- 172.21.15.73:0/572972509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f46840b31c0 0x7f468414f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:34.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.952+0000 7f4689dba640 1 --2- 172.21.15.73:0/572972509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46840b2810 0x7f46840b1750 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:34.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.952+0000 7f4689dba640 1 -- 172.21.15.73:0/572972509 >> 172.21.15.73:0/572972509 conn(0x7f46840d0450 msgr2=0x7f46840b37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:34.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.952+0000 7f4689dba640 1 -- 172.21.15.73:0/572972509 shutdown_connections 2024-03-29T04:08:34.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:34.952+0000 7f4689dba640 1 -- 172.21.15.73:0/572972509 wait complete. 2024-03-29T04:08:34.942 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-29T04:08:35.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.063+0000 7ff9b9f9b640 1 Processor -- start 2024-03-29T04:08:35.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.063+0000 7ff9b9f9b640 1 -- start start 2024-03-29T04:08:35.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.064+0000 7ff9b9f9b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff9b415c670 0x7ff9b406c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:35.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.064+0000 7ff9b9f9b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9b406f060 0x7ff9b406d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:35.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.064+0000 7ff9b9f9b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff9b40ad230 0x7ff9b40ad6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:35.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.064+0000 7ff9b9f9b640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7ff9b4146230 con 0x7ff9b40ad230 2024-03-29T04:08:35.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.064+0000 7ff9b9f9b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7ff9b406dfc0 con 0x7ff9b415c670 2024-03-29T04:08:35.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.064+0000 7ff9b9f9b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff9b406e2a0 con 0x7ff9b406f060 2024-03-29T04:08:35.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.064+0000 7ff9b3fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff9b40ad230 0x7ff9b40ad6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:35.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.064+0000 7ff9b37fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff9b415c670 0x7ff9b406c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:35.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.064+0000 7ff9b3fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff9b40ad230 0x7ff9b40ad6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45772/0 (socket says 172.21.15.73:45772) 2024-03-29T04:08:35.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.064+0000 7ff9abfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9b406f060 0x7ff9b406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:35.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.064+0000 7ff9b3fff640 1 -- 172.21.15.73:0/2281866316 learned_addr learned my addr 172.21.15.73:0/2281866316 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:35.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.064+0000 7ff9b37fe640 1 -- 172.21.15.73:0/2281866316 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9b406f060 msgr2=0x7ff9b406d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:35.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.064+0000 7ff9b37fe640 1 --2- 172.21.15.73:0/2281866316 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9b406f060 0x7ff9b406d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:35.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.064+0000 7ff9b37fe640 1 -- 172.21.15.73:0/2281866316 >> v2:172.21.15.73:3300/0 conn(0x7ff9b40ad230 msgr2=0x7ff9b40ad6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:35.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.064+0000 7ff9b37fe640 1 --2- 172.21.15.73:0/2281866316 >> v2:172.21.15.73:3300/0 conn(0x7ff9b40ad230 0x7ff9b40ad6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:35.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.064+0000 7ff9b37fe640 1 -- 172.21.15.73:0/2281866316 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b406e580 con 0x7ff9b415c670 2024-03-29T04:08:35.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.065+0000 7ff9b37fe640 1 --2- 172.21.15.73:0/2281866316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9b415c670 0x7ff9b406c030 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff9b406f960 tx=0x7ff9a402b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acdb9e6a598f08c9 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:35.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.065+0000 7ff9b2ffd640 1 -- 172.21.15.73:0/2281866316 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4038070 con 0x7ff9b415c670 2024-03-29T04:08:35.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.065+0000 7ff9b2ffd640 1 -- 172.21.15.73:0/2281866316 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9a4031700 con 0x7ff9b415c670 2024-03-29T04:08:35.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.065+0000 7ff9b2ffd640 1 -- 172.21.15.73:0/2281866316 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4031ad0 con 0x7ff9b415c670 2024-03-29T04:08:35.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.066+0000 7ff9b9f9b640 1 -- 172.21.15.73:0/2281866316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9b415c670 msgr2=0x7ff9b406c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:35.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.066+0000 7ff9b9f9b640 1 --2- 172.21.15.73:0/2281866316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9b415c670 0x7ff9b406c030 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff9b406f960 tx=0x7ff9a402b7a0 comp rx=0 tx=0).stop 2024-03-29T04:08:35.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.066+0000 7ff9b9f9b640 1 -- 172.21.15.73:0/2281866316 shutdown_connections 2024-03-29T04:08:35.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.066+0000 7ff9b9f9b640 1 --2- 172.21.15.73:0/2281866316 >> v2:172.21.15.73:3300/0 conn(0x7ff9b40ad230 0x7ff9b40ad6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:35.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.066+0000 7ff9b9f9b640 1 --2- 172.21.15.73:0/2281866316 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9b406f060 0x7ff9b406d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:35.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.066+0000 7ff9b9f9b640 1 --2- 172.21.15.73:0/2281866316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9b415c670 0x7ff9b406c030 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:35.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.066+0000 7ff9b9f9b640 1 -- 172.21.15.73:0/2281866316 >> 172.21.15.73:0/2281866316 conn(0x7ff9b406b510 msgr2=0x7ff9b406b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:35.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.066+0000 7ff9b9f9b640 1 -- 172.21.15.73:0/2281866316 shutdown_connections 2024-03-29T04:08:35.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.066+0000 7ff9b9f9b640 1 -- 172.21.15.73:0/2281866316 wait complete. 2024-03-29T04:08:35.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.067+0000 7ff9b9f9b640 1 Processor -- start 2024-03-29T04:08:35.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.067+0000 7ff9b9f9b640 1 -- start start 2024-03-29T04:08:35.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.068+0000 7ff9b9f9b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9b406f060 0x7ff9b40cca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:35.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.068+0000 7ff9b9f9b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9b40ad230 0x7ff9b40c9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:35.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.068+0000 7ff9b9f9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9b415c670 0x7ff9b415f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:35.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.068+0000 7ff9b9f9b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b40b32c0 con 0x7ff9b415c670 2024-03-29T04:08:35.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.068+0000 7ff9b9f9b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b415ca50 con 0x7ff9b40ad230 2024-03-29T04:08:35.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.068+0000 7ff9b9f9b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff9b40b3440 con 0x7ff9b406f060 2024-03-29T04:08:35.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.068+0000 7ff9b3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9b415c670 0x7ff9b415f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:35.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.068+0000 7ff9b3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9b415c670 0x7ff9b415f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45774/0 (socket says 172.21.15.73:45774) 2024-03-29T04:08:35.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.068+0000 7ff9b3fff640 1 -- 172.21.15.73:0/544751062 learned_addr learned my addr 172.21.15.73:0/544751062 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:35.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.068+0000 7ff9b37fe640 1 --2- 172.21.15.73:0/544751062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9b406f060 0x7ff9b40cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:35.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.068+0000 7ff9abfff640 1 --2- 172.21.15.73:0/544751062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9b40ad230 0x7ff9b40c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:35.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.068+0000 7ff9b3fff640 1 -- 172.21.15.73:0/544751062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9b406f060 msgr2=0x7ff9b40cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:35.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.068+0000 7ff9b3fff640 1 --2- 172.21.15.73:0/544751062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9b406f060 0x7ff9b40cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:35.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.068+0000 7ff9b3fff640 1 -- 172.21.15.73:0/544751062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9b40ad230 msgr2=0x7ff9b40c9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:35.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.068+0000 7ff9b3fff640 1 --2- 172.21.15.73:0/544751062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9b40ad230 0x7ff9b40c9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:35.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.068+0000 7ff9b3fff640 1 -- 172.21.15.73:0/544751062 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b40c9d90 con 0x7ff9b415c670 2024-03-29T04:08:35.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.068+0000 7ff9b3fff640 1 --2- 172.21.15.73:0/544751062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9b415c670 0x7ff9b415f150 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac00efc0 tx=0x7ff9ac00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:35.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.068+0000 7ff9b0ff9640 1 -- 172.21.15.73:0/544751062 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac00cd20 con 0x7ff9b415c670 2024-03-29T04:08:35.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.068+0000 7ff9b0ff9640 1 -- 172.21.15.73:0/544751062 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9ac003990 con 0x7ff9b415c670 2024-03-29T04:08:35.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.068+0000 7ff9b9f9b640 1 -- 172.21.15.73:0/544751062 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9b40ca070 con 0x7ff9b415c670 2024-03-29T04:08:35.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.069+0000 7ff9b0ff9640 1 -- 172.21.15.73:0/544751062 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac003d80 con 0x7ff9b415c670 2024-03-29T04:08:35.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.069+0000 7ff9b9f9b640 1 -- 172.21.15.73:0/544751062 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9b40ca630 con 0x7ff9b415c670 2024-03-29T04:08:35.052 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.069+0000 7ff9b9f9b640 1 -- 172.21.15.73:0/544751062 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9b4068640 con 0x7ff9b415c670 2024-03-29T04:08:35.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.070+0000 7ff9b0ff9640 1 -- 172.21.15.73:0/544751062 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff9ac012050 con 0x7ff9b415c670 2024-03-29T04:08:35.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.070+0000 7ff9b0ff9640 1 --2- 172.21.15.73:0/544751062 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff99406c530 0x7ff99406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:35.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.070+0000 7ff9b0ff9640 1 -- 172.21.15.73:0/544751062 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff9ac08bad0 con 0x7ff9b415c670 2024-03-29T04:08:35.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.070+0000 7ff9b37fe640 1 --2- 172.21.15.73:0/544751062 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff99406c530 0x7ff99406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:35.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.071+0000 7ff9b37fe640 1 --2- 172.21.15.73:0/544751062 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff99406c530 0x7ff99406e9f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4035000 tx=0x7ff9a4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:35.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.075+0000 7ff9b0ff9640 1 -- 172.21.15.73:0/544751062 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7ff9ac010040 con 0x7ff9b415c670 2024-03-29T04:08:35.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.249+0000 7ff9b9f9b640 1 -- 172.21.15.73:0/544751062 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff9b415bc10 con 0x7ff9b415c670 2024-03-29T04:08:35.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.250+0000 7ff9b0ff9640 1 -- 172.21.15.73:0/544751062 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16605 (secure 0 0 0) 0x7ff9ac059aa0 con 0x7ff9b415c670 2024-03-29T04:08:35.230 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:35.230 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"6bff1617-b138-4517-acca-3ecaae3f2bb3","created":"2024-03-29T04:07:47.346864+0000","modified":"2024-03-29T04:08:13.577603+0000","last_up_change":"2024-03-29T04:07:58.507139+0000","last_in_change":"2024-03-29T04:07:49.637816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-29T04:07:59.537301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-29T04:08:09.570906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-29T04:08:10.882349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"925d7de1-14ab-48c0-aebd-7bded108f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6820","nonce":2387335359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6824","nonce":2387335359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6831","nonce":2387335359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6828","nonce":2387335359}]},"public_addr":"172.21.15.73:6820/2387335359","cluster_addr":"172.21.15.73:6824/2387335359","heartbeat_back_addr":"172.21.15.73:6831/2387335359","heartbeat_front_addr":"172.21.15.73:6828/2387335359","state":["exists","up"]},{"osd":1,"uuid":"6b182102-882a-4e0c-99db-0afae5cfb38b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6801","nonce":2431315515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6803","nonce":2431315515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6807","nonce":2431315515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6805","nonce":2431315515}]},"public_addr":"172.21.15.73:6801/2431315515","cluster_addr":"172.21.15.73:6803/2431315515","heartbeat_back_addr":"172.21.15.73:6807/2431315515","heartbeat_front_addr":"172.21.15.73:6805/2431315515","state":["exists","up"]},{"osd":2,"uuid":"8040902e-b0b8-4a21-bf64-ce1c222115ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6809","nonce":407236597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6811","nonce":407236597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6815","nonce":407236597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6813","nonce":407236597}]},"public_addr":"172.21.15.73:6809/407236597","cluster_addr":"172.21.15.73:6811/407236597","heartbeat_back_addr":"172.21.15.73:6815/407236597","heartbeat_front_addr":"172.21.15.73:6813/407236597","state":["exists","up"]},{"osd":3,"uuid":"1bab19ee-3775-4ce1-a4ce-cf7cda3bbbf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6817","nonce":4291100709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6821","nonce":4291100709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6829","nonce":4291100709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6825","nonce":4291100709}]},"public_addr":"172.21.15.73:6817/4291100709","cluster_addr":"172.21.15.73:6821/4291100709","heartbeat_back_addr":"172.21.15.73:6829/4291100709","heartbeat_front_addr":"172.21.15.73:6825/4291100709","state":["exists","up"]},{"osd":4,"uuid":"b0c74337-8fe4-47dc-b3da-2d07591b1f6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6817","nonce":3703256194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6819","nonce":3703256194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6823","nonce":3703256194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6821","nonce":3703256194}]},"public_addr":"172.21.15.142:6817/3703256194","cluster_addr":"172.21.15.142:6819/3703256194","heartbeat_back_addr":"172.21.15.142:6823/3703256194","heartbeat_front_addr":"172.21.15.142:6821/3703256194","state":["exists","up"]},{"osd":5,"uuid":"9ce36410-a29a-42c6-99f4-f95d4afdd7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6825","nonce":4271575803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6827","nonce":4271575803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6831","nonce":4271575803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6829","nonce":4271575803}]},"public_addr":"172.21.15.142:6825/4271575803","cluster_addr":"172.21.15.142:6827/4271575803","heartbeat_back_addr":"172.21.15.142:6831/4271575803","heartbeat_front_addr":"172.21.15.142:6829/4271575803","state":["exists","up"]},{"osd":6,"uuid":"aec4264a-64ac-428e-a860-d2920a304019","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6801","nonce":1772722570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6803","nonce":1772722570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6807","nonce":1772722570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6805","nonce":1772722570}]},"public_addr":"172.21.15.142:6801/1772722570","cluster_addr":"172.21.15.142:6803/1772722570","heartbeat_back_addr":"172.21.15.142:6807/1772722570","heartbeat_front_addr":"172.21.15.142:6805/1772722570","state":["exists","up"]},{"osd":7,"uuid":"fe599052-8e5a-4c7a-91e7-52d1bae24a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6809","nonce":3910589675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6811","nonce":3910589675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6815","nonce":3910589675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6813","nonce":3910589675}]},"public_addr":"172.21.15.142:6809/3910589675","cluster_addr":"172.21.15.142:6811/3910589675","heartbeat_back_addr":"172.21.15.142:6815/3910589675","heartbeat_front_addr":"172.21.15.142:6813/3910589675","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.835096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.587210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.786547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.778004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.843740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.791160+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.837992+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.718722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:08:35.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.252+0000 7ff9b9f9b640 1 -- 172.21.15.73:0/544751062 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff99406c530 msgr2=0x7ff99406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:35.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.252+0000 7ff9b9f9b640 1 --2- 172.21.15.73:0/544751062 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff99406c530 0x7ff99406e9f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4035000 tx=0x7ff9a4008030 comp rx=0 tx=0).stop 2024-03-29T04:08:35.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.252+0000 7ff9b9f9b640 1 -- 172.21.15.73:0/544751062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9b415c670 msgr2=0x7ff9b415f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:35.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.252+0000 7ff9b9f9b640 1 --2- 172.21.15.73:0/544751062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9b415c670 0x7ff9b415f150 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac00efc0 tx=0x7ff9ac00c490 comp rx=0 tx=0).stop 2024-03-29T04:08:35.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.252+0000 7ff9b9f9b640 1 -- 172.21.15.73:0/544751062 shutdown_connections 2024-03-29T04:08:35.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.252+0000 7ff9b9f9b640 1 --2- 172.21.15.73:0/544751062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9b415c670 0x7ff9b415f150 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:35.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.252+0000 7ff9b9f9b640 1 --2- 172.21.15.73:0/544751062 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff99406c530 0x7ff99406e9f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:35.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.252+0000 7ff9b9f9b640 1 --2- 172.21.15.73:0/544751062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9b40ad230 0x7ff9b40c9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:35.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.252+0000 7ff9b9f9b640 1 --2- 172.21.15.73:0/544751062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9b406f060 0x7ff9b40cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:35.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.252+0000 7ff9b9f9b640 1 -- 172.21.15.73:0/544751062 >> 172.21.15.73:0/544751062 conn(0x7ff9b406b510 msgr2=0x7ff9b40b36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:35.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.252+0000 7ff9b9f9b640 1 -- 172.21.15.73:0/544751062 shutdown_connections 2024-03-29T04:08:35.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.252+0000 7ff9b9f9b640 1 -- 172.21.15.73:0/544751062 wait complete. 2024-03-29T04:08:35.242 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-29T04:07:59.537301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-29T04:08:09.570906+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-29T04:08:10.882349+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-29T04:08:35.243 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-29T04:08:35.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.368+0000 7fc66a749640 1 Processor -- start 2024-03-29T04:08:35.347 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.368+0000 7fc66a749640 1 -- start start 2024-03-29T04:08:35.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.368+0000 7fc66a749640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc66415b4f0 0x7fc6640c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:35.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.368+0000 7fc66a749640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc66415b8d0 0x7fc6640ca950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:35.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.368+0000 7fc66a749640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc66415bd30 con 0x7fc6640b2100 2024-03-29T04:08:35.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.368+0000 7fc66a749640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fc66415bfa0 con 0x7fc66415b4f0 2024-03-29T04:08:35.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.368+0000 7fc66a749640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc66415c280 con 0x7fc66415b8d0 2024-03-29T04:08:35.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.369+0000 7fc6637fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc66415b8d0 0x7fc6640ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:35.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.369+0000 7fc663fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc66415b4f0 0x7fc6640c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:35.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.369+0000 7fc6637fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc66415b8d0 0x7fc6640ca950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:40770/0 (socket says 172.21.15.73:40770) 2024-03-29T04:08:35.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.369+0000 7fc663fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc66415b4f0 0x7fc6640c6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:34238/0 (socket says 172.21.15.73:34238) 2024-03-29T04:08:35.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.369+0000 7fc6637fe640 1 -- 172.21.15.73:0/2725806524 learned_addr learned my addr 172.21.15.73:0/2725806524 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:35.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.369+0000 7fc668ce6640 1 --1- 172.21.15.73:0/2725806524 >> v1:172.21.15.142:6789/0 conn(0x7fc6640b2100 0x7fc6640ce170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.73:40334/0 (socket says 172.21.15.73:40334) 2024-03-29T04:08:35.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.369+0000 7fc6637fe640 1 -- 172.21.15.73:0/2725806524 >> v2:172.21.15.142:3300/0 conn(0x7fc66415b4f0 msgr2=0x7fc6640c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:35.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.369+0000 7fc6637fe640 1 --2- 172.21.15.73:0/2725806524 >> v2:172.21.15.142:3300/0 conn(0x7fc66415b4f0 0x7fc6640c6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:35.349 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.369+0000 7fc6637fe640 1 -- 172.21.15.73:0/2725806524 >> v1:172.21.15.142:6789/0 conn(0x7fc6640b2100 legacy=0x7fc6640ce170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:35.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.369+0000 7fc6637fe640 1 -- 172.21.15.73:0/2725806524 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc66415c560 con 0x7fc66415b8d0 2024-03-29T04:08:35.350 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.369+0000 7fc663fff640 1 --2- 172.21.15.73:0/2725806524 >> v2:172.21.15.142:3300/0 conn(0x7fc66415b4f0 0x7fc6640c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:08:35.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.370+0000 7fc6637fe640 1 --2- 172.21.15.73:0/2725806524 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc66415b8d0 0x7fc6640ca950 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc658009870 tx=0x7fc65802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b768b56d9939309 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:35.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.370+0000 7fc662ffd640 1 -- 172.21.15.73:0/2725806524 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc658034070 con 0x7fc66415b8d0 2024-03-29T04:08:35.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.370+0000 7fc662ffd640 1 -- 172.21.15.73:0/2725806524 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc658030840 con 0x7fc66415b8d0 2024-03-29T04:08:35.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.370+0000 7fc662ffd640 1 -- 172.21.15.73:0/2725806524 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc658030c10 con 0x7fc66415b8d0 2024-03-29T04:08:35.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.370+0000 7fc66a749640 1 -- 172.21.15.73:0/2725806524 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc66415b8d0 msgr2=0x7fc6640ca950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:35.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.370+0000 7fc66a749640 1 --2- 172.21.15.73:0/2725806524 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc66415b8d0 0x7fc6640ca950 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc658009870 tx=0x7fc65802b980 comp rx=0 tx=0).stop 2024-03-29T04:08:35.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.370+0000 7fc66a749640 1 -- 172.21.15.73:0/2725806524 shutdown_connections 2024-03-29T04:08:35.351 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.370+0000 7fc66a749640 1 --2- 172.21.15.73:0/2725806524 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc66415b8d0 0x7fc6640ca950 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:35.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.370+0000 7fc66a749640 1 --2- 172.21.15.73:0/2725806524 >> v2:172.21.15.142:3300/0 conn(0x7fc66415b4f0 0x7fc6640c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:35.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.370+0000 7fc66a749640 1 -- 172.21.15.73:0/2725806524 >> 172.21.15.73:0/2725806524 conn(0x7fc6640d0450 msgr2=0x7fc6640d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:35.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.370+0000 7fc66a749640 1 -- 172.21.15.73:0/2725806524 shutdown_connections 2024-03-29T04:08:35.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.370+0000 7fc66a749640 1 -- 172.21.15.73:0/2725806524 wait complete. 2024-03-29T04:08:35.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.372+0000 7fc66a749640 1 Processor -- start 2024-03-29T04:08:35.352 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.372+0000 7fc66a749640 1 -- start start 2024-03-29T04:08:35.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.372+0000 7fc66a749640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6640b2100 0x7fc6641f46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:35.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.372+0000 7fc66a749640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc66415b4f0 0x7fc664072ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:35.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.372+0000 7fc66a749640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc66415b8d0 0x7fc6640b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:35.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.372+0000 7fc66a749640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc6640b4bd0 con 0x7fc66415b4f0 2024-03-29T04:08:35.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.372+0000 7fc66a749640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc6640cae90 con 0x7fc6640b2100 2024-03-29T04:08:35.354 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.372+0000 7fc66a749640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc6640b4d50 con 0x7fc66415b8d0 2024-03-29T04:08:35.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.373+0000 7fc6637fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc66415b4f0 0x7fc664072ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:35.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.373+0000 7fc6637fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc66415b4f0 0x7fc664072ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45780/0 (socket says 172.21.15.73:45780) 2024-03-29T04:08:35.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.373+0000 7fc6637fe640 1 -- 172.21.15.73:0/2689273049 learned_addr learned my addr 172.21.15.73:0/2689273049 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:35.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.373+0000 7fc663fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6640b2100 0x7fc6641f46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:35.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.373+0000 7fc668ce6640 1 --2- 172.21.15.73:0/2689273049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc66415b8d0 0x7fc6640b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:35.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.373+0000 7fc6637fe640 1 -- 172.21.15.73:0/2689273049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc66415b8d0 msgr2=0x7fc6640b0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:35.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.373+0000 7fc6637fe640 1 --2- 172.21.15.73:0/2689273049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc66415b8d0 0x7fc6640b0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:35.355 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.373+0000 7fc6637fe640 1 -- 172.21.15.73:0/2689273049 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6640b2100 msgr2=0x7fc6641f46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:35.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.373+0000 7fc6637fe640 1 --2- 172.21.15.73:0/2689273049 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6640b2100 0x7fc6641f46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:35.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.373+0000 7fc6637fe640 1 -- 172.21.15.73:0/2689273049 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc664071cd0 con 0x7fc66415b4f0 2024-03-29T04:08:35.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.373+0000 7fc668ce6640 1 --2- 172.21.15.73:0/2689273049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc66415b8d0 0x7fc6640b0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:08:35.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.373+0000 7fc663fff640 1 --2- 172.21.15.73:0/2689273049 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6640b2100 0x7fc6641f46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:08:35.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.373+0000 7fc6637fe640 1 --2- 172.21.15.73:0/2689273049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc66415b4f0 0x7fc664072ee0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc658000c00 tx=0x7fc6580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:35.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.373+0000 7fc660ff9640 1 -- 172.21.15.73:0/2689273049 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc658034040 con 0x7fc66415b4f0 2024-03-29T04:08:35.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.373+0000 7fc660ff9640 1 -- 172.21.15.73:0/2689273049 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc658039d90 con 0x7fc66415b4f0 2024-03-29T04:08:35.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.373+0000 7fc66a749640 1 -- 172.21.15.73:0/2689273049 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc664071fb0 con 0x7fc66415b4f0 2024-03-29T04:08:35.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.373+0000 7fc660ff9640 1 -- 172.21.15.73:0/2689273049 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc658043630 con 0x7fc66415b4f0 2024-03-29T04:08:35.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.373+0000 7fc66a749640 1 -- 172.21.15.73:0/2689273049 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc664072570 con 0x7fc66415b4f0 2024-03-29T04:08:35.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.374+0000 7fc66a749640 1 -- 172.21.15.73:0/2689273049 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6640b4260 con 0x7fc66415b4f0 2024-03-29T04:08:35.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.375+0000 7fc660ff9640 1 -- 172.21.15.73:0/2689273049 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc65804a060 con 0x7fc66415b4f0 2024-03-29T04:08:35.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.375+0000 7fc660ff9640 1 --2- 172.21.15.73:0/2689273049 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fc65006c530 0x7fc65006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:35.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.375+0000 7fc660ff9640 1 -- 172.21.15.73:0/2689273049 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc6580ad470 con 0x7fc66415b4f0 2024-03-29T04:08:35.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.375+0000 7fc663fff640 1 --2- 172.21.15.73:0/2689273049 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fc65006c530 0x7fc65006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:35.357 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.376+0000 7fc663fff640 1 --2- 172.21.15.73:0/2689273049 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fc65006c530 0x7fc65006e9f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc654009560 tx=0x7fc654009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:35.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.379+0000 7fc660ff9640 1 -- 172.21.15.73:0/2689273049 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fc6640b4260 con 0x7fc66415b4f0 2024-03-29T04:08:35.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.551+0000 7fc66a749640 1 -- 172.21.15.73:0/2689273049 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc66409e520 con 0x7fc66415b4f0 2024-03-29T04:08:35.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.552+0000 7fc660ff9640 1 -- 172.21.15.73:0/2689273049 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7fc65803e070 con 0x7fc66415b4f0 2024-03-29T04:08:35.531 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-03-29T04:08:35.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.554+0000 7fc66a749640 1 -- 172.21.15.73:0/2689273049 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fc65006c530 msgr2=0x7fc65006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:35.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.554+0000 7fc66a749640 1 --2- 172.21.15.73:0/2689273049 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fc65006c530 0x7fc65006e9f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc654009560 tx=0x7fc654009190 comp rx=0 tx=0).stop 2024-03-29T04:08:35.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.554+0000 7fc66a749640 1 -- 172.21.15.73:0/2689273049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc66415b4f0 msgr2=0x7fc664072ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:35.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.554+0000 7fc66a749640 1 --2- 172.21.15.73:0/2689273049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc66415b4f0 0x7fc664072ee0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc658000c00 tx=0x7fc6580046c0 comp rx=0 tx=0).stop 2024-03-29T04:08:35.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.554+0000 7fc66a749640 1 -- 172.21.15.73:0/2689273049 shutdown_connections 2024-03-29T04:08:35.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.554+0000 7fc66a749640 1 --2- 172.21.15.73:0/2689273049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc66415b8d0 0x7fc6640b0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:35.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.554+0000 7fc66a749640 1 --2- 172.21.15.73:0/2689273049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc66415b4f0 0x7fc664072ee0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:35.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.554+0000 7fc66a749640 1 --2- 172.21.15.73:0/2689273049 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fc65006c530 0x7fc65006e9f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:35.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.554+0000 7fc66a749640 1 --2- 172.21.15.73:0/2689273049 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc6640b2100 0x7fc6641f46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:35.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.554+0000 7fc66a749640 1 -- 172.21.15.73:0/2689273049 >> 172.21.15.73:0/2689273049 conn(0x7fc6640d0450 msgr2=0x7fc6640d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:35.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.554+0000 7fc66a749640 1 -- 172.21.15.73:0/2689273049 shutdown_connections 2024-03-29T04:08:35.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.554+0000 7fc66a749640 1 -- 172.21.15.73:0/2689273049 wait complete. 2024-03-29T04:08:35.545 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-29T04:08:35.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.670+0000 7f15c669a640 1 Processor -- start 2024-03-29T04:08:35.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.670+0000 7f15c669a640 1 -- start start 2024-03-29T04:08:35.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.671+0000 7f15c669a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15c00b6020 0x7f15c00b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:35.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.671+0000 7f15c669a640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15c00b6500 con 0x7f15c015e8b0 2024-03-29T04:08:35.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.671+0000 7f15c669a640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15c00b4470 con 0x7f15c006b510 2024-03-29T04:08:35.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.671+0000 7f15c669a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f15c00b67e0 con 0x7f15c00b6020 2024-03-29T04:08:35.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.671+0000 7f15bffff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f15c015e8b0 0x7f15c00b2140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:34410/0 (socket says 172.21.15.73:34410) 2024-03-29T04:08:35.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.671+0000 7f15bffff640 1 -- 172.21.15.73:0/221408736 learned_addr learned my addr 172.21.15.73:0/221408736 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:35.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.671+0000 7f15bf7fe640 1 --2- 172.21.15.73:0/221408736 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15c00b6020 0x7f15c00b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:35.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.672+0000 7f15beffd640 1 -- 172.21.15.73:0/221408736 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 951574164 0 0) 0x7f15c00b6500 con 0x7f15c015e8b0 2024-03-29T04:08:35.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.672+0000 7f15beffd640 1 -- 172.21.15.73:0/221408736 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15a8003520 con 0x7f15c015e8b0 2024-03-29T04:08:35.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.672+0000 7f15beffd640 1 -- 172.21.15.73:0/221408736 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3702239508 0 0) 0x7f15c00b4470 con 0x7f15c006b510 2024-03-29T04:08:35.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.672+0000 7f15beffd640 1 -- 172.21.15.73:0/221408736 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15c00b6500 con 0x7f15c006b510 2024-03-29T04:08:35.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.672+0000 7f15bf7fe640 1 -- 172.21.15.73:0/221408736 >> v1:172.21.15.142:6789/0 conn(0x7f15c006b510 legacy=0x7f15c00ae320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:35.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.672+0000 7f15bf7fe640 1 -- 172.21.15.73:0/221408736 >> v1:172.21.15.73:6789/0 conn(0x7f15c015e8b0 legacy=0x7f15c00b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:35.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.672+0000 7f15bf7fe640 1 -- 172.21.15.73:0/221408736 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15c00b4750 con 0x7f15c00b6020 2024-03-29T04:08:35.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.672+0000 7f15bf7fe640 1 --2- 172.21.15.73:0/221408736 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15c00b6020 0x7f15c00b2a40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f15b40097d0 tx=0x7f15b402b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c36f84058ece530c server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:35.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.673+0000 7f15beffd640 1 -- 172.21.15.73:0/221408736 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b4035020 con 0x7f15c00b6020 2024-03-29T04:08:35.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.673+0000 7f15beffd640 1 -- 172.21.15.73:0/221408736 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15b4031800 con 0x7f15c00b6020 2024-03-29T04:08:35.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.673+0000 7f15beffd640 1 -- 172.21.15.73:0/221408736 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b4031bd0 con 0x7f15c00b6020 2024-03-29T04:08:35.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.673+0000 7f15c669a640 1 -- 172.21.15.73:0/221408736 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15c00b6020 msgr2=0x7f15c00b2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:35.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.673+0000 7f15c669a640 1 --2- 172.21.15.73:0/221408736 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15c00b6020 0x7f15c00b2a40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f15b40097d0 tx=0x7f15b402b8a0 comp rx=0 tx=0).stop 2024-03-29T04:08:35.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.673+0000 7f15c669a640 1 -- 172.21.15.73:0/221408736 shutdown_connections 2024-03-29T04:08:35.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.673+0000 7f15c669a640 1 --2- 172.21.15.73:0/221408736 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15c00b6020 0x7f15c00b2a40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:35.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.673+0000 7f15c669a640 1 -- 172.21.15.73:0/221408736 >> 172.21.15.73:0/221408736 conn(0x7f15c0072e40 msgr2=0x7f15c00b3040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:35.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.673+0000 7f15c669a640 1 -- 172.21.15.73:0/221408736 shutdown_connections 2024-03-29T04:08:35.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.673+0000 7f15c669a640 1 -- 172.21.15.73:0/221408736 wait complete. 2024-03-29T04:08:35.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.674+0000 7f15c669a640 1 Processor -- start 2024-03-29T04:08:35.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.674+0000 7f15c669a640 1 -- start start 2024-03-29T04:08:35.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.675+0000 7f15c669a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15c006b510 0x7f15c01f5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:35.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.675+0000 7f15c669a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15c00b6020 0x7f15c01f4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:35.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.675+0000 7f15c669a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15c015e8b0 0x7f15c01f14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:35.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.675+0000 7f15c669a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f15c006c190 con 0x7f15c015e8b0 2024-03-29T04:08:35.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.675+0000 7f15c669a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f15c00b4b30 con 0x7f15c006b510 2024-03-29T04:08:35.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.675+0000 7f15c669a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f15c006c310 con 0x7f15c00b6020 2024-03-29T04:08:35.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.675+0000 7f15c4c37640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15c015e8b0 0x7f15c01f14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:35.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.675+0000 7f15c4c37640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15c015e8b0 0x7f15c01f14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45784/0 (socket says 172.21.15.73:45784) 2024-03-29T04:08:35.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.675+0000 7f15c4c37640 1 -- 172.21.15.73:0/1173534818 learned_addr learned my addr 172.21.15.73:0/1173534818 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:35.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.675+0000 7f15bffff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15c006b510 0x7f15c01f5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:35.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.675+0000 7f15bf7fe640 1 --2- 172.21.15.73:0/1173534818 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15c00b6020 0x7f15c01f4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:35.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.676+0000 7f15c4c37640 1 -- 172.21.15.73:0/1173534818 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15c00b6020 msgr2=0x7f15c01f4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:35.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.676+0000 7f15c4c37640 1 --2- 172.21.15.73:0/1173534818 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15c00b6020 0x7f15c01f4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:35.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.676+0000 7f15c4c37640 1 -- 172.21.15.73:0/1173534818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15c006b510 msgr2=0x7f15c01f5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:35.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.676+0000 7f15c4c37640 1 --2- 172.21.15.73:0/1173534818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15c006b510 0x7f15c01f5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:35.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.676+0000 7f15c4c37640 1 -- 172.21.15.73:0/1173534818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15c0151d80 con 0x7f15c015e8b0 2024-03-29T04:08:35.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.676+0000 7f15c4c37640 1 --2- 172.21.15.73:0/1173534818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15c015e8b0 0x7f15c01f14a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f15b800c7c0 tx=0x7f15b800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:35.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.676+0000 7f15bcff9640 1 -- 172.21.15.73:0/1173534818 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b8003b70 con 0x7f15c015e8b0 2024-03-29T04:08:35.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.676+0000 7f15bcff9640 1 -- 172.21.15.73:0/1173534818 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15b8003d10 con 0x7f15c015e8b0 2024-03-29T04:08:35.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.676+0000 7f15c669a640 1 -- 172.21.15.73:0/1173534818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15c01f4590 con 0x7f15c015e8b0 2024-03-29T04:08:35.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.676+0000 7f15bcff9640 1 -- 172.21.15.73:0/1173534818 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b800aa50 con 0x7f15c015e8b0 2024-03-29T04:08:35.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.676+0000 7f15c669a640 1 -- 172.21.15.73:0/1173534818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15c01f4830 con 0x7f15c015e8b0 2024-03-29T04:08:35.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.677+0000 7f15c669a640 1 -- 172.21.15.73:0/1173534818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15c01521e0 con 0x7f15c015e8b0 2024-03-29T04:08:35.659 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.677+0000 7f15bcff9640 1 -- 172.21.15.73:0/1173534818 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f15b800abf0 con 0x7f15c015e8b0 2024-03-29T04:08:35.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.678+0000 7f15bcff9640 1 --2- 172.21.15.73:0/1173534818 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f15ac06c530 0x7f15ac06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:35.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.678+0000 7f15bffff640 1 --2- 172.21.15.73:0/1173534818 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f15ac06c530 0x7f15ac06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:35.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.678+0000 7f15bcff9640 1 -- 172.21.15.73:0/1173534818 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f15b808b540 con 0x7f15c015e8b0 2024-03-29T04:08:35.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.678+0000 7f15bffff640 1 --2- 172.21.15.73:0/1173534818 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f15ac06c530 0x7f15ac06e9f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f15b0000f60 tx=0x7f15b0007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:35.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.682+0000 7f15bcff9640 1 -- 172.21.15.73:0/1173534818 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f15c01521e0 con 0x7f15c015e8b0 2024-03-29T04:08:35.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.856+0000 7f15c669a640 1 -- 172.21.15.73:0/1173534818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f15c009f6a0 con 0x7f15c015e8b0 2024-03-29T04:08:35.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.857+0000 7f15bcff9640 1 -- 172.21.15.73:0/1173534818 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f15c0151d80 con 0x7f15c015e8b0 2024-03-29T04:08:35.836 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-03-29T04:08:35.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.859+0000 7f15c669a640 1 -- 172.21.15.73:0/1173534818 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f15ac06c530 msgr2=0x7f15ac06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:35.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.859+0000 7f15c669a640 1 --2- 172.21.15.73:0/1173534818 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f15ac06c530 0x7f15ac06e9f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f15b0000f60 tx=0x7f15b0007d30 comp rx=0 tx=0).stop 2024-03-29T04:08:35.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.859+0000 7f15c669a640 1 -- 172.21.15.73:0/1173534818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15c015e8b0 msgr2=0x7f15c01f14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:35.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.859+0000 7f15c669a640 1 --2- 172.21.15.73:0/1173534818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15c015e8b0 0x7f15c01f14a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f15b800c7c0 tx=0x7f15b800cc80 comp rx=0 tx=0).stop 2024-03-29T04:08:35.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.859+0000 7f15c669a640 1 -- 172.21.15.73:0/1173534818 shutdown_connections 2024-03-29T04:08:35.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.859+0000 7f15c669a640 1 --2- 172.21.15.73:0/1173534818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15c015e8b0 0x7f15c01f14a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:35.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.859+0000 7f15c669a640 1 --2- 172.21.15.73:0/1173534818 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f15c00b6020 0x7f15c01f4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:35.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.859+0000 7f15c669a640 1 --2- 172.21.15.73:0/1173534818 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f15ac06c530 0x7f15ac06e9f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:35.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.859+0000 7f15c669a640 1 --2- 172.21.15.73:0/1173534818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15c006b510 0x7f15c01f5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:35.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.859+0000 7f15c669a640 1 -- 172.21.15.73:0/1173534818 >> 172.21.15.73:0/1173534818 conn(0x7f15c0072e40 msgr2=0x7f15c00b3010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:35.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.859+0000 7f15c669a640 1 -- 172.21.15.73:0/1173534818 shutdown_connections 2024-03-29T04:08:35.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.859+0000 7f15c669a640 1 -- 172.21.15.73:0/1173534818 wait complete. 2024-03-29T04:08:35.849 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-29T04:08:35.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.972+0000 7fe0fb129640 1 Processor -- start 2024-03-29T04:08:35.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.972+0000 7fe0fb129640 1 -- start start 2024-03-29T04:08:35.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.973+0000 7fe0fb129640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe0f415e8b0 0x7fe0f40b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:35.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.973+0000 7fe0fb129640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe0f40b6020 0x7fe0f40b2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:35.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.973+0000 7fe0fb129640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0f40b6500 con 0x7fe0f406b510 2024-03-29T04:08:35.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.973+0000 7fe0fb129640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fe0f40b67e0 con 0x7fe0f415e8b0 2024-03-29T04:08:35.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.973+0000 7fe0fb129640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fe0f40b4470 con 0x7fe0f40b6020 2024-03-29T04:08:35.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.973+0000 7fe0f8ec5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe0f415e8b0 0x7fe0f40b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:35.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.973+0000 7fe0f8ec5640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe0f415e8b0 0x7fe0f40b2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45794/0 (socket says 172.21.15.73:45794) 2024-03-29T04:08:35.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.973+0000 7fe0f8ec5640 1 -- 172.21.15.73:0/1431052840 learned_addr learned my addr 172.21.15.73:0/1431052840 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:35.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.973+0000 7fe0f3fff640 1 --2- 172.21.15.73:0/1431052840 >> v2:172.21.15.142:3300/0 conn(0x7fe0f40b6020 0x7fe0f40b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:35.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.973+0000 7fe0f8ec5640 1 -- 172.21.15.73:0/1431052840 >> v2:172.21.15.142:3300/0 conn(0x7fe0f40b6020 msgr2=0x7fe0f40b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:35.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.973+0000 7fe0f8ec5640 1 --2- 172.21.15.73:0/1431052840 >> v2:172.21.15.142:3300/0 conn(0x7fe0f40b6020 0x7fe0f40b2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:35.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.973+0000 7fe0f8ec5640 1 -- 172.21.15.73:0/1431052840 >> v1:172.21.15.142:6789/0 conn(0x7fe0f406b510 legacy=0x7fe0f40ae320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:35.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.973+0000 7fe0f8ec5640 1 -- 172.21.15.73:0/1431052840 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0f40b4750 con 0x7fe0f415e8b0 2024-03-29T04:08:35.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.973+0000 7fe0f3fff640 1 --2- 172.21.15.73:0/1431052840 >> v2:172.21.15.142:3300/0 conn(0x7fe0f40b6020 0x7fe0f40b2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:08:35.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.974+0000 7fe0f8ec5640 1 --2- 172.21.15.73:0/1431052840 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0f415e8b0 0x7fe0f40b2a40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4071370 tx=0x7fe0e802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=598eb13167ecef45 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:35.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.974+0000 7fe0f37fe640 1 -- 172.21.15.73:0/1431052840 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e8035020 con 0x7fe0f415e8b0 2024-03-29T04:08:35.955 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.974+0000 7fe0f37fe640 1 -- 172.21.15.73:0/1431052840 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0e8031870 con 0x7fe0f415e8b0 2024-03-29T04:08:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.974+0000 7fe0f37fe640 1 -- 172.21.15.73:0/1431052840 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e8031c40 con 0x7fe0f415e8b0 2024-03-29T04:08:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.975+0000 7fe0fb129640 1 -- 172.21.15.73:0/1431052840 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0f415e8b0 msgr2=0x7fe0f40b2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.975+0000 7fe0fb129640 1 --2- 172.21.15.73:0/1431052840 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0f415e8b0 0x7fe0f40b2a40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4071370 tx=0x7fe0e802b910 comp rx=0 tx=0).stop 2024-03-29T04:08:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.975+0000 7fe0fb129640 1 -- 172.21.15.73:0/1431052840 shutdown_connections 2024-03-29T04:08:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.975+0000 7fe0fb129640 1 --2- 172.21.15.73:0/1431052840 >> v2:172.21.15.142:3300/0 conn(0x7fe0f40b6020 0x7fe0f40b2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.975+0000 7fe0fb129640 1 --2- 172.21.15.73:0/1431052840 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0f415e8b0 0x7fe0f40b2a40 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.975+0000 7fe0fb129640 1 -- 172.21.15.73:0/1431052840 >> 172.21.15.73:0/1431052840 conn(0x7fe0f4072e40 msgr2=0x7fe0f40b3040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.975+0000 7fe0fb129640 1 -- 172.21.15.73:0/1431052840 shutdown_connections 2024-03-29T04:08:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.975+0000 7fe0fb129640 1 -- 172.21.15.73:0/1431052840 wait complete. 2024-03-29T04:08:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.976+0000 7fe0fb129640 1 Processor -- start 2024-03-29T04:08:35.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.976+0000 7fe0fb129640 1 -- start start 2024-03-29T04:08:35.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.977+0000 7fe0fb129640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0f406b510 0x7fe0f413f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:35.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.977+0000 7fe0fb129640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0f40b6020 0x7fe0f413c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:35.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.977+0000 7fe0fb129640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0f415e8b0 0x7fe0f414fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:35.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.977+0000 7fe0fb129640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f40b2680 con 0x7fe0f415e8b0 2024-03-29T04:08:35.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.977+0000 7fe0fb129640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f40b4b30 con 0x7fe0f40b6020 2024-03-29T04:08:35.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.977+0000 7fe0fb129640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe0f414c6a0 con 0x7fe0f406b510 2024-03-29T04:08:35.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.977+0000 7fe0f96c6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0f415e8b0 0x7fe0f414fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:35.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.977+0000 7fe0f96c6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0f415e8b0 0x7fe0f414fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45806/0 (socket says 172.21.15.73:45806) 2024-03-29T04:08:35.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.977+0000 7fe0f96c6640 1 -- 172.21.15.73:0/2103463170 learned_addr learned my addr 172.21.15.73:0/2103463170 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:35.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.977+0000 7fe0f3fff640 1 --2- 172.21.15.73:0/2103463170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0f40b6020 0x7fe0f413c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:35.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.977+0000 7fe0f8ec5640 1 --2- 172.21.15.73:0/2103463170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0f406b510 0x7fe0f413f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:35.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.977+0000 7fe0f96c6640 1 -- 172.21.15.73:0/2103463170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0f406b510 msgr2=0x7fe0f413f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:35.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.977+0000 7fe0f96c6640 1 --2- 172.21.15.73:0/2103463170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0f406b510 0x7fe0f413f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:35.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.977+0000 7fe0f96c6640 1 -- 172.21.15.73:0/2103463170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0f40b6020 msgr2=0x7fe0f413c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:35.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.977+0000 7fe0f96c6640 1 --2- 172.21.15.73:0/2103463170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0f40b6020 0x7fe0f413c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:35.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.977+0000 7fe0f96c6640 1 -- 172.21.15.73:0/2103463170 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0f413fcc0 con 0x7fe0f415e8b0 2024-03-29T04:08:35.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.977+0000 7fe0f96c6640 1 --2- 172.21.15.73:0/2103463170 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0f415e8b0 0x7fe0f414fe70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec00c7a0 tx=0x7fe0ec00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:35.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.977+0000 7fe0f17fa640 1 -- 172.21.15.73:0/2103463170 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec003b70 con 0x7fe0f415e8b0 2024-03-29T04:08:35.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.977+0000 7fe0f17fa640 1 -- 172.21.15.73:0/2103463170 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0ec003d30 con 0x7fe0f415e8b0 2024-03-29T04:08:35.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.977+0000 7fe0fb129640 1 -- 172.21.15.73:0/2103463170 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0f41525a0 con 0x7fe0f415e8b0 2024-03-29T04:08:35.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.977+0000 7fe0f17fa640 1 -- 172.21.15.73:0/2103463170 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec00aa90 con 0x7fe0f415e8b0 2024-03-29T04:08:35.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.977+0000 7fe0fb129640 1 -- 172.21.15.73:0/2103463170 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0f4152de0 con 0x7fe0f415e8b0 2024-03-29T04:08:35.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.978+0000 7fe0fb129640 1 -- 172.21.15.73:0/2103463170 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0f409f6a0 con 0x7fe0f415e8b0 2024-03-29T04:08:35.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.979+0000 7fe0f17fa640 1 -- 172.21.15.73:0/2103463170 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fe0ec00ac30 con 0x7fe0f415e8b0 2024-03-29T04:08:35.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.979+0000 7fe0f17fa640 1 --2- 172.21.15.73:0/2103463170 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fe0d806c530 0x7fe0d806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:35.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.979+0000 7fe0f17fa640 1 -- 172.21.15.73:0/2103463170 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe0ec08b510 con 0x7fe0f415e8b0 2024-03-29T04:08:35.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.979+0000 7fe0f8ec5640 1 --2- 172.21.15.73:0/2103463170 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fe0d806c530 0x7fe0d806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:35.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.980+0000 7fe0f8ec5640 1 --2- 172.21.15.73:0/2103463170 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fe0d806c530 0x7fe0d806e9f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe0e8036000 tx=0x7fe0e803c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:35.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:35.983+0000 7fe0f17fa640 1 -- 172.21.15.73:0/2103463170 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fe0f41525a0 con 0x7fe0f415e8b0 2024-03-29T04:08:36.062 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-29T04:08:36.064 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-29T04:08:36.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.161+0000 7fe0fb129640 1 -- 172.21.15.73:0/2103463170 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe0f404f9d0 con 0x7fe0f415e8b0 2024-03-29T04:08:36.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.161+0000 7fe0f17fa640 1 -- 172.21.15.73:0/2103463170 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7fe0ec0594e0 con 0x7fe0f415e8b0 2024-03-29T04:08:36.141 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-29T04:08:36.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.163+0000 7fe0fb129640 1 -- 172.21.15.73:0/2103463170 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fe0d806c530 msgr2=0x7fe0d806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:36.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.163+0000 7fe0fb129640 1 --2- 172.21.15.73:0/2103463170 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fe0d806c530 0x7fe0d806e9f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe0e8036000 tx=0x7fe0e803c040 comp rx=0 tx=0).stop 2024-03-29T04:08:36.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.163+0000 7fe0fb129640 1 -- 172.21.15.73:0/2103463170 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0f415e8b0 msgr2=0x7fe0f414fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:36.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.163+0000 7fe0fb129640 1 --2- 172.21.15.73:0/2103463170 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0f415e8b0 0x7fe0f414fe70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec00c7a0 tx=0x7fe0ec00cc60 comp rx=0 tx=0).stop 2024-03-29T04:08:36.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.163+0000 7fe0fb129640 1 -- 172.21.15.73:0/2103463170 shutdown_connections 2024-03-29T04:08:36.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.163+0000 7fe0fb129640 1 --2- 172.21.15.73:0/2103463170 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0f415e8b0 0x7fe0f414fe70 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:36.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.163+0000 7fe0fb129640 1 --2- 172.21.15.73:0/2103463170 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fe0d806c530 0x7fe0d806e9f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:36.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.163+0000 7fe0fb129640 1 --2- 172.21.15.73:0/2103463170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0f40b6020 0x7fe0f413c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:36.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.163+0000 7fe0fb129640 1 --2- 172.21.15.73:0/2103463170 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe0f406b510 0x7fe0f413f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:36.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.163+0000 7fe0fb129640 1 -- 172.21.15.73:0/2103463170 >> 172.21.15.73:0/2103463170 conn(0x7fe0f4072e40 msgr2=0x7fe0f40b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:36.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.164+0000 7fe0fb129640 1 -- 172.21.15.73:0/2103463170 shutdown_connections 2024-03-29T04:08:36.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.164+0000 7fe0fb129640 1 -- 172.21.15.73:0/2103463170 wait complete. 2024-03-29T04:08:36.162 INFO:tasks.cephfs_test_runner:Starting test: test_data_uninlining (tasks.cephfs.test_uninlining.TestDataUninlining) 2024-03-29T04:08:36.162 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-29T04:08:36.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.315+0000 7f8fa8641640 1 Processor -- start 2024-03-29T04:08:36.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.316+0000 7f8fa8641640 1 -- start start 2024-03-29T04:08:36.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.316+0000 7f8fa8641640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8fa015b370 0x7f8fa00b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:36.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.316+0000 7f8fa8641640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fa0071ae0 con 0x7f8fa0073290 2024-03-29T04:08:36.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.316+0000 7f8fa8641640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fa0071dc0 con 0x7f8fa006f3f0 2024-03-29T04:08:36.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.316+0000 7f8fa8641640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f8fa00720a0 con 0x7f8fa015b370 2024-03-29T04:08:36.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.317+0000 7f8fa63dd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8fa015b370 0x7f8fa00b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:36.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.317+0000 7f8fa6bde640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8fa0073290 0x7f8fa015f0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:34412/0 (socket says 172.21.15.73:34412) 2024-03-29T04:08:36.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.317+0000 7f8fa6bde640 1 -- 172.21.15.73:0/1929555550 learned_addr learned my addr 172.21.15.73:0/1929555550 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:36.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.317+0000 7f8fa63dd640 1 -- 172.21.15.73:0/1929555550 >> v1:172.21.15.142:6789/0 conn(0x7f8fa006f3f0 legacy=0x7f8fa0072b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:36.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.317+0000 7f8fa63dd640 1 -- 172.21.15.73:0/1929555550 >> v1:172.21.15.73:6789/0 conn(0x7f8fa0073290 legacy=0x7f8fa015f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:36.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.317+0000 7f8fa53db640 1 -- 172.21.15.73:0/1929555550 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1034465136 0 0) 0x7f8fa0071ae0 con 0x7f8fa0073290 2024-03-29T04:08:36.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.317+0000 7f8fa63dd640 1 -- 172.21.15.73:0/1929555550 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa0072380 con 0x7f8fa015b370 2024-03-29T04:08:36.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.318+0000 7f8fa63dd640 1 --2- 172.21.15.73:0/1929555550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fa015b370 0x7f8fa00b32c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c009d90 tx=0x7f8f9c02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bd4eeab61b11b0d server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:36.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.318+0000 7f8fa53db640 1 -- 172.21.15.73:0/1929555550 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c039070 con 0x7f8fa015b370 2024-03-29T04:08:36.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.318+0000 7f8fa53db640 1 -- 172.21.15.73:0/1929555550 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f9c02cd00 con 0x7f8fa015b370 2024-03-29T04:08:36.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.318+0000 7f8fa53db640 1 -- 172.21.15.73:0/1929555550 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c034660 con 0x7f8fa015b370 2024-03-29T04:08:36.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.318+0000 7f8fa8641640 1 -- 172.21.15.73:0/1929555550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fa015b370 msgr2=0x7f8fa00b32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:36.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.318+0000 7f8fa8641640 1 --2- 172.21.15.73:0/1929555550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fa015b370 0x7f8fa00b32c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c009d90 tx=0x7f8f9c02bf50 comp rx=0 tx=0).stop 2024-03-29T04:08:36.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.318+0000 7f8fa8641640 1 -- 172.21.15.73:0/1929555550 shutdown_connections 2024-03-29T04:08:36.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.318+0000 7f8fa8641640 1 --2- 172.21.15.73:0/1929555550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fa015b370 0x7f8fa00b32c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:36.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.318+0000 7f8fa8641640 1 -- 172.21.15.73:0/1929555550 >> 172.21.15.73:0/1929555550 conn(0x7f8fa006b510 msgr2=0x7f8fa006b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:36.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.319+0000 7f8fa8641640 1 -- 172.21.15.73:0/1929555550 shutdown_connections 2024-03-29T04:08:36.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.319+0000 7f8fa8641640 1 -- 172.21.15.73:0/1929555550 wait complete. 2024-03-29T04:08:36.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.320+0000 7f8fa8641640 1 Processor -- start 2024-03-29T04:08:36.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.320+0000 7f8fa8641640 1 -- start start 2024-03-29T04:08:36.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.320+0000 7f8fa8641640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8fa006f3f0 0x7f8fa014c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:36.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.320+0000 7f8fa8641640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fa0073290 0x7f8fa014cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:36.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.320+0000 7f8fa8641640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8fa015b370 0x7f8fa014d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:36.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.320+0000 7f8fa8641640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa00b3980 con 0x7f8fa0073290 2024-03-29T04:08:36.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.320+0000 7f8fa8641640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa00b3800 con 0x7f8fa015b370 2024-03-29T04:08:36.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.320+0000 7f8fa8641640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f8fa015b750 con 0x7f8fa006f3f0 2024-03-29T04:08:36.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.320+0000 7f8fa5bdc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fa0073290 0x7f8fa014cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:36.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.320+0000 7f8fa5bdc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fa0073290 0x7f8fa014cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45810/0 (socket says 172.21.15.73:45810) 2024-03-29T04:08:36.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.320+0000 7f8fa5bdc640 1 -- 172.21.15.73:0/3831429910 learned_addr learned my addr 172.21.15.73:0/3831429910 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:36.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.321+0000 7f8fa63dd640 1 --2- 172.21.15.73:0/3831429910 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8fa006f3f0 0x7f8fa014c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:36.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.321+0000 7f8fa6bde640 1 --2- 172.21.15.73:0/3831429910 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8fa015b370 0x7f8fa014d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:36.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.321+0000 7f8fa5bdc640 1 -- 172.21.15.73:0/3831429910 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8fa006f3f0 msgr2=0x7f8fa014c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:36.303 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.321+0000 7f8fa5bdc640 1 --2- 172.21.15.73:0/3831429910 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8fa006f3f0 0x7f8fa014c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:36.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.321+0000 7f8fa5bdc640 1 -- 172.21.15.73:0/3831429910 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8fa015b370 msgr2=0x7f8fa014d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:36.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.321+0000 7f8fa5bdc640 1 --2- 172.21.15.73:0/3831429910 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8fa015b370 0x7f8fa014d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:36.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.321+0000 7f8fa5bdc640 1 -- 172.21.15.73:0/3831429910 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa014c760 con 0x7f8fa0073290 2024-03-29T04:08:36.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.321+0000 7f8fa5bdc640 1 --2- 172.21.15.73:0/3831429910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fa0073290 0x7f8fa014cf00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8f9000c400 tx=0x7f8f9000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:36.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.321+0000 7f8f96ffd640 1 -- 172.21.15.73:0/3831429910 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f90017070 con 0x7f8fa0073290 2024-03-29T04:08:36.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.321+0000 7f8f96ffd640 1 -- 172.21.15.73:0/3831429910 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f900052d0 con 0x7f8fa0073290 2024-03-29T04:08:36.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.321+0000 7f8fa8641640 1 -- 172.21.15.73:0/3831429910 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fa014b8b0 con 0x7f8fa0073290 2024-03-29T04:08:36.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.321+0000 7f8f96ffd640 1 -- 172.21.15.73:0/3831429910 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f90003830 con 0x7f8fa0073290 2024-03-29T04:08:36.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.321+0000 7f8fa8641640 1 -- 172.21.15.73:0/3831429910 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fa014dd50 con 0x7f8fa0073290 2024-03-29T04:08:36.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.322+0000 7f8fa8641640 1 -- 172.21.15.73:0/3831429910 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fa0068640 con 0x7f8fa0073290 2024-03-29T04:08:36.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.323+0000 7f8f96ffd640 1 -- 172.21.15.73:0/3831429910 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f8f9001a070 con 0x7f8fa0073290 2024-03-29T04:08:36.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.323+0000 7f8f96ffd640 1 --2- 172.21.15.73:0/3831429910 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f8f8406c530 0x7f8f8406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:36.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.323+0000 7f8f96ffd640 1 -- 172.21.15.73:0/3831429910 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8f9008aad0 con 0x7f8fa0073290 2024-03-29T04:08:36.304 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.323+0000 7f8fa63dd640 1 --2- 172.21.15.73:0/3831429910 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f8f8406c530 0x7f8f8406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:36.305 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.323+0000 7f8fa63dd640 1 --2- 172.21.15.73:0/3831429910 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f8f8406c530 0x7f8f8406e9f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c036000 tx=0x7f8f9c030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:36.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.327+0000 7f8f96ffd640 1 -- 172.21.15.73:0/3831429910 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f8f90058990 con 0x7f8fa0073290 2024-03-29T04:08:36.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.501+0000 7f8fa8641640 1 -- 172.21.15.73:0/3831429910 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8fa00b1950 con 0x7f8fa0073290 2024-03-29T04:08:36.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.503+0000 7f8f96ffd640 1 -- 172.21.15.73:0/3831429910 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16605 (secure 0 0 0) 0x7f8f9005cc90 con 0x7f8fa0073290 2024-03-29T04:08:36.483 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:36.483 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"6bff1617-b138-4517-acca-3ecaae3f2bb3","created":"2024-03-29T04:07:47.346864+0000","modified":"2024-03-29T04:08:13.577603+0000","last_up_change":"2024-03-29T04:07:58.507139+0000","last_in_change":"2024-03-29T04:07:49.637816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-29T04:07:59.537301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-29T04:08:09.570906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-29T04:08:10.882349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"925d7de1-14ab-48c0-aebd-7bded108f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6820","nonce":2387335359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6824","nonce":2387335359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6831","nonce":2387335359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6828","nonce":2387335359}]},"public_addr":"172.21.15.73:6820/2387335359","cluster_addr":"172.21.15.73:6824/2387335359","heartbeat_back_addr":"172.21.15.73:6831/2387335359","heartbeat_front_addr":"172.21.15.73:6828/2387335359","state":["exists","up"]},{"osd":1,"uuid":"6b182102-882a-4e0c-99db-0afae5cfb38b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6801","nonce":2431315515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6803","nonce":2431315515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6807","nonce":2431315515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6805","nonce":2431315515}]},"public_addr":"172.21.15.73:6801/2431315515","cluster_addr":"172.21.15.73:6803/2431315515","heartbeat_back_addr":"172.21.15.73:6807/2431315515","heartbeat_front_addr":"172.21.15.73:6805/2431315515","state":["exists","up"]},{"osd":2,"uuid":"8040902e-b0b8-4a21-bf64-ce1c222115ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6809","nonce":407236597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6811","nonce":407236597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6815","nonce":407236597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6813","nonce":407236597}]},"public_addr":"172.21.15.73:6809/407236597","cluster_addr":"172.21.15.73:6811/407236597","heartbeat_back_addr":"172.21.15.73:6815/407236597","heartbeat_front_addr":"172.21.15.73:6813/407236597","state":["exists","up"]},{"osd":3,"uuid":"1bab19ee-3775-4ce1-a4ce-cf7cda3bbbf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6817","nonce":4291100709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6821","nonce":4291100709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6829","nonce":4291100709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6825","nonce":4291100709}]},"public_addr":"172.21.15.73:6817/4291100709","cluster_addr":"172.21.15.73:6821/4291100709","heartbeat_back_addr":"172.21.15.73:6829/4291100709","heartbeat_front_addr":"172.21.15.73:6825/4291100709","state":["exists","up"]},{"osd":4,"uuid":"b0c74337-8fe4-47dc-b3da-2d07591b1f6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6817","nonce":3703256194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6819","nonce":3703256194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6823","nonce":3703256194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6821","nonce":3703256194}]},"public_addr":"172.21.15.142:6817/3703256194","cluster_addr":"172.21.15.142:6819/3703256194","heartbeat_back_addr":"172.21.15.142:6823/3703256194","heartbeat_front_addr":"172.21.15.142:6821/3703256194","state":["exists","up"]},{"osd":5,"uuid":"9ce36410-a29a-42c6-99f4-f95d4afdd7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6825","nonce":4271575803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6827","nonce":4271575803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6831","nonce":4271575803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6829","nonce":4271575803}]},"public_addr":"172.21.15.142:6825/4271575803","cluster_addr":"172.21.15.142:6827/4271575803","heartbeat_back_addr":"172.21.15.142:6831/4271575803","heartbeat_front_addr":"172.21.15.142:6829/4271575803","state":["exists","up"]},{"osd":6,"uuid":"aec4264a-64ac-428e-a860-d2920a304019","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6801","nonce":1772722570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6803","nonce":1772722570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6807","nonce":1772722570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6805","nonce":1772722570}]},"public_addr":"172.21.15.142:6801/1772722570","cluster_addr":"172.21.15.142:6803/1772722570","heartbeat_back_addr":"172.21.15.142:6807/1772722570","heartbeat_front_addr":"172.21.15.142:6805/1772722570","state":["exists","up"]},{"osd":7,"uuid":"fe599052-8e5a-4c7a-91e7-52d1bae24a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6809","nonce":3910589675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6811","nonce":3910589675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6815","nonce":3910589675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6813","nonce":3910589675}]},"public_addr":"172.21.15.142:6809/3910589675","cluster_addr":"172.21.15.142:6811/3910589675","heartbeat_back_addr":"172.21.15.142:6815/3910589675","heartbeat_front_addr":"172.21.15.142:6813/3910589675","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.835096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.587210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.786547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.778004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.843740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.791160+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.837992+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.718722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:08:36.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.505+0000 7f8fa8641640 1 -- 172.21.15.73:0/3831429910 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f8f8406c530 msgr2=0x7f8f8406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:36.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.505+0000 7f8fa8641640 1 --2- 172.21.15.73:0/3831429910 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f8f8406c530 0x7f8f8406e9f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c036000 tx=0x7f8f9c030000 comp rx=0 tx=0).stop 2024-03-29T04:08:36.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.505+0000 7f8fa8641640 1 -- 172.21.15.73:0/3831429910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fa0073290 msgr2=0x7f8fa014cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:36.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.505+0000 7f8fa8641640 1 --2- 172.21.15.73:0/3831429910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fa0073290 0x7f8fa014cf00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8f9000c400 tx=0x7f8f9000c8c0 comp rx=0 tx=0).stop 2024-03-29T04:08:36.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.505+0000 7f8fa8641640 1 -- 172.21.15.73:0/3831429910 shutdown_connections 2024-03-29T04:08:36.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.505+0000 7f8fa8641640 1 --2- 172.21.15.73:0/3831429910 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f8f8406c530 0x7f8f8406e9f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:36.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.505+0000 7f8fa8641640 1 --2- 172.21.15.73:0/3831429910 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8fa015b370 0x7f8fa014d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:36.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.505+0000 7f8fa8641640 1 --2- 172.21.15.73:0/3831429910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8fa0073290 0x7f8fa014cf00 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:36.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.505+0000 7f8fa8641640 1 --2- 172.21.15.73:0/3831429910 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8fa006f3f0 0x7f8fa014c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:36.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.505+0000 7f8fa8641640 1 -- 172.21.15.73:0/3831429910 >> 172.21.15.73:0/3831429910 conn(0x7f8fa006b510 msgr2=0x7f8fa00affc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:36.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.505+0000 7f8fa8641640 1 -- 172.21.15.73:0/3831429910 shutdown_connections 2024-03-29T04:08:36.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.505+0000 7f8fa8641640 1 -- 172.21.15.73:0/3831429910 wait complete. 2024-03-29T04:08:36.495 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-29T04:07:59.537301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-29T04:08:09.570906+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-29T04:08:10.882349+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-29T04:08:36.496 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-29T04:08:36.601 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.622+0000 7f027bc70640 1 Processor -- start 2024-03-29T04:08:36.602 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.622+0000 7f027bc70640 1 -- start start 2024-03-29T04:08:36.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.622+0000 7f027bc70640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0274161f50 0x7f027406fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:36.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.623+0000 7f027bc70640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0274163240 con 0x7f027409aec0 2024-03-29T04:08:36.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.623+0000 7f027bc70640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02740d06f0 con 0x7f027409aa30 2024-03-29T04:08:36.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.623+0000 7f027bc70640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f027415f300 con 0x7f0274161f50 2024-03-29T04:08:36.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.623+0000 7f0279a0c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0274161f50 0x7f027406fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:36.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.623+0000 7f0279a0c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0274161f50 0x7f027406fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45816/0 (socket says 172.21.15.73:45816) 2024-03-29T04:08:36.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.623+0000 7f027a20d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f027409aec0 0x7f0274162b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:34418/0 (socket says 172.21.15.73:34418) 2024-03-29T04:08:36.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.623+0000 7f0279a0c640 1 -- 172.21.15.73:0/1247972885 learned_addr learned my addr 172.21.15.73:0/1247972885 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:36.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.623+0000 7f0279a0c640 1 -- 172.21.15.73:0/1247972885 >> v1:172.21.15.142:6789/0 conn(0x7f027409aa30 legacy=0x7f0274162420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:36.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.623+0000 7f0279a0c640 1 -- 172.21.15.73:0/1247972885 >> v1:172.21.15.73:6789/0 conn(0x7f027409aec0 legacy=0x7f0274162b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:36.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.623+0000 7f0279a0c640 1 -- 172.21.15.73:0/1247972885 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f027415f5e0 con 0x7f0274161f50 2024-03-29T04:08:36.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.623+0000 7f0278a0a640 1 -- 172.21.15.73:0/1247972885 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4189860056 0 0) 0x7f0274163240 con 0x7f027409aec0 2024-03-29T04:08:36.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.624+0000 7f0279a0c640 1 --2- 172.21.15.73:0/1247972885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0274161f50 0x7f027406fb40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0270009870 tx=0x7f027002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f47ff36a29f47b server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:36.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.624+0000 7f0278a0a640 1 -- 172.21.15.73:0/1247972885 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0270034070 con 0x7f0274161f50 2024-03-29T04:08:36.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.624+0000 7f0278a0a640 1 -- 172.21.15.73:0/1247972885 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0270030860 con 0x7f0274161f50 2024-03-29T04:08:36.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.624+0000 7f0278a0a640 1 -- 172.21.15.73:0/1247972885 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0270030c30 con 0x7f0274161f50 2024-03-29T04:08:36.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.624+0000 7f027bc70640 1 -- 172.21.15.73:0/1247972885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0274161f50 msgr2=0x7f027406fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:36.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.624+0000 7f027bc70640 1 --2- 172.21.15.73:0/1247972885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0274161f50 0x7f027406fb40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0270009870 tx=0x7f027002b9a0 comp rx=0 tx=0).stop 2024-03-29T04:08:36.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.624+0000 7f027bc70640 1 -- 172.21.15.73:0/1247972885 shutdown_connections 2024-03-29T04:08:36.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.624+0000 7f027bc70640 1 --2- 172.21.15.73:0/1247972885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0274161f50 0x7f027406fb40 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:36.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.624+0000 7f027bc70640 1 -- 172.21.15.73:0/1247972885 >> 172.21.15.73:0/1247972885 conn(0x7f02740b3fa0 msgr2=0x7f02740b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:36.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.625+0000 7f027bc70640 1 -- 172.21.15.73:0/1247972885 shutdown_connections 2024-03-29T04:08:36.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.625+0000 7f027bc70640 1 -- 172.21.15.73:0/1247972885 wait complete. 2024-03-29T04:08:36.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.626+0000 7f027bc70640 1 Processor -- start 2024-03-29T04:08:36.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.626+0000 7f027bc70640 1 -- start start 2024-03-29T04:08:36.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.626+0000 7f027bc70640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f027409aa30 0x7f02740af240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:36.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.626+0000 7f027bc70640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f027409aec0 0x7f02740b7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:36.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.626+0000 7f027bc70640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0274161f50 0x7f02740b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:36.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.626+0000 7f027bc70640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f027409b2d0 con 0x7f027409aec0 2024-03-29T04:08:36.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.626+0000 7f027bc70640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f027415fba0 con 0x7f0274161f50 2024-03-29T04:08:36.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.626+0000 7f027bc70640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f0274160220 con 0x7f027409aa30 2024-03-29T04:08:36.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.626+0000 7f027920b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f027409aec0 0x7f02740b7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:36.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.626+0000 7f027920b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f027409aec0 0x7f02740b7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45820/0 (socket says 172.21.15.73:45820) 2024-03-29T04:08:36.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.627+0000 7f027920b640 1 -- 172.21.15.73:0/2802545474 learned_addr learned my addr 172.21.15.73:0/2802545474 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:36.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.627+0000 7f0279a0c640 1 --2- 172.21.15.73:0/2802545474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f027409aa30 0x7f02740af240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:36.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.627+0000 7f027a20d640 1 --2- 172.21.15.73:0/2802545474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0274161f50 0x7f02740b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:36.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.627+0000 7f027920b640 1 -- 172.21.15.73:0/2802545474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f027409aa30 msgr2=0x7f02740af240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:36.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.627+0000 7f027920b640 1 --2- 172.21.15.73:0/2802545474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f027409aa30 0x7f02740af240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:36.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.627+0000 7f027920b640 1 -- 172.21.15.73:0/2802545474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0274161f50 msgr2=0x7f02740b79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:36.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.627+0000 7f027920b640 1 --2- 172.21.15.73:0/2802545474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0274161f50 0x7f02740b79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:36.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.627+0000 7f027920b640 1 -- 172.21.15.73:0/2802545474 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02740b66c0 con 0x7f027409aec0 2024-03-29T04:08:36.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.627+0000 7f027920b640 1 --2- 172.21.15.73:0/2802545474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f027409aec0 0x7f02740b7480 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f026400c480 tx=0x7f026400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:36.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.627+0000 7f026a7fc640 1 -- 172.21.15.73:0/2802545474 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02640052d0 con 0x7f027409aec0 2024-03-29T04:08:36.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.627+0000 7f026a7fc640 1 -- 172.21.15.73:0/2802545474 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0264005470 con 0x7f027409aec0 2024-03-29T04:08:36.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.627+0000 7f027bc70640 1 -- 172.21.15.73:0/2802545474 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02740b69a0 con 0x7f027409aec0 2024-03-29T04:08:36.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.627+0000 7f026a7fc640 1 -- 172.21.15.73:0/2802545474 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0264012870 con 0x7f027409aec0 2024-03-29T04:08:36.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.627+0000 7f027bc70640 1 -- 172.21.15.73:0/2802545474 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02740b62e0 con 0x7f027409aec0 2024-03-29T04:08:36.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.628+0000 7f027bc70640 1 -- 172.21.15.73:0/2802545474 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02740a05c0 con 0x7f027409aec0 2024-03-29T04:08:36.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.629+0000 7f026a7fc640 1 -- 172.21.15.73:0/2802545474 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f0264012a10 con 0x7f027409aec0 2024-03-29T04:08:36.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.629+0000 7f026a7fc640 1 --2- 172.21.15.73:0/2802545474 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f025806c530 0x7f025806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:36.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.629+0000 7f0279a0c640 1 --2- 172.21.15.73:0/2802545474 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f025806c530 0x7f025806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:36.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.629+0000 7f026a7fc640 1 -- 172.21.15.73:0/2802545474 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f026408b180 con 0x7f027409aec0 2024-03-29T04:08:36.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.629+0000 7f0279a0c640 1 --2- 172.21.15.73:0/2802545474 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f025806c530 0x7f025806e9f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0270036000 tx=0x7f027003c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:36.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.633+0000 7f026a7fc640 1 -- 172.21.15.73:0/2802545474 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f02640591e0 con 0x7f027409aec0 2024-03-29T04:08:36.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.806+0000 7f027bc70640 1 -- 172.21.15.73:0/2802545474 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f02740b4de0 con 0x7f027409aec0 2024-03-29T04:08:36.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.807+0000 7f026a7fc640 1 -- 172.21.15.73:0/2802545474 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f026405d4e0 con 0x7f027409aec0 2024-03-29T04:08:36.786 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-03-29T04:08:36.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.808+0000 7f027bc70640 1 -- 172.21.15.73:0/2802545474 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f025806c530 msgr2=0x7f025806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:36.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.808+0000 7f027bc70640 1 --2- 172.21.15.73:0/2802545474 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f025806c530 0x7f025806e9f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0270036000 tx=0x7f027003c040 comp rx=0 tx=0).stop 2024-03-29T04:08:36.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.808+0000 7f027bc70640 1 -- 172.21.15.73:0/2802545474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f027409aec0 msgr2=0x7f02740b7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:36.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.808+0000 7f027bc70640 1 --2- 172.21.15.73:0/2802545474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f027409aec0 0x7f02740b7480 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f026400c480 tx=0x7f026400c940 comp rx=0 tx=0).stop 2024-03-29T04:08:36.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.808+0000 7f027bc70640 1 -- 172.21.15.73:0/2802545474 shutdown_connections 2024-03-29T04:08:36.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.808+0000 7f027bc70640 1 --2- 172.21.15.73:0/2802545474 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f025806c530 0x7f025806e9f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:36.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.808+0000 7f027bc70640 1 --2- 172.21.15.73:0/2802545474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0274161f50 0x7f02740b79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:36.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.808+0000 7f027bc70640 1 --2- 172.21.15.73:0/2802545474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f027409aec0 0x7f02740b7480 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:36.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.808+0000 7f027bc70640 1 --2- 172.21.15.73:0/2802545474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f027409aa30 0x7f02740af240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:36.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.808+0000 7f027bc70640 1 -- 172.21.15.73:0/2802545474 >> 172.21.15.73:0/2802545474 conn(0x7f02740b3fa0 msgr2=0x7f027415e330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:36.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.809+0000 7f027bc70640 1 -- 172.21.15.73:0/2802545474 shutdown_connections 2024-03-29T04:08:36.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.809+0000 7f027bc70640 1 -- 172.21.15.73:0/2802545474 wait complete. 2024-03-29T04:08:36.799 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-29T04:08:36.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.922+0000 7f421e63f640 1 Processor -- start 2024-03-29T04:08:36.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.922+0000 7f421e63f640 1 -- start start 2024-03-29T04:08:36.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.922+0000 7f421e63f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f42180b4e40 0x7f42180c6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:36.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.922+0000 7f421e63f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f42180b2810 0x7f42180cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:36.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.922+0000 7f421e63f640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42181604d0 con 0x7f42180b31c0 2024-03-29T04:08:36.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.922+0000 7f421e63f640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f42180c6d60 con 0x7f42180b4e40 2024-03-29T04:08:36.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.922+0000 7f421e63f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f42180cba20 con 0x7f42180b2810 2024-03-29T04:08:36.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.923+0000 7f4217fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f42180b4e40 0x7f42180c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:36.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.923+0000 7f42177fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f42180b31c0 0x7f42180b2100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:34428/0 (socket says 172.21.15.73:34428) 2024-03-29T04:08:36.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.923+0000 7f42177fe640 1 -- 172.21.15.73:0/3993912355 learned_addr learned my addr 172.21.15.73:0/3993912355 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:36.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.923+0000 7f421cbdc640 1 --2- 172.21.15.73:0/3993912355 >> v2:172.21.15.142:3300/0 conn(0x7f42180b2810 0x7f42180cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:36.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.923+0000 7f4217fff640 1 -- 172.21.15.73:0/3993912355 >> v2:172.21.15.142:3300/0 conn(0x7f42180b2810 msgr2=0x7f42180cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:36.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.923+0000 7f4217fff640 1 --2- 172.21.15.73:0/3993912355 >> v2:172.21.15.142:3300/0 conn(0x7f42180b2810 0x7f42180cbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:36.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.923+0000 7f4217fff640 1 -- 172.21.15.73:0/3993912355 >> v1:172.21.15.73:6789/0 conn(0x7f42180b31c0 legacy=0x7f42180b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:36.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.923+0000 7f4216ffd640 1 -- 172.21.15.73:0/3993912355 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 596616172 0 0) 0x7f42181604d0 con 0x7f42180b31c0 2024-03-29T04:08:36.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.923+0000 7f4217fff640 1 -- 172.21.15.73:0/3993912355 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42181607b0 con 0x7f42180b4e40 2024-03-29T04:08:36.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.924+0000 7f4217fff640 1 --2- 172.21.15.73:0/3993912355 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42180b4e40 0x7f42180c6820 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f421815a640 tx=0x7f420002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a6f27232528e7f1 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:36.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.924+0000 7f4216ffd640 1 -- 172.21.15.73:0/3993912355 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42000315a0 con 0x7f42180b4e40 2024-03-29T04:08:36.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.924+0000 7f4216ffd640 1 -- 172.21.15.73:0/3993912355 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4200037070 con 0x7f42180b4e40 2024-03-29T04:08:36.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.924+0000 7f4216ffd640 1 -- 172.21.15.73:0/3993912355 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4200031960 con 0x7f42180b4e40 2024-03-29T04:08:36.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.924+0000 7f421e63f640 1 -- 172.21.15.73:0/3993912355 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42180b4e40 msgr2=0x7f42180c6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:36.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.924+0000 7f421e63f640 1 --2- 172.21.15.73:0/3993912355 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42180b4e40 0x7f42180c6820 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f421815a640 tx=0x7f420002b840 comp rx=0 tx=0).stop 2024-03-29T04:08:36.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.924+0000 7f421e63f640 1 -- 172.21.15.73:0/3993912355 shutdown_connections 2024-03-29T04:08:36.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.924+0000 7f421e63f640 1 --2- 172.21.15.73:0/3993912355 >> v2:172.21.15.142:3300/0 conn(0x7f42180b2810 0x7f42180cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:36.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.924+0000 7f421e63f640 1 --2- 172.21.15.73:0/3993912355 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42180b4e40 0x7f42180c6820 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:36.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.924+0000 7f421e63f640 1 -- 172.21.15.73:0/3993912355 >> 172.21.15.73:0/3993912355 conn(0x7f42180d0450 msgr2=0x7f42180d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:36.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.924+0000 7f421e63f640 1 -- 172.21.15.73:0/3993912355 shutdown_connections 2024-03-29T04:08:36.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.924+0000 7f421e63f640 1 -- 172.21.15.73:0/3993912355 wait complete. 2024-03-29T04:08:36.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.925+0000 7f421e63f640 1 Processor -- start 2024-03-29T04:08:36.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.926+0000 7f421e63f640 1 -- start start 2024-03-29T04:08:36.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.926+0000 7f421e63f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42180b2810 0x7f42181503b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:36.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.926+0000 7f421e63f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42180b31c0 0x7f42180b1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:36.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.926+0000 7f421e63f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42180b4e40 0x7f42180cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:36.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.926+0000 7f421e63f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f42180b3650 con 0x7f42180b4e40 2024-03-29T04:08:36.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.926+0000 7f421e63f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4218160d70 con 0x7f42180b31c0 2024-03-29T04:08:36.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.926+0000 7f421e63f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f42180c60f0 con 0x7f42180b2810 2024-03-29T04:08:36.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.926+0000 7f421cbdc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42180b4e40 0x7f42180cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:36.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.926+0000 7f421cbdc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42180b4e40 0x7f42180cddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45828/0 (socket says 172.21.15.73:45828) 2024-03-29T04:08:36.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.926+0000 7f421cbdc640 1 -- 172.21.15.73:0/3187765730 learned_addr learned my addr 172.21.15.73:0/3187765730 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:36.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.926+0000 7f42177fe640 1 --2- 172.21.15.73:0/3187765730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42180b31c0 0x7f42180b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:36.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.926+0000 7f4217fff640 1 --2- 172.21.15.73:0/3187765730 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42180b2810 0x7f42181503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:36.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.927+0000 7f421cbdc640 1 -- 172.21.15.73:0/3187765730 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42180b2810 msgr2=0x7f42181503b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:36.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.927+0000 7f421cbdc640 1 --2- 172.21.15.73:0/3187765730 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42180b2810 0x7f42181503b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:36.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.927+0000 7f421cbdc640 1 -- 172.21.15.73:0/3187765730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42180b31c0 msgr2=0x7f42180b1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:36.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.927+0000 7f421cbdc640 1 --2- 172.21.15.73:0/3187765730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42180b31c0 0x7f42180b1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:36.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.927+0000 7f421cbdc640 1 -- 172.21.15.73:0/3187765730 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42180ce550 con 0x7f42180b4e40 2024-03-29T04:08:36.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.927+0000 7f421cbdc640 1 --2- 172.21.15.73:0/3187765730 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42180b4e40 0x7f42180cddb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f421000efc0 tx=0x7f421000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:36.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.927+0000 7f4214ff9640 1 -- 172.21.15.73:0/3187765730 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4210018020 con 0x7f42180b4e40 2024-03-29T04:08:36.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.927+0000 7f4214ff9640 1 -- 172.21.15.73:0/3187765730 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4210014480 con 0x7f42180b4e40 2024-03-29T04:08:36.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.927+0000 7f421e63f640 1 -- 172.21.15.73:0/3187765730 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42180ce830 con 0x7f42180b4e40 2024-03-29T04:08:36.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.927+0000 7f4214ff9640 1 -- 172.21.15.73:0/3187765730 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4210014870 con 0x7f42180b4e40 2024-03-29T04:08:36.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.927+0000 7f421e63f640 1 -- 172.21.15.73:0/3187765730 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42180cedf0 con 0x7f42180b4e40 2024-03-29T04:08:36.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.928+0000 7f421e63f640 1 -- 172.21.15.73:0/3187765730 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f421804f9d0 con 0x7f42180b4e40 2024-03-29T04:08:36.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.928+0000 7f4214ff9640 1 -- 172.21.15.73:0/3187765730 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f4210005d10 con 0x7f42180b4e40 2024-03-29T04:08:36.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.929+0000 7f4214ff9640 1 --2- 172.21.15.73:0/3187765730 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f41f806c530 0x7f41f806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:36.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.929+0000 7f4214ff9640 1 -- 172.21.15.73:0/3187765730 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f421008c0d0 con 0x7f42180b4e40 2024-03-29T04:08:36.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.929+0000 7f4217fff640 1 --2- 172.21.15.73:0/3187765730 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f41f806c530 0x7f41f806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:36.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.929+0000 7f4217fff640 1 --2- 172.21.15.73:0/3187765730 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f41f806c530 0x7f41f806e9f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4200036000 tx=0x7f4200008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:36.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:36.933+0000 7f4214ff9640 1 -- 172.21.15.73:0/3187765730 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f4210022070 con 0x7f42180b4e40 2024-03-29T04:08:37.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.104+0000 7f421e63f640 1 -- 172.21.15.73:0/3187765730 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f42180c5cb0 con 0x7f42180b4e40 2024-03-29T04:08:37.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.105+0000 7f4214ff9640 1 -- 172.21.15.73:0/3187765730 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f4210010040 con 0x7f42180b4e40 2024-03-29T04:08:37.085 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-03-29T04:08:37.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.107+0000 7f421e63f640 1 -- 172.21.15.73:0/3187765730 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f41f806c530 msgr2=0x7f41f806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:37.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.107+0000 7f421e63f640 1 --2- 172.21.15.73:0/3187765730 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f41f806c530 0x7f41f806e9f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4200036000 tx=0x7f4200008030 comp rx=0 tx=0).stop 2024-03-29T04:08:37.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.107+0000 7f421e63f640 1 -- 172.21.15.73:0/3187765730 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42180b4e40 msgr2=0x7f42180cddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:37.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.107+0000 7f421e63f640 1 --2- 172.21.15.73:0/3187765730 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42180b4e40 0x7f42180cddb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f421000efc0 tx=0x7f421000c490 comp rx=0 tx=0).stop 2024-03-29T04:08:37.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.107+0000 7f421e63f640 1 -- 172.21.15.73:0/3187765730 shutdown_connections 2024-03-29T04:08:37.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.107+0000 7f421e63f640 1 --2- 172.21.15.73:0/3187765730 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42180b4e40 0x7f42180cddb0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:37.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.107+0000 7f421e63f640 1 --2- 172.21.15.73:0/3187765730 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f41f806c530 0x7f41f806e9f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:37.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.107+0000 7f421e63f640 1 --2- 172.21.15.73:0/3187765730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42180b31c0 0x7f42180b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:37.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.107+0000 7f421e63f640 1 --2- 172.21.15.73:0/3187765730 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42180b2810 0x7f42181503b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:37.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.107+0000 7f421e63f640 1 -- 172.21.15.73:0/3187765730 >> 172.21.15.73:0/3187765730 conn(0x7f42180d0450 msgr2=0x7f42180cbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:37.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.107+0000 7f421e63f640 1 -- 172.21.15.73:0/3187765730 shutdown_connections 2024-03-29T04:08:37.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.107+0000 7f421e63f640 1 -- 172.21.15.73:0/3187765730 wait complete. 2024-03-29T04:08:37.098 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-29T04:08:37.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.221+0000 7f0498796640 1 Processor -- start 2024-03-29T04:08:37.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.221+0000 7f0498796640 1 -- start start 2024-03-29T04:08:37.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.222+0000 7f0498796640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f049015e920 0x7f04900d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:37.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.222+0000 7f0498796640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f04900d16a0 0x7f04900d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:37.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.222+0000 7f0498796640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04900d3780 con 0x7f04900cfde0 2024-03-29T04:08:37.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.222+0000 7f0498796640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f049015ed00 con 0x7f049015e920 2024-03-29T04:08:37.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.222+0000 7f0498796640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f04900d21e0 con 0x7f04900d16a0 2024-03-29T04:08:37.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.223+0000 7f0496532640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f049015e920 0x7f04900d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:37.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.223+0000 7f0496532640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f049015e920 0x7f04900d3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45832/0 (socket says 172.21.15.73:45832) 2024-03-29T04:08:37.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.223+0000 7f0495d31640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f04900cfde0 0x7f04900d0f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:34442/0 (socket says 172.21.15.73:34442) 2024-03-29T04:08:37.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.223+0000 7f0496532640 1 -- 172.21.15.73:0/1592576629 learned_addr learned my addr 172.21.15.73:0/1592576629 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:37.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.223+0000 7f0496d33640 1 --2- 172.21.15.73:0/1592576629 >> v2:172.21.15.142:3300/0 conn(0x7f04900d16a0 0x7f04900d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:37.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.223+0000 7f0496532640 1 -- 172.21.15.73:0/1592576629 >> v2:172.21.15.142:3300/0 conn(0x7f04900d16a0 msgr2=0x7f04900d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:37.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.223+0000 7f0496532640 1 --2- 172.21.15.73:0/1592576629 >> v2:172.21.15.142:3300/0 conn(0x7f04900d16a0 0x7f04900d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:37.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.223+0000 7f0496532640 1 -- 172.21.15.73:0/1592576629 >> v1:172.21.15.73:6789/0 conn(0x7f04900cfde0 legacy=0x7f04900d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:37.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.223+0000 7f0495530640 1 -- 172.21.15.73:0/1592576629 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 942615336 0 0) 0x7f048c001110 con 0x7f04900cfde0 2024-03-29T04:08:37.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.223+0000 7f0496532640 1 -- 172.21.15.73:0/1592576629 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04900d2480 con 0x7f049015e920 2024-03-29T04:08:37.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.224+0000 7f0496532640 1 --2- 172.21.15.73:0/1592576629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f049015e920 0x7f04900d3240 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f04900cb670 tx=0x7f048402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcab9759981040dc server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:37.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.224+0000 7f0495530640 1 -- 172.21.15.73:0/1592576629 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0484034070 con 0x7f049015e920 2024-03-29T04:08:37.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.224+0000 7f0495530640 1 -- 172.21.15.73:0/1592576629 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0484030860 con 0x7f049015e920 2024-03-29T04:08:37.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.224+0000 7f0495530640 1 -- 172.21.15.73:0/1592576629 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0484030c30 con 0x7f049015e920 2024-03-29T04:08:37.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.224+0000 7f0498796640 1 -- 172.21.15.73:0/1592576629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f049015e920 msgr2=0x7f04900d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:37.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.224+0000 7f0498796640 1 --2- 172.21.15.73:0/1592576629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f049015e920 0x7f04900d3240 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f04900cb670 tx=0x7f048402b9a0 comp rx=0 tx=0).stop 2024-03-29T04:08:37.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.224+0000 7f0498796640 1 -- 172.21.15.73:0/1592576629 shutdown_connections 2024-03-29T04:08:37.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.224+0000 7f0498796640 1 --2- 172.21.15.73:0/1592576629 >> v2:172.21.15.142:3300/0 conn(0x7f04900d16a0 0x7f04900d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:37.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.224+0000 7f0498796640 1 --2- 172.21.15.73:0/1592576629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f049015e920 0x7f04900d3240 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:37.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.224+0000 7f0498796640 1 -- 172.21.15.73:0/1592576629 >> 172.21.15.73:0/1592576629 conn(0x7f049008bfc0 msgr2=0x7f04900d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:37.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.224+0000 7f0498796640 1 -- 172.21.15.73:0/1592576629 shutdown_connections 2024-03-29T04:08:37.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.224+0000 7f0498796640 1 -- 172.21.15.73:0/1592576629 wait complete. 2024-03-29T04:08:37.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.225+0000 7f0498796640 1 Processor -- start 2024-03-29T04:08:37.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.226+0000 7f0498796640 1 -- start start 2024-03-29T04:08:37.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.226+0000 7f0498796640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04900cfde0 0x7f049014edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:37.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.226+0000 7f0498796640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04900d16a0 0x7f04900c9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:37.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.226+0000 7f0498796640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f049015e920 0x7f049006d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:37.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.226+0000 7f0498796640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f04900d2d20 con 0x7f04900cfde0 2024-03-29T04:08:37.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.226+0000 7f0498796640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f04900d2a40 con 0x7f049015e920 2024-03-29T04:08:37.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.226+0000 7f0498796640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f04900d4ef0 con 0x7f04900d16a0 2024-03-29T04:08:37.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.226+0000 7f0496532640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04900cfde0 0x7f049014edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:37.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.226+0000 7f0496532640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04900cfde0 0x7f049014edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:45834/0 (socket says 172.21.15.73:45834) 2024-03-29T04:08:37.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.226+0000 7f0496532640 1 -- 172.21.15.73:0/3590255006 learned_addr learned my addr 172.21.15.73:0/3590255006 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:37.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.226+0000 7f0495d31640 1 --2- 172.21.15.73:0/3590255006 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04900d16a0 0x7f04900c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:37.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.226+0000 7f0496d33640 1 --2- 172.21.15.73:0/3590255006 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f049015e920 0x7f049006d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:37.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.227+0000 7f0496532640 1 -- 172.21.15.73:0/3590255006 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04900d16a0 msgr2=0x7f04900c9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:37.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.227+0000 7f0496532640 1 --2- 172.21.15.73:0/3590255006 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04900d16a0 0x7f04900c9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:37.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.227+0000 7f0496532640 1 -- 172.21.15.73:0/3590255006 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f049015e920 msgr2=0x7f049006d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:37.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.227+0000 7f0496532640 1 --2- 172.21.15.73:0/3590255006 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f049015e920 0x7f049006d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:37.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.227+0000 7f0496532640 1 -- 172.21.15.73:0/3590255006 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f049014f300 con 0x7f04900cfde0 2024-03-29T04:08:37.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.227+0000 7f0496532640 1 --2- 172.21.15.73:0/3590255006 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04900cfde0 0x7f049014edc0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f048402b9e0 tx=0x7f0484004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:37.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.227+0000 7f0482ffd640 1 -- 172.21.15.73:0/3590255006 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0484048070 con 0x7f04900cfde0 2024-03-29T04:08:37.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.227+0000 7f0482ffd640 1 -- 172.21.15.73:0/3590255006 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0484030660 con 0x7f04900cfde0 2024-03-29T04:08:37.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.227+0000 7f0498796640 1 -- 172.21.15.73:0/3590255006 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04900caf10 con 0x7f04900cfde0 2024-03-29T04:08:37.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.227+0000 7f0482ffd640 1 -- 172.21.15.73:0/3590255006 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0484034040 con 0x7f04900cfde0 2024-03-29T04:08:37.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.227+0000 7f0498796640 1 -- 172.21.15.73:0/3590255006 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04900ca150 con 0x7f04900cfde0 2024-03-29T04:08:37.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.228+0000 7f0498796640 1 -- 172.21.15.73:0/3590255006 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04900a2560 con 0x7f04900cfde0 2024-03-29T04:08:37.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.228+0000 7f0482ffd640 1 -- 172.21.15.73:0/3590255006 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f048404b070 con 0x7f04900cfde0 2024-03-29T04:08:37.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.229+0000 7f0482ffd640 1 --2- 172.21.15.73:0/3590255006 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f047406c530 0x7f047406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:37.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.229+0000 7f0482ffd640 1 -- 172.21.15.73:0/3590255006 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f04840ad6c0 con 0x7f04900cfde0 2024-03-29T04:08:37.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.229+0000 7f0495d31640 1 --2- 172.21.15.73:0/3590255006 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f047406c530 0x7f047406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:37.211 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.229+0000 7f0495d31640 1 --2- 172.21.15.73:0/3590255006 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f047406c530 0x7f047406e9f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f048c007fd0 tx=0x7f048c007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:37.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.233+0000 7f0482ffd640 1 -- 172.21.15.73:0/3590255006 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f0484030830 con 0x7f04900cfde0 2024-03-29T04:08:37.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.406+0000 7f0498796640 1 -- 172.21.15.73:0/3590255006 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f049004f9d0 con 0x7f04900cfde0 2024-03-29T04:08:37.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.406+0000 7f0482ffd640 1 -- 172.21.15.73:0/3590255006 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f048407b690 con 0x7f04900cfde0 2024-03-29T04:08:37.386 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-29T04:08:37.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.408+0000 7f0498796640 1 -- 172.21.15.73:0/3590255006 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f047406c530 msgr2=0x7f047406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:37.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.408+0000 7f0498796640 1 --2- 172.21.15.73:0/3590255006 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f047406c530 0x7f047406e9f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f048c007fd0 tx=0x7f048c007de0 comp rx=0 tx=0).stop 2024-03-29T04:08:37.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.408+0000 7f0498796640 1 -- 172.21.15.73:0/3590255006 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04900cfde0 msgr2=0x7f049014edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:37.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.408+0000 7f0498796640 1 --2- 172.21.15.73:0/3590255006 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04900cfde0 0x7f049014edc0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f048402b9e0 tx=0x7f0484004730 comp rx=0 tx=0).stop 2024-03-29T04:08:37.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.408+0000 7f0498796640 1 -- 172.21.15.73:0/3590255006 shutdown_connections 2024-03-29T04:08:37.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.408+0000 7f0498796640 1 --2- 172.21.15.73:0/3590255006 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f047406c530 0x7f047406e9f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:37.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.408+0000 7f0498796640 1 --2- 172.21.15.73:0/3590255006 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f049015e920 0x7f049006d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:37.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.408+0000 7f0498796640 1 --2- 172.21.15.73:0/3590255006 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f04900d16a0 0x7f04900c9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:37.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.408+0000 7f0498796640 1 --2- 172.21.15.73:0/3590255006 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04900cfde0 0x7f049014edc0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:37.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.408+0000 7f0498796640 1 -- 172.21.15.73:0/3590255006 >> 172.21.15.73:0/3590255006 conn(0x7f049008bfc0 msgr2=0x7f04900d44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:37.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.408+0000 7f0498796640 1 -- 172.21.15.73:0/3590255006 shutdown_connections 2024-03-29T04:08:37.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.408+0000 7f0498796640 1 -- 172.21.15.73:0/3590255006 wait complete. 2024-03-29T04:08:37.399 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_uninlining.TestDataUninlining.test_data_uninlining' 2024-03-29T04:08:37.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.519+0000 7f7c251ba640 1 Processor -- start 2024-03-29T04:08:37.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.519+0000 7f7c251ba640 1 -- start start 2024-03-29T04:08:37.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.519+0000 7f7c251ba640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7c2006d5f0 0x7f7c200b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:37.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.519+0000 7f7c251ba640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c2009b550 con 0x7f7c20161c50 2024-03-29T04:08:37.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.519+0000 7f7c251ba640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c2009b830 con 0x7f7c2006d160 2024-03-29T04:08:37.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.519+0000 7f7c251ba640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f7c200b3d90 con 0x7f7c2006d5f0 2024-03-29T04:08:37.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.520+0000 7f7c1ed9d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7c20161c50 0x7f7c2006ca50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:46742/0 (socket says 172.21.15.73:46742) 2024-03-29T04:08:37.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.520+0000 7f7c1ed9d640 1 -- 172.21.15.73:0/3970299239 learned_addr learned my addr 172.21.15.73:0/3970299239 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:37.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.520+0000 7f7c1f59e640 1 --2- 172.21.15.73:0/3970299239 >> v2:172.21.15.142:3300/0 conn(0x7f7c2006d5f0 0x7f7c200b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:37.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.520+0000 7f7c1dd9b640 1 -- 172.21.15.73:0/3970299239 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 173352761 0 0) 0x7f7c2009b550 con 0x7f7c20161c50 2024-03-29T04:08:37.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.520+0000 7f7c1dd9b640 1 -- 172.21.15.73:0/3970299239 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c0c003520 con 0x7f7c20161c50 2024-03-29T04:08:37.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.520+0000 7f7c1dd9b640 1 -- 172.21.15.73:0/3970299239 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3083167585 0 0) 0x7f7c2009b830 con 0x7f7c2006d160 2024-03-29T04:08:37.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.520+0000 7f7c1dd9b640 1 -- 172.21.15.73:0/3970299239 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c2009b550 con 0x7f7c2006d160 2024-03-29T04:08:37.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.520+0000 7f7c1f59e640 1 -- 172.21.15.73:0/3970299239 >> v1:172.21.15.142:6789/0 conn(0x7f7c2006d160 legacy=0x7f7c200b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:37.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.520+0000 7f7c1f59e640 1 -- 172.21.15.73:0/3970299239 >> v1:172.21.15.73:6789/0 conn(0x7f7c20161c50 legacy=0x7f7c2006ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:37.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.520+0000 7f7c1f59e640 1 -- 172.21.15.73:0/3970299239 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c2009bb10 con 0x7f7c2006d5f0 2024-03-29T04:08:37.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.521+0000 7f7c1f59e640 1 --2- 172.21.15.73:0/3970299239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c2006d5f0 0x7f7c200b26f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7c100097a0 tx=0x7f7c1002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=711580e3b12d6880 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:37.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.521+0000 7f7c1dd9b640 1 -- 172.21.15.73:0/3970299239 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c10035020 con 0x7f7c2006d5f0 2024-03-29T04:08:37.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.521+0000 7f7c1dd9b640 1 -- 172.21.15.73:0/3970299239 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c10031830 con 0x7f7c2006d5f0 2024-03-29T04:08:37.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.521+0000 7f7c1dd9b640 1 -- 172.21.15.73:0/3970299239 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c10031be0 con 0x7f7c2006d5f0 2024-03-29T04:08:37.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.521+0000 7f7c251ba640 1 -- 172.21.15.73:0/3970299239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c2006d5f0 msgr2=0x7f7c200b26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:37.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.521+0000 7f7c251ba640 1 --2- 172.21.15.73:0/3970299239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c2006d5f0 0x7f7c200b26f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7c100097a0 tx=0x7f7c1002b8d0 comp rx=0 tx=0).stop 2024-03-29T04:08:37.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.521+0000 7f7c251ba640 1 -- 172.21.15.73:0/3970299239 shutdown_connections 2024-03-29T04:08:37.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.521+0000 7f7c251ba640 1 --2- 172.21.15.73:0/3970299239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c2006d5f0 0x7f7c200b26f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:37.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.521+0000 7f7c251ba640 1 -- 172.21.15.73:0/3970299239 >> 172.21.15.73:0/3970299239 conn(0x7f7c200d2410 msgr2=0x7f7c200d2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:37.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.522+0000 7f7c251ba640 1 -- 172.21.15.73:0/3970299239 shutdown_connections 2024-03-29T04:08:37.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.522+0000 7f7c251ba640 1 -- 172.21.15.73:0/3970299239 wait complete. 2024-03-29T04:08:37.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.523+0000 7f7c251ba640 1 Processor -- start 2024-03-29T04:08:37.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.523+0000 7f7c251ba640 1 -- start start 2024-03-29T04:08:37.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.524+0000 7f7c251ba640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c2006d160 0x7f7c20155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:37.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.524+0000 7f7c251ba640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c2006d5f0 0x7f7c200b06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:37.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.524+0000 7f7c251ba640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c20161c50 0x7f7c200b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:37.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.524+0000 7f7c251ba640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7c200d04a0 con 0x7f7c2006d160 2024-03-29T04:08:37.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.524+0000 7f7c251ba640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2009be80 con 0x7f7c20161c50 2024-03-29T04:08:37.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.524+0000 7f7c251ba640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7c200b3940 con 0x7f7c2006d5f0 2024-03-29T04:08:37.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.524+0000 7f7c1ed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c2006d160 0x7f7c20155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:37.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.524+0000 7f7c1ed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c2006d160 0x7f7c20155b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36224/0 (socket says 172.21.15.73:36224) 2024-03-29T04:08:37.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.524+0000 7f7c1ed9d640 1 -- 172.21.15.73:0/2923177079 learned_addr learned my addr 172.21.15.73:0/2923177079 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:37.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.524+0000 7f7c1e59c640 1 --2- 172.21.15.73:0/2923177079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c2006d5f0 0x7f7c200b06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:37.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.524+0000 7f7c1f59e640 1 --2- 172.21.15.73:0/2923177079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c20161c50 0x7f7c200b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:37.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.524+0000 7f7c1ed9d640 1 -- 172.21.15.73:0/2923177079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c2006d5f0 msgr2=0x7f7c200b06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:37.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.524+0000 7f7c1ed9d640 1 --2- 172.21.15.73:0/2923177079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c2006d5f0 0x7f7c200b06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:37.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.524+0000 7f7c1ed9d640 1 -- 172.21.15.73:0/2923177079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c20161c50 msgr2=0x7f7c200b0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:37.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.524+0000 7f7c1ed9d640 1 --2- 172.21.15.73:0/2923177079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c20161c50 0x7f7c200b0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:37.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.524+0000 7f7c1ed9d640 1 -- 172.21.15.73:0/2923177079 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c201f5940 con 0x7f7c2006d160 2024-03-29T04:08:37.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.524+0000 7f7c1ed9d640 1 --2- 172.21.15.73:0/2923177079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c2006d160 0x7f7c20155b00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7c1800c410 tx=0x7f7c1800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:37.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.524+0000 7f7c177fe640 1 -- 172.21.15.73:0/2923177079 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c18017070 con 0x7f7c2006d160 2024-03-29T04:08:37.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.524+0000 7f7c177fe640 1 -- 172.21.15.73:0/2923177079 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c18005ce0 con 0x7f7c2006d160 2024-03-29T04:08:37.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.524+0000 7f7c251ba640 1 -- 172.21.15.73:0/2923177079 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c201f62a0 con 0x7f7c2006d160 2024-03-29T04:08:37.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.524+0000 7f7c177fe640 1 -- 172.21.15.73:0/2923177079 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c180072d0 con 0x7f7c2006d160 2024-03-29T04:08:37.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.524+0000 7f7c251ba640 1 -- 172.21.15.73:0/2923177079 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c201f6860 con 0x7f7c2006d160 2024-03-29T04:08:37.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.525+0000 7f7c251ba640 1 -- 172.21.15.73:0/2923177079 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c200d0080 con 0x7f7c2006d160 2024-03-29T04:08:37.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.526+0000 7f7c177fe640 1 -- 172.21.15.73:0/2923177079 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f7c1801a070 con 0x7f7c2006d160 2024-03-29T04:08:37.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.526+0000 7f7c177fe640 1 --2- 172.21.15.73:0/2923177079 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7c0006c530 0x7f7c0006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:37.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.526+0000 7f7c177fe640 1 -- 172.21.15.73:0/2923177079 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7c1808a9a0 con 0x7f7c2006d160 2024-03-29T04:08:37.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.526+0000 7f7c1e59c640 1 --2- 172.21.15.73:0/2923177079 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7c0006c530 0x7f7c0006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:37.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.527+0000 7f7c1e59c640 1 --2- 172.21.15.73:0/2923177079 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7c0006c530 0x7f7c0006e9f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7c200d1780 tx=0x7f7c08009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:37.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.531+0000 7f7c177fe640 1 -- 172.21.15.73:0/2923177079 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f7c200d0080 con 0x7f7c2006d160 2024-03-29T04:08:37.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:37.772+0000 7f7c251ba640 1 -- 172.21.15.73:0/2923177079 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_uninlining.TestDataUninlining.test_data_uninlining"]} v 0) -- 0x7f7c201f6a60 con 0x7f7c2006d160 2024-03-29T04:08:38.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.650+0000 7f7c177fe640 1 -- 172.21.15.73:0/2923177079 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_uninlining.TestDataUninlining.test_data_uninlining"]}]=0 v48) ==== 150+0+0 (secure 0 0 0) 0x7f7c201f6a60 con 0x7f7c2006d160 2024-03-29T04:08:38.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.652+0000 7f7c251ba640 1 -- 172.21.15.73:0/2923177079 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7c0006c530 msgr2=0x7f7c0006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:38.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.652+0000 7f7c251ba640 1 --2- 172.21.15.73:0/2923177079 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7c0006c530 0x7f7c0006e9f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7c200d1780 tx=0x7f7c08009040 comp rx=0 tx=0).stop 2024-03-29T04:08:38.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.652+0000 7f7c251ba640 1 -- 172.21.15.73:0/2923177079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c2006d160 msgr2=0x7f7c20155b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:38.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.652+0000 7f7c251ba640 1 --2- 172.21.15.73:0/2923177079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c2006d160 0x7f7c20155b00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7c1800c410 tx=0x7f7c1800c8d0 comp rx=0 tx=0).stop 2024-03-29T04:08:38.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.653+0000 7f7c251ba640 1 -- 172.21.15.73:0/2923177079 shutdown_connections 2024-03-29T04:08:38.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.653+0000 7f7c251ba640 1 --2- 172.21.15.73:0/2923177079 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7c0006c530 0x7f7c0006e9f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:38.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.653+0000 7f7c251ba640 1 --2- 172.21.15.73:0/2923177079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c20161c50 0x7f7c200b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:38.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.653+0000 7f7c251ba640 1 --2- 172.21.15.73:0/2923177079 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7c2006d5f0 0x7f7c200b06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:38.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.653+0000 7f7c251ba640 1 --2- 172.21.15.73:0/2923177079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c2006d160 0x7f7c20155b00 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:38.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.653+0000 7f7c251ba640 1 -- 172.21.15.73:0/2923177079 >> 172.21.15.73:0/2923177079 conn(0x7f7c200d2410 msgr2=0x7f7c200d27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:38.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.653+0000 7f7c251ba640 1 -- 172.21.15.73:0/2923177079 shutdown_connections 2024-03-29T04:08:38.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.653+0000 7f7c251ba640 1 -- 172.21.15.73:0/2923177079 wait complete. 2024-03-29T04:08:38.646 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-03-29T04:08:38.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.774+0000 7f2407952640 1 Processor -- start 2024-03-29T04:08:38.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.774+0000 7f2407952640 1 -- start start 2024-03-29T04:08:38.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.775+0000 7f2407952640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f240015e8b0 0x7f24000b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:38.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.775+0000 7f2407952640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f240006b510 0x7f240006b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:38.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.775+0000 7f2407952640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24000b6500 con 0x7f24000b6020 2024-03-29T04:08:38.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.775+0000 7f2407952640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f24000b67e0 con 0x7f240015e8b0 2024-03-29T04:08:38.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.775+0000 7f2407952640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f24000b4470 con 0x7f240006b510 2024-03-29T04:08:38.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.775+0000 7f2405eef640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f240006b510 0x7f240006b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:38.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.775+0000 7f24056ee640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f240015e8b0 0x7f24000b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:38.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.775+0000 7f2404eed640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f24000b6020 0x7f24000b2140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.73:59476/0 (socket says 172.21.15.73:59476) 2024-03-29T04:08:38.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.775+0000 7f2404eed640 1 -- 172.21.15.73:0/4151160285 learned_addr learned my addr 172.21.15.73:0/4151160285 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:38.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.776+0000 7f24056ee640 1 -- 172.21.15.73:0/4151160285 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f240006b510 msgr2=0x7f240006b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:38.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.776+0000 7f24056ee640 1 --2- 172.21.15.73:0/4151160285 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f240006b510 0x7f240006b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:38.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.776+0000 7f24056ee640 1 -- 172.21.15.73:0/4151160285 >> v1:172.21.15.142:6789/0 conn(0x7f24000b6020 legacy=0x7f24000b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:38.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.776+0000 7f24056ee640 1 -- 172.21.15.73:0/4151160285 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24000b4750 con 0x7f240015e8b0 2024-03-29T04:08:38.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.776+0000 7f23f7fff640 1 -- 172.21.15.73:0/4151160285 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2830356320 0 0) 0x7f24000b6500 con 0x7f24000b6020 2024-03-29T04:08:38.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.776+0000 7f2405eef640 1 --2- 172.21.15.73:0/4151160285 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f240006b510 0x7f240006b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:08:38.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.776+0000 7f24056ee640 1 --2- 172.21.15.73:0/4151160285 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f240015e8b0 0x7f24000b2a40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f23fc0097a0 tx=0x7f23fc02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85dc3664e17f7b66 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:38.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.777+0000 7f23f7fff640 1 -- 172.21.15.73:0/4151160285 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23fc0315a0 con 0x7f240015e8b0 2024-03-29T04:08:38.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.777+0000 7f23f7fff640 1 -- 172.21.15.73:0/4151160285 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23fc037070 con 0x7f240015e8b0 2024-03-29T04:08:38.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.777+0000 7f23f7fff640 1 -- 172.21.15.73:0/4151160285 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23fc031960 con 0x7f240015e8b0 2024-03-29T04:08:38.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.777+0000 7f2407952640 1 -- 172.21.15.73:0/4151160285 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f240015e8b0 msgr2=0x7f24000b2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:38.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.777+0000 7f2407952640 1 --2- 172.21.15.73:0/4151160285 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f240015e8b0 0x7f24000b2a40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f23fc0097a0 tx=0x7f23fc02b840 comp rx=0 tx=0).stop 2024-03-29T04:08:38.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.777+0000 7f2407952640 1 -- 172.21.15.73:0/4151160285 shutdown_connections 2024-03-29T04:08:38.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.777+0000 7f2407952640 1 --2- 172.21.15.73:0/4151160285 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f240006b510 0x7f240006b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:38.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.777+0000 7f2407952640 1 --2- 172.21.15.73:0/4151160285 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f240015e8b0 0x7f24000b2a40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:38.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.777+0000 7f2407952640 1 -- 172.21.15.73:0/4151160285 >> 172.21.15.73:0/4151160285 conn(0x7f2400072e40 msgr2=0x7f24000b3040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:38.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.777+0000 7f2407952640 1 -- 172.21.15.73:0/4151160285 shutdown_connections 2024-03-29T04:08:38.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.777+0000 7f2407952640 1 -- 172.21.15.73:0/4151160285 wait complete. 2024-03-29T04:08:38.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.778+0000 7f2407952640 1 Processor -- start 2024-03-29T04:08:38.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.778+0000 7f2407952640 1 -- start start 2024-03-29T04:08:38.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.779+0000 7f2407952640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f240006b510 0x7f2400146ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:38.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.779+0000 7f2407952640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24000b6020 0x7f2400142ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:38.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.779+0000 7f2407952640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f240015e8b0 0x7f24001597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:38.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.779+0000 7f2407952640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f240006c190 con 0x7f240015e8b0 2024-03-29T04:08:38.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.779+0000 7f2407952640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f24000b4b30 con 0x7f240006b510 2024-03-29T04:08:38.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.779+0000 7f2407952640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f240006c310 con 0x7f24000b6020 2024-03-29T04:08:38.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.779+0000 7f2405eef640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f240015e8b0 0x7f24001597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:38.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.779+0000 7f2405eef640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f240015e8b0 0x7f24001597d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36228/0 (socket says 172.21.15.73:36228) 2024-03-29T04:08:38.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.779+0000 7f2404eed640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24000b6020 0x7f2400142ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:38.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.779+0000 7f2405eef640 1 -- 172.21.15.73:0/733180348 learned_addr learned my addr 172.21.15.73:0/733180348 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:38.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.779+0000 7f24056ee640 1 --2- 172.21.15.73:0/733180348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f240006b510 0x7f2400146ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:38.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.780+0000 7f2405eef640 1 -- 172.21.15.73:0/733180348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24000b6020 msgr2=0x7f2400142ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:38.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.780+0000 7f2405eef640 1 --2- 172.21.15.73:0/733180348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24000b6020 0x7f2400142ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:38.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.780+0000 7f2405eef640 1 -- 172.21.15.73:0/733180348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f240006b510 msgr2=0x7f2400146ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:38.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.780+0000 7f2405eef640 1 --2- 172.21.15.73:0/733180348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f240006b510 0x7f2400146ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:38.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.780+0000 7f2405eef640 1 -- 172.21.15.73:0/733180348 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f240015fb70 con 0x7f240015e8b0 2024-03-29T04:08:38.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.780+0000 7f2405eef640 1 --2- 172.21.15.73:0/733180348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f240015e8b0 0x7f24001597d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f23f800efc0 tx=0x7f23f8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:38.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.780+0000 7f23f5ffb640 1 -- 172.21.15.73:0/733180348 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f8018030 con 0x7f240015e8b0 2024-03-29T04:08:38.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.780+0000 7f2407952640 1 -- 172.21.15.73:0/733180348 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f240015fe50 con 0x7f240015e8b0 2024-03-29T04:08:38.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.780+0000 7f23f5ffb640 1 -- 172.21.15.73:0/733180348 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23f800cde0 con 0x7f240015e8b0 2024-03-29T04:08:38.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.780+0000 7f23f5ffb640 1 -- 172.21.15.73:0/733180348 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f8003bb0 con 0x7f240015e8b0 2024-03-29T04:08:38.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.780+0000 7f2407952640 1 -- 172.21.15.73:0/733180348 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24001608e0 con 0x7f240015e8b0 2024-03-29T04:08:38.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.781+0000 7f2407952640 1 -- 172.21.15.73:0/733180348 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f240009f6a0 con 0x7f240015e8b0 2024-03-29T04:08:38.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.781+0000 7f23f5ffb640 1 -- 172.21.15.73:0/733180348 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f23f801b070 con 0x7f240015e8b0 2024-03-29T04:08:38.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.782+0000 7f23f5ffb640 1 --2- 172.21.15.73:0/733180348 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f23e406c530 0x7f23e406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:38.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.782+0000 7f23f5ffb640 1 -- 172.21.15.73:0/733180348 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f23f808c0b0 con 0x7f240015e8b0 2024-03-29T04:08:38.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.782+0000 7f24056ee640 1 --2- 172.21.15.73:0/733180348 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f23e406c530 0x7f23e406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:38.763 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.782+0000 7f24056ee640 1 --2- 172.21.15.73:0/733180348 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f23e406c530 0x7f23e406e9f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f23fc036000 tx=0x7f23fc03d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:38.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.786+0000 7f23f5ffb640 1 -- 172.21.15.73:0/733180348 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f23f8010040 con 0x7f240015e8b0 2024-03-29T04:08:38.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.960+0000 7f2407952640 1 -- 172.21.15.73:0/733180348 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f240004f9d0 con 0x7f240015e8b0 2024-03-29T04:08:38.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.963+0000 7f23f5ffb640 1 -- 172.21.15.73:0/733180348 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f23f805a000 con 0x7f240015e8b0 2024-03-29T04:08:38.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.965+0000 7f2407952640 1 -- 172.21.15.73:0/733180348 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f23e406c530 msgr2=0x7f23e406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:38.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.965+0000 7f2407952640 1 --2- 172.21.15.73:0/733180348 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f23e406c530 0x7f23e406e9f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f23fc036000 tx=0x7f23fc03d040 comp rx=0 tx=0).stop 2024-03-29T04:08:38.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.965+0000 7f2407952640 1 -- 172.21.15.73:0/733180348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f240015e8b0 msgr2=0x7f24001597d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:38.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.965+0000 7f2407952640 1 --2- 172.21.15.73:0/733180348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f240015e8b0 0x7f24001597d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f23f800efc0 tx=0x7f23f8009f90 comp rx=0 tx=0).stop 2024-03-29T04:08:38.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.965+0000 7f2407952640 1 -- 172.21.15.73:0/733180348 shutdown_connections 2024-03-29T04:08:38.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.965+0000 7f2407952640 1 --2- 172.21.15.73:0/733180348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f240015e8b0 0x7f24001597d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:38.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.965+0000 7f2407952640 1 --2- 172.21.15.73:0/733180348 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f24000b6020 0x7f2400142ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:38.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.965+0000 7f2407952640 1 --2- 172.21.15.73:0/733180348 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f23e406c530 0x7f23e406e9f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:38.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.965+0000 7f2407952640 1 --2- 172.21.15.73:0/733180348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f240006b510 0x7f2400146ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:38.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.965+0000 7f2407952640 1 -- 172.21.15.73:0/733180348 >> 172.21.15.73:0/733180348 conn(0x7f2400072e40 msgr2=0x7f24000af9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:38.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.965+0000 7f2407952640 1 -- 172.21.15.73:0/733180348 shutdown_connections 2024-03-29T04:08:38.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:38.965+0000 7f2407952640 1 -- 172.21.15.73:0/733180348 wait complete. 2024-03-29T04:08:38.955 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-29T04:08:38.956 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-29T04:08:39.007 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-29T04:08:39.061 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-29T04:08:39.061 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-29T04:08:39.061 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-29T04:08:39.077 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-29T04:08:39.077 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-29T04:08:39.133 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-29T04:08:39.133 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-29T04:08:39.188 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-29T04:08:39.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.349+0000 7f6dca347640 1 Processor -- start 2024-03-29T04:08:39.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.349+0000 7f6dca347640 1 -- start start 2024-03-29T04:08:39.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.349+0000 7f6dca347640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6dc4070990 0x7f6dc409b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:39.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.349+0000 7f6dca347640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6dc409b140 0x7f6dc415e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:39.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.349+0000 7f6dca347640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dc40d0e10 con 0x7f6dc40d05c0 2024-03-29T04:08:39.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.349+0000 7f6dca347640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f6dc40d10f0 con 0x7f6dc409b140 2024-03-29T04:08:39.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.349+0000 7f6dca347640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f6dc40d13d0 con 0x7f6dc4070990 2024-03-29T04:08:39.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.349+0000 7f6dc88e4640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6dc409b140 0x7f6dc415e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:39.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.350+0000 7f6dc88e4640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6dc409b140 0x7f6dc415e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36242/0 (socket says 172.21.15.73:36242) 2024-03-29T04:08:39.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.350+0000 7f6dc37fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f6dc40d05c0 0x7f6dc409aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:46746/0 (socket says 172.21.15.73:46746) 2024-03-29T04:08:39.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.350+0000 7f6dc88e4640 1 -- 172.21.15.73:0/1686768574 learned_addr learned my addr 172.21.15.73:0/1686768574 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:39.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.350+0000 7f6dc3fff640 1 --2- 172.21.15.73:0/1686768574 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6dc4070990 0x7f6dc409b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:39.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.350+0000 7f6dc88e4640 1 -- 172.21.15.73:0/1686768574 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6dc4070990 msgr2=0x7f6dc409b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:39.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.350+0000 7f6dc88e4640 1 --2- 172.21.15.73:0/1686768574 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6dc4070990 0x7f6dc409b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:39.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.350+0000 7f6dc88e4640 1 -- 172.21.15.73:0/1686768574 >> v1:172.21.15.73:6789/0 conn(0x7f6dc40d05c0 legacy=0x7f6dc409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:39.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.350+0000 7f6dc88e4640 1 -- 172.21.15.73:0/1686768574 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc40d16b0 con 0x7f6dc409b140 2024-03-29T04:08:39.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.350+0000 7f6dc2ffd640 1 -- 172.21.15.73:0/1686768574 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3357511594 0 0) 0x7f6dc40d0e10 con 0x7f6dc40d05c0 2024-03-29T04:08:39.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.351+0000 7f6dc88e4640 1 --2- 172.21.15.73:0/1686768574 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6dc409b140 0x7f6dc415e0a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc009e50 tx=0x7f6dbc02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b02d765830b5ff57 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:39.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.351+0000 7f6dc2ffd640 1 -- 172.21.15.73:0/1686768574 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc02cb00 con 0x7f6dc409b140 2024-03-29T04:08:39.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.351+0000 7f6dc2ffd640 1 -- 172.21.15.73:0/1686768574 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dbc02cca0 con 0x7f6dc409b140 2024-03-29T04:08:39.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.351+0000 7f6dc2ffd640 1 -- 172.21.15.73:0/1686768574 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc034610 con 0x7f6dc409b140 2024-03-29T04:08:39.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.351+0000 7f6dca347640 1 -- 172.21.15.73:0/1686768574 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6dc409b140 msgr2=0x7f6dc415e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:39.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.351+0000 7f6dca347640 1 --2- 172.21.15.73:0/1686768574 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6dc409b140 0x7f6dc415e0a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc009e50 tx=0x7f6dbc02bf60 comp rx=0 tx=0).stop 2024-03-29T04:08:39.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.351+0000 7f6dca347640 1 -- 172.21.15.73:0/1686768574 shutdown_connections 2024-03-29T04:08:39.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.351+0000 7f6dca347640 1 --2- 172.21.15.73:0/1686768574 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6dc409b140 0x7f6dc415e0a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:39.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.351+0000 7f6dca347640 1 --2- 172.21.15.73:0/1686768574 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6dc4070990 0x7f6dc409b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:39.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.351+0000 7f6dca347640 1 -- 172.21.15.73:0/1686768574 >> 172.21.15.73:0/1686768574 conn(0x7f6dc40d2430 msgr2=0x7f6dc40d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:39.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.351+0000 7f6dca347640 1 -- 172.21.15.73:0/1686768574 shutdown_connections 2024-03-29T04:08:39.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.351+0000 7f6dca347640 1 -- 172.21.15.73:0/1686768574 wait complete. 2024-03-29T04:08:39.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.352+0000 7f6dca347640 1 Processor -- start 2024-03-29T04:08:39.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.353+0000 7f6dca347640 1 -- start start 2024-03-29T04:08:39.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.353+0000 7f6dca347640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6dc4070990 0x7f6dc414ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:39.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.353+0000 7f6dca347640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6dc409b140 0x7f6dc4149f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:39.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.353+0000 7f6dca347640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6dc40d05c0 0x7f6dc40b0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:39.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.353+0000 7f6dca347640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc40d0ba0 con 0x7f6dc409b140 2024-03-29T04:08:39.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.353+0000 7f6dca347640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc40d0a20 con 0x7f6dc4070990 2024-03-29T04:08:39.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.353+0000 7f6dca347640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f6dc4070d70 con 0x7f6dc40d05c0 2024-03-29T04:08:39.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.353+0000 7f6dc37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6dc409b140 0x7f6dc4149f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:39.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.353+0000 7f6dc37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6dc409b140 0x7f6dc4149f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36248/0 (socket says 172.21.15.73:36248) 2024-03-29T04:08:39.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.353+0000 7f6dc37fe640 1 -- 172.21.15.73:0/530970146 learned_addr learned my addr 172.21.15.73:0/530970146 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:39.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.353+0000 7f6dc3fff640 1 --2- 172.21.15.73:0/530970146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6dc4070990 0x7f6dc414ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:39.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.354+0000 7f6dc88e4640 1 --2- 172.21.15.73:0/530970146 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6dc40d05c0 0x7f6dc40b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:39.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.354+0000 7f6dc37fe640 1 -- 172.21.15.73:0/530970146 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6dc40d05c0 msgr2=0x7f6dc40b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:39.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.354+0000 7f6dc37fe640 1 --2- 172.21.15.73:0/530970146 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6dc40d05c0 0x7f6dc40b0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:39.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.354+0000 7f6dc37fe640 1 -- 172.21.15.73:0/530970146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6dc4070990 msgr2=0x7f6dc414ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:39.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.354+0000 7f6dc37fe640 1 --2- 172.21.15.73:0/530970146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6dc4070990 0x7f6dc414ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:39.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.354+0000 7f6dc37fe640 1 -- 172.21.15.73:0/530970146 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc414d300 con 0x7f6dc409b140 2024-03-29T04:08:39.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.354+0000 7f6dc37fe640 1 --2- 172.21.15.73:0/530970146 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6dc409b140 0x7f6dc4149f60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6db400c430 tx=0x7f6db400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:39.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.354+0000 7f6dc0ff9640 1 -- 172.21.15.73:0/530970146 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db40074e0 con 0x7f6dc409b140 2024-03-29T04:08:39.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.354+0000 7f6dc0ff9640 1 -- 172.21.15.73:0/530970146 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6db40047e0 con 0x7f6dc409b140 2024-03-29T04:08:39.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.354+0000 7f6dc0ff9640 1 -- 172.21.15.73:0/530970146 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db4004bd0 con 0x7f6dc409b140 2024-03-29T04:08:39.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.354+0000 7f6dca347640 1 -- 172.21.15.73:0/530970146 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dc414d5e0 con 0x7f6dc409b140 2024-03-29T04:08:39.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.354+0000 7f6dca347640 1 -- 172.21.15.73:0/530970146 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dc414aa30 con 0x7f6dc409b140 2024-03-29T04:08:39.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.355+0000 7f6dca347640 1 -- 172.21.15.73:0/530970146 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dc4068640 con 0x7f6dc409b140 2024-03-29T04:08:39.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.355+0000 7f6dc0ff9640 1 -- 172.21.15.73:0/530970146 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f6db4011070 con 0x7f6dc409b140 2024-03-29T04:08:39.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.356+0000 7f6dc0ff9640 1 --2- 172.21.15.73:0/530970146 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f6db006c560 0x7f6db006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:39.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.356+0000 7f6dc0ff9640 1 -- 172.21.15.73:0/530970146 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6db408b1f0 con 0x7f6dc409b140 2024-03-29T04:08:39.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.356+0000 7f6dc3fff640 1 --2- 172.21.15.73:0/530970146 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f6db006c560 0x7f6db006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:39.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.356+0000 7f6dc3fff640 1 --2- 172.21.15.73:0/530970146 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f6db006c560 0x7f6db006ea20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6db8009b40 tx=0x7f6db8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:39.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.360+0000 7f6dc0ff9640 1 -- 172.21.15.73:0/530970146 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f6db40591c0 con 0x7f6dc409b140 2024-03-29T04:08:39.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.537+0000 7f6dca347640 1 -- 172.21.15.73:0/530970146 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6dc409b800 con 0x7f6dc409b140 2024-03-29T04:08:39.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.538+0000 7f6dc0ff9640 1 -- 172.21.15.73:0/530970146 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16605 (secure 0 0 0) 0x7f6db405d4c0 con 0x7f6dc409b140 2024-03-29T04:08:39.518 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:39.518 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"6bff1617-b138-4517-acca-3ecaae3f2bb3","created":"2024-03-29T04:07:47.346864+0000","modified":"2024-03-29T04:08:13.577603+0000","last_up_change":"2024-03-29T04:07:58.507139+0000","last_in_change":"2024-03-29T04:07:49.637816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-29T04:07:59.537301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-29T04:08:09.570906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-29T04:08:10.882349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"925d7de1-14ab-48c0-aebd-7bded108f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6820","nonce":2387335359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6824","nonce":2387335359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6831","nonce":2387335359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6828","nonce":2387335359}]},"public_addr":"172.21.15.73:6820/2387335359","cluster_addr":"172.21.15.73:6824/2387335359","heartbeat_back_addr":"172.21.15.73:6831/2387335359","heartbeat_front_addr":"172.21.15.73:6828/2387335359","state":["exists","up"]},{"osd":1,"uuid":"6b182102-882a-4e0c-99db-0afae5cfb38b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6801","nonce":2431315515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6803","nonce":2431315515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6807","nonce":2431315515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6805","nonce":2431315515}]},"public_addr":"172.21.15.73:6801/2431315515","cluster_addr":"172.21.15.73:6803/2431315515","heartbeat_back_addr":"172.21.15.73:6807/2431315515","heartbeat_front_addr":"172.21.15.73:6805/2431315515","state":["exists","up"]},{"osd":2,"uuid":"8040902e-b0b8-4a21-bf64-ce1c222115ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6809","nonce":407236597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6811","nonce":407236597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6815","nonce":407236597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6813","nonce":407236597}]},"public_addr":"172.21.15.73:6809/407236597","cluster_addr":"172.21.15.73:6811/407236597","heartbeat_back_addr":"172.21.15.73:6815/407236597","heartbeat_front_addr":"172.21.15.73:6813/407236597","state":["exists","up"]},{"osd":3,"uuid":"1bab19ee-3775-4ce1-a4ce-cf7cda3bbbf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6817","nonce":4291100709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6821","nonce":4291100709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6829","nonce":4291100709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6825","nonce":4291100709}]},"public_addr":"172.21.15.73:6817/4291100709","cluster_addr":"172.21.15.73:6821/4291100709","heartbeat_back_addr":"172.21.15.73:6829/4291100709","heartbeat_front_addr":"172.21.15.73:6825/4291100709","state":["exists","up"]},{"osd":4,"uuid":"b0c74337-8fe4-47dc-b3da-2d07591b1f6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6817","nonce":3703256194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6819","nonce":3703256194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6823","nonce":3703256194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6821","nonce":3703256194}]},"public_addr":"172.21.15.142:6817/3703256194","cluster_addr":"172.21.15.142:6819/3703256194","heartbeat_back_addr":"172.21.15.142:6823/3703256194","heartbeat_front_addr":"172.21.15.142:6821/3703256194","state":["exists","up"]},{"osd":5,"uuid":"9ce36410-a29a-42c6-99f4-f95d4afdd7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6825","nonce":4271575803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6827","nonce":4271575803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6831","nonce":4271575803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6829","nonce":4271575803}]},"public_addr":"172.21.15.142:6825/4271575803","cluster_addr":"172.21.15.142:6827/4271575803","heartbeat_back_addr":"172.21.15.142:6831/4271575803","heartbeat_front_addr":"172.21.15.142:6829/4271575803","state":["exists","up"]},{"osd":6,"uuid":"aec4264a-64ac-428e-a860-d2920a304019","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6801","nonce":1772722570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6803","nonce":1772722570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6807","nonce":1772722570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6805","nonce":1772722570}]},"public_addr":"172.21.15.142:6801/1772722570","cluster_addr":"172.21.15.142:6803/1772722570","heartbeat_back_addr":"172.21.15.142:6807/1772722570","heartbeat_front_addr":"172.21.15.142:6805/1772722570","state":["exists","up"]},{"osd":7,"uuid":"fe599052-8e5a-4c7a-91e7-52d1bae24a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6809","nonce":3910589675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6811","nonce":3910589675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6815","nonce":3910589675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6813","nonce":3910589675}]},"public_addr":"172.21.15.142:6809/3910589675","cluster_addr":"172.21.15.142:6811/3910589675","heartbeat_back_addr":"172.21.15.142:6815/3910589675","heartbeat_front_addr":"172.21.15.142:6813/3910589675","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.835096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.587210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.786547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.778004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.843740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.791160+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.837992+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.718722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:08:39.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.540+0000 7f6dca347640 1 -- 172.21.15.73:0/530970146 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f6db006c560 msgr2=0x7f6db006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:39.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.540+0000 7f6dca347640 1 --2- 172.21.15.73:0/530970146 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f6db006c560 0x7f6db006ea20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6db8009b40 tx=0x7f6db8009190 comp rx=0 tx=0).stop 2024-03-29T04:08:39.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.540+0000 7f6dca347640 1 -- 172.21.15.73:0/530970146 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6dc409b140 msgr2=0x7f6dc4149f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:39.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.540+0000 7f6dca347640 1 --2- 172.21.15.73:0/530970146 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6dc409b140 0x7f6dc4149f60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6db400c430 tx=0x7f6db400c8f0 comp rx=0 tx=0).stop 2024-03-29T04:08:39.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.540+0000 7f6dca347640 1 -- 172.21.15.73:0/530970146 shutdown_connections 2024-03-29T04:08:39.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.540+0000 7f6dca347640 1 --2- 172.21.15.73:0/530970146 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6dc40d05c0 0x7f6dc40b0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:39.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.540+0000 7f6dca347640 1 --2- 172.21.15.73:0/530970146 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6dc409b140 0x7f6dc4149f60 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:39.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.540+0000 7f6dca347640 1 --2- 172.21.15.73:0/530970146 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f6db006c560 0x7f6db006ea20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:39.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.540+0000 7f6dca347640 1 --2- 172.21.15.73:0/530970146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6dc4070990 0x7f6dc414ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:39.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.540+0000 7f6dca347640 1 -- 172.21.15.73:0/530970146 >> 172.21.15.73:0/530970146 conn(0x7f6dc40d2430 msgr2=0x7f6dc40afb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:39.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.541+0000 7f6dca347640 1 -- 172.21.15.73:0/530970146 shutdown_connections 2024-03-29T04:08:39.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.541+0000 7f6dca347640 1 -- 172.21.15.73:0/530970146 wait complete. 2024-03-29T04:08:39.531 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-29T04:07:59.537301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-29T04:08:09.570906+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-29T04:08:10.882349+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-29T04:08:39.532 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-29T04:08:39.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.655+0000 7f1a0439d640 1 Processor -- start 2024-03-29T04:08:39.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.655+0000 7f1a0439d640 1 -- start start 2024-03-29T04:08:39.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.656+0000 7f1a0439d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19fc0b1980 0x7f19fc0d12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:39.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.656+0000 7f1a0439d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f19fc162d20 0x7f19fc15e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:39.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.656+0000 7f1a0439d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19fc09aec0 con 0x7f19fc09aa30 2024-03-29T04:08:39.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.656+0000 7f1a0439d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f19fc09b1a0 con 0x7f19fc162d20 2024-03-29T04:08:39.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.656+0000 7f1a0439d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f19fc09b480 con 0x7f19fc0b1980 2024-03-29T04:08:39.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.657+0000 7f1a0293a640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f19fc162d20 0x7f19fc15e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:39.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.657+0000 7f1a01938640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f19fc09aa30 0x7f19fc162610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:46762/0 (socket says 172.21.15.73:46762) 2024-03-29T04:08:39.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.657+0000 7f1a01938640 1 -- 172.21.15.73:0/278285638 learned_addr learned my addr 172.21.15.73:0/278285638 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:39.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.657+0000 7f1a02139640 1 --2- 172.21.15.73:0/278285638 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19fc0b1980 0x7f19fc0d12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:39.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.657+0000 7f1a0293a640 1 -- 172.21.15.73:0/278285638 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19fc0b1980 msgr2=0x7f19fc0d12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:39.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.657+0000 7f1a0293a640 1 --2- 172.21.15.73:0/278285638 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19fc0b1980 0x7f19fc0d12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:39.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.657+0000 7f1a0293a640 1 -- 172.21.15.73:0/278285638 >> v1:172.21.15.73:6789/0 conn(0x7f19fc09aa30 legacy=0x7f19fc162610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:39.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.657+0000 7f1a0293a640 1 -- 172.21.15.73:0/278285638 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19fc09b760 con 0x7f19fc162d20 2024-03-29T04:08:39.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.657+0000 7f1a01137640 1 -- 172.21.15.73:0/278285638 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2944750913 0 0) 0x7f19fc09aec0 con 0x7f19fc09aa30 2024-03-29T04:08:39.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.658+0000 7f1a0293a640 1 --2- 172.21.15.73:0/278285638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19fc162d20 0x7f19fc15e0c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f19f4009d90 tx=0x7f19f402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a972a72ea6d77f2 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:39.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.658+0000 7f1a01137640 1 -- 172.21.15.73:0/278285638 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f4039070 con 0x7f19fc162d20 2024-03-29T04:08:39.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.658+0000 7f1a01137640 1 -- 172.21.15.73:0/278285638 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19f402cc50 con 0x7f19fc162d20 2024-03-29T04:08:39.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.658+0000 7f1a01137640 1 -- 172.21.15.73:0/278285638 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f4034440 con 0x7f19fc162d20 2024-03-29T04:08:39.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.658+0000 7f1a0439d640 1 -- 172.21.15.73:0/278285638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19fc162d20 msgr2=0x7f19fc15e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:39.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.658+0000 7f1a0439d640 1 --2- 172.21.15.73:0/278285638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19fc162d20 0x7f19fc15e0c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f19f4009d90 tx=0x7f19f402bea0 comp rx=0 tx=0).stop 2024-03-29T04:08:39.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.658+0000 7f1a0439d640 1 -- 172.21.15.73:0/278285638 shutdown_connections 2024-03-29T04:08:39.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.658+0000 7f1a0439d640 1 --2- 172.21.15.73:0/278285638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19fc162d20 0x7f19fc15e0c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:39.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.658+0000 7f1a0439d640 1 --2- 172.21.15.73:0/278285638 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19fc0b1980 0x7f19fc0d12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:39.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.658+0000 7f1a0439d640 1 -- 172.21.15.73:0/278285638 >> 172.21.15.73:0/278285638 conn(0x7f19fc0b3f40 msgr2=0x7f19fc0b4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:39.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.658+0000 7f1a0439d640 1 -- 172.21.15.73:0/278285638 shutdown_connections 2024-03-29T04:08:39.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.658+0000 7f1a0439d640 1 -- 172.21.15.73:0/278285638 wait complete. 2024-03-29T04:08:39.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.659+0000 7f1a0439d640 1 Processor -- start 2024-03-29T04:08:39.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.660+0000 7f1a0439d640 1 -- start start 2024-03-29T04:08:39.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.660+0000 7f1a0439d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19fc0b1980 0x7f19fc157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:39.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.660+0000 7f1a0439d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19fc162d20 0x7f19fc06e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:39.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.660+0000 7f1a0439d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19fc157050 0x7f19fc0c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:39.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.660+0000 7f1a0439d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f19fc0d1970 con 0x7f19fc0b1980 2024-03-29T04:08:39.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.660+0000 7f1a0439d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f19fc0d17f0 con 0x7f19fc157050 2024-03-29T04:08:39.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.660+0000 7f1a0439d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f19fc15e600 con 0x7f19fc162d20 2024-03-29T04:08:39.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.660+0000 7f1a02139640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19fc0b1980 0x7f19fc157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:39.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.660+0000 7f1a02139640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19fc0b1980 0x7f19fc157980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36270/0 (socket says 172.21.15.73:36270) 2024-03-29T04:08:39.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.660+0000 7f1a02139640 1 -- 172.21.15.73:0/1303924500 learned_addr learned my addr 172.21.15.73:0/1303924500 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:39.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.660+0000 7f1a01938640 1 --2- 172.21.15.73:0/1303924500 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19fc162d20 0x7f19fc06e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:39.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.660+0000 7f1a0293a640 1 --2- 172.21.15.73:0/1303924500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19fc157050 0x7f19fc0c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:39.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.661+0000 7f1a02139640 1 -- 172.21.15.73:0/1303924500 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19fc162d20 msgr2=0x7f19fc06e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:39.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.661+0000 7f1a02139640 1 --2- 172.21.15.73:0/1303924500 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19fc162d20 0x7f19fc06e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:39.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.661+0000 7f1a02139640 1 -- 172.21.15.73:0/1303924500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19fc157050 msgr2=0x7f19fc0c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:39.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.661+0000 7f1a02139640 1 --2- 172.21.15.73:0/1303924500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19fc157050 0x7f19fc0c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:39.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.661+0000 7f1a02139640 1 -- 172.21.15.73:0/1303924500 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19fc15cb60 con 0x7f19fc0b1980 2024-03-29T04:08:39.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.661+0000 7f1a0293a640 1 --2- 172.21.15.73:0/1303924500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19fc157050 0x7f19fc0c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:08:39.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.661+0000 7f1a02139640 1 --2- 172.21.15.73:0/1303924500 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19fc0b1980 0x7f19fc157980 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f19ec00e9b0 tx=0x7f19ec00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:39.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.661+0000 7f19f2ffd640 1 -- 172.21.15.73:0/1303924500 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ec017070 con 0x7f19fc0b1980 2024-03-29T04:08:39.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.661+0000 7f19f2ffd640 1 -- 172.21.15.73:0/1303924500 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19ec00c9a0 con 0x7f19fc0b1980 2024-03-29T04:08:39.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.661+0000 7f19f2ffd640 1 -- 172.21.15.73:0/1303924500 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ec00cd90 con 0x7f19fc0b1980 2024-03-29T04:08:39.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.661+0000 7f1a0439d640 1 -- 172.21.15.73:0/1303924500 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19fc15ce40 con 0x7f19fc0b1980 2024-03-29T04:08:39.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.661+0000 7f1a0439d640 1 -- 172.21.15.73:0/1303924500 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19fc15d400 con 0x7f19fc0b1980 2024-03-29T04:08:39.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.662+0000 7f1a0439d640 1 -- 172.21.15.73:0/1303924500 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19fc0a0520 con 0x7f19fc0b1980 2024-03-29T04:08:39.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.662+0000 7f19f2ffd640 1 -- 172.21.15.73:0/1303924500 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f19ec01a070 con 0x7f19fc0b1980 2024-03-29T04:08:39.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.663+0000 7f19f2ffd640 1 --2- 172.21.15.73:0/1303924500 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f19e006c530 0x7f19e006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:39.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.663+0000 7f19f2ffd640 1 -- 172.21.15.73:0/1303924500 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f19ec08b9b0 con 0x7f19fc0b1980 2024-03-29T04:08:39.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.663+0000 7f1a01938640 1 --2- 172.21.15.73:0/1303924500 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f19e006c530 0x7f19e006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:39.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.663+0000 7f1a01938640 1 --2- 172.21.15.73:0/1303924500 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f19e006c530 0x7f19e006e9f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f19f8007f70 tx=0x7f19f8007f00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:39.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.667+0000 7f19f2ffd640 1 -- 172.21.15.73:0/1303924500 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f19ec059980 con 0x7f19fc0b1980 2024-03-29T04:08:39.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.841+0000 7f1a0439d640 1 -- 172.21.15.73:0/1303924500 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f19fc04f9d0 con 0x7f19fc0b1980 2024-03-29T04:08:39.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.841+0000 7f19f2ffd640 1 -- 172.21.15.73:0/1303924500 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f19ec05dc80 con 0x7f19fc0b1980 2024-03-29T04:08:39.821 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-03-29T04:08:39.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.843+0000 7f1a0439d640 1 -- 172.21.15.73:0/1303924500 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f19e006c530 msgr2=0x7f19e006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:39.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.843+0000 7f1a0439d640 1 --2- 172.21.15.73:0/1303924500 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f19e006c530 0x7f19e006e9f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f19f8007f70 tx=0x7f19f8007f00 comp rx=0 tx=0).stop 2024-03-29T04:08:39.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.843+0000 7f1a0439d640 1 -- 172.21.15.73:0/1303924500 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19fc0b1980 msgr2=0x7f19fc157980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:39.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.843+0000 7f1a0439d640 1 --2- 172.21.15.73:0/1303924500 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19fc0b1980 0x7f19fc157980 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f19ec00e9b0 tx=0x7f19ec00ee70 comp rx=0 tx=0).stop 2024-03-29T04:08:39.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.843+0000 7f1a0439d640 1 -- 172.21.15.73:0/1303924500 shutdown_connections 2024-03-29T04:08:39.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.843+0000 7f1a0439d640 1 --2- 172.21.15.73:0/1303924500 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f19e006c530 0x7f19e006e9f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:39.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.843+0000 7f1a0439d640 1 --2- 172.21.15.73:0/1303924500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f19fc157050 0x7f19fc0c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:39.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.843+0000 7f1a0439d640 1 --2- 172.21.15.73:0/1303924500 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f19fc162d20 0x7f19fc06e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:39.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.843+0000 7f1a0439d640 1 --2- 172.21.15.73:0/1303924500 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19fc0b1980 0x7f19fc157980 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:39.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.843+0000 7f1a0439d640 1 -- 172.21.15.73:0/1303924500 >> 172.21.15.73:0/1303924500 conn(0x7f19fc0b3f40 msgr2=0x7f19fc162550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:39.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.843+0000 7f1a0439d640 1 -- 172.21.15.73:0/1303924500 shutdown_connections 2024-03-29T04:08:39.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.843+0000 7f1a0439d640 1 -- 172.21.15.73:0/1303924500 wait complete. 2024-03-29T04:08:39.834 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-29T04:08:39.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.957+0000 7f93931c8640 1 Processor -- start 2024-03-29T04:08:39.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.957+0000 7f93931c8640 1 -- start start 2024-03-29T04:08:39.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.958+0000 7f93931c8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f938c0b2810 0x7f938c0cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:39.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.958+0000 7f93931c8640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f938c1604d0 con 0x7f938c0c6820 2024-03-29T04:08:39.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.958+0000 7f93931c8640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f938c1607b0 con 0x7f938c0b4e40 2024-03-29T04:08:39.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.958+0000 7f93931c8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f938c0cba20 con 0x7f938c0b2810 2024-03-29T04:08:39.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.958+0000 7f938bfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f938c0c6820 0x7f938c0b2100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:46772/0 (socket says 172.21.15.73:46772) 2024-03-29T04:08:39.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.958+0000 7f938bfff640 1 -- 172.21.15.73:0/3499235334 learned_addr learned my addr 172.21.15.73:0/3499235334 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:39.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.958+0000 7f9391765640 1 --2- 172.21.15.73:0/3499235334 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f938c0b2810 0x7f938c0cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:39.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.958+0000 7f938b7fe640 1 -- 172.21.15.73:0/3499235334 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2672771003 0 0) 0x7f938c1604d0 con 0x7f938c0c6820 2024-03-29T04:08:39.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.958+0000 7f938b7fe640 1 -- 172.21.15.73:0/3499235334 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f937c003520 con 0x7f938c0c6820 2024-03-29T04:08:39.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.958+0000 7f938b7fe640 1 -- 172.21.15.73:0/3499235334 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 174413832 0 0) 0x7f938c1607b0 con 0x7f938c0b4e40 2024-03-29T04:08:39.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.958+0000 7f938b7fe640 1 -- 172.21.15.73:0/3499235334 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f938c1604d0 con 0x7f938c0b4e40 2024-03-29T04:08:39.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.958+0000 7f9391765640 1 -- 172.21.15.73:0/3499235334 >> v1:172.21.15.142:6789/0 conn(0x7f938c0b4e40 legacy=0x7f938c0b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:39.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.958+0000 7f9391765640 1 -- 172.21.15.73:0/3499235334 >> v1:172.21.15.73:6789/0 conn(0x7f938c0c6820 legacy=0x7f938c0b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:39.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.958+0000 7f9391765640 1 -- 172.21.15.73:0/3499235334 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f938c160a90 con 0x7f938c0b2810 2024-03-29T04:08:39.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.959+0000 7f9391765640 1 --2- 172.21.15.73:0/3499235334 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f938c0b2810 0x7f938c0cbec0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9384009dc0 tx=0x7f938402be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4efb5797f27b718d server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:39.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.959+0000 7f938b7fe640 1 -- 172.21.15.73:0/3499235334 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9384039070 con 0x7f938c0b2810 2024-03-29T04:08:39.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.959+0000 7f938b7fe640 1 -- 172.21.15.73:0/3499235334 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f938402cc40 con 0x7f938c0b2810 2024-03-29T04:08:39.940 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.959+0000 7f938b7fe640 1 -- 172.21.15.73:0/3499235334 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9384034440 con 0x7f938c0b2810 2024-03-29T04:08:39.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.960+0000 7f93931c8640 1 -- 172.21.15.73:0/3499235334 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f938c0b2810 msgr2=0x7f938c0cbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:39.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.960+0000 7f93931c8640 1 --2- 172.21.15.73:0/3499235334 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f938c0b2810 0x7f938c0cbec0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9384009dc0 tx=0x7f938402be90 comp rx=0 tx=0).stop 2024-03-29T04:08:39.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.960+0000 7f93931c8640 1 -- 172.21.15.73:0/3499235334 shutdown_connections 2024-03-29T04:08:39.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.960+0000 7f93931c8640 1 --2- 172.21.15.73:0/3499235334 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f938c0b2810 0x7f938c0cbec0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:39.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.960+0000 7f93931c8640 1 -- 172.21.15.73:0/3499235334 >> 172.21.15.73:0/3499235334 conn(0x7f938c0d0450 msgr2=0x7f938c0d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:39.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.960+0000 7f93931c8640 1 -- 172.21.15.73:0/3499235334 shutdown_connections 2024-03-29T04:08:39.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.960+0000 7f93931c8640 1 -- 172.21.15.73:0/3499235334 wait complete. 2024-03-29T04:08:39.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.961+0000 7f93931c8640 1 Processor -- start 2024-03-29T04:08:39.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.961+0000 7f93931c8640 1 -- start start 2024-03-29T04:08:39.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.962+0000 7f93931c8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f938c0b2810 0x7f938c146280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:39.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.962+0000 7f93931c8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f938c0b4e40 0x7f938c15b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:39.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.962+0000 7f93931c8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f938c0c6820 0x7f938c149310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:39.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.962+0000 7f93931c8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f938c0c60f0 con 0x7f938c0c6820 2024-03-29T04:08:39.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.962+0000 7f93931c8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f938c0c6cb0 con 0x7f938c0b4e40 2024-03-29T04:08:39.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.962+0000 7f93931c8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f938c1600f0 con 0x7f938c0b2810 2024-03-29T04:08:39.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.962+0000 7f9391765640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f938c0c6820 0x7f938c149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:39.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.962+0000 7f9390f64640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f938c0b2810 0x7f938c146280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:39.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.962+0000 7f9391765640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f938c0c6820 0x7f938c149310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36284/0 (socket says 172.21.15.73:36284) 2024-03-29T04:08:39.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.962+0000 7f9391765640 1 -- 172.21.15.73:0/3065020705 learned_addr learned my addr 172.21.15.73:0/3065020705 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:39.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.962+0000 7f938bfff640 1 --2- 172.21.15.73:0/3065020705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f938c0b4e40 0x7f938c15b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:39.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.962+0000 7f9391765640 1 -- 172.21.15.73:0/3065020705 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f938c0b2810 msgr2=0x7f938c146280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:39.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.962+0000 7f9391765640 1 --2- 172.21.15.73:0/3065020705 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f938c0b2810 0x7f938c146280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:39.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.962+0000 7f9391765640 1 -- 172.21.15.73:0/3065020705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f938c0b4e40 msgr2=0x7f938c15b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:39.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.962+0000 7f9391765640 1 --2- 172.21.15.73:0/3065020705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f938c0b4e40 0x7f938c15b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:39.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.962+0000 7f9391765640 1 -- 172.21.15.73:0/3065020705 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f938c1e6420 con 0x7f938c0c6820 2024-03-29T04:08:39.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.962+0000 7f938bfff640 1 --2- 172.21.15.73:0/3065020705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f938c0b4e40 0x7f938c15b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:08:39.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.962+0000 7f9390f64640 1 --2- 172.21.15.73:0/3065020705 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f938c0b2810 0x7f938c146280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:08:39.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.963+0000 7f9391765640 1 --2- 172.21.15.73:0/3065020705 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f938c0c6820 0x7f938c149310 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9384037040 tx=0x7f9384004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:39.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.964+0000 7f93897fa640 1 -- 172.21.15.73:0/3065020705 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9384039050 con 0x7f938c0c6820 2024-03-29T04:08:39.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.964+0000 7f93897fa640 1 -- 172.21.15.73:0/3065020705 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9384045070 con 0x7f938c0c6820 2024-03-29T04:08:39.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.964+0000 7f93931c8640 1 -- 172.21.15.73:0/3065020705 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f938c15a7a0 con 0x7f938c0c6820 2024-03-29T04:08:39.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.964+0000 7f93897fa640 1 -- 172.21.15.73:0/3065020705 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9384040690 con 0x7f938c0c6820 2024-03-29T04:08:39.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.964+0000 7f93931c8640 1 -- 172.21.15.73:0/3065020705 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f938c1e6700 con 0x7f938c0c6820 2024-03-29T04:08:39.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.965+0000 7f93931c8640 1 -- 172.21.15.73:0/3065020705 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f938c15f860 con 0x7f938c0c6820 2024-03-29T04:08:39.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.965+0000 7f93897fa640 1 -- 172.21.15.73:0/3065020705 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f9384040830 con 0x7f938c0c6820 2024-03-29T04:08:39.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.965+0000 7f93897fa640 1 --2- 172.21.15.73:0/3065020705 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f937006c530 0x7f937006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:39.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.966+0000 7f93897fa640 1 -- 172.21.15.73:0/3065020705 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f93840adef0 con 0x7f938c0c6820 2024-03-29T04:08:39.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.966+0000 7f9390f64640 1 --2- 172.21.15.73:0/3065020705 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f937006c530 0x7f937006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:39.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.966+0000 7f9390f64640 1 --2- 172.21.15.73:0/3065020705 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f937006c530 0x7f937006e9f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9380007fd0 tx=0x7f9380009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:39.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:39.970+0000 7f93897fa640 1 -- 172.21.15.73:0/3065020705 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f938c15f860 con 0x7f938c0c6820 2024-03-29T04:08:40.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.143+0000 7f93931c8640 1 -- 172.21.15.73:0/3065020705 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f938c04f9d0 con 0x7f938c0c6820 2024-03-29T04:08:40.123 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.143+0000 7f93897fa640 1 -- 172.21.15.73:0/3065020705 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f938407bec0 con 0x7f938c0c6820 2024-03-29T04:08:40.123 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-03-29T04:08:40.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.145+0000 7f93931c8640 1 -- 172.21.15.73:0/3065020705 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f937006c530 msgr2=0x7f937006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:40.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.145+0000 7f93931c8640 1 --2- 172.21.15.73:0/3065020705 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f937006c530 0x7f937006e9f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9380007fd0 tx=0x7f9380009040 comp rx=0 tx=0).stop 2024-03-29T04:08:40.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.145+0000 7f93931c8640 1 -- 172.21.15.73:0/3065020705 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f938c0c6820 msgr2=0x7f938c149310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:40.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.145+0000 7f93931c8640 1 --2- 172.21.15.73:0/3065020705 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f938c0c6820 0x7f938c149310 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9384037040 tx=0x7f9384004a40 comp rx=0 tx=0).stop 2024-03-29T04:08:40.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.145+0000 7f93931c8640 1 -- 172.21.15.73:0/3065020705 shutdown_connections 2024-03-29T04:08:40.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.145+0000 7f93931c8640 1 --2- 172.21.15.73:0/3065020705 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f938c0c6820 0x7f938c149310 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:40.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.145+0000 7f93931c8640 1 --2- 172.21.15.73:0/3065020705 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f937006c530 0x7f937006e9f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:40.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.145+0000 7f93931c8640 1 --2- 172.21.15.73:0/3065020705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f938c0b4e40 0x7f938c15b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:40.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.145+0000 7f93931c8640 1 --2- 172.21.15.73:0/3065020705 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f938c0b2810 0x7f938c146280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:40.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.145+0000 7f93931c8640 1 -- 172.21.15.73:0/3065020705 >> 172.21.15.73:0/3065020705 conn(0x7f938c0d0450 msgr2=0x7f938c15f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:40.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.145+0000 7f93931c8640 1 -- 172.21.15.73:0/3065020705 shutdown_connections 2024-03-29T04:08:40.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.145+0000 7f93931c8640 1 -- 172.21.15.73:0/3065020705 wait complete. 2024-03-29T04:08:40.136 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-29T04:08:40.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.259+0000 7f6a48dcd640 1 Processor -- start 2024-03-29T04:08:40.239 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.259+0000 7f6a48dcd640 1 -- start start 2024-03-29T04:08:40.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.260+0000 7f6a48dcd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6a4415ad60 0x7f6a440ce120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:40.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.260+0000 7f6a48dcd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6a440b49b0 0x7f6a440b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:40.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.260+0000 7f6a48dcd640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a440c70a0 con 0x7f6a440b4460 2024-03-29T04:08:40.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.260+0000 7f6a48dcd640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f6a440c5ce0 con 0x7f6a4415ad60 2024-03-29T04:08:40.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.260+0000 7f6a48dcd640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f6a440c5fc0 con 0x7f6a440b49b0 2024-03-29T04:08:40.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.260+0000 7f6a4259c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6a4415ad60 0x7f6a440ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:40.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.260+0000 7f6a4259c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6a4415ad60 0x7f6a440ce120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36298/0 (socket says 172.21.15.73:36298) 2024-03-29T04:08:40.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.260+0000 7f6a4259c640 1 -- 172.21.15.73:0/868780448 learned_addr learned my addr 172.21.15.73:0/868780448 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:40.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.260+0000 7f6a42d9d640 1 --2- 172.21.15.73:0/868780448 >> v2:172.21.15.142:3300/0 conn(0x7f6a440b49b0 0x7f6a440b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:40.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.260+0000 7f6a4259c640 1 -- 172.21.15.73:0/868780448 >> v2:172.21.15.142:3300/0 conn(0x7f6a440b49b0 msgr2=0x7f6a440b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:40.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.260+0000 7f6a4259c640 1 --2- 172.21.15.73:0/868780448 >> v2:172.21.15.142:3300/0 conn(0x7f6a440b49b0 0x7f6a440b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:40.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.260+0000 7f6a4259c640 1 -- 172.21.15.73:0/868780448 >> v1:172.21.15.142:6789/0 conn(0x7f6a440b4460 legacy=0x7f6a440c6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:40.241 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.260+0000 7f6a4259c640 1 -- 172.21.15.73:0/868780448 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a440cfd90 con 0x7f6a4415ad60 2024-03-29T04:08:40.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.261+0000 7f6a4259c640 1 --2- 172.21.15.73:0/868780448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a4415ad60 0x7f6a440ce120 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6a4406fdc0 tx=0x7f6a3402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b3a5f05dd803960 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:40.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.261+0000 7f6a41d9b640 1 -- 172.21.15.73:0/868780448 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a34035020 con 0x7f6a4415ad60 2024-03-29T04:08:40.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.261+0000 7f6a41d9b640 1 -- 172.21.15.73:0/868780448 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a34031870 con 0x7f6a4415ad60 2024-03-29T04:08:40.242 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.261+0000 7f6a41d9b640 1 -- 172.21.15.73:0/868780448 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a34031c40 con 0x7f6a4415ad60 2024-03-29T04:08:40.244 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.262+0000 7f6a48dcd640 1 -- 172.21.15.73:0/868780448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a4415ad60 msgr2=0x7f6a440ce120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:40.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.262+0000 7f6a48dcd640 1 --2- 172.21.15.73:0/868780448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a4415ad60 0x7f6a440ce120 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6a4406fdc0 tx=0x7f6a3402b910 comp rx=0 tx=0).stop 2024-03-29T04:08:40.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.262+0000 7f6a48dcd640 1 -- 172.21.15.73:0/868780448 shutdown_connections 2024-03-29T04:08:40.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.262+0000 7f6a48dcd640 1 --2- 172.21.15.73:0/868780448 >> v2:172.21.15.142:3300/0 conn(0x7f6a440b49b0 0x7f6a440b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:40.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.262+0000 7f6a48dcd640 1 --2- 172.21.15.73:0/868780448 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a4415ad60 0x7f6a440ce120 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:40.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.262+0000 7f6a48dcd640 1 -- 172.21.15.73:0/868780448 >> 172.21.15.73:0/868780448 conn(0x7f6a440d0450 msgr2=0x7f6a440d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:40.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.262+0000 7f6a48dcd640 1 -- 172.21.15.73:0/868780448 shutdown_connections 2024-03-29T04:08:40.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.262+0000 7f6a48dcd640 1 -- 172.21.15.73:0/868780448 wait complete. 2024-03-29T04:08:40.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.263+0000 7f6a48dcd640 1 Processor -- start 2024-03-29T04:08:40.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.263+0000 7f6a48dcd640 1 -- start start 2024-03-29T04:08:40.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.264+0000 7f6a48dcd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a440b4460 0x7f6a441f19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:40.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.264+0000 7f6a48dcd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a440b49b0 0x7f6a44151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:40.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.264+0000 7f6a48dcd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a4415ad60 0x7f6a441501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:40.245 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.264+0000 7f6a48dcd640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6a440cfb30 con 0x7f6a440b49b0 2024-03-29T04:08:40.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.264+0000 7f6a48dcd640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6a440cf9b0 con 0x7f6a440b4460 2024-03-29T04:08:40.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.264+0000 7f6a48dcd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f6a440b2100 con 0x7f6a4415ad60 2024-03-29T04:08:40.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.264+0000 7f6a3bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a440b49b0 0x7f6a44151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:40.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.264+0000 7f6a3bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a440b49b0 0x7f6a44151bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36308/0 (socket says 172.21.15.73:36308) 2024-03-29T04:08:40.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.264+0000 7f6a3bfff640 1 -- 172.21.15.73:0/1657282050 learned_addr learned my addr 172.21.15.73:0/1657282050 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:40.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.264+0000 7f6a42d9d640 1 --2- 172.21.15.73:0/1657282050 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a4415ad60 0x7f6a441501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:40.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.264+0000 7f6a4259c640 1 --2- 172.21.15.73:0/1657282050 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a440b4460 0x7f6a441f19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:40.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.264+0000 7f6a3bfff640 1 -- 172.21.15.73:0/1657282050 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a4415ad60 msgr2=0x7f6a441501c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:40.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.264+0000 7f6a3bfff640 1 --2- 172.21.15.73:0/1657282050 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a4415ad60 0x7f6a441501c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:40.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.264+0000 7f6a3bfff640 1 -- 172.21.15.73:0/1657282050 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a440b4460 msgr2=0x7f6a441f19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:40.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.264+0000 7f6a3bfff640 1 --2- 172.21.15.73:0/1657282050 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a440b4460 0x7f6a441f19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:40.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.264+0000 7f6a3bfff640 1 -- 172.21.15.73:0/1657282050 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a44152330 con 0x7f6a440b49b0 2024-03-29T04:08:40.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.264+0000 7f6a3bfff640 1 --2- 172.21.15.73:0/1657282050 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a440b49b0 0x7f6a44151bc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c00c400 tx=0x7f6a2c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:40.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.264+0000 7f6a3affd640 1 -- 172.21.15.73:0/1657282050 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c0052d0 con 0x7f6a440b49b0 2024-03-29T04:08:40.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.264+0000 7f6a3affd640 1 -- 172.21.15.73:0/1657282050 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a2c005490 con 0x7f6a440b49b0 2024-03-29T04:08:40.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.264+0000 7f6a48dcd640 1 -- 172.21.15.73:0/1657282050 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a4415c470 con 0x7f6a440b49b0 2024-03-29T04:08:40.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.264+0000 7f6a3affd640 1 -- 172.21.15.73:0/1657282050 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c007260 con 0x7f6a440b49b0 2024-03-29T04:08:40.247 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.265+0000 7f6a48dcd640 1 -- 172.21.15.73:0/1657282050 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a4415ca30 con 0x7f6a440b49b0 2024-03-29T04:08:40.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.265+0000 7f6a48dcd640 1 -- 172.21.15.73:0/1657282050 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a4409e520 con 0x7f6a440b49b0 2024-03-29T04:08:40.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.266+0000 7f6a3affd640 1 -- 172.21.15.73:0/1657282050 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f6a2c007400 con 0x7f6a440b49b0 2024-03-29T04:08:40.250 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.266+0000 7f6a3affd640 1 --2- 172.21.15.73:0/1657282050 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f6a2406c530 0x7f6a2406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:40.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.266+0000 7f6a3affd640 1 -- 172.21.15.73:0/1657282050 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6a2c08aba0 con 0x7f6a440b49b0 2024-03-29T04:08:40.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.266+0000 7f6a4259c640 1 --2- 172.21.15.73:0/1657282050 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f6a2406c530 0x7f6a2406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:40.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.267+0000 7f6a4259c640 1 --2- 172.21.15.73:0/1657282050 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f6a2406c530 0x7f6a2406e9f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6a34036000 tx=0x7f6a3403c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:40.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.271+0000 7f6a3affd640 1 -- 172.21.15.73:0/1657282050 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f6a2c058b70 con 0x7f6a440b49b0 2024-03-29T04:08:40.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.444+0000 7f6a48dcd640 1 -- 172.21.15.73:0/1657282050 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6a4404f9d0 con 0x7f6a440b49b0 2024-03-29T04:08:40.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.444+0000 7f6a3affd640 1 -- 172.21.15.73:0/1657282050 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f6a2c05ce70 con 0x7f6a440b49b0 2024-03-29T04:08:40.424 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-29T04:08:40.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.446+0000 7f6a48dcd640 1 -- 172.21.15.73:0/1657282050 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f6a2406c530 msgr2=0x7f6a2406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:40.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.446+0000 7f6a48dcd640 1 --2- 172.21.15.73:0/1657282050 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f6a2406c530 0x7f6a2406e9f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6a34036000 tx=0x7f6a3403c040 comp rx=0 tx=0).stop 2024-03-29T04:08:40.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.446+0000 7f6a48dcd640 1 -- 172.21.15.73:0/1657282050 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a440b49b0 msgr2=0x7f6a44151bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:40.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.446+0000 7f6a48dcd640 1 --2- 172.21.15.73:0/1657282050 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a440b49b0 0x7f6a44151bc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c00c400 tx=0x7f6a2c00c8c0 comp rx=0 tx=0).stop 2024-03-29T04:08:40.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.446+0000 7f6a48dcd640 1 -- 172.21.15.73:0/1657282050 shutdown_connections 2024-03-29T04:08:40.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.446+0000 7f6a48dcd640 1 --2- 172.21.15.73:0/1657282050 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6a4415ad60 0x7f6a441501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:40.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.446+0000 7f6a48dcd640 1 --2- 172.21.15.73:0/1657282050 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a440b49b0 0x7f6a44151bc0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:40.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.446+0000 7f6a48dcd640 1 --2- 172.21.15.73:0/1657282050 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f6a2406c530 0x7f6a2406e9f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:40.426 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.446+0000 7f6a48dcd640 1 --2- 172.21.15.73:0/1657282050 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6a440b4460 0x7f6a441f19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:40.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.446+0000 7f6a48dcd640 1 -- 172.21.15.73:0/1657282050 >> 172.21.15.73:0/1657282050 conn(0x7f6a440d0450 msgr2=0x7f6a440afce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:40.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.446+0000 7f6a48dcd640 1 -- 172.21.15.73:0/1657282050 shutdown_connections 2024-03-29T04:08:40.427 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.446+0000 7f6a48dcd640 1 -- 172.21.15.73:0/1657282050 wait complete. 2024-03-29T04:08:40.437 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-29T04:08:40.539 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.560+0000 7f9a2eeeb640 1 Processor -- start 2024-03-29T04:08:40.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.560+0000 7f9a2eeeb640 1 -- start start 2024-03-29T04:08:40.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.560+0000 7f9a2eeeb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9a2815fc20 0x7f9a280c6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:40.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.560+0000 7f9a2eeeb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a280c5020 0x7f9a280c6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:40.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.560+0000 7f9a2eeeb640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9a280b4b20 0x7f9a280d00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:40.541 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.560+0000 7f9a2eeeb640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f9a28161090 con 0x7f9a280b4b20 2024-03-29T04:08:40.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.560+0000 7f9a2eeeb640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f9a28160480 con 0x7f9a2815fc20 2024-03-29T04:08:40.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.560+0000 7f9a2eeeb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9a28160760 con 0x7f9a280c5020 2024-03-29T04:08:40.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.561+0000 7f9a2d488640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9a280b4b20 0x7f9a280d00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:40.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.561+0000 7f9a27fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a280c5020 0x7f9a280c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:40.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.561+0000 7f9a2d488640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9a280b4b20 0x7f9a280d00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36318/0 (socket says 172.21.15.73:36318) 2024-03-29T04:08:40.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.561+0000 7f9a2d488640 1 -- 172.21.15.73:0/2766539220 learned_addr learned my addr 172.21.15.73:0/2766539220 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:40.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.561+0000 7f9a2cc87640 1 --2- 172.21.15.73:0/2766539220 >> v2:172.21.15.142:3300/0 conn(0x7f9a2815fc20 0x7f9a280c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:40.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.561+0000 7f9a2d488640 1 -- 172.21.15.73:0/2766539220 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a280c5020 msgr2=0x7f9a280c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:40.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.561+0000 7f9a2d488640 1 --2- 172.21.15.73:0/2766539220 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a280c5020 0x7f9a280c6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:40.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.561+0000 7f9a2d488640 1 -- 172.21.15.73:0/2766539220 >> v2:172.21.15.142:3300/0 conn(0x7f9a2815fc20 msgr2=0x7f9a280c6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:40.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.561+0000 7f9a2d488640 1 --2- 172.21.15.73:0/2766539220 >> v2:172.21.15.142:3300/0 conn(0x7f9a2815fc20 0x7f9a280c6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:40.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.561+0000 7f9a2d488640 1 -- 172.21.15.73:0/2766539220 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a28160a40 con 0x7f9a280b4b20 2024-03-29T04:08:40.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.561+0000 7f9a27fff640 1 --2- 172.21.15.73:0/2766539220 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a280c5020 0x7f9a280c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:08:40.542 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.562+0000 7f9a2d488640 1 --2- 172.21.15.73:0/2766539220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a280b4b20 0x7f9a280d00f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9a280d1200 tx=0x7f9a2002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db3b87b0d5a83d88 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:40.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.562+0000 7f9a277fe640 1 -- 172.21.15.73:0/2766539220 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a2002c9e0 con 0x7f9a280b4b20 2024-03-29T04:08:40.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.562+0000 7f9a277fe640 1 -- 172.21.15.73:0/2766539220 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a2002cb80 con 0x7f9a280b4b20 2024-03-29T04:08:40.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.562+0000 7f9a277fe640 1 -- 172.21.15.73:0/2766539220 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a200343f0 con 0x7f9a280b4b20 2024-03-29T04:08:40.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.562+0000 7f9a2eeeb640 1 -- 172.21.15.73:0/2766539220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a280b4b20 msgr2=0x7f9a280d00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:40.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.562+0000 7f9a2eeeb640 1 --2- 172.21.15.73:0/2766539220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a280b4b20 0x7f9a280d00f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9a280d1200 tx=0x7f9a2002be40 comp rx=0 tx=0).stop 2024-03-29T04:08:40.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.562+0000 7f9a2eeeb640 1 -- 172.21.15.73:0/2766539220 shutdown_connections 2024-03-29T04:08:40.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.562+0000 7f9a2eeeb640 1 --2- 172.21.15.73:0/2766539220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a280b4b20 0x7f9a280d00f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:40.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.562+0000 7f9a2eeeb640 1 --2- 172.21.15.73:0/2766539220 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a280c5020 0x7f9a280c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:40.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.562+0000 7f9a2eeeb640 1 --2- 172.21.15.73:0/2766539220 >> v2:172.21.15.142:3300/0 conn(0x7f9a2815fc20 0x7f9a280c6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:40.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.562+0000 7f9a2eeeb640 1 -- 172.21.15.73:0/2766539220 >> 172.21.15.73:0/2766539220 conn(0x7f9a2806b510 msgr2=0x7f9a2806b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:40.546 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.562+0000 7f9a2eeeb640 1 -- 172.21.15.73:0/2766539220 shutdown_connections 2024-03-29T04:08:40.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.562+0000 7f9a2eeeb640 1 -- 172.21.15.73:0/2766539220 wait complete. 2024-03-29T04:08:40.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.563+0000 7f9a2eeeb640 1 Processor -- start 2024-03-29T04:08:40.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.564+0000 7f9a2eeeb640 1 -- start start 2024-03-29T04:08:40.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.564+0000 7f9a2eeeb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a280b4b20 0x7f9a28146540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:40.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.564+0000 7f9a2eeeb640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a280c5020 0x7f9a28072d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:40.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.564+0000 7f9a2eeeb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a2815fc20 0x7f9a280c7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:40.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.564+0000 7f9a2eeeb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9a28160260 con 0x7f9a2815fc20 2024-03-29T04:08:40.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.564+0000 7f9a2eeeb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9a281600e0 con 0x7f9a280b4b20 2024-03-29T04:08:40.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.564+0000 7f9a2eeeb640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9a280d0630 con 0x7f9a280c5020 2024-03-29T04:08:40.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.564+0000 7f9a2d488640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a2815fc20 0x7f9a280c7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:40.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.565+0000 7f9a27fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a280c5020 0x7f9a28072d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:40.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.565+0000 7f9a2d488640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a2815fc20 0x7f9a280c7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36320/0 (socket says 172.21.15.73:36320) 2024-03-29T04:08:40.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.565+0000 7f9a2d488640 1 -- 172.21.15.73:0/809123821 learned_addr learned my addr 172.21.15.73:0/809123821 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:40.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.565+0000 7f9a2cc87640 1 --2- 172.21.15.73:0/809123821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a280b4b20 0x7f9a28146540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:40.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.565+0000 7f9a2d488640 1 -- 172.21.15.73:0/809123821 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a280c5020 msgr2=0x7f9a28072d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:40.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.565+0000 7f9a2d488640 1 --2- 172.21.15.73:0/809123821 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a280c5020 0x7f9a28072d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:40.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.565+0000 7f9a2d488640 1 -- 172.21.15.73:0/809123821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a280b4b20 msgr2=0x7f9a28146540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:40.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.565+0000 7f9a2d488640 1 --2- 172.21.15.73:0/809123821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a280b4b20 0x7f9a28146540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:40.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.565+0000 7f9a2d488640 1 -- 172.21.15.73:0/809123821 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a280c93b0 con 0x7f9a2815fc20 2024-03-29T04:08:40.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.565+0000 7f9a27fff640 1 --2- 172.21.15.73:0/809123821 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a280c5020 0x7f9a28072d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:08:40.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.565+0000 7f9a2d488640 1 --2- 172.21.15.73:0/809123821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a2815fc20 0x7f9a280c7230 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9a20036040 tx=0x7f9a20004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:40.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.565+0000 7f9a257fa640 1 -- 172.21.15.73:0/809123821 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a20043020 con 0x7f9a2815fc20 2024-03-29T04:08:40.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.565+0000 7f9a257fa640 1 -- 172.21.15.73:0/809123821 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a2003e450 con 0x7f9a2815fc20 2024-03-29T04:08:40.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.565+0000 7f9a2eeeb640 1 -- 172.21.15.73:0/809123821 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a280c9690 con 0x7f9a2815fc20 2024-03-29T04:08:40.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.565+0000 7f9a257fa640 1 -- 172.21.15.73:0/809123821 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a20009510 con 0x7f9a2815fc20 2024-03-29T04:08:40.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.565+0000 7f9a2eeeb640 1 -- 172.21.15.73:0/809123821 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a280c9c50 con 0x7f9a2815fc20 2024-03-29T04:08:40.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.566+0000 7f9a2eeeb640 1 -- 172.21.15.73:0/809123821 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a28068640 con 0x7f9a2815fc20 2024-03-29T04:08:40.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.567+0000 7f9a257fa640 1 -- 172.21.15.73:0/809123821 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f9a20046020 con 0x7f9a2815fc20 2024-03-29T04:08:40.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.567+0000 7f9a257fa640 1 --2- 172.21.15.73:0/809123821 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9a0c06c530 0x7f9a0c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:40.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.567+0000 7f9a2cc87640 1 --2- 172.21.15.73:0/809123821 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9a0c06c530 0x7f9a0c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:40.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.567+0000 7f9a257fa640 1 -- 172.21.15.73:0/809123821 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9a200adce0 con 0x7f9a2815fc20 2024-03-29T04:08:40.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.568+0000 7f9a2cc87640 1 --2- 172.21.15.73:0/809123821 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9a0c06c530 0x7f9a0c06e9f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c009aa0 tx=0x7f9a1c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:40.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.572+0000 7f9a257fa640 1 -- 172.21.15.73:0/809123821 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f9a2004d030 con 0x7f9a2815fc20 2024-03-29T04:08:40.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.759+0000 7f9a2eeeb640 1 -- 172.21.15.73:0/809123821 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9a280cfd50 con 0x7f9a2815fc20 2024-03-29T04:08:40.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.759+0000 7f9a257fa640 1 -- 172.21.15.73:0/809123821 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f9a2007bcb0 con 0x7f9a2815fc20 2024-03-29T04:08:40.739 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-03-29T04:08:40.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.761+0000 7f9a2eeeb640 1 -- 172.21.15.73:0/809123821 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9a0c06c530 msgr2=0x7f9a0c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:40.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.761+0000 7f9a2eeeb640 1 --2- 172.21.15.73:0/809123821 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9a0c06c530 0x7f9a0c06e9f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c009aa0 tx=0x7f9a1c009190 comp rx=0 tx=0).stop 2024-03-29T04:08:40.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.761+0000 7f9a2eeeb640 1 -- 172.21.15.73:0/809123821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a2815fc20 msgr2=0x7f9a280c7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:40.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.761+0000 7f9a2eeeb640 1 --2- 172.21.15.73:0/809123821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a2815fc20 0x7f9a280c7230 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9a20036040 tx=0x7f9a20004a40 comp rx=0 tx=0).stop 2024-03-29T04:08:40.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.761+0000 7f9a2eeeb640 1 -- 172.21.15.73:0/809123821 shutdown_connections 2024-03-29T04:08:40.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.761+0000 7f9a2eeeb640 1 --2- 172.21.15.73:0/809123821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a2815fc20 0x7f9a280c7230 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:40.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.761+0000 7f9a2eeeb640 1 --2- 172.21.15.73:0/809123821 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9a280c5020 0x7f9a28072d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:40.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.761+0000 7f9a2eeeb640 1 --2- 172.21.15.73:0/809123821 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9a0c06c530 0x7f9a0c06e9f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:40.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.761+0000 7f9a2eeeb640 1 --2- 172.21.15.73:0/809123821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a280b4b20 0x7f9a28146540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:40.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.761+0000 7f9a2eeeb640 1 -- 172.21.15.73:0/809123821 >> 172.21.15.73:0/809123821 conn(0x7f9a2806b510 msgr2=0x7f9a280c6140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:40.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.761+0000 7f9a2eeeb640 1 -- 172.21.15.73:0/809123821 shutdown_connections 2024-03-29T04:08:40.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:40.761+0000 7f9a2eeeb640 1 -- 172.21.15.73:0/809123821 wait complete. 2024-03-29T04:08:40.751 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-29T04:08:40.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:40.752 DEBUG:teuthology.orchestra.run.smithi073:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-03-29T04:08:40.779 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2024-03-29T04:08:40.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:40.780 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-29T04:08:40.837 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-03-29T04:08:40.837 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-29T04:08:40.855 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-03-29T04:08:40.855 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-29T04:08:40.911 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-03-29T04:08:40.911 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-29T04:08:40.967 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-29T04:08:41.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.089+0000 7fd6af635640 1 Processor -- start 2024-03-29T04:08:41.069 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.089+0000 7fd6af635640 1 -- start start 2024-03-29T04:08:41.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.090+0000 7fd6af635640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd6a815b370 0x7fd6a80b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:41.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.090+0000 7fd6af635640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd6a806f3f0 0x7fd6a8072b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:41.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.090+0000 7fd6af635640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6a80730c0 0x7fd6a80ae020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:41.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.090+0000 7fd6af635640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fd6a8071ae0 con 0x7fd6a815b370 2024-03-29T04:08:41.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.090+0000 7fd6af635640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd6a8071dc0 con 0x7fd6a806f3f0 2024-03-29T04:08:41.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.090+0000 7fd6af635640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd6a80720a0 con 0x7fd6a80730c0 2024-03-29T04:08:41.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.090+0000 7fd6ad3d1640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd6a815b370 0x7fd6a80b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:41.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.090+0000 7fd6ad3d1640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd6a815b370 0x7fd6a80b32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36334/0 (socket says 172.21.15.73:36334) 2024-03-29T04:08:41.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.090+0000 7fd6ad3d1640 1 -- 172.21.15.73:0/2202469941 learned_addr learned my addr 172.21.15.73:0/2202469941 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:41.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.090+0000 7fd6adbd2640 1 --2- 172.21.15.73:0/2202469941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6a80730c0 0x7fd6a80ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:41.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.090+0000 7fd6acbd0640 1 --2- 172.21.15.73:0/2202469941 >> v2:172.21.15.142:3300/0 conn(0x7fd6a806f3f0 0x7fd6a8072b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:41.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.090+0000 7fd6ad3d1640 1 -- 172.21.15.73:0/2202469941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6a80730c0 msgr2=0x7fd6a80ae020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:41.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.090+0000 7fd6ad3d1640 1 --2- 172.21.15.73:0/2202469941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6a80730c0 0x7fd6a80ae020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:41.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.090+0000 7fd6ad3d1640 1 -- 172.21.15.73:0/2202469941 >> v2:172.21.15.142:3300/0 conn(0x7fd6a806f3f0 msgr2=0x7fd6a8072b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:41.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.090+0000 7fd6ad3d1640 1 --2- 172.21.15.73:0/2202469941 >> v2:172.21.15.142:3300/0 conn(0x7fd6a806f3f0 0x7fd6a8072b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:41.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.090+0000 7fd6ad3d1640 1 -- 172.21.15.73:0/2202469941 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a8072380 con 0x7fd6a815b370 2024-03-29T04:08:41.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.091+0000 7fd6ad3d1640 1 --2- 172.21.15.73:0/2202469941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6a815b370 0x7fd6a80b32c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd6a80d1390 tx=0x7fd6a402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f67d7e2377fbe07 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:41.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.091+0000 7fd69ffff640 1 -- 172.21.15.73:0/2202469941 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a4035020 con 0x7fd6a815b370 2024-03-29T04:08:41.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.091+0000 7fd69ffff640 1 -- 172.21.15.73:0/2202469941 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6a4031870 con 0x7fd6a815b370 2024-03-29T04:08:41.072 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.091+0000 7fd69ffff640 1 -- 172.21.15.73:0/2202469941 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a4031c40 con 0x7fd6a815b370 2024-03-29T04:08:41.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.091+0000 7fd6af635640 1 -- 172.21.15.73:0/2202469941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6a815b370 msgr2=0x7fd6a80b32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:41.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.091+0000 7fd6af635640 1 --2- 172.21.15.73:0/2202469941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6a815b370 0x7fd6a80b32c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd6a80d1390 tx=0x7fd6a402b910 comp rx=0 tx=0).stop 2024-03-29T04:08:41.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.091+0000 7fd6af635640 1 -- 172.21.15.73:0/2202469941 shutdown_connections 2024-03-29T04:08:41.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.092+0000 7fd6af635640 1 --2- 172.21.15.73:0/2202469941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6a80730c0 0x7fd6a80ae020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:41.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.092+0000 7fd6af635640 1 --2- 172.21.15.73:0/2202469941 >> v2:172.21.15.142:3300/0 conn(0x7fd6a806f3f0 0x7fd6a8072b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:41.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.092+0000 7fd6af635640 1 --2- 172.21.15.73:0/2202469941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6a815b370 0x7fd6a80b32c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:41.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.092+0000 7fd6af635640 1 -- 172.21.15.73:0/2202469941 >> 172.21.15.73:0/2202469941 conn(0x7fd6a806b510 msgr2=0x7fd6a806b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:41.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.092+0000 7fd6af635640 1 -- 172.21.15.73:0/2202469941 shutdown_connections 2024-03-29T04:08:41.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.092+0000 7fd6af635640 1 -- 172.21.15.73:0/2202469941 wait complete. 2024-03-29T04:08:41.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.093+0000 7fd6af635640 1 Processor -- start 2024-03-29T04:08:41.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.093+0000 7fd6af635640 1 -- start start 2024-03-29T04:08:41.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.093+0000 7fd6af635640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6a806f3f0 0x7fd6a815a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:41.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.093+0000 7fd6af635640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6a80730c0 0x7fd6a81f2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:41.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.093+0000 7fd6af635640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6a815b370 0x7fd6a8153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:41.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.093+0000 7fd6af635640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a80b3800 con 0x7fd6a80730c0 2024-03-29T04:08:41.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.094+0000 7fd6af635640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a8073550 con 0x7fd6a815b370 2024-03-29T04:08:41.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.094+0000 7fd6af635640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd6a80b3980 con 0x7fd6a806f3f0 2024-03-29T04:08:41.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.094+0000 7fd6acbd0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6a80730c0 0x7fd6a81f2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:41.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.094+0000 7fd6acbd0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6a80730c0 0x7fd6a81f2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36350/0 (socket says 172.21.15.73:36350) 2024-03-29T04:08:41.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.094+0000 7fd6acbd0640 1 -- 172.21.15.73:0/2420997594 learned_addr learned my addr 172.21.15.73:0/2420997594 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:41.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.094+0000 7fd6adbd2640 1 --2- 172.21.15.73:0/2420997594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6a815b370 0x7fd6a8153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:41.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.094+0000 7fd6ad3d1640 1 --2- 172.21.15.73:0/2420997594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6a806f3f0 0x7fd6a815a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:41.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.094+0000 7fd6acbd0640 1 -- 172.21.15.73:0/2420997594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6a806f3f0 msgr2=0x7fd6a815a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:41.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.094+0000 7fd6acbd0640 1 --2- 172.21.15.73:0/2420997594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6a806f3f0 0x7fd6a815a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:41.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.094+0000 7fd6acbd0640 1 -- 172.21.15.73:0/2420997594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6a815b370 msgr2=0x7fd6a8153ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:41.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.094+0000 7fd6acbd0640 1 --2- 172.21.15.73:0/2420997594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6a815b370 0x7fd6a8153ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:41.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.094+0000 7fd6acbd0640 1 -- 172.21.15.73:0/2420997594 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a8152660 con 0x7fd6a80730c0 2024-03-29T04:08:41.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.094+0000 7fd6acbd0640 1 --2- 172.21.15.73:0/2420997594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6a80730c0 0x7fd6a81f2580 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd69800e870 tx=0x7fd69800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:41.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.094+0000 7fd69dffb640 1 -- 172.21.15.73:0/2420997594 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd698017070 con 0x7fd6a80730c0 2024-03-29T04:08:41.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.094+0000 7fd69dffb640 1 -- 172.21.15.73:0/2420997594 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd69800ee60 con 0x7fd6a80730c0 2024-03-29T04:08:41.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.094+0000 7fd6af635640 1 -- 172.21.15.73:0/2420997594 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6a8152920 con 0x7fd6a80730c0 2024-03-29T04:08:41.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.094+0000 7fd69dffb640 1 -- 172.21.15.73:0/2420997594 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69800cb80 con 0x7fd6a80730c0 2024-03-29T04:08:41.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.094+0000 7fd6af635640 1 -- 172.21.15.73:0/2420997594 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6a8152ee0 con 0x7fd6a80730c0 2024-03-29T04:08:41.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.095+0000 7fd6af635640 1 -- 172.21.15.73:0/2420997594 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6a8068640 con 0x7fd6a80730c0 2024-03-29T04:08:41.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.096+0000 7fd69dffb640 1 -- 172.21.15.73:0/2420997594 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fd69801a070 con 0x7fd6a80730c0 2024-03-29T04:08:41.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.096+0000 7fd69dffb640 1 --2- 172.21.15.73:0/2420997594 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd68c06c530 0x7fd68c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:41.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.096+0000 7fd69dffb640 1 -- 172.21.15.73:0/2420997594 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd69808b4b0 con 0x7fd6a80730c0 2024-03-29T04:08:41.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.096+0000 7fd6ad3d1640 1 --2- 172.21.15.73:0/2420997594 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd68c06c530 0x7fd68c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:41.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.097+0000 7fd6ad3d1640 1 --2- 172.21.15.73:0/2420997594 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd68c06c530 0x7fd68c06e9f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4036000 tx=0x7fd6a403c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:41.080 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.101+0000 7fd69dffb640 1 -- 172.21.15.73:0/2420997594 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fd698059480 con 0x7fd6a80730c0 2024-03-29T04:08:41.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.277+0000 7fd6af635640 1 -- 172.21.15.73:0/2420997594 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd6a806c0c0 con 0x7fd6a80730c0 2024-03-29T04:08:41.258 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.278+0000 7fd69dffb640 1 -- 172.21.15.73:0/2420997594 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16605 (secure 0 0 0) 0x7fd69805d780 con 0x7fd6a80730c0 2024-03-29T04:08:41.258 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:41.259 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"6bff1617-b138-4517-acca-3ecaae3f2bb3","created":"2024-03-29T04:07:47.346864+0000","modified":"2024-03-29T04:08:13.577603+0000","last_up_change":"2024-03-29T04:07:58.507139+0000","last_in_change":"2024-03-29T04:07:49.637816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-29T04:07:59.537301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-29T04:08:09.570906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-29T04:08:10.882349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"925d7de1-14ab-48c0-aebd-7bded108f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6820","nonce":2387335359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6824","nonce":2387335359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6831","nonce":2387335359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6828","nonce":2387335359}]},"public_addr":"172.21.15.73:6820/2387335359","cluster_addr":"172.21.15.73:6824/2387335359","heartbeat_back_addr":"172.21.15.73:6831/2387335359","heartbeat_front_addr":"172.21.15.73:6828/2387335359","state":["exists","up"]},{"osd":1,"uuid":"6b182102-882a-4e0c-99db-0afae5cfb38b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6801","nonce":2431315515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6803","nonce":2431315515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6807","nonce":2431315515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6805","nonce":2431315515}]},"public_addr":"172.21.15.73:6801/2431315515","cluster_addr":"172.21.15.73:6803/2431315515","heartbeat_back_addr":"172.21.15.73:6807/2431315515","heartbeat_front_addr":"172.21.15.73:6805/2431315515","state":["exists","up"]},{"osd":2,"uuid":"8040902e-b0b8-4a21-bf64-ce1c222115ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6809","nonce":407236597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6811","nonce":407236597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6815","nonce":407236597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6813","nonce":407236597}]},"public_addr":"172.21.15.73:6809/407236597","cluster_addr":"172.21.15.73:6811/407236597","heartbeat_back_addr":"172.21.15.73:6815/407236597","heartbeat_front_addr":"172.21.15.73:6813/407236597","state":["exists","up"]},{"osd":3,"uuid":"1bab19ee-3775-4ce1-a4ce-cf7cda3bbbf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6817","nonce":4291100709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6821","nonce":4291100709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6829","nonce":4291100709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6825","nonce":4291100709}]},"public_addr":"172.21.15.73:6817/4291100709","cluster_addr":"172.21.15.73:6821/4291100709","heartbeat_back_addr":"172.21.15.73:6829/4291100709","heartbeat_front_addr":"172.21.15.73:6825/4291100709","state":["exists","up"]},{"osd":4,"uuid":"b0c74337-8fe4-47dc-b3da-2d07591b1f6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6817","nonce":3703256194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6819","nonce":3703256194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6823","nonce":3703256194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6821","nonce":3703256194}]},"public_addr":"172.21.15.142:6817/3703256194","cluster_addr":"172.21.15.142:6819/3703256194","heartbeat_back_addr":"172.21.15.142:6823/3703256194","heartbeat_front_addr":"172.21.15.142:6821/3703256194","state":["exists","up"]},{"osd":5,"uuid":"9ce36410-a29a-42c6-99f4-f95d4afdd7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6825","nonce":4271575803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6827","nonce":4271575803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6831","nonce":4271575803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6829","nonce":4271575803}]},"public_addr":"172.21.15.142:6825/4271575803","cluster_addr":"172.21.15.142:6827/4271575803","heartbeat_back_addr":"172.21.15.142:6831/4271575803","heartbeat_front_addr":"172.21.15.142:6829/4271575803","state":["exists","up"]},{"osd":6,"uuid":"aec4264a-64ac-428e-a860-d2920a304019","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6801","nonce":1772722570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6803","nonce":1772722570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6807","nonce":1772722570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6805","nonce":1772722570}]},"public_addr":"172.21.15.142:6801/1772722570","cluster_addr":"172.21.15.142:6803/1772722570","heartbeat_back_addr":"172.21.15.142:6807/1772722570","heartbeat_front_addr":"172.21.15.142:6805/1772722570","state":["exists","up"]},{"osd":7,"uuid":"fe599052-8e5a-4c7a-91e7-52d1bae24a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6809","nonce":3910589675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6811","nonce":3910589675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6815","nonce":3910589675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6813","nonce":3910589675}]},"public_addr":"172.21.15.142:6809/3910589675","cluster_addr":"172.21.15.142:6811/3910589675","heartbeat_back_addr":"172.21.15.142:6815/3910589675","heartbeat_front_addr":"172.21.15.142:6813/3910589675","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.835096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.587210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.786547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.778004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.843740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.791160+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.837992+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.718722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:08:41.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.280+0000 7fd6af635640 1 -- 172.21.15.73:0/2420997594 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd68c06c530 msgr2=0x7fd68c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:41.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.280+0000 7fd6af635640 1 --2- 172.21.15.73:0/2420997594 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd68c06c530 0x7fd68c06e9f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4036000 tx=0x7fd6a403c040 comp rx=0 tx=0).stop 2024-03-29T04:08:41.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.280+0000 7fd6af635640 1 -- 172.21.15.73:0/2420997594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6a80730c0 msgr2=0x7fd6a81f2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:41.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.280+0000 7fd6af635640 1 --2- 172.21.15.73:0/2420997594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6a80730c0 0x7fd6a81f2580 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd69800e870 tx=0x7fd69800ed30 comp rx=0 tx=0).stop 2024-03-29T04:08:41.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.280+0000 7fd6af635640 1 -- 172.21.15.73:0/2420997594 shutdown_connections 2024-03-29T04:08:41.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.280+0000 7fd6af635640 1 --2- 172.21.15.73:0/2420997594 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd68c06c530 0x7fd68c06e9f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:41.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.280+0000 7fd6af635640 1 --2- 172.21.15.73:0/2420997594 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6a815b370 0x7fd6a8153ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:41.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.280+0000 7fd6af635640 1 --2- 172.21.15.73:0/2420997594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6a80730c0 0x7fd6a81f2580 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:41.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.280+0000 7fd6af635640 1 --2- 172.21.15.73:0/2420997594 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd6a806f3f0 0x7fd6a815a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:41.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.280+0000 7fd6af635640 1 -- 172.21.15.73:0/2420997594 >> 172.21.15.73:0/2420997594 conn(0x7fd6a806b510 msgr2=0x7fd6a80b3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:41.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.280+0000 7fd6af635640 1 -- 172.21.15.73:0/2420997594 shutdown_connections 2024-03-29T04:08:41.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.280+0000 7fd6af635640 1 -- 172.21.15.73:0/2420997594 wait complete. 2024-03-29T04:08:41.271 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-29T04:07:59.537301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-29T04:08:09.570906+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-29T04:08:10.882349+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-29T04:08:41.272 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-29T04:08:41.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.396+0000 7f0add660640 1 Processor -- start 2024-03-29T04:08:41.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.396+0000 7f0add660640 1 -- start start 2024-03-29T04:08:41.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.396+0000 7f0add660640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0ad815e920 0x7f0ad80d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:41.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.396+0000 7f0add660640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0ad80d16a0 0x7f0ad80d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:41.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.396+0000 7f0add660640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ad80d3780 con 0x7f0ad80cfde0 2024-03-29T04:08:41.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.397+0000 7f0add660640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f0ad815ed00 con 0x7f0ad80d16a0 2024-03-29T04:08:41.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.397+0000 7f0add660640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f0ad80d21e0 con 0x7f0ad815e920 2024-03-29T04:08:41.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.397+0000 7f0ad77fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0ad80d16a0 0x7f0ad80d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:41.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.397+0000 7f0ad67fc640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0ad80cfde0 0x7f0ad80d0f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:46776/0 (socket says 172.21.15.73:46776) 2024-03-29T04:08:41.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.397+0000 7f0ad67fc640 1 -- 172.21.15.73:0/1439804932 learned_addr learned my addr 172.21.15.73:0/1439804932 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:41.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.397+0000 7f0ad6ffd640 1 --2- 172.21.15.73:0/1439804932 >> v2:172.21.15.142:3300/0 conn(0x7f0ad815e920 0x7f0ad80d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:41.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.397+0000 7f0ad77fe640 1 -- 172.21.15.73:0/1439804932 >> v2:172.21.15.142:3300/0 conn(0x7f0ad815e920 msgr2=0x7f0ad80d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:41.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.397+0000 7f0ad77fe640 1 --2- 172.21.15.73:0/1439804932 >> v2:172.21.15.142:3300/0 conn(0x7f0ad815e920 0x7f0ad80d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:41.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.397+0000 7f0ad77fe640 1 -- 172.21.15.73:0/1439804932 >> v1:172.21.15.73:6789/0 conn(0x7f0ad80cfde0 legacy=0x7f0ad80d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:41.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.397+0000 7f0ad77fe640 1 -- 172.21.15.73:0/1439804932 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad80d2480 con 0x7f0ad80d16a0 2024-03-29T04:08:41.377 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.397+0000 7f0ad5ffb640 1 -- 172.21.15.73:0/1439804932 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1543360497 0 0) 0x7f0acc001110 con 0x7f0ad80cfde0 2024-03-29T04:08:41.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.398+0000 7f0ad77fe640 1 --2- 172.21.15.73:0/1439804932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ad80d16a0 0x7f0ad80d0240 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0ad808e880 tx=0x7f0ad002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d0c68703f092810 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:41.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.398+0000 7f0ad5ffb640 1 -- 172.21.15.73:0/1439804932 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad0039070 con 0x7f0ad80d16a0 2024-03-29T04:08:41.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.398+0000 7f0ad5ffb640 1 -- 172.21.15.73:0/1439804932 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ad002cc80 con 0x7f0ad80d16a0 2024-03-29T04:08:41.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.398+0000 7f0ad5ffb640 1 -- 172.21.15.73:0/1439804932 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad0034660 con 0x7f0ad80d16a0 2024-03-29T04:08:41.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.398+0000 7f0add660640 1 -- 172.21.15.73:0/1439804932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ad80d16a0 msgr2=0x7f0ad80d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:41.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.398+0000 7f0add660640 1 --2- 172.21.15.73:0/1439804932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ad80d16a0 0x7f0ad80d0240 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0ad808e880 tx=0x7f0ad002bed0 comp rx=0 tx=0).stop 2024-03-29T04:08:41.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.398+0000 7f0add660640 1 -- 172.21.15.73:0/1439804932 shutdown_connections 2024-03-29T04:08:41.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.398+0000 7f0add660640 1 --2- 172.21.15.73:0/1439804932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ad80d16a0 0x7f0ad80d0240 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:41.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.398+0000 7f0add660640 1 --2- 172.21.15.73:0/1439804932 >> v2:172.21.15.142:3300/0 conn(0x7f0ad815e920 0x7f0ad80d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:41.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.398+0000 7f0add660640 1 -- 172.21.15.73:0/1439804932 >> 172.21.15.73:0/1439804932 conn(0x7f0ad808bfc0 msgr2=0x7f0ad80d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:41.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.398+0000 7f0add660640 1 -- 172.21.15.73:0/1439804932 shutdown_connections 2024-03-29T04:08:41.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.398+0000 7f0add660640 1 -- 172.21.15.73:0/1439804932 wait complete. 2024-03-29T04:08:41.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.400+0000 7f0add660640 1 Processor -- start 2024-03-29T04:08:41.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.400+0000 7f0add660640 1 -- start start 2024-03-29T04:08:41.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.400+0000 7f0add660640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ad80cfde0 0x7f0ad80cd530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:41.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.400+0000 7f0add660640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ad80d16a0 0x7f0ad8157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:41.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.400+0000 7f0add660640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ad815e920 0x7f0ad81ea660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:41.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.400+0000 7f0add660640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad80d2d20 con 0x7f0ad815e920 2024-03-29T04:08:41.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.400+0000 7f0add660640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad80d2a40 con 0x7f0ad80d16a0 2024-03-29T04:08:41.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.400+0000 7f0add660640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f0ad80d4ef0 con 0x7f0ad80cfde0 2024-03-29T04:08:41.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.401+0000 7f0ad77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ad815e920 0x7f0ad81ea660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:41.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.401+0000 7f0ad77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ad815e920 0x7f0ad81ea660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36362/0 (socket says 172.21.15.73:36362) 2024-03-29T04:08:41.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.401+0000 7f0ad77fe640 1 -- 172.21.15.73:0/2068850090 learned_addr learned my addr 172.21.15.73:0/2068850090 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:41.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.401+0000 7f0ad67fc640 1 --2- 172.21.15.73:0/2068850090 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ad80d16a0 0x7f0ad8157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:41.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.401+0000 7f0ad6ffd640 1 --2- 172.21.15.73:0/2068850090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ad80cfde0 0x7f0ad80cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:41.382 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.401+0000 7f0ad77fe640 1 -- 172.21.15.73:0/2068850090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ad80cfde0 msgr2=0x7f0ad80cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:41.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.401+0000 7f0ad77fe640 1 --2- 172.21.15.73:0/2068850090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ad80cfde0 0x7f0ad80cd530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:41.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.401+0000 7f0ad77fe640 1 -- 172.21.15.73:0/2068850090 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ad80d16a0 msgr2=0x7f0ad8157720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:41.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.401+0000 7f0ad77fe640 1 --2- 172.21.15.73:0/2068850090 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ad80d16a0 0x7f0ad8157720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:41.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.401+0000 7f0ad77fe640 1 -- 172.21.15.73:0/2068850090 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad80cc490 con 0x7f0ad815e920 2024-03-29T04:08:41.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.401+0000 7f0ad77fe640 1 --2- 172.21.15.73:0/2068850090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ad815e920 0x7f0ad81ea660 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0009e80 tx=0x7f0ad0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:41.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.401+0000 7f0abf7fe640 1 -- 172.21.15.73:0/2068850090 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad0044020 con 0x7f0ad815e920 2024-03-29T04:08:41.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.401+0000 7f0abf7fe640 1 -- 172.21.15.73:0/2068850090 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ad003f470 con 0x7f0ad815e920 2024-03-29T04:08:41.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.401+0000 7f0add660640 1 -- 172.21.15.73:0/2068850090 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ad80cc770 con 0x7f0ad815e920 2024-03-29T04:08:41.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.401+0000 7f0abf7fe640 1 -- 172.21.15.73:0/2068850090 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad0039040 con 0x7f0ad815e920 2024-03-29T04:08:41.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.401+0000 7f0add660640 1 -- 172.21.15.73:0/2068850090 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ad80ccd30 con 0x7f0ad815e920 2024-03-29T04:08:41.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.402+0000 7f0add660640 1 -- 172.21.15.73:0/2068850090 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ad80a2560 con 0x7f0ad815e920 2024-03-29T04:08:41.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.402+0000 7f0abf7fe640 1 -- 172.21.15.73:0/2068850090 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f0ad0047020 con 0x7f0ad815e920 2024-03-29T04:08:41.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.403+0000 7f0abf7fe640 1 --2- 172.21.15.73:0/2068850090 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f0ac406c530 0x7f0ac406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:41.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.403+0000 7f0abf7fe640 1 -- 172.21.15.73:0/2068850090 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0ad00ae0f0 con 0x7f0ad815e920 2024-03-29T04:08:41.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.403+0000 7f0ad6ffd640 1 --2- 172.21.15.73:0/2068850090 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f0ac406c530 0x7f0ac406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:41.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.403+0000 7f0ad6ffd640 1 --2- 172.21.15.73:0/2068850090 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f0ac406c530 0x7f0ac406e9f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8009b40 tx=0x7f0ac8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:41.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.407+0000 7f0abf7fe640 1 -- 172.21.15.73:0/2068850090 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f0ad004e030 con 0x7f0ad815e920 2024-03-29T04:08:41.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.583+0000 7f0add660640 1 -- 172.21.15.73:0/2068850090 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0ad804f9d0 con 0x7f0ad815e920 2024-03-29T04:08:41.563 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.583+0000 7f0abf7fe640 1 -- 172.21.15.73:0/2068850090 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f0ad007c030 con 0x7f0ad815e920 2024-03-29T04:08:41.563 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-03-29T04:08:41.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.585+0000 7f0add660640 1 -- 172.21.15.73:0/2068850090 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f0ac406c530 msgr2=0x7f0ac406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:41.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.585+0000 7f0add660640 1 --2- 172.21.15.73:0/2068850090 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f0ac406c530 0x7f0ac406e9f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8009b40 tx=0x7f0ac8009190 comp rx=0 tx=0).stop 2024-03-29T04:08:41.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.585+0000 7f0add660640 1 -- 172.21.15.73:0/2068850090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ad815e920 msgr2=0x7f0ad81ea660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:41.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.585+0000 7f0add660640 1 --2- 172.21.15.73:0/2068850090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ad815e920 0x7f0ad81ea660 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0009e80 tx=0x7f0ad0004a40 comp rx=0 tx=0).stop 2024-03-29T04:08:41.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.585+0000 7f0add660640 1 -- 172.21.15.73:0/2068850090 shutdown_connections 2024-03-29T04:08:41.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.585+0000 7f0add660640 1 --2- 172.21.15.73:0/2068850090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ad815e920 0x7f0ad81ea660 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:41.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.585+0000 7f0add660640 1 --2- 172.21.15.73:0/2068850090 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f0ac406c530 0x7f0ac406e9f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:41.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.585+0000 7f0add660640 1 --2- 172.21.15.73:0/2068850090 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ad80d16a0 0x7f0ad8157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:41.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.585+0000 7f0add660640 1 --2- 172.21.15.73:0/2068850090 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0ad80cfde0 0x7f0ad80cd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:41.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.585+0000 7f0add660640 1 -- 172.21.15.73:0/2068850090 >> 172.21.15.73:0/2068850090 conn(0x7f0ad808bfc0 msgr2=0x7f0ad80cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:41.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.585+0000 7f0add660640 1 -- 172.21.15.73:0/2068850090 shutdown_connections 2024-03-29T04:08:41.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.585+0000 7f0add660640 1 -- 172.21.15.73:0/2068850090 wait complete. 2024-03-29T04:08:41.576 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-29T04:08:41.679 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.700+0000 7f2ee7d1c640 1 Processor -- start 2024-03-29T04:08:41.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.700+0000 7f2ee7d1c640 1 -- start start 2024-03-29T04:08:41.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.701+0000 7f2ee7d1c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ee00b6020 0x7f2ee00b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:41.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.701+0000 7f2ee7d1c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2ee006b510 0x7f2ee006b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:41.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.701+0000 7f2ee7d1c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ee00b6500 con 0x7f2ee015e8b0 2024-03-29T04:08:41.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.701+0000 7f2ee7d1c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f2ee00b67e0 con 0x7f2ee006b510 2024-03-29T04:08:41.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.701+0000 7f2ee7d1c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2ee00b4470 con 0x7f2ee00b6020 2024-03-29T04:08:41.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.701+0000 7f2ee62b9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2ee006b510 0x7f2ee006b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:41.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.701+0000 7f2ee62b9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2ee006b510 0x7f2ee006b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36370/0 (socket says 172.21.15.73:36370) 2024-03-29T04:08:41.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.701+0000 7f2ee62b9640 1 -- 172.21.15.73:0/4098809307 learned_addr learned my addr 172.21.15.73:0/4098809307 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:41.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.701+0000 7f2ee52b7640 1 --2- 172.21.15.73:0/4098809307 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ee00b6020 0x7f2ee00b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:41.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.701+0000 7f2ee62b9640 1 -- 172.21.15.73:0/4098809307 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ee00b6020 msgr2=0x7f2ee00b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:41.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.701+0000 7f2ee62b9640 1 --2- 172.21.15.73:0/4098809307 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ee00b6020 0x7f2ee00b2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:41.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.701+0000 7f2ee62b9640 1 -- 172.21.15.73:0/4098809307 >> v1:172.21.15.142:6789/0 conn(0x7f2ee015e8b0 legacy=0x7f2ee00b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:41.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.701+0000 7f2ee62b9640 1 -- 172.21.15.73:0/4098809307 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee00b4750 con 0x7f2ee006b510 2024-03-29T04:08:41.682 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.702+0000 7f2ee62b9640 1 --2- 172.21.15.73:0/4098809307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ee006b510 0x7f2ee006b9c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8009e50 tx=0x7f2ed802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8ee0a872435e116 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:41.683 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.702+0000 7f2ee4ab6640 1 -- 172.21.15.73:0/4098809307 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed802ca70 con 0x7f2ee006b510 2024-03-29T04:08:41.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.702+0000 7f2ee4ab6640 1 -- 172.21.15.73:0/4098809307 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ed802cc10 con 0x7f2ee006b510 2024-03-29T04:08:41.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.702+0000 7f2ee4ab6640 1 -- 172.21.15.73:0/4098809307 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed80343f0 con 0x7f2ee006b510 2024-03-29T04:08:41.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.702+0000 7f2ee7d1c640 1 -- 172.21.15.73:0/4098809307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ee006b510 msgr2=0x7f2ee006b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:41.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.702+0000 7f2ee7d1c640 1 --2- 172.21.15.73:0/4098809307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ee006b510 0x7f2ee006b9c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8009e50 tx=0x7f2ed802bed0 comp rx=0 tx=0).stop 2024-03-29T04:08:41.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.703+0000 7f2ee7d1c640 1 -- 172.21.15.73:0/4098809307 shutdown_connections 2024-03-29T04:08:41.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.703+0000 7f2ee7d1c640 1 --2- 172.21.15.73:0/4098809307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ee006b510 0x7f2ee006b9c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:41.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.703+0000 7f2ee7d1c640 1 --2- 172.21.15.73:0/4098809307 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ee00b6020 0x7f2ee00b2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:41.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.703+0000 7f2ee7d1c640 1 -- 172.21.15.73:0/4098809307 >> 172.21.15.73:0/4098809307 conn(0x7f2ee0072e40 msgr2=0x7f2ee00b3040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:41.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.703+0000 7f2ee7d1c640 1 -- 172.21.15.73:0/4098809307 shutdown_connections 2024-03-29T04:08:41.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.703+0000 7f2ee7d1c640 1 -- 172.21.15.73:0/4098809307 wait complete. 2024-03-29T04:08:41.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.704+0000 7f2ee7d1c640 1 Processor -- start 2024-03-29T04:08:41.684 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.704+0000 7f2ee7d1c640 1 -- start start 2024-03-29T04:08:41.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.704+0000 7f2ee7d1c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ee006b510 0x7f2ee0144490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:41.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.704+0000 7f2ee7d1c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ee00b6020 0x7f2ee0147640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:41.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.704+0000 7f2ee7d1c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ee015e8b0 0x7f2ee015a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:41.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.704+0000 7f2ee7d1c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee006c190 con 0x7f2ee00b6020 2024-03-29T04:08:41.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.704+0000 7f2ee7d1c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee00b4b30 con 0x7f2ee015e8b0 2024-03-29T04:08:41.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.704+0000 7f2ee7d1c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2ee006c310 con 0x7f2ee006b510 2024-03-29T04:08:41.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.705+0000 7f2ee52b7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ee00b6020 0x7f2ee0147640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:41.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.705+0000 7f2ee52b7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ee00b6020 0x7f2ee0147640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36380/0 (socket says 172.21.15.73:36380) 2024-03-29T04:08:41.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.705+0000 7f2ee52b7640 1 -- 172.21.15.73:0/3790136626 learned_addr learned my addr 172.21.15.73:0/3790136626 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:41.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.705+0000 7f2ee62b9640 1 --2- 172.21.15.73:0/3790136626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ee015e8b0 0x7f2ee015a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:41.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.705+0000 7f2ee5ab8640 1 --2- 172.21.15.73:0/3790136626 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ee006b510 0x7f2ee0144490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:41.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.705+0000 7f2ee52b7640 1 -- 172.21.15.73:0/3790136626 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ee006b510 msgr2=0x7f2ee0144490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:41.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.705+0000 7f2ee52b7640 1 --2- 172.21.15.73:0/3790136626 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ee006b510 0x7f2ee0144490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:41.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.705+0000 7f2ee52b7640 1 -- 172.21.15.73:0/3790136626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ee015e8b0 msgr2=0x7f2ee015a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:41.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.705+0000 7f2ee52b7640 1 --2- 172.21.15.73:0/3790136626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ee015e8b0 0x7f2ee015a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:41.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.705+0000 7f2ee52b7640 1 -- 172.21.15.73:0/3790136626 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee0161d10 con 0x7f2ee00b6020 2024-03-29T04:08:41.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.705+0000 7f2ee52b7640 1 --2- 172.21.15.73:0/3790136626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ee00b6020 0x7f2ee0147640 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000e9e0 tx=0x7f2ed000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:41.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.705+0000 7f2ed67fc640 1 -- 172.21.15.73:0/3790136626 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed0017070 con 0x7f2ee00b6020 2024-03-29T04:08:41.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.705+0000 7f2ed67fc640 1 -- 172.21.15.73:0/3790136626 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ed000c9d0 con 0x7f2ee00b6020 2024-03-29T04:08:41.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.705+0000 7f2ee7d1c640 1 -- 172.21.15.73:0/3790136626 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ee0161750 con 0x7f2ee00b6020 2024-03-29T04:08:41.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.705+0000 7f2ed67fc640 1 -- 172.21.15.73:0/3790136626 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed000cdc0 con 0x7f2ee00b6020 2024-03-29T04:08:41.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.705+0000 7f2ee7d1c640 1 -- 172.21.15.73:0/3790136626 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ee0146e40 con 0x7f2ee00b6020 2024-03-29T04:08:41.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.706+0000 7f2ee7d1c640 1 -- 172.21.15.73:0/3790136626 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ee009f6a0 con 0x7f2ee00b6020 2024-03-29T04:08:41.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.707+0000 7f2ed67fc640 1 -- 172.21.15.73:0/3790136626 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f2ed001a070 con 0x7f2ee00b6020 2024-03-29T04:08:41.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.707+0000 7f2ed67fc640 1 --2- 172.21.15.73:0/3790136626 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2ec406c530 0x7f2ec406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:41.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.707+0000 7f2ed67fc640 1 -- 172.21.15.73:0/3790136626 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2ed008b580 con 0x7f2ee00b6020 2024-03-29T04:08:41.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.707+0000 7f2ee5ab8640 1 --2- 172.21.15.73:0/3790136626 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2ec406c530 0x7f2ec406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:41.689 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.707+0000 7f2ee5ab8640 1 --2- 172.21.15.73:0/3790136626 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2ec406c530 0x7f2ec406e9f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2edc0016e0 tx=0x7f2edc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:41.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.711+0000 7f2ed67fc640 1 -- 172.21.15.73:0/3790136626 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f2ed00595e0 con 0x7f2ee00b6020 2024-03-29T04:08:41.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.883+0000 7f2ee7d1c640 1 -- 172.21.15.73:0/3790136626 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2ee004f9d0 con 0x7f2ee00b6020 2024-03-29T04:08:41.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.884+0000 7f2ed67fc640 1 -- 172.21.15.73:0/3790136626 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f2ed005d8e0 con 0x7f2ee00b6020 2024-03-29T04:08:41.864 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-03-29T04:08:41.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.886+0000 7f2ee7d1c640 1 -- 172.21.15.73:0/3790136626 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2ec406c530 msgr2=0x7f2ec406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:41.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.886+0000 7f2ee7d1c640 1 --2- 172.21.15.73:0/3790136626 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2ec406c530 0x7f2ec406e9f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2edc0016e0 tx=0x7f2edc009040 comp rx=0 tx=0).stop 2024-03-29T04:08:41.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.886+0000 7f2ee7d1c640 1 -- 172.21.15.73:0/3790136626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ee00b6020 msgr2=0x7f2ee0147640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:41.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.886+0000 7f2ee7d1c640 1 --2- 172.21.15.73:0/3790136626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ee00b6020 0x7f2ee0147640 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000e9e0 tx=0x7f2ed000eea0 comp rx=0 tx=0).stop 2024-03-29T04:08:41.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.886+0000 7f2ee7d1c640 1 -- 172.21.15.73:0/3790136626 shutdown_connections 2024-03-29T04:08:41.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.886+0000 7f2ee7d1c640 1 --2- 172.21.15.73:0/3790136626 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2ec406c530 0x7f2ec406e9f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:41.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.886+0000 7f2ee7d1c640 1 --2- 172.21.15.73:0/3790136626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ee015e8b0 0x7f2ee015a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:41.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.886+0000 7f2ee7d1c640 1 --2- 172.21.15.73:0/3790136626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ee00b6020 0x7f2ee0147640 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:41.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.886+0000 7f2ee7d1c640 1 --2- 172.21.15.73:0/3790136626 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ee006b510 0x7f2ee0144490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:41.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.886+0000 7f2ee7d1c640 1 -- 172.21.15.73:0/3790136626 >> 172.21.15.73:0/3790136626 conn(0x7f2ee0072e40 msgr2=0x7f2ee006e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:41.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.886+0000 7f2ee7d1c640 1 -- 172.21.15.73:0/3790136626 shutdown_connections 2024-03-29T04:08:41.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.886+0000 7f2ee7d1c640 1 -- 172.21.15.73:0/3790136626 wait complete. 2024-03-29T04:08:41.876 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-29T04:08:41.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.999+0000 7f9197159640 1 Processor -- start 2024-03-29T04:08:41.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:41.999+0000 7f9197159640 1 -- start start 2024-03-29T04:08:41.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.000+0000 7f9197159640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f919015e920 0x7f91900d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:41.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.000+0000 7f9197159640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f91900d16a0 0x7f91900d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:41.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.000+0000 7f9197159640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91900d3780 con 0x7f91900cfde0 2024-03-29T04:08:41.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.000+0000 7f9197159640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f919015ed00 con 0x7f91900d16a0 2024-03-29T04:08:41.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.000+0000 7f9197159640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f91900d21e0 con 0x7f919015e920 2024-03-29T04:08:41.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.000+0000 7f918ffff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f91900cfde0 0x7f91900d0f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:46792/0 (socket says 172.21.15.73:46792) 2024-03-29T04:08:41.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.000+0000 7f918ffff640 1 -- 172.21.15.73:0/2384525089 learned_addr learned my addr 172.21.15.73:0/2384525089 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:41.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.000+0000 7f9194ef5640 1 --2- 172.21.15.73:0/2384525089 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f919015e920 0x7f91900d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:41.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.000+0000 7f91956f6640 1 --2- 172.21.15.73:0/2384525089 >> v2:172.21.15.142:3300/0 conn(0x7f91900d16a0 0x7f91900d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:41.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.001+0000 7f918f7fe640 1 -- 172.21.15.73:0/2384525089 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 247423375 0 0) 0x7f9184001110 con 0x7f91900cfde0 2024-03-29T04:08:41.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.001+0000 7f918f7fe640 1 -- 172.21.15.73:0/2384525089 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9178003520 con 0x7f91900cfde0 2024-03-29T04:08:41.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.001+0000 7f91956f6640 1 -- 172.21.15.73:0/2384525089 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f919015e920 msgr2=0x7f91900d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:41.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.001+0000 7f91956f6640 1 --2- 172.21.15.73:0/2384525089 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f919015e920 0x7f91900d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:41.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.001+0000 7f91956f6640 1 -- 172.21.15.73:0/2384525089 >> v1:172.21.15.73:6789/0 conn(0x7f91900cfde0 legacy=0x7f91900d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:41.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.001+0000 7f91956f6640 1 -- 172.21.15.73:0/2384525089 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91900d2480 con 0x7f91900d16a0 2024-03-29T04:08:41.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.001+0000 7f9194ef5640 1 --2- 172.21.15.73:0/2384525089 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f919015e920 0x7f91900d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:08:41.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.001+0000 7f91956f6640 1 --2- 172.21.15.73:0/2384525089 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91900d16a0 0x7f91900d0240 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9188009d90 tx=0x7f918802bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e32b0bfab19b821 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:41.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.002+0000 7f918f7fe640 1 -- 172.21.15.73:0/2384525089 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9188039070 con 0x7f91900d16a0 2024-03-29T04:08:41.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.002+0000 7f918f7fe640 1 -- 172.21.15.73:0/2384525089 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f918802cc50 con 0x7f91900d16a0 2024-03-29T04:08:41.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.002+0000 7f918f7fe640 1 -- 172.21.15.73:0/2384525089 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9188034440 con 0x7f91900d16a0 2024-03-29T04:08:41.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.002+0000 7f9197159640 1 -- 172.21.15.73:0/2384525089 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91900d16a0 msgr2=0x7f91900d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:41.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.002+0000 7f9197159640 1 --2- 172.21.15.73:0/2384525089 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91900d16a0 0x7f91900d0240 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9188009d90 tx=0x7f918802bea0 comp rx=0 tx=0).stop 2024-03-29T04:08:41.986 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.002+0000 7f9197159640 1 -- 172.21.15.73:0/2384525089 shutdown_connections 2024-03-29T04:08:41.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.002+0000 7f9197159640 1 --2- 172.21.15.73:0/2384525089 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91900d16a0 0x7f91900d0240 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:41.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.002+0000 7f9197159640 1 --2- 172.21.15.73:0/2384525089 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f919015e920 0x7f91900d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:41.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.002+0000 7f9197159640 1 -- 172.21.15.73:0/2384525089 >> 172.21.15.73:0/2384525089 conn(0x7f919008bfc0 msgr2=0x7f91900d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:41.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.002+0000 7f9197159640 1 -- 172.21.15.73:0/2384525089 shutdown_connections 2024-03-29T04:08:41.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.002+0000 7f9197159640 1 -- 172.21.15.73:0/2384525089 wait complete. 2024-03-29T04:08:41.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.003+0000 7f9197159640 1 Processor -- start 2024-03-29T04:08:41.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.003+0000 7f9197159640 1 -- start start 2024-03-29T04:08:41.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.004+0000 7f9197159640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91900cfde0 0x7f9190150900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:41.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.004+0000 7f9197159640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91900d16a0 0x7f91901611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:41.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.004+0000 7f9197159640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f919015e920 0x7f91901616f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:41.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.004+0000 7f9197159640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f91900d2d20 con 0x7f919015e920 2024-03-29T04:08:41.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.004+0000 7f9197159640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f91900d2a40 con 0x7f91900d16a0 2024-03-29T04:08:41.987 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.004+0000 7f9197159640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f91900d4ef0 con 0x7f91900cfde0 2024-03-29T04:08:41.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.004+0000 7f91956f6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f919015e920 0x7f91901616f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:41.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.004+0000 7f91956f6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f919015e920 0x7f91901616f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36396/0 (socket says 172.21.15.73:36396) 2024-03-29T04:08:41.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.004+0000 7f91956f6640 1 -- 172.21.15.73:0/1909476573 learned_addr learned my addr 172.21.15.73:0/1909476573 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:41.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.005+0000 7f918ffff640 1 --2- 172.21.15.73:0/1909476573 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91900d16a0 0x7f91901611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:41.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.005+0000 7f9194ef5640 1 --2- 172.21.15.73:0/1909476573 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91900cfde0 0x7f9190150900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:41.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.005+0000 7f91956f6640 1 -- 172.21.15.73:0/1909476573 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91900cfde0 msgr2=0x7f9190150900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:41.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.005+0000 7f91956f6640 1 --2- 172.21.15.73:0/1909476573 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91900cfde0 0x7f9190150900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:41.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.005+0000 7f91956f6640 1 -- 172.21.15.73:0/1909476573 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91900d16a0 msgr2=0x7f91901611b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:41.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.005+0000 7f91956f6640 1 --2- 172.21.15.73:0/1909476573 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91900d16a0 0x7f91901611b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:41.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.005+0000 7f91956f6640 1 -- 172.21.15.73:0/1909476573 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91901e9a60 con 0x7f919015e920 2024-03-29T04:08:41.988 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.005+0000 7f9194ef5640 1 --2- 172.21.15.73:0/1909476573 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91900cfde0 0x7f9190150900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:08:41.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.005+0000 7f91956f6640 1 --2- 172.21.15.73:0/1909476573 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f919015e920 0x7f91901616f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9188009d90 tx=0x7f9188004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:41.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.005+0000 7f918d7fa640 1 -- 172.21.15.73:0/1909476573 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9188039050 con 0x7f919015e920 2024-03-29T04:08:41.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.005+0000 7f918d7fa640 1 -- 172.21.15.73:0/1909476573 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9188045070 con 0x7f919015e920 2024-03-29T04:08:41.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.005+0000 7f9197159640 1 -- 172.21.15.73:0/1909476573 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f919015fa60 con 0x7f919015e920 2024-03-29T04:08:41.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.005+0000 7f918d7fa640 1 -- 172.21.15.73:0/1909476573 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9188009450 con 0x7f919015e920 2024-03-29T04:08:41.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.005+0000 7f9197159640 1 -- 172.21.15.73:0/1909476573 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9190160020 con 0x7f919015e920 2024-03-29T04:08:41.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.006+0000 7f9197159640 1 -- 172.21.15.73:0/1909476573 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91900a2560 con 0x7f919015e920 2024-03-29T04:08:41.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.006+0000 7f918d7fa640 1 -- 172.21.15.73:0/1909476573 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f918803e610 con 0x7f919015e920 2024-03-29T04:08:41.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.007+0000 7f918d7fa640 1 --2- 172.21.15.73:0/1909476573 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f917c06c530 0x7f917c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:41.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.007+0000 7f918d7fa640 1 -- 172.21.15.73:0/1909476573 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f91880ae050 con 0x7f919015e920 2024-03-29T04:08:41.989 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.007+0000 7f9194ef5640 1 --2- 172.21.15.73:0/1909476573 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f917c06c530 0x7f917c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:41.990 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.007+0000 7f9194ef5640 1 --2- 172.21.15.73:0/1909476573 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f917c06c530 0x7f917c06e9f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9190154770 tx=0x7f9180008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:41.991 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.011+0000 7f918d7fa640 1 -- 172.21.15.73:0/1909476573 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f91901e9a60 con 0x7f919015e920 2024-03-29T04:08:42.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.184+0000 7f9197159640 1 -- 172.21.15.73:0/1909476573 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f919004f9d0 con 0x7f919015e920 2024-03-29T04:08:42.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.184+0000 7f918d7fa640 1 -- 172.21.15.73:0/1909476573 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f918807c730 con 0x7f919015e920 2024-03-29T04:08:42.164 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-29T04:08:42.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.186+0000 7f9197159640 1 -- 172.21.15.73:0/1909476573 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f917c06c530 msgr2=0x7f917c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:42.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.186+0000 7f9197159640 1 --2- 172.21.15.73:0/1909476573 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f917c06c530 0x7f917c06e9f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9190154770 tx=0x7f9180008040 comp rx=0 tx=0).stop 2024-03-29T04:08:42.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.186+0000 7f9197159640 1 -- 172.21.15.73:0/1909476573 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f919015e920 msgr2=0x7f91901616f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:42.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.186+0000 7f9197159640 1 --2- 172.21.15.73:0/1909476573 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f919015e920 0x7f91901616f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9188009d90 tx=0x7f9188004a40 comp rx=0 tx=0).stop 2024-03-29T04:08:42.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.186+0000 7f9197159640 1 -- 172.21.15.73:0/1909476573 shutdown_connections 2024-03-29T04:08:42.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.186+0000 7f9197159640 1 --2- 172.21.15.73:0/1909476573 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f919015e920 0x7f91901616f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:42.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.186+0000 7f9197159640 1 --2- 172.21.15.73:0/1909476573 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f917c06c530 0x7f917c06e9f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:42.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.186+0000 7f9197159640 1 --2- 172.21.15.73:0/1909476573 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f91900d16a0 0x7f91901611b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:42.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.186+0000 7f9197159640 1 --2- 172.21.15.73:0/1909476573 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f91900cfde0 0x7f9190150900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:42.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.186+0000 7f9197159640 1 -- 172.21.15.73:0/1909476573 >> 172.21.15.73:0/1909476573 conn(0x7f919008bfc0 msgr2=0x7f91900b1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:42.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.186+0000 7f9197159640 1 -- 172.21.15.73:0/1909476573 shutdown_connections 2024-03-29T04:08:42.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.186+0000 7f9197159640 1 -- 172.21.15.73:0/1909476573 wait complete. 2024-03-29T04:08:42.177 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-29T04:08:42.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.298+0000 7f42eb014640 1 Processor -- start 2024-03-29T04:08:42.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.298+0000 7f42eb014640 1 -- start start 2024-03-29T04:08:42.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.299+0000 7f42eb014640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42e415fc20 0x7f42e40c6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:42.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.299+0000 7f42eb014640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f42e40c5020 0x7f42e40c6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:42.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.299+0000 7f42eb014640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42e4160480 con 0x7f42e40b4b20 2024-03-29T04:08:42.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.299+0000 7f42eb014640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f42e4161090 con 0x7f42e40c5020 2024-03-29T04:08:42.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.299+0000 7f42eb014640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f42e4160760 con 0x7f42e415fc20 2024-03-29T04:08:42.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.299+0000 7f42e3fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f42e40c5020 0x7f42e40c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:42.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.299+0000 7f42e8db0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42e415fc20 0x7f42e40c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:42.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.299+0000 7f42e95b1640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f42e40b4b20 0x7f42e40d00f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.73:59528/0 (socket says 172.21.15.73:59528) 2024-03-29T04:08:42.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.299+0000 7f42e95b1640 1 -- 172.21.15.73:0/2610486639 learned_addr learned my addr 172.21.15.73:0/2610486639 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:42.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.299+0000 7f42e8db0640 1 -- 172.21.15.73:0/2610486639 >> v2:172.21.15.142:3300/0 conn(0x7f42e40c5020 msgr2=0x7f42e40c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:42.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.299+0000 7f42e8db0640 1 --2- 172.21.15.73:0/2610486639 >> v2:172.21.15.142:3300/0 conn(0x7f42e40c5020 0x7f42e40c6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:42.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.299+0000 7f42e8db0640 1 -- 172.21.15.73:0/2610486639 >> v1:172.21.15.142:6789/0 conn(0x7f42e40b4b20 legacy=0x7f42e40d00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:42.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.299+0000 7f42e8db0640 1 -- 172.21.15.73:0/2610486639 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42e4160a40 con 0x7f42e415fc20 2024-03-29T04:08:42.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.300+0000 7f42e8db0640 1 --2- 172.21.15.73:0/2610486639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42e415fc20 0x7f42e40c6140 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f42dc009d90 tx=0x7f42dc02be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24a26c68b46d7895 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:42.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.300+0000 7f42e37fe640 1 -- 172.21.15.73:0/2610486639 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42dc039070 con 0x7f42e415fc20 2024-03-29T04:08:42.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.300+0000 7f42e37fe640 1 -- 172.21.15.73:0/2610486639 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42dc02cbc0 con 0x7f42e415fc20 2024-03-29T04:08:42.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.300+0000 7f42e37fe640 1 -- 172.21.15.73:0/2610486639 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42dc034440 con 0x7f42e415fc20 2024-03-29T04:08:42.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.301+0000 7f42eb014640 1 -- 172.21.15.73:0/2610486639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42e415fc20 msgr2=0x7f42e40c6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:42.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.301+0000 7f42eb014640 1 --2- 172.21.15.73:0/2610486639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42e415fc20 0x7f42e40c6140 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f42dc009d90 tx=0x7f42dc02be10 comp rx=0 tx=0).stop 2024-03-29T04:08:42.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.301+0000 7f42eb014640 1 -- 172.21.15.73:0/2610486639 shutdown_connections 2024-03-29T04:08:42.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.301+0000 7f42eb014640 1 --2- 172.21.15.73:0/2610486639 >> v2:172.21.15.142:3300/0 conn(0x7f42e40c5020 0x7f42e40c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:42.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.301+0000 7f42eb014640 1 --2- 172.21.15.73:0/2610486639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42e415fc20 0x7f42e40c6140 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:42.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.301+0000 7f42eb014640 1 -- 172.21.15.73:0/2610486639 >> 172.21.15.73:0/2610486639 conn(0x7f42e406b510 msgr2=0x7f42e406b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:42.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.301+0000 7f42eb014640 1 -- 172.21.15.73:0/2610486639 shutdown_connections 2024-03-29T04:08:42.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.301+0000 7f42eb014640 1 -- 172.21.15.73:0/2610486639 wait complete. 2024-03-29T04:08:42.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.302+0000 7f42eb014640 1 Processor -- start 2024-03-29T04:08:42.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.302+0000 7f42eb014640 1 -- start start 2024-03-29T04:08:42.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.303+0000 7f42eb014640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42e40b4b20 0x7f42e41577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:42.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.303+0000 7f42eb014640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42e40c5020 0x7f42e40c7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:42.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.303+0000 7f42eb014640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42e415fc20 0x7f42e40b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:42.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.303+0000 7f42eb014640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f42e4160260 con 0x7f42e40b4b20 2024-03-29T04:08:42.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.303+0000 7f42eb014640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f42e41600e0 con 0x7f42e40c5020 2024-03-29T04:08:42.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.303+0000 7f42eb014640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f42e40ccbe0 con 0x7f42e415fc20 2024-03-29T04:08:42.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.303+0000 7f42e8db0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42e40b4b20 0x7f42e41577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:42.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.303+0000 7f42e8db0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42e40b4b20 0x7f42e41577f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36400/0 (socket says 172.21.15.73:36400) 2024-03-29T04:08:42.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.303+0000 7f42e8db0640 1 -- 172.21.15.73:0/1365296775 learned_addr learned my addr 172.21.15.73:0/1365296775 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:42.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.303+0000 7f42e3fff640 1 --2- 172.21.15.73:0/1365296775 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42e40c5020 0x7f42e40c7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:42.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.303+0000 7f42e95b1640 1 --2- 172.21.15.73:0/1365296775 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42e415fc20 0x7f42e40b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:42.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.303+0000 7f42e8db0640 1 -- 172.21.15.73:0/1365296775 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42e415fc20 msgr2=0x7f42e40b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:42.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.303+0000 7f42e8db0640 1 --2- 172.21.15.73:0/1365296775 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42e415fc20 0x7f42e40b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:42.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.303+0000 7f42e8db0640 1 -- 172.21.15.73:0/1365296775 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42e40c5020 msgr2=0x7f42e40c7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:42.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.303+0000 7f42e8db0640 1 --2- 172.21.15.73:0/1365296775 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42e40c5020 0x7f42e40c7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:42.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.303+0000 7f42e8db0640 1 -- 172.21.15.73:0/1365296775 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42e40c7c80 con 0x7f42e40b4b20 2024-03-29T04:08:42.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.303+0000 7f42e8db0640 1 --2- 172.21.15.73:0/1365296775 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42e40b4b20 0x7f42e41577f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f42dc009d90 tx=0x7f42dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:42.289 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.304+0000 7f42e17fa640 1 -- 172.21.15.73:0/1365296775 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42dc039050 con 0x7f42e40b4b20 2024-03-29T04:08:42.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.304+0000 7f42e17fa640 1 -- 172.21.15.73:0/1365296775 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42dc045070 con 0x7f42e40b4b20 2024-03-29T04:08:42.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.304+0000 7f42e17fa640 1 -- 172.21.15.73:0/1365296775 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42dc03e850 con 0x7f42e40b4b20 2024-03-29T04:08:42.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.304+0000 7f42eb014640 1 -- 172.21.15.73:0/1365296775 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42e40c7f60 con 0x7f42e40b4b20 2024-03-29T04:08:42.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.304+0000 7f42eb014640 1 -- 172.21.15.73:0/1365296775 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42e41585b0 con 0x7f42e40b4b20 2024-03-29T04:08:42.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.305+0000 7f42eb014640 1 -- 172.21.15.73:0/1365296775 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42e415f450 con 0x7f42e40b4b20 2024-03-29T04:08:42.290 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.305+0000 7f42e17fa640 1 -- 172.21.15.73:0/1365296775 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f42dc03e9f0 con 0x7f42e40b4b20 2024-03-29T04:08:42.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.305+0000 7f42e17fa640 1 --2- 172.21.15.73:0/1365296775 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f42d006c530 0x7f42d006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:42.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.306+0000 7f42e17fa640 1 -- 172.21.15.73:0/1365296775 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f42dc0ae560 con 0x7f42e40b4b20 2024-03-29T04:08:42.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.306+0000 7f42e3fff640 1 --2- 172.21.15.73:0/1365296775 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f42d006c530 0x7f42d006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:42.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.306+0000 7f42e3fff640 1 --2- 172.21.15.73:0/1365296775 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f42d006c530 0x7f42d006e9f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f42e4073670 tx=0x7f42d8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:42.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.310+0000 7f42e17fa640 1 -- 172.21.15.73:0/1365296775 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f42e415f450 con 0x7f42e40b4b20 2024-03-29T04:08:42.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.497+0000 7f42eb014640 1 -- 172.21.15.73:0/1365296775 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f42e4068640 con 0x7f42e40b4b20 2024-03-29T04:08:42.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.497+0000 7f42e17fa640 1 -- 172.21.15.73:0/1365296775 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f42dc07c6e0 con 0x7f42e40b4b20 2024-03-29T04:08:42.477 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-03-29T04:08:42.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.499+0000 7f42eb014640 1 -- 172.21.15.73:0/1365296775 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f42d006c530 msgr2=0x7f42d006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:42.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.499+0000 7f42eb014640 1 --2- 172.21.15.73:0/1365296775 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f42d006c530 0x7f42d006e9f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f42e4073670 tx=0x7f42d8009190 comp rx=0 tx=0).stop 2024-03-29T04:08:42.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.499+0000 7f42eb014640 1 -- 172.21.15.73:0/1365296775 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42e40b4b20 msgr2=0x7f42e41577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:42.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.499+0000 7f42eb014640 1 --2- 172.21.15.73:0/1365296775 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42e40b4b20 0x7f42e41577f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f42dc009d90 tx=0x7f42dc004a40 comp rx=0 tx=0).stop 2024-03-29T04:08:42.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.499+0000 7f42eb014640 1 -- 172.21.15.73:0/1365296775 shutdown_connections 2024-03-29T04:08:42.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.499+0000 7f42eb014640 1 --2- 172.21.15.73:0/1365296775 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f42e415fc20 0x7f42e40b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:42.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.499+0000 7f42eb014640 1 --2- 172.21.15.73:0/1365296775 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f42d006c530 0x7f42d006e9f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:42.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.499+0000 7f42eb014640 1 --2- 172.21.15.73:0/1365296775 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42e40c5020 0x7f42e40c7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:42.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.499+0000 7f42eb014640 1 --2- 172.21.15.73:0/1365296775 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42e40b4b20 0x7f42e41577f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:42.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.499+0000 7f42eb014640 1 -- 172.21.15.73:0/1365296775 >> 172.21.15.73:0/1365296775 conn(0x7f42e406b510 msgr2=0x7f42e415ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:42.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.499+0000 7f42eb014640 1 -- 172.21.15.73:0/1365296775 shutdown_connections 2024-03-29T04:08:42.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.499+0000 7f42eb014640 1 -- 172.21.15.73:0/1365296775 wait complete. 2024-03-29T04:08:42.489 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-03-29T04:08:42.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:42.490 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-03-29T04:08:42.522 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2024-03-29T04:08:42.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:42.522 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-29T04:08:42.591 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-29T04:08:42.591 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-29T04:08:42.607 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-29T04:08:42.607 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-29T04:08:42.663 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-29T04:08:42.663 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-29T04:08:42.718 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-29T04:08:42.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.878+0000 7ff2d9222640 1 Processor -- start 2024-03-29T04:08:42.858 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.878+0000 7ff2d9222640 1 -- start start 2024-03-29T04:08:42.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.879+0000 7ff2d9222640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2d40b3c50 0x7ff2d40d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:42.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.879+0000 7ff2d9222640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2d40cfb30 con 0x7ff2d40d3140 2024-03-29T04:08:42.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.879+0000 7ff2d9222640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2d40cfe10 con 0x7ff2d415e930 2024-03-29T04:08:42.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.879+0000 7ff2d9222640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff2d406c780 con 0x7ff2d40b3c50 2024-03-29T04:08:42.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.879+0000 7ff2d359e640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff2d40d3140 0x7ff2d406cc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:46808/0 (socket says 172.21.15.73:46808) 2024-03-29T04:08:42.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.879+0000 7ff2d359e640 1 -- 172.21.15.73:0/3656236332 learned_addr learned my addr 172.21.15.73:0/3656236332 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:42.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.879+0000 7ff2d259c640 1 --2- 172.21.15.73:0/3656236332 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2d40b3c50 0x7ff2d40d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:42.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.880+0000 7ff2d1d9b640 1 -- 172.21.15.73:0/3656236332 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2326109041 0 0) 0x7ff2d40cfb30 con 0x7ff2d40d3140 2024-03-29T04:08:42.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.880+0000 7ff2d1d9b640 1 -- 172.21.15.73:0/3656236332 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2c0003520 con 0x7ff2d40d3140 2024-03-29T04:08:42.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.880+0000 7ff2d1d9b640 1 -- 172.21.15.73:0/3656236332 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 419795394 0 0) 0x7ff2d40cfe10 con 0x7ff2d415e930 2024-03-29T04:08:42.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.880+0000 7ff2d1d9b640 1 -- 172.21.15.73:0/3656236332 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2d40cfb30 con 0x7ff2d415e930 2024-03-29T04:08:42.860 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.880+0000 7ff2d259c640 1 -- 172.21.15.73:0/3656236332 >> v1:172.21.15.142:6789/0 conn(0x7ff2d415e930 legacy=0x7ff2d40cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:42.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.880+0000 7ff2d259c640 1 -- 172.21.15.73:0/3656236332 >> v1:172.21.15.73:6789/0 conn(0x7ff2d40d3140 legacy=0x7ff2d406cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:42.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.880+0000 7ff2d259c640 1 -- 172.21.15.73:0/3656236332 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d40d00f0 con 0x7ff2d40b3c50 2024-03-29T04:08:42.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.881+0000 7ff2d259c640 1 --2- 172.21.15.73:0/3656236332 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2d40b3c50 0x7ff2d40d2c00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff2c40097d0 tx=0x7ff2c402b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a4f996976850a4a server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:42.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.881+0000 7ff2d1d9b640 1 -- 172.21.15.73:0/3656236332 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c4035020 con 0x7ff2d40b3c50 2024-03-29T04:08:42.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.881+0000 7ff2d1d9b640 1 -- 172.21.15.73:0/3656236332 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2c4031800 con 0x7ff2d40b3c50 2024-03-29T04:08:42.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.881+0000 7ff2d1d9b640 1 -- 172.21.15.73:0/3656236332 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c4031bd0 con 0x7ff2d40b3c50 2024-03-29T04:08:42.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.881+0000 7ff2d9222640 1 -- 172.21.15.73:0/3656236332 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2d40b3c50 msgr2=0x7ff2d40d2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:42.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.881+0000 7ff2d9222640 1 --2- 172.21.15.73:0/3656236332 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2d40b3c50 0x7ff2d40d2c00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff2c40097d0 tx=0x7ff2c402b8a0 comp rx=0 tx=0).stop 2024-03-29T04:08:42.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.882+0000 7ff2d9222640 1 -- 172.21.15.73:0/3656236332 shutdown_connections 2024-03-29T04:08:42.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.882+0000 7ff2d9222640 1 --2- 172.21.15.73:0/3656236332 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2d40b3c50 0x7ff2d40d2c00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:42.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.882+0000 7ff2d9222640 1 -- 172.21.15.73:0/3656236332 >> 172.21.15.73:0/3656236332 conn(0x7ff2d408bfc0 msgr2=0x7ff2d40d4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:42.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.882+0000 7ff2d9222640 1 -- 172.21.15.73:0/3656236332 shutdown_connections 2024-03-29T04:08:42.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.882+0000 7ff2d9222640 1 -- 172.21.15.73:0/3656236332 wait complete. 2024-03-29T04:08:42.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.883+0000 7ff2d9222640 1 Processor -- start 2024-03-29T04:08:42.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.883+0000 7ff2d9222640 1 -- start start 2024-03-29T04:08:42.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.884+0000 7ff2d9222640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2d40b3c50 0x7ff2d40ca210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:42.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.884+0000 7ff2d9222640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2d40d3140 0x7ff2d4156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:42.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.884+0000 7ff2d9222640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2d415e930 0x7ff2d4159710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:42.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.884+0000 7ff2d9222640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d415ed10 con 0x7ff2d40d3140 2024-03-29T04:08:42.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.884+0000 7ff2d9222640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d40cf840 con 0x7ff2d415e930 2024-03-29T04:08:42.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.884+0000 7ff2d9222640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff2d415ee90 con 0x7ff2d40b3c50 2024-03-29T04:08:42.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.884+0000 7ff2d259c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2d40d3140 0x7ff2d4156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:42.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.884+0000 7ff2d2d9d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2d40b3c50 0x7ff2d40ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:42.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.884+0000 7ff2d259c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2d40d3140 0x7ff2d4156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36404/0 (socket says 172.21.15.73:36404) 2024-03-29T04:08:42.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.884+0000 7ff2d259c640 1 -- 172.21.15.73:0/1277285928 learned_addr learned my addr 172.21.15.73:0/1277285928 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:42.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.884+0000 7ff2d359e640 1 --2- 172.21.15.73:0/1277285928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2d415e930 0x7ff2d4159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:42.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.884+0000 7ff2d259c640 1 -- 172.21.15.73:0/1277285928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2d40b3c50 msgr2=0x7ff2d40ca210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:42.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.884+0000 7ff2d259c640 1 --2- 172.21.15.73:0/1277285928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2d40b3c50 0x7ff2d40ca210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:42.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.884+0000 7ff2d259c640 1 -- 172.21.15.73:0/1277285928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2d415e930 msgr2=0x7ff2d4159710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:42.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.884+0000 7ff2d259c640 1 --2- 172.21.15.73:0/1277285928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2d415e930 0x7ff2d4159710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:42.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.884+0000 7ff2d259c640 1 -- 172.21.15.73:0/1277285928 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d41571a0 con 0x7ff2d40d3140 2024-03-29T04:08:42.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.884+0000 7ff2d359e640 1 --2- 172.21.15.73:0/1277285928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2d415e930 0x7ff2d4159710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:08:42.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.885+0000 7ff2d259c640 1 --2- 172.21.15.73:0/1277285928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2d40d3140 0x7ff2d4156c60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4034040 tx=0x7ff2c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:42.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.885+0000 7ff2cb7fe640 1 -- 172.21.15.73:0/1277285928 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c4040070 con 0x7ff2d40d3140 2024-03-29T04:08:42.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.885+0000 7ff2cb7fe640 1 -- 172.21.15.73:0/1277285928 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2c4031e50 con 0x7ff2d40d3140 2024-03-29T04:08:42.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.885+0000 7ff2d9222640 1 -- 172.21.15.73:0/1277285928 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2d41552c0 con 0x7ff2d40d3140 2024-03-29T04:08:42.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.885+0000 7ff2cb7fe640 1 -- 172.21.15.73:0/1277285928 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c4035040 con 0x7ff2d40d3140 2024-03-29T04:08:42.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.885+0000 7ff2d9222640 1 -- 172.21.15.73:0/1277285928 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2d4155880 con 0x7ff2d40d3140 2024-03-29T04:08:42.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.886+0000 7ff2d9222640 1 -- 172.21.15.73:0/1277285928 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2d4068640 con 0x7ff2d40d3140 2024-03-29T04:08:42.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.886+0000 7ff2cb7fe640 1 -- 172.21.15.73:0/1277285928 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff2c404b060 con 0x7ff2d40d3140 2024-03-29T04:08:42.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.887+0000 7ff2cb7fe640 1 --2- 172.21.15.73:0/1277285928 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff2b406c530 0x7ff2b406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:42.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.887+0000 7ff2cb7fe640 1 -- 172.21.15.73:0/1277285928 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff2c40acf50 con 0x7ff2d40d3140 2024-03-29T04:08:42.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.887+0000 7ff2d2d9d640 1 --2- 172.21.15.73:0/1277285928 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff2b406c530 0x7ff2b406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:42.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.887+0000 7ff2d2d9d640 1 --2- 172.21.15.73:0/1277285928 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff2b406c530 0x7ff2b406e9f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc007fd0 tx=0x7ff2bc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:42.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:42.895+0000 7ff2cb7fe640 1 -- 172.21.15.73:0/1277285928 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7ff2c407af20 con 0x7ff2d40d3140 2024-03-29T04:08:43.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.074+0000 7ff2d9222640 1 -- 172.21.15.73:0/1277285928 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff2d40d19d0 con 0x7ff2d40d3140 2024-03-29T04:08:43.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.075+0000 7ff2cb7fe640 1 -- 172.21.15.73:0/1277285928 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16605 (secure 0 0 0) 0x7ff2c407f220 con 0x7ff2d40d3140 2024-03-29T04:08:43.055 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:43.055 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"6bff1617-b138-4517-acca-3ecaae3f2bb3","created":"2024-03-29T04:07:47.346864+0000","modified":"2024-03-29T04:08:13.577603+0000","last_up_change":"2024-03-29T04:07:58.507139+0000","last_in_change":"2024-03-29T04:07:49.637816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-29T04:07:59.537301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-29T04:08:09.570906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-29T04:08:10.882349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"925d7de1-14ab-48c0-aebd-7bded108f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6820","nonce":2387335359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6824","nonce":2387335359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6831","nonce":2387335359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6828","nonce":2387335359}]},"public_addr":"172.21.15.73:6820/2387335359","cluster_addr":"172.21.15.73:6824/2387335359","heartbeat_back_addr":"172.21.15.73:6831/2387335359","heartbeat_front_addr":"172.21.15.73:6828/2387335359","state":["exists","up"]},{"osd":1,"uuid":"6b182102-882a-4e0c-99db-0afae5cfb38b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6801","nonce":2431315515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6803","nonce":2431315515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6807","nonce":2431315515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6805","nonce":2431315515}]},"public_addr":"172.21.15.73:6801/2431315515","cluster_addr":"172.21.15.73:6803/2431315515","heartbeat_back_addr":"172.21.15.73:6807/2431315515","heartbeat_front_addr":"172.21.15.73:6805/2431315515","state":["exists","up"]},{"osd":2,"uuid":"8040902e-b0b8-4a21-bf64-ce1c222115ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6809","nonce":407236597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6811","nonce":407236597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6815","nonce":407236597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6813","nonce":407236597}]},"public_addr":"172.21.15.73:6809/407236597","cluster_addr":"172.21.15.73:6811/407236597","heartbeat_back_addr":"172.21.15.73:6815/407236597","heartbeat_front_addr":"172.21.15.73:6813/407236597","state":["exists","up"]},{"osd":3,"uuid":"1bab19ee-3775-4ce1-a4ce-cf7cda3bbbf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6817","nonce":4291100709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6821","nonce":4291100709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6829","nonce":4291100709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6825","nonce":4291100709}]},"public_addr":"172.21.15.73:6817/4291100709","cluster_addr":"172.21.15.73:6821/4291100709","heartbeat_back_addr":"172.21.15.73:6829/4291100709","heartbeat_front_addr":"172.21.15.73:6825/4291100709","state":["exists","up"]},{"osd":4,"uuid":"b0c74337-8fe4-47dc-b3da-2d07591b1f6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6817","nonce":3703256194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6819","nonce":3703256194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6823","nonce":3703256194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6821","nonce":3703256194}]},"public_addr":"172.21.15.142:6817/3703256194","cluster_addr":"172.21.15.142:6819/3703256194","heartbeat_back_addr":"172.21.15.142:6823/3703256194","heartbeat_front_addr":"172.21.15.142:6821/3703256194","state":["exists","up"]},{"osd":5,"uuid":"9ce36410-a29a-42c6-99f4-f95d4afdd7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6825","nonce":4271575803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6827","nonce":4271575803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6831","nonce":4271575803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6829","nonce":4271575803}]},"public_addr":"172.21.15.142:6825/4271575803","cluster_addr":"172.21.15.142:6827/4271575803","heartbeat_back_addr":"172.21.15.142:6831/4271575803","heartbeat_front_addr":"172.21.15.142:6829/4271575803","state":["exists","up"]},{"osd":6,"uuid":"aec4264a-64ac-428e-a860-d2920a304019","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6801","nonce":1772722570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6803","nonce":1772722570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6807","nonce":1772722570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6805","nonce":1772722570}]},"public_addr":"172.21.15.142:6801/1772722570","cluster_addr":"172.21.15.142:6803/1772722570","heartbeat_back_addr":"172.21.15.142:6807/1772722570","heartbeat_front_addr":"172.21.15.142:6805/1772722570","state":["exists","up"]},{"osd":7,"uuid":"fe599052-8e5a-4c7a-91e7-52d1bae24a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6809","nonce":3910589675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6811","nonce":3910589675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6815","nonce":3910589675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6813","nonce":3910589675}]},"public_addr":"172.21.15.142:6809/3910589675","cluster_addr":"172.21.15.142:6811/3910589675","heartbeat_back_addr":"172.21.15.142:6815/3910589675","heartbeat_front_addr":"172.21.15.142:6813/3910589675","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.835096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.587210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.786547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.778004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.843740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.791160+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.837992+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.718722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:08:43.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.077+0000 7ff2d9222640 1 -- 172.21.15.73:0/1277285928 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff2b406c530 msgr2=0x7ff2b406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:43.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.077+0000 7ff2d9222640 1 --2- 172.21.15.73:0/1277285928 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff2b406c530 0x7ff2b406e9f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc007fd0 tx=0x7ff2bc009040 comp rx=0 tx=0).stop 2024-03-29T04:08:43.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.077+0000 7ff2d9222640 1 -- 172.21.15.73:0/1277285928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2d40d3140 msgr2=0x7ff2d4156c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:43.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.077+0000 7ff2d9222640 1 --2- 172.21.15.73:0/1277285928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2d40d3140 0x7ff2d4156c60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4034040 tx=0x7ff2c40046c0 comp rx=0 tx=0).stop 2024-03-29T04:08:43.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.077+0000 7ff2d9222640 1 -- 172.21.15.73:0/1277285928 shutdown_connections 2024-03-29T04:08:43.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.077+0000 7ff2d9222640 1 --2- 172.21.15.73:0/1277285928 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff2b406c530 0x7ff2b406e9f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:43.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.077+0000 7ff2d9222640 1 --2- 172.21.15.73:0/1277285928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff2d415e930 0x7ff2d4159710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:43.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.077+0000 7ff2d9222640 1 --2- 172.21.15.73:0/1277285928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2d40d3140 0x7ff2d4156c60 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:43.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.077+0000 7ff2d9222640 1 --2- 172.21.15.73:0/1277285928 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff2d40b3c50 0x7ff2d40ca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:43.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.077+0000 7ff2d9222640 1 -- 172.21.15.73:0/1277285928 >> 172.21.15.73:0/1277285928 conn(0x7ff2d408bfc0 msgr2=0x7ff2d41619b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:43.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.077+0000 7ff2d9222640 1 -- 172.21.15.73:0/1277285928 shutdown_connections 2024-03-29T04:08:43.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.077+0000 7ff2d9222640 1 -- 172.21.15.73:0/1277285928 wait complete. 2024-03-29T04:08:43.067 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-29T04:07:59.537301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-29T04:08:09.570906+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-29T04:08:10.882349+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-29T04:08:43.068 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-29T04:08:43.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.191+0000 7fedfcc35640 1 Processor -- start 2024-03-29T04:08:43.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.191+0000 7fedfcc35640 1 -- start start 2024-03-29T04:08:43.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.192+0000 7fedfcc35640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fedf80cfde0 0x7fedf80d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:43.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.192+0000 7fedfcc35640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedf80d0f90 0x7fedf80d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:43.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.192+0000 7fedfcc35640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedf815ed00 con 0x7fedf815e920 2024-03-29T04:08:43.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.192+0000 7fedfcc35640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fedf80d21e0 con 0x7fedf80cfde0 2024-03-29T04:08:43.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.192+0000 7fedfcc35640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fedf80d2480 con 0x7fedf80d0f90 2024-03-29T04:08:43.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.192+0000 7fedf5d9b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fedf80cfde0 0x7fedf80d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:43.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.192+0000 7fedf659c640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fedf815e920 0x7fedf80d3240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.73:59558/0 (socket says 172.21.15.73:59558) 2024-03-29T04:08:43.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.192+0000 7fedf659c640 1 -- 172.21.15.73:0/1463715842 learned_addr learned my addr 172.21.15.73:0/1463715842 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:43.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.192+0000 7fedf6d9d640 1 --2- 172.21.15.73:0/1463715842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedf80d0f90 0x7fedf80d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:43.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.193+0000 7fedf559a640 1 -- 172.21.15.73:0/1463715842 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1254747272 0 0) 0x7fedf815ed00 con 0x7fedf815e920 2024-03-29T04:08:43.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.193+0000 7fedf559a640 1 -- 172.21.15.73:0/1463715842 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fede4003520 con 0x7fedf815e920 2024-03-29T04:08:43.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.193+0000 7fedf5d9b640 1 -- 172.21.15.73:0/1463715842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedf80d0f90 msgr2=0x7fedf80d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:43.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.193+0000 7fedf5d9b640 1 --2- 172.21.15.73:0/1463715842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedf80d0f90 0x7fedf80d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:43.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.193+0000 7fedf5d9b640 1 -- 172.21.15.73:0/1463715842 >> v1:172.21.15.142:6789/0 conn(0x7fedf815e920 legacy=0x7fedf80d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:43.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.193+0000 7fedf5d9b640 1 -- 172.21.15.73:0/1463715842 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf80d2760 con 0x7fedf80cfde0 2024-03-29T04:08:43.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.193+0000 7fedf5d9b640 1 --2- 172.21.15.73:0/1463715842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedf80cfde0 0x7fedf80d0240 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fede00097a0 tx=0x7fede002b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6181a5aa07418d67 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:43.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.194+0000 7fedf559a640 1 -- 172.21.15.73:0/1463715842 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede0035020 con 0x7fedf80cfde0 2024-03-29T04:08:43.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.194+0000 7fedf559a640 1 -- 172.21.15.73:0/1463715842 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fede0031810 con 0x7fedf80cfde0 2024-03-29T04:08:43.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.194+0000 7fedf559a640 1 -- 172.21.15.73:0/1463715842 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede0031be0 con 0x7fedf80cfde0 2024-03-29T04:08:43.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.194+0000 7fedfcc35640 1 -- 172.21.15.73:0/1463715842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedf80cfde0 msgr2=0x7fedf80d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:43.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.194+0000 7fedfcc35640 1 --2- 172.21.15.73:0/1463715842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedf80cfde0 0x7fedf80d0240 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fede00097a0 tx=0x7fede002b8b0 comp rx=0 tx=0).stop 2024-03-29T04:08:43.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.194+0000 7fedfcc35640 1 -- 172.21.15.73:0/1463715842 shutdown_connections 2024-03-29T04:08:43.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.194+0000 7fedfcc35640 1 --2- 172.21.15.73:0/1463715842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedf80d0f90 0x7fedf80d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:43.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.194+0000 7fedfcc35640 1 --2- 172.21.15.73:0/1463715842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedf80cfde0 0x7fedf80d0240 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:43.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.194+0000 7fedfcc35640 1 -- 172.21.15.73:0/1463715842 >> 172.21.15.73:0/1463715842 conn(0x7fedf808bfc0 msgr2=0x7fedf80d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:43.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.194+0000 7fedfcc35640 1 -- 172.21.15.73:0/1463715842 shutdown_connections 2024-03-29T04:08:43.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.194+0000 7fedfcc35640 1 -- 172.21.15.73:0/1463715842 wait complete. 2024-03-29T04:08:43.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.196+0000 7fedfcc35640 1 Processor -- start 2024-03-29T04:08:43.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.196+0000 7fedfcc35640 1 -- start start 2024-03-29T04:08:43.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.196+0000 7fedfcc35640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedf80cfde0 0x7fedf815bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:43.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.196+0000 7fedfcc35640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedf80d0f90 0x7fedf80b71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:43.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.196+0000 7fedfcc35640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedf815e920 0x7fedf81ea3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:43.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.196+0000 7fedfcc35640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fedf80d4ef0 con 0x7fedf80d0f90 2024-03-29T04:08:43.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.196+0000 7fedfcc35640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fedf80d2d20 con 0x7fedf80cfde0 2024-03-29T04:08:43.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.196+0000 7fedfcc35640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fedf80d5070 con 0x7fedf815e920 2024-03-29T04:08:43.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.196+0000 7fedf5d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedf80d0f90 0x7fedf80b71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:43.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.197+0000 7fedf5d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedf80d0f90 0x7fedf80b71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36410/0 (socket says 172.21.15.73:36410) 2024-03-29T04:08:43.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.197+0000 7fedf659c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedf80cfde0 0x7fedf815bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:43.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.197+0000 7fedf5d9b640 1 -- 172.21.15.73:0/181947292 learned_addr learned my addr 172.21.15.73:0/181947292 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:43.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.197+0000 7fedf6d9d640 1 --2- 172.21.15.73:0/181947292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedf815e920 0x7fedf81ea3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:43.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.197+0000 7fedf5d9b640 1 -- 172.21.15.73:0/181947292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedf815e920 msgr2=0x7fedf81ea3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:43.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.197+0000 7fedf5d9b640 1 --2- 172.21.15.73:0/181947292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedf815e920 0x7fedf81ea3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:43.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.197+0000 7fedf5d9b640 1 -- 172.21.15.73:0/181947292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedf80cfde0 msgr2=0x7fedf815bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:43.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.197+0000 7fedf5d9b640 1 --2- 172.21.15.73:0/181947292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedf80cfde0 0x7fedf815bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:43.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.197+0000 7fedf5d9b640 1 -- 172.21.15.73:0/181947292 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf815bff0 con 0x7fedf80d0f90 2024-03-29T04:08:43.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.197+0000 7fedf659c640 1 --2- 172.21.15.73:0/181947292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedf80cfde0 0x7fedf815bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:08:43.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.197+0000 7fedf5d9b640 1 --2- 172.21.15.73:0/181947292 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedf80d0f90 0x7fedf80b71c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fede0034040 tx=0x7fede00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:43.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.197+0000 7fedeeffd640 1 -- 172.21.15.73:0/181947292 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede0040070 con 0x7fedf80d0f90 2024-03-29T04:08:43.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.197+0000 7fedeeffd640 1 -- 172.21.15.73:0/181947292 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fede0031e40 con 0x7fedf80d0f90 2024-03-29T04:08:43.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.197+0000 7fedeeffd640 1 -- 172.21.15.73:0/181947292 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede0035040 con 0x7fedf80d0f90 2024-03-29T04:08:43.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.197+0000 7fedfcc35640 1 -- 172.21.15.73:0/181947292 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedf80b7a50 con 0x7fedf80d0f90 2024-03-29T04:08:43.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.197+0000 7fedfcc35640 1 -- 172.21.15.73:0/181947292 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedf80c8330 con 0x7fedf80d0f90 2024-03-29T04:08:43.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.198+0000 7fedfcc35640 1 -- 172.21.15.73:0/181947292 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedf80b7f70 con 0x7fedf80d0f90 2024-03-29T04:08:43.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.198+0000 7fedeeffd640 1 -- 172.21.15.73:0/181947292 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fede0038020 con 0x7fedf80d0f90 2024-03-29T04:08:43.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.199+0000 7fedeeffd640 1 --2- 172.21.15.73:0/181947292 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fedd806c530 0x7fedd806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:43.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.199+0000 7fedeeffd640 1 -- 172.21.15.73:0/181947292 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fede00ad0c0 con 0x7fedf80d0f90 2024-03-29T04:08:43.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.199+0000 7fedf659c640 1 --2- 172.21.15.73:0/181947292 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fedd806c530 0x7fedd806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:43.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.199+0000 7fedf659c640 1 --2- 172.21.15.73:0/181947292 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fedd806c530 0x7fedd806e9f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fede8002230 tx=0x7fede8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:43.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.203+0000 7fedeeffd640 1 -- 172.21.15.73:0/181947292 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fede007b090 con 0x7fedf80d0f90 2024-03-29T04:08:43.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.378+0000 7fedfcc35640 1 -- 172.21.15.73:0/181947292 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fedf80a2560 con 0x7fedf80d0f90 2024-03-29T04:08:43.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.379+0000 7fedeeffd640 1 -- 172.21.15.73:0/181947292 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7fede007f390 con 0x7fedf80d0f90 2024-03-29T04:08:43.358 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-03-29T04:08:43.360 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.381+0000 7fedfcc35640 1 -- 172.21.15.73:0/181947292 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fedd806c530 msgr2=0x7fedd806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:43.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.381+0000 7fedfcc35640 1 --2- 172.21.15.73:0/181947292 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fedd806c530 0x7fedd806e9f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fede8002230 tx=0x7fede8009040 comp rx=0 tx=0).stop 2024-03-29T04:08:43.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.381+0000 7fedfcc35640 1 -- 172.21.15.73:0/181947292 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedf80d0f90 msgr2=0x7fedf80b71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:43.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.381+0000 7fedfcc35640 1 --2- 172.21.15.73:0/181947292 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedf80d0f90 0x7fedf80b71c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fede0034040 tx=0x7fede00046c0 comp rx=0 tx=0).stop 2024-03-29T04:08:43.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.381+0000 7fedfcc35640 1 -- 172.21.15.73:0/181947292 shutdown_connections 2024-03-29T04:08:43.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.381+0000 7fedfcc35640 1 --2- 172.21.15.73:0/181947292 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedf815e920 0x7fedf81ea3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:43.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.381+0000 7fedfcc35640 1 --2- 172.21.15.73:0/181947292 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedf80d0f90 0x7fedf80b71c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:43.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.381+0000 7fedfcc35640 1 --2- 172.21.15.73:0/181947292 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fedd806c530 0x7fedd806e9f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:43.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.381+0000 7fedfcc35640 1 --2- 172.21.15.73:0/181947292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedf80cfde0 0x7fedf815bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:43.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.381+0000 7fedfcc35640 1 -- 172.21.15.73:0/181947292 >> 172.21.15.73:0/181947292 conn(0x7fedf808bfc0 msgr2=0x7fedf80b15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:43.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.381+0000 7fedfcc35640 1 -- 172.21.15.73:0/181947292 shutdown_connections 2024-03-29T04:08:43.361 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.381+0000 7fedfcc35640 1 -- 172.21.15.73:0/181947292 wait complete. 2024-03-29T04:08:43.371 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-29T04:08:43.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.499+0000 7f9b4184a640 1 Processor -- start 2024-03-29T04:08:43.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.499+0000 7f9b4184a640 1 -- start start 2024-03-29T04:08:43.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.500+0000 7f9b4184a640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9b3c15e5d0 0x7f9b3c0ada80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:43.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.500+0000 7f9b4184a640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9b3c0b3b80 0x7f9b3c06c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:43.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.500+0000 7f9b4184a640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b3c06e170 con 0x7f9b3c15e9b0 2024-03-29T04:08:43.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.501+0000 7f9b4184a640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f9b3c06ed80 con 0x7f9b3c15e5d0 2024-03-29T04:08:43.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.501+0000 7f9b3affd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9b3c15e5d0 0x7f9b3c0ada80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:43.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.501+0000 7f9b4184a640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f9b3c06e450 con 0x7f9b3c0b3b80 2024-03-29T04:08:43.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.501+0000 7f9b327fc640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9b3c15e9b0 0x7f9b3c072ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:46820/0 (socket says 172.21.15.73:46820) 2024-03-29T04:08:43.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.501+0000 7f9b327fc640 1 -- 172.21.15.73:0/619047787 learned_addr learned my addr 172.21.15.73:0/619047787 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:43.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.501+0000 7f9b3b7fe640 1 --2- 172.21.15.73:0/619047787 >> v2:172.21.15.142:3300/0 conn(0x7f9b3c0b3b80 0x7f9b3c06c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:43.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.501+0000 7f9b3affd640 1 -- 172.21.15.73:0/619047787 >> v2:172.21.15.142:3300/0 conn(0x7f9b3c0b3b80 msgr2=0x7f9b3c06c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:43.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.501+0000 7f9b3affd640 1 --2- 172.21.15.73:0/619047787 >> v2:172.21.15.142:3300/0 conn(0x7f9b3c0b3b80 0x7f9b3c06c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:43.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.501+0000 7f9b3affd640 1 -- 172.21.15.73:0/619047787 >> v1:172.21.15.73:6789/0 conn(0x7f9b3c15e9b0 legacy=0x7f9b3c072ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:43.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.501+0000 7f9b3affd640 1 -- 172.21.15.73:0/619047787 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b3c06e730 con 0x7f9b3c15e5d0 2024-03-29T04:08:43.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.501+0000 7f9b3a7fc640 1 -- 172.21.15.73:0/619047787 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3549906778 0 0) 0x7f9b3c06e170 con 0x7f9b3c15e9b0 2024-03-29T04:08:43.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.502+0000 7f9b3affd640 1 --2- 172.21.15.73:0/619047787 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b3c15e5d0 0x7f9b3c0ada80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c0b0600 tx=0x7f9b2c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=178cbc3953002eee server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:43.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.502+0000 7f9b3a7fc640 1 -- 172.21.15.73:0/619047787 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c035020 con 0x7f9b3c15e5d0 2024-03-29T04:08:43.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.502+0000 7f9b3a7fc640 1 -- 172.21.15.73:0/619047787 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b2c031830 con 0x7f9b3c15e5d0 2024-03-29T04:08:43.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.502+0000 7f9b3a7fc640 1 -- 172.21.15.73:0/619047787 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c031c00 con 0x7f9b3c15e5d0 2024-03-29T04:08:43.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.502+0000 7f9b4184a640 1 -- 172.21.15.73:0/619047787 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b3c15e5d0 msgr2=0x7f9b3c0ada80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:43.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.502+0000 7f9b4184a640 1 --2- 172.21.15.73:0/619047787 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b3c15e5d0 0x7f9b3c0ada80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c0b0600 tx=0x7f9b2c02b8d0 comp rx=0 tx=0).stop 2024-03-29T04:08:43.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.502+0000 7f9b4184a640 1 -- 172.21.15.73:0/619047787 shutdown_connections 2024-03-29T04:08:43.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.502+0000 7f9b4184a640 1 --2- 172.21.15.73:0/619047787 >> v2:172.21.15.142:3300/0 conn(0x7f9b3c0b3b80 0x7f9b3c06c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:43.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.502+0000 7f9b4184a640 1 --2- 172.21.15.73:0/619047787 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b3c15e5d0 0x7f9b3c0ada80 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:43.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.502+0000 7f9b4184a640 1 -- 172.21.15.73:0/619047787 >> 172.21.15.73:0/619047787 conn(0x7f9b3c072070 msgr2=0x7f9b3c072480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:43.485 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.502+0000 7f9b4184a640 1 -- 172.21.15.73:0/619047787 shutdown_connections 2024-03-29T04:08:43.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.502+0000 7f9b4184a640 1 -- 172.21.15.73:0/619047787 wait complete. 2024-03-29T04:08:43.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.503+0000 7f9b4184a640 1 Processor -- start 2024-03-29T04:08:43.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.504+0000 7f9b4184a640 1 -- start start 2024-03-29T04:08:43.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.504+0000 7f9b4184a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b3c0b3b80 0x7f9b3c150750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:43.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.504+0000 7f9b4184a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b3c15e5d0 0x7f9b3c1f44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:43.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.504+0000 7f9b4184a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b3c15e9b0 0x7f9b3c153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:43.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.504+0000 7f9b4184a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3c06cbe0 con 0x7f9b3c15e9b0 2024-03-29T04:08:43.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.504+0000 7f9b4184a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3c06ca60 con 0x7f9b3c15e5d0 2024-03-29T04:08:43.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.504+0000 7f9b4184a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9b3c06cd60 con 0x7f9b3c0b3b80 2024-03-29T04:08:43.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.504+0000 7f9b3b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b3c15e9b0 0x7f9b3c153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:43.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.504+0000 7f9b3b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b3c15e9b0 0x7f9b3c153180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36422/0 (socket says 172.21.15.73:36422) 2024-03-29T04:08:43.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.504+0000 7f9b3b7fe640 1 -- 172.21.15.73:0/3805836439 learned_addr learned my addr 172.21.15.73:0/3805836439 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:43.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.505+0000 7f9b327fc640 1 --2- 172.21.15.73:0/3805836439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b3c15e5d0 0x7f9b3c1f44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:43.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.505+0000 7f9b3affd640 1 --2- 172.21.15.73:0/3805836439 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b3c0b3b80 0x7f9b3c150750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:43.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.505+0000 7f9b3b7fe640 1 -- 172.21.15.73:0/3805836439 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b3c0b3b80 msgr2=0x7f9b3c150750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:43.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.505+0000 7f9b3b7fe640 1 --2- 172.21.15.73:0/3805836439 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b3c0b3b80 0x7f9b3c150750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:43.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.505+0000 7f9b3b7fe640 1 -- 172.21.15.73:0/3805836439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b3c15e5d0 msgr2=0x7f9b3c1f44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:43.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.505+0000 7f9b3b7fe640 1 --2- 172.21.15.73:0/3805836439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b3c15e5d0 0x7f9b3c1f44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:43.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.505+0000 7f9b3b7fe640 1 -- 172.21.15.73:0/3805836439 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b3c1f4c40 con 0x7f9b3c15e9b0 2024-03-29T04:08:43.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.505+0000 7f9b3b7fe640 1 --2- 172.21.15.73:0/3805836439 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b3c15e9b0 0x7f9b3c153180 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9b3400efc0 tx=0x7f9b3400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:43.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.505+0000 7f9b38ff9640 1 -- 172.21.15.73:0/3805836439 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b34018020 con 0x7f9b3c15e9b0 2024-03-29T04:08:43.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.505+0000 7f9b38ff9640 1 -- 172.21.15.73:0/3805836439 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b34014480 con 0x7f9b3c15e9b0 2024-03-29T04:08:43.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.505+0000 7f9b4184a640 1 -- 172.21.15.73:0/3805836439 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b3c1f4f20 con 0x7f9b3c15e9b0 2024-03-29T04:08:43.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.505+0000 7f9b38ff9640 1 -- 172.21.15.73:0/3805836439 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b34014870 con 0x7f9b3c15e9b0 2024-03-29T04:08:43.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.505+0000 7f9b4184a640 1 -- 172.21.15.73:0/3805836439 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b3c0ce4e0 con 0x7f9b3c15e9b0 2024-03-29T04:08:43.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.506+0000 7f9b4184a640 1 -- 172.21.15.73:0/3805836439 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b3c1f5440 con 0x7f9b3c15e9b0 2024-03-29T04:08:43.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.506+0000 7f9b38ff9640 1 -- 172.21.15.73:0/3805836439 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f9b34005d10 con 0x7f9b3c15e9b0 2024-03-29T04:08:43.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.507+0000 7f9b38ff9640 1 --2- 172.21.15.73:0/3805836439 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9b1c06c560 0x7f9b1c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:43.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.507+0000 7f9b38ff9640 1 -- 172.21.15.73:0/3805836439 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9b3408c110 con 0x7f9b3c15e9b0 2024-03-29T04:08:43.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.507+0000 7f9b3affd640 1 --2- 172.21.15.73:0/3805836439 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9b1c06c560 0x7f9b1c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:43.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.507+0000 7f9b3affd640 1 --2- 172.21.15.73:0/3805836439 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9b1c06c560 0x7f9b1c06ea20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c036000 tx=0x7f9b2c03d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:43.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.511+0000 7f9b38ff9640 1 -- 172.21.15.73:0/3805836439 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f9b3c1f5440 con 0x7f9b3c15e9b0 2024-03-29T04:08:43.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.691+0000 7f9b4184a640 1 -- 172.21.15.73:0/3805836439 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f9b3c0ce6b0 con 0x7f9b3c15e9b0 2024-03-29T04:08:43.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.692+0000 7f9b38ff9640 1 -- 172.21.15.73:0/3805836439 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f9b34022070 con 0x7f9b3c15e9b0 2024-03-29T04:08:43.672 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-03-29T04:08:43.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.694+0000 7f9b4184a640 1 -- 172.21.15.73:0/3805836439 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9b1c06c560 msgr2=0x7f9b1c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:43.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.694+0000 7f9b4184a640 1 --2- 172.21.15.73:0/3805836439 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9b1c06c560 0x7f9b1c06ea20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c036000 tx=0x7f9b2c03d040 comp rx=0 tx=0).stop 2024-03-29T04:08:43.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.694+0000 7f9b4184a640 1 -- 172.21.15.73:0/3805836439 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b3c15e9b0 msgr2=0x7f9b3c153180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:43.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.694+0000 7f9b4184a640 1 --2- 172.21.15.73:0/3805836439 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b3c15e9b0 0x7f9b3c153180 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9b3400efc0 tx=0x7f9b3400c490 comp rx=0 tx=0).stop 2024-03-29T04:08:43.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.694+0000 7f9b4184a640 1 -- 172.21.15.73:0/3805836439 shutdown_connections 2024-03-29T04:08:43.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.694+0000 7f9b4184a640 1 --2- 172.21.15.73:0/3805836439 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b3c15e9b0 0x7f9b3c153180 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:43.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.694+0000 7f9b4184a640 1 --2- 172.21.15.73:0/3805836439 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9b1c06c560 0x7f9b1c06ea20 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:43.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.694+0000 7f9b4184a640 1 --2- 172.21.15.73:0/3805836439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b3c15e5d0 0x7f9b3c1f44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:43.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.694+0000 7f9b4184a640 1 --2- 172.21.15.73:0/3805836439 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b3c0b3b80 0x7f9b3c150750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:43.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.694+0000 7f9b4184a640 1 -- 172.21.15.73:0/3805836439 >> 172.21.15.73:0/3805836439 conn(0x7f9b3c072070 msgr2=0x7f9b3c159310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:43.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.694+0000 7f9b4184a640 1 -- 172.21.15.73:0/3805836439 shutdown_connections 2024-03-29T04:08:43.675 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.694+0000 7f9b4184a640 1 -- 172.21.15.73:0/3805836439 wait complete. 2024-03-29T04:08:43.685 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-29T04:08:43.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.808+0000 7f391d340640 1 Processor -- start 2024-03-29T04:08:43.788 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.808+0000 7f391d340640 1 -- start start 2024-03-29T04:08:43.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.809+0000 7f391d340640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f39180d1010 0x7f39180d13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:43.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.809+0000 7f391d340640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f39180d3430 0x7f39180cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:43.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.809+0000 7f391d340640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39180d0210 0x7f39181622f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:43.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.809+0000 7f391d340640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f39180d5060 con 0x7f39180d1010 2024-03-29T04:08:43.789 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.809+0000 7f391d340640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f39180d1930 con 0x7f39180d3430 2024-03-29T04:08:43.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.809+0000 7f391d340640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f39180d2390 con 0x7f39180d0210 2024-03-29T04:08:43.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.809+0000 7f3916ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f39180d1010 0x7f39180d13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:43.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.809+0000 7f3916ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f39180d1010 0x7f39180d13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36436/0 (socket says 172.21.15.73:36436) 2024-03-29T04:08:43.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.809+0000 7f3916ffd640 1 -- 172.21.15.73:0/2153680754 learned_addr learned my addr 172.21.15.73:0/2153680754 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:43.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.809+0000 7f39167fc640 1 --2- 172.21.15.73:0/2153680754 >> v2:172.21.15.142:3300/0 conn(0x7f39180d3430 0x7f39180cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:43.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.809+0000 7f39177fe640 1 --2- 172.21.15.73:0/2153680754 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39180d0210 0x7f39181622f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:43.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.809+0000 7f3916ffd640 1 -- 172.21.15.73:0/2153680754 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39180d0210 msgr2=0x7f39181622f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:43.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.809+0000 7f3916ffd640 1 --2- 172.21.15.73:0/2153680754 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39180d0210 0x7f39181622f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:43.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.809+0000 7f3916ffd640 1 -- 172.21.15.73:0/2153680754 >> v2:172.21.15.142:3300/0 conn(0x7f39180d3430 msgr2=0x7f39180cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:43.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.809+0000 7f3916ffd640 1 --2- 172.21.15.73:0/2153680754 >> v2:172.21.15.142:3300/0 conn(0x7f39180d3430 0x7f39180cfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:43.790 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.809+0000 7f3916ffd640 1 -- 172.21.15.73:0/2153680754 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39180d2670 con 0x7f39180d1010 2024-03-29T04:08:43.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.810+0000 7f3916ffd640 1 --2- 172.21.15.73:0/2153680754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39180d1010 0x7f39180d13f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f391808cfa0 tx=0x7f390802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f3c6f2ed4956a server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:43.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.810+0000 7f3915ffb640 1 -- 172.21.15.73:0/2153680754 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3908035020 con 0x7f39180d1010 2024-03-29T04:08:43.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.810+0000 7f3915ffb640 1 -- 172.21.15.73:0/2153680754 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3908031870 con 0x7f39180d1010 2024-03-29T04:08:43.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.810+0000 7f3915ffb640 1 -- 172.21.15.73:0/2153680754 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3908031c40 con 0x7f39180d1010 2024-03-29T04:08:43.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.811+0000 7f391d340640 1 -- 172.21.15.73:0/2153680754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39180d1010 msgr2=0x7f39180d13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:43.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.811+0000 7f391d340640 1 --2- 172.21.15.73:0/2153680754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39180d1010 0x7f39180d13f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f391808cfa0 tx=0x7f390802b910 comp rx=0 tx=0).stop 2024-03-29T04:08:43.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.811+0000 7f391d340640 1 -- 172.21.15.73:0/2153680754 shutdown_connections 2024-03-29T04:08:43.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.811+0000 7f391d340640 1 --2- 172.21.15.73:0/2153680754 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39180d0210 0x7f39181622f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:43.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.811+0000 7f391d340640 1 --2- 172.21.15.73:0/2153680754 >> v2:172.21.15.142:3300/0 conn(0x7f39180d3430 0x7f39180cfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:43.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.811+0000 7f391d340640 1 --2- 172.21.15.73:0/2153680754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39180d1010 0x7f39180d13f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:43.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.811+0000 7f391d340640 1 -- 172.21.15.73:0/2153680754 >> 172.21.15.73:0/2153680754 conn(0x7f391808bfc0 msgr2=0x7f39180d4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:43.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.811+0000 7f391d340640 1 -- 172.21.15.73:0/2153680754 shutdown_connections 2024-03-29T04:08:43.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.811+0000 7f391d340640 1 -- 172.21.15.73:0/2153680754 wait complete. 2024-03-29T04:08:43.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.812+0000 7f391d340640 1 Processor -- start 2024-03-29T04:08:43.793 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.812+0000 7f391d340640 1 -- start start 2024-03-29T04:08:43.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.813+0000 7f391d340640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39180d0210 0x7f39180c8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:43.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.813+0000 7f391d340640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39180d1010 0x7f39180cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:43.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.813+0000 7f391d340640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39180d3430 0x7f3918158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:43.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.813+0000 7f391d340640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f39180d2f10 con 0x7f39180d3430 2024-03-29T04:08:43.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.813+0000 7f391d340640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f39180d2c30 con 0x7f39180d0210 2024-03-29T04:08:43.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.813+0000 7f391d340640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f391815eaf0 con 0x7f39180d1010 2024-03-29T04:08:43.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.813+0000 7f39177fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39180d3430 0x7f3918158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:43.795 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.813+0000 7f39177fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39180d3430 0x7f3918158e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36450/0 (socket says 172.21.15.73:36450) 2024-03-29T04:08:43.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.813+0000 7f39177fe640 1 -- 172.21.15.73:0/1593808344 learned_addr learned my addr 172.21.15.73:0/1593808344 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:43.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.813+0000 7f39167fc640 1 --2- 172.21.15.73:0/1593808344 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39180d1010 0x7f39180cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:43.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.813+0000 7f3916ffd640 1 --2- 172.21.15.73:0/1593808344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39180d0210 0x7f39180c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:43.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.813+0000 7f39177fe640 1 -- 172.21.15.73:0/1593808344 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39180d1010 msgr2=0x7f39180cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:43.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.813+0000 7f39177fe640 1 --2- 172.21.15.73:0/1593808344 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39180d1010 0x7f39180cdd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:43.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.813+0000 7f39177fe640 1 -- 172.21.15.73:0/1593808344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39180d0210 msgr2=0x7f39180c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:43.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.813+0000 7f39177fe640 1 --2- 172.21.15.73:0/1593808344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39180d0210 0x7f39180c8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:43.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.813+0000 7f39177fe640 1 -- 172.21.15.73:0/1593808344 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39180c8850 con 0x7f39180d3430 2024-03-29T04:08:43.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.814+0000 7f39177fe640 1 --2- 172.21.15.73:0/1593808344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39180d3430 0x7f3918158e20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f391000eed0 tx=0x7f391000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:43.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.814+0000 7f38ff7fe640 1 -- 172.21.15.73:0/1593808344 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3910018020 con 0x7f39180d3430 2024-03-29T04:08:43.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.814+0000 7f38ff7fe640 1 -- 172.21.15.73:0/1593808344 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3910014400 con 0x7f39180d3430 2024-03-29T04:08:43.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.814+0000 7f391d340640 1 -- 172.21.15.73:0/1593808344 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39180c8b30 con 0x7f39180d3430 2024-03-29T04:08:43.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.814+0000 7f38ff7fe640 1 -- 172.21.15.73:0/1593808344 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39100147f0 con 0x7f39180d3430 2024-03-29T04:08:43.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.814+0000 7f391d340640 1 -- 172.21.15.73:0/1593808344 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39180c90f0 con 0x7f39180d3430 2024-03-29T04:08:43.796 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.815+0000 7f391d340640 1 -- 172.21.15.73:0/1593808344 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39180a2570 con 0x7f39180d3430 2024-03-29T04:08:43.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.815+0000 7f38ff7fe640 1 -- 172.21.15.73:0/1593808344 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f3910005d10 con 0x7f39180d3430 2024-03-29T04:08:43.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.816+0000 7f38ff7fe640 1 --2- 172.21.15.73:0/1593808344 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f390406c530 0x7f390406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:43.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.816+0000 7f38ff7fe640 1 -- 172.21.15.73:0/1593808344 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f391008bc70 con 0x7f39180d3430 2024-03-29T04:08:43.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.816+0000 7f3916ffd640 1 --2- 172.21.15.73:0/1593808344 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f390406c530 0x7f390406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:43.797 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.816+0000 7f3916ffd640 1 --2- 172.21.15.73:0/1593808344 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f390406c530 0x7f390406e9f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3908036000 tx=0x7f390803c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:43.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.820+0000 7f38ff7fe640 1 -- 172.21.15.73:0/1593808344 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f3910022070 con 0x7f39180d3430 2024-03-29T04:08:43.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.993+0000 7f391d340640 1 -- 172.21.15.73:0/1593808344 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f391804f9d0 con 0x7f39180d3430 2024-03-29T04:08:43.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.994+0000 7f38ff7fe640 1 -- 172.21.15.73:0/1593808344 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f3910059c40 con 0x7f39180d3430 2024-03-29T04:08:43.973 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-29T04:08:43.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.996+0000 7f391d340640 1 -- 172.21.15.73:0/1593808344 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f390406c530 msgr2=0x7f390406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:43.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.996+0000 7f391d340640 1 --2- 172.21.15.73:0/1593808344 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f390406c530 0x7f390406e9f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3908036000 tx=0x7f390803c040 comp rx=0 tx=0).stop 2024-03-29T04:08:43.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.996+0000 7f391d340640 1 -- 172.21.15.73:0/1593808344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39180d3430 msgr2=0x7f3918158e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:43.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.996+0000 7f391d340640 1 --2- 172.21.15.73:0/1593808344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39180d3430 0x7f3918158e20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f391000eed0 tx=0x7f391000b480 comp rx=0 tx=0).stop 2024-03-29T04:08:43.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.996+0000 7f391d340640 1 -- 172.21.15.73:0/1593808344 shutdown_connections 2024-03-29T04:08:43.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.996+0000 7f391d340640 1 --2- 172.21.15.73:0/1593808344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39180d3430 0x7f3918158e20 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:43.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.996+0000 7f391d340640 1 --2- 172.21.15.73:0/1593808344 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f39180d1010 0x7f39180cdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:43.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.996+0000 7f391d340640 1 --2- 172.21.15.73:0/1593808344 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f390406c530 0x7f390406e9f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:43.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.996+0000 7f391d340640 1 --2- 172.21.15.73:0/1593808344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39180d0210 0x7f39180c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:43.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.996+0000 7f391d340640 1 -- 172.21.15.73:0/1593808344 >> 172.21.15.73:0/1593808344 conn(0x7f391808bfc0 msgr2=0x7f391815ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:43.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.996+0000 7f391d340640 1 -- 172.21.15.73:0/1593808344 shutdown_connections 2024-03-29T04:08:43.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:43.996+0000 7f391d340640 1 -- 172.21.15.73:0/1593808344 wait complete. 2024-03-29T04:08:43.986 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-29T04:08:44.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.108+0000 7f9bccb8d640 1 Processor -- start 2024-03-29T04:08:44.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.108+0000 7f9bccb8d640 1 -- start start 2024-03-29T04:08:44.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.109+0000 7f9bccb8d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bc815ec10 0x7f9bc80c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:44.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.109+0000 7f9bccb8d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9bc80d0730 0x7f9bc80b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:44.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.109+0000 7f9bccb8d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bc815f100 con 0x7f9bc80ce740 2024-03-29T04:08:44.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.109+0000 7f9bccb8d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f9bc80ceba0 con 0x7f9bc80d0730 2024-03-29T04:08:44.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.109+0000 7f9bccb8d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9bc815f370 con 0x7f9bc815ec10 2024-03-29T04:08:44.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.109+0000 7f9bc6d9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9bc80d0730 0x7f9bc80b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:44.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.109+0000 7f9bc5d9b640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9bc80ce740 0x7f9bc80d0020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:46824/0 (socket says 172.21.15.73:46824) 2024-03-29T04:08:44.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.109+0000 7f9bc5d9b640 1 -- 172.21.15.73:0/3006264739 learned_addr learned my addr 172.21.15.73:0/3006264739 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:44.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.109+0000 7f9bc659c640 1 --2- 172.21.15.73:0/3006264739 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bc815ec10 0x7f9bc80c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:44.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.109+0000 7f9bc6d9d640 1 -- 172.21.15.73:0/3006264739 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bc815ec10 msgr2=0x7f9bc80c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:44.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.109+0000 7f9bc6d9d640 1 --2- 172.21.15.73:0/3006264739 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bc815ec10 0x7f9bc80c67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:44.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.109+0000 7f9bc6d9d640 1 -- 172.21.15.73:0/3006264739 >> v1:172.21.15.73:6789/0 conn(0x7f9bc80ce740 legacy=0x7f9bc80d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:44.090 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.109+0000 7f9bc6d9d640 1 -- 172.21.15.73:0/3006264739 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bc815f650 con 0x7f9bc80d0730 2024-03-29T04:08:44.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.110+0000 7f9bc6d9d640 1 --2- 172.21.15.73:0/3006264739 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bc80d0730 0x7f9bc80b30b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0009d90 tx=0x7f9bc002be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3ef1b5b3e21353e server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:44.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.110+0000 7f9bc559a640 1 -- 172.21.15.73:0/3006264739 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc0039070 con 0x7f9bc80d0730 2024-03-29T04:08:44.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.110+0000 7f9bc559a640 1 -- 172.21.15.73:0/3006264739 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bc002cbc0 con 0x7f9bc80d0730 2024-03-29T04:08:44.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.110+0000 7f9bc559a640 1 -- 172.21.15.73:0/3006264739 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc0034440 con 0x7f9bc80d0730 2024-03-29T04:08:44.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.110+0000 7f9bccb8d640 1 -- 172.21.15.73:0/3006264739 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bc80d0730 msgr2=0x7f9bc80b30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:44.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.110+0000 7f9bccb8d640 1 --2- 172.21.15.73:0/3006264739 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bc80d0730 0x7f9bc80b30b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0009d90 tx=0x7f9bc002be10 comp rx=0 tx=0).stop 2024-03-29T04:08:44.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.111+0000 7f9bccb8d640 1 -- 172.21.15.73:0/3006264739 shutdown_connections 2024-03-29T04:08:44.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.111+0000 7f9bccb8d640 1 --2- 172.21.15.73:0/3006264739 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bc80d0730 0x7f9bc80b30b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:44.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.111+0000 7f9bccb8d640 1 --2- 172.21.15.73:0/3006264739 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bc815ec10 0x7f9bc80c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:44.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.111+0000 7f9bccb8d640 1 -- 172.21.15.73:0/3006264739 >> 172.21.15.73:0/3006264739 conn(0x7f9bc806b510 msgr2=0x7f9bc806b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:44.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.111+0000 7f9bccb8d640 1 -- 172.21.15.73:0/3006264739 shutdown_connections 2024-03-29T04:08:44.091 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.111+0000 7f9bccb8d640 1 -- 172.21.15.73:0/3006264739 wait complete. 2024-03-29T04:08:44.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.112+0000 7f9bccb8d640 1 Processor -- start 2024-03-29T04:08:44.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.112+0000 7f9bccb8d640 1 -- start start 2024-03-29T04:08:44.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.113+0000 7f9bccb8d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bc80ce740 0x7f9bc81f62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:44.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.113+0000 7f9bccb8d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bc80d0730 0x7f9bc814e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:44.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.113+0000 7f9bccb8d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bc815ec10 0x7f9bc80ae380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:44.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.113+0000 7f9bccb8d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc815fe50 con 0x7f9bc815ec10 2024-03-29T04:08:44.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.113+0000 7f9bccb8d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc80c6ee0 con 0x7f9bc80ce740 2024-03-29T04:08:44.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.113+0000 7f9bccb8d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9bc815ffd0 con 0x7f9bc80d0730 2024-03-29T04:08:44.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.113+0000 7f9bc6d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bc815ec10 0x7f9bc80ae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:44.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.113+0000 7f9bc6d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bc815ec10 0x7f9bc80ae380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36466/0 (socket says 172.21.15.73:36466) 2024-03-29T04:08:44.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.113+0000 7f9bc6d9d640 1 -- 172.21.15.73:0/867591829 learned_addr learned my addr 172.21.15.73:0/867591829 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:44.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.113+0000 7f9bc659c640 1 --2- 172.21.15.73:0/867591829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bc80ce740 0x7f9bc81f62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:44.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.113+0000 7f9bc5d9b640 1 --2- 172.21.15.73:0/867591829 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bc80d0730 0x7f9bc814e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:44.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.113+0000 7f9bc6d9d640 1 -- 172.21.15.73:0/867591829 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bc80d0730 msgr2=0x7f9bc814e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:44.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.113+0000 7f9bc6d9d640 1 --2- 172.21.15.73:0/867591829 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bc80d0730 0x7f9bc814e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:44.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.113+0000 7f9bc6d9d640 1 -- 172.21.15.73:0/867591829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bc80ce740 msgr2=0x7f9bc81f62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:44.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.113+0000 7f9bc6d9d640 1 --2- 172.21.15.73:0/867591829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bc80ce740 0x7f9bc81f62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:44.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.113+0000 7f9bc6d9d640 1 -- 172.21.15.73:0/867591829 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bc814eb30 con 0x7f9bc815ec10 2024-03-29T04:08:44.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.113+0000 7f9bc6d9d640 1 --2- 172.21.15.73:0/867591829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bc815ec10 0x7f9bc80ae380 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0009d90 tx=0x7f9bc0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:44.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.113+0000 7f9bb6ffd640 1 -- 172.21.15.73:0/867591829 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc0039050 con 0x7f9bc815ec10 2024-03-29T04:08:44.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.113+0000 7f9bb6ffd640 1 -- 172.21.15.73:0/867591829 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bc0045070 con 0x7f9bc815ec10 2024-03-29T04:08:44.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.113+0000 7f9bccb8d640 1 -- 172.21.15.73:0/867591829 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bc81593a0 con 0x7f9bc815ec10 2024-03-29T04:08:44.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.113+0000 7f9bb6ffd640 1 -- 172.21.15.73:0/867591829 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc0009450 con 0x7f9bc815ec10 2024-03-29T04:08:44.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.113+0000 7f9bccb8d640 1 -- 172.21.15.73:0/867591829 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bc806dc40 con 0x7f9bc815ec10 2024-03-29T04:08:44.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.114+0000 7f9bccb8d640 1 -- 172.21.15.73:0/867591829 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bc8068640 con 0x7f9bc815ec10 2024-03-29T04:08:44.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.115+0000 7f9bb6ffd640 1 -- 172.21.15.73:0/867591829 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f9bc003e850 con 0x7f9bc815ec10 2024-03-29T04:08:44.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.115+0000 7f9bb6ffd640 1 --2- 172.21.15.73:0/867591829 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9ba806c530 0x7f9ba806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:44.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.115+0000 7f9bc659c640 1 --2- 172.21.15.73:0/867591829 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9ba806c530 0x7f9ba806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:44.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.116+0000 7f9bb6ffd640 1 -- 172.21.15.73:0/867591829 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9bc00ae430 con 0x7f9bc815ec10 2024-03-29T04:08:44.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.116+0000 7f9bc659c640 1 --2- 172.21.15.73:0/867591829 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9ba806c530 0x7f9ba806e9f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc009b40 tx=0x7f9bbc009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:44.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.120+0000 7f9bb6ffd640 1 -- 172.21.15.73:0/867591829 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f9bc007c530 con 0x7f9bc815ec10 2024-03-29T04:08:44.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.305+0000 7f9bccb8d640 1 -- 172.21.15.73:0/867591829 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9bc80b4f60 con 0x7f9bc815ec10 2024-03-29T04:08:44.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.305+0000 7f9bb6ffd640 1 -- 172.21.15.73:0/867591829 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f9bc0080830 con 0x7f9bc815ec10 2024-03-29T04:08:44.285 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-03-29T04:08:44.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.307+0000 7f9bccb8d640 1 -- 172.21.15.73:0/867591829 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9ba806c530 msgr2=0x7f9ba806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:44.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.307+0000 7f9bccb8d640 1 --2- 172.21.15.73:0/867591829 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9ba806c530 0x7f9ba806e9f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc009b40 tx=0x7f9bbc009190 comp rx=0 tx=0).stop 2024-03-29T04:08:44.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.307+0000 7f9bccb8d640 1 -- 172.21.15.73:0/867591829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bc815ec10 msgr2=0x7f9bc80ae380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:44.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.307+0000 7f9bccb8d640 1 --2- 172.21.15.73:0/867591829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bc815ec10 0x7f9bc80ae380 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0009d90 tx=0x7f9bc0004a40 comp rx=0 tx=0).stop 2024-03-29T04:08:44.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.307+0000 7f9bccb8d640 1 -- 172.21.15.73:0/867591829 shutdown_connections 2024-03-29T04:08:44.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.307+0000 7f9bccb8d640 1 --2- 172.21.15.73:0/867591829 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9bc815ec10 0x7f9bc80ae380 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:44.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.307+0000 7f9bccb8d640 1 --2- 172.21.15.73:0/867591829 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9bc80d0730 0x7f9bc814e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:44.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.307+0000 7f9bccb8d640 1 --2- 172.21.15.73:0/867591829 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9ba806c530 0x7f9ba806e9f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:44.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.307+0000 7f9bccb8d640 1 --2- 172.21.15.73:0/867591829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9bc80ce740 0x7f9bc81f62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:44.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.307+0000 7f9bccb8d640 1 -- 172.21.15.73:0/867591829 >> 172.21.15.73:0/867591829 conn(0x7f9bc806b510 msgr2=0x7f9bc80b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:44.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.307+0000 7f9bccb8d640 1 -- 172.21.15.73:0/867591829 shutdown_connections 2024-03-29T04:08:44.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.308+0000 7f9bccb8d640 1 -- 172.21.15.73:0/867591829 wait complete. 2024-03-29T04:08:44.298 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-03-29T04:08:44.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:44.298 DEBUG:teuthology.orchestra.run.smithi073:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-03-29T04:08:44.327 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2024-03-29T04:08:44.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:44.328 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-03-29T04:08:44.383 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-03-29T04:08:44.383 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-29T04:08:44.398 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-03-29T04:08:44.398 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-29T04:08:44.453 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-03-29T04:08:44.453 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-29T04:08:44.508 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-29T04:08:44.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.631+0000 7f01028e4640 1 Processor -- start 2024-03-29T04:08:44.611 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.631+0000 7f01028e4640 1 -- start start 2024-03-29T04:08:44.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.632+0000 7f01028e4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00fc15c670 0x7f00fc06c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:44.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.632+0000 7f01028e4640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f00fc06f060 0x7f00fc06d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:44.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.632+0000 7f01028e4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f00fc0ad230 0x7f00fc0ad6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:44.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.632+0000 7f01028e4640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f00fc146230 con 0x7f00fc06f060 2024-03-29T04:08:44.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.632+0000 7f01028e4640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f00fc06dfc0 con 0x7f00fc0ad230 2024-03-29T04:08:44.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.632+0000 7f01028e4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f00fc06e2a0 con 0x7f00fc15c670 2024-03-29T04:08:44.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.632+0000 7f00fb7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f00fc06f060 0x7f00fc06d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:44.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.632+0000 7f00fb7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f00fc06f060 0x7f00fc06d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36476/0 (socket says 172.21.15.73:36476) 2024-03-29T04:08:44.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.632+0000 7f00fb7fe640 1 -- 172.21.15.73:0/2870994544 learned_addr learned my addr 172.21.15.73:0/2870994544 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:44.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.632+0000 7f00fbfff640 1 --2- 172.21.15.73:0/2870994544 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00fc15c670 0x7f00fc06c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:44.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.632+0000 7f0100e81640 1 --2- 172.21.15.73:0/2870994544 >> v2:172.21.15.142:3300/0 conn(0x7f00fc0ad230 0x7f00fc0ad6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:44.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.632+0000 7f00fb7fe640 1 -- 172.21.15.73:0/2870994544 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00fc15c670 msgr2=0x7f00fc06c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:44.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.632+0000 7f00fb7fe640 1 --2- 172.21.15.73:0/2870994544 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00fc15c670 0x7f00fc06c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:44.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.632+0000 7f00fb7fe640 1 -- 172.21.15.73:0/2870994544 >> v2:172.21.15.142:3300/0 conn(0x7f00fc0ad230 msgr2=0x7f00fc0ad6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:44.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.632+0000 7f00fb7fe640 1 --2- 172.21.15.73:0/2870994544 >> v2:172.21.15.142:3300/0 conn(0x7f00fc0ad230 0x7f00fc0ad6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:44.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.632+0000 7f00fb7fe640 1 -- 172.21.15.73:0/2870994544 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00fc06e580 con 0x7f00fc06f060 2024-03-29T04:08:44.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.633+0000 7f00fb7fe640 1 --2- 172.21.15.73:0/2870994544 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00fc06f060 0x7f00fc06d930 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f00fc06fc20 tx=0x7f00f002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd1bc29edea174b9 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:44.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.633+0000 7f00faffd640 1 -- 172.21.15.73:0/2870994544 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f002e070 con 0x7f00fc06f060 2024-03-29T04:08:44.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.633+0000 7f00faffd640 1 -- 172.21.15.73:0/2870994544 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00f0037070 con 0x7f00fc06f060 2024-03-29T04:08:44.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.633+0000 7f00faffd640 1 -- 172.21.15.73:0/2870994544 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f0031a00 con 0x7f00fc06f060 2024-03-29T04:08:44.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.634+0000 7f01028e4640 1 -- 172.21.15.73:0/2870994544 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00fc06f060 msgr2=0x7f00fc06d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:44.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.634+0000 7f01028e4640 1 --2- 172.21.15.73:0/2870994544 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00fc06f060 0x7f00fc06d930 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f00fc06fc20 tx=0x7f00f002b880 comp rx=0 tx=0).stop 2024-03-29T04:08:44.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.634+0000 7f01028e4640 1 -- 172.21.15.73:0/2870994544 shutdown_connections 2024-03-29T04:08:44.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.634+0000 7f01028e4640 1 --2- 172.21.15.73:0/2870994544 >> v2:172.21.15.142:3300/0 conn(0x7f00fc0ad230 0x7f00fc0ad6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:44.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.634+0000 7f01028e4640 1 --2- 172.21.15.73:0/2870994544 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00fc06f060 0x7f00fc06d930 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:44.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.634+0000 7f01028e4640 1 --2- 172.21.15.73:0/2870994544 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00fc15c670 0x7f00fc06c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:44.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.634+0000 7f01028e4640 1 -- 172.21.15.73:0/2870994544 >> 172.21.15.73:0/2870994544 conn(0x7f00fc06b510 msgr2=0x7f00fc06b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:44.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.634+0000 7f01028e4640 1 -- 172.21.15.73:0/2870994544 shutdown_connections 2024-03-29T04:08:44.618 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.634+0000 7f01028e4640 1 -- 172.21.15.73:0/2870994544 wait complete. 2024-03-29T04:08:44.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.635+0000 7f01028e4640 1 Processor -- start 2024-03-29T04:08:44.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.635+0000 7f01028e4640 1 -- start start 2024-03-29T04:08:44.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.636+0000 7f01028e4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00fc06f060 0x7f00fc072b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:44.623 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.636+0000 7f01028e4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00fc0ad230 0x7f00fc144440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:44.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.636+0000 7f01028e4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00fc15c670 0x7f00fc1f39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:44.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.636+0000 7f01028e4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f00fc0b32c0 con 0x7f00fc15c670 2024-03-29T04:08:44.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.636+0000 7f01028e4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f00fc15ca50 con 0x7f00fc0ad230 2024-03-29T04:08:44.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.636+0000 7f01028e4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f00fc0b3440 con 0x7f00fc06f060 2024-03-29T04:08:44.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.636+0000 7f0100e81640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00fc15c670 0x7f00fc1f39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:44.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.636+0000 7f0100e81640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00fc15c670 0x7f00fc1f39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36478/0 (socket says 172.21.15.73:36478) 2024-03-29T04:08:44.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.636+0000 7f0100e81640 1 -- 172.21.15.73:0/3996097686 learned_addr learned my addr 172.21.15.73:0/3996097686 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:44.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.636+0000 7f00fbfff640 1 --2- 172.21.15.73:0/3996097686 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00fc06f060 0x7f00fc072b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:44.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.636+0000 7f00fb7fe640 1 --2- 172.21.15.73:0/3996097686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00fc0ad230 0x7f00fc144440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:44.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.636+0000 7f0100e81640 1 -- 172.21.15.73:0/3996097686 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00fc06f060 msgr2=0x7f00fc072b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:44.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.636+0000 7f0100e81640 1 --2- 172.21.15.73:0/3996097686 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00fc06f060 0x7f00fc072b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:44.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.636+0000 7f0100e81640 1 -- 172.21.15.73:0/3996097686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00fc0ad230 msgr2=0x7f00fc144440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:44.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.636+0000 7f0100e81640 1 --2- 172.21.15.73:0/3996097686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00fc0ad230 0x7f00fc144440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:44.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.636+0000 7f0100e81640 1 -- 172.21.15.73:0/3996097686 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00fc071ae0 con 0x7f00fc15c670 2024-03-29T04:08:44.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.636+0000 7f0100e81640 1 --2- 172.21.15.73:0/3996097686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00fc15c670 0x7f00fc1f39d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f00f400ef00 tx=0x7f00f400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:44.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.637+0000 7f00f8ff9640 1 -- 172.21.15.73:0/3996097686 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f4018020 con 0x7f00fc15c670 2024-03-29T04:08:44.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.637+0000 7f00f8ff9640 1 -- 172.21.15.73:0/3996097686 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00f4014400 con 0x7f00fc15c670 2024-03-29T04:08:44.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.637+0000 7f01028e4640 1 -- 172.21.15.73:0/3996097686 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00fc071dc0 con 0x7f00fc15c670 2024-03-29T04:08:44.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.637+0000 7f00f8ff9640 1 -- 172.21.15.73:0/3996097686 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f40147f0 con 0x7f00fc15c670 2024-03-29T04:08:44.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.637+0000 7f01028e4640 1 -- 172.21.15.73:0/3996097686 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00fc072380 con 0x7f00fc15c670 2024-03-29T04:08:44.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.638+0000 7f01028e4640 1 -- 172.21.15.73:0/3996097686 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00fc068640 con 0x7f00fc15c670 2024-03-29T04:08:44.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.638+0000 7f00f8ff9640 1 -- 172.21.15.73:0/3996097686 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f00f4005d10 con 0x7f00fc15c670 2024-03-29T04:08:44.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.638+0000 7f00f8ff9640 1 --2- 172.21.15.73:0/3996097686 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f00e806c530 0x7f00e806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:44.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.639+0000 7f00f8ff9640 1 -- 172.21.15.73:0/3996097686 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f00f408bcb0 con 0x7f00fc15c670 2024-03-29T04:08:44.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.639+0000 7f00fbfff640 1 --2- 172.21.15.73:0/3996097686 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f00e806c530 0x7f00e806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:44.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.639+0000 7f00fbfff640 1 --2- 172.21.15.73:0/3996097686 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f00e806c530 0x7f00e806e9f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f00ec009aa0 tx=0x7f00ec009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:44.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.643+0000 7f00f8ff9640 1 -- 172.21.15.73:0/3996097686 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f00f4022070 con 0x7f00fc15c670 2024-03-29T04:08:44.799 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.820+0000 7f01028e4640 1 -- 172.21.15.73:0/3996097686 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f00fc145ac0 con 0x7f00fc15c670 2024-03-29T04:08:44.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.821+0000 7f00f8ff9640 1 -- 172.21.15.73:0/3996097686 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16605 (secure 0 0 0) 0x7f00f4059c80 con 0x7f00fc15c670 2024-03-29T04:08:44.801 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:44.801 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"6bff1617-b138-4517-acca-3ecaae3f2bb3","created":"2024-03-29T04:07:47.346864+0000","modified":"2024-03-29T04:08:13.577603+0000","last_up_change":"2024-03-29T04:07:58.507139+0000","last_in_change":"2024-03-29T04:07:49.637816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-29T04:07:59.537301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-29T04:08:09.570906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-29T04:08:10.882349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"925d7de1-14ab-48c0-aebd-7bded108f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6820","nonce":2387335359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6824","nonce":2387335359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6831","nonce":2387335359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6828","nonce":2387335359}]},"public_addr":"172.21.15.73:6820/2387335359","cluster_addr":"172.21.15.73:6824/2387335359","heartbeat_back_addr":"172.21.15.73:6831/2387335359","heartbeat_front_addr":"172.21.15.73:6828/2387335359","state":["exists","up"]},{"osd":1,"uuid":"6b182102-882a-4e0c-99db-0afae5cfb38b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6801","nonce":2431315515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6803","nonce":2431315515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6807","nonce":2431315515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6805","nonce":2431315515}]},"public_addr":"172.21.15.73:6801/2431315515","cluster_addr":"172.21.15.73:6803/2431315515","heartbeat_back_addr":"172.21.15.73:6807/2431315515","heartbeat_front_addr":"172.21.15.73:6805/2431315515","state":["exists","up"]},{"osd":2,"uuid":"8040902e-b0b8-4a21-bf64-ce1c222115ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6809","nonce":407236597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6811","nonce":407236597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6815","nonce":407236597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6813","nonce":407236597}]},"public_addr":"172.21.15.73:6809/407236597","cluster_addr":"172.21.15.73:6811/407236597","heartbeat_back_addr":"172.21.15.73:6815/407236597","heartbeat_front_addr":"172.21.15.73:6813/407236597","state":["exists","up"]},{"osd":3,"uuid":"1bab19ee-3775-4ce1-a4ce-cf7cda3bbbf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6817","nonce":4291100709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6821","nonce":4291100709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6829","nonce":4291100709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6825","nonce":4291100709}]},"public_addr":"172.21.15.73:6817/4291100709","cluster_addr":"172.21.15.73:6821/4291100709","heartbeat_back_addr":"172.21.15.73:6829/4291100709","heartbeat_front_addr":"172.21.15.73:6825/4291100709","state":["exists","up"]},{"osd":4,"uuid":"b0c74337-8fe4-47dc-b3da-2d07591b1f6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6817","nonce":3703256194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6819","nonce":3703256194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6823","nonce":3703256194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6821","nonce":3703256194}]},"public_addr":"172.21.15.142:6817/3703256194","cluster_addr":"172.21.15.142:6819/3703256194","heartbeat_back_addr":"172.21.15.142:6823/3703256194","heartbeat_front_addr":"172.21.15.142:6821/3703256194","state":["exists","up"]},{"osd":5,"uuid":"9ce36410-a29a-42c6-99f4-f95d4afdd7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6825","nonce":4271575803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6827","nonce":4271575803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6831","nonce":4271575803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6829","nonce":4271575803}]},"public_addr":"172.21.15.142:6825/4271575803","cluster_addr":"172.21.15.142:6827/4271575803","heartbeat_back_addr":"172.21.15.142:6831/4271575803","heartbeat_front_addr":"172.21.15.142:6829/4271575803","state":["exists","up"]},{"osd":6,"uuid":"aec4264a-64ac-428e-a860-d2920a304019","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6801","nonce":1772722570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6803","nonce":1772722570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6807","nonce":1772722570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6805","nonce":1772722570}]},"public_addr":"172.21.15.142:6801/1772722570","cluster_addr":"172.21.15.142:6803/1772722570","heartbeat_back_addr":"172.21.15.142:6807/1772722570","heartbeat_front_addr":"172.21.15.142:6805/1772722570","state":["exists","up"]},{"osd":7,"uuid":"fe599052-8e5a-4c7a-91e7-52d1bae24a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6809","nonce":3910589675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6811","nonce":3910589675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6815","nonce":3910589675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6813","nonce":3910589675}]},"public_addr":"172.21.15.142:6809/3910589675","cluster_addr":"172.21.15.142:6811/3910589675","heartbeat_back_addr":"172.21.15.142:6815/3910589675","heartbeat_front_addr":"172.21.15.142:6813/3910589675","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.835096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.587210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.786547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.778004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.843740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.791160+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.837992+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.718722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:08:44.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.823+0000 7f01028e4640 1 -- 172.21.15.73:0/3996097686 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f00e806c530 msgr2=0x7f00e806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:44.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.823+0000 7f01028e4640 1 --2- 172.21.15.73:0/3996097686 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f00e806c530 0x7f00e806e9f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f00ec009aa0 tx=0x7f00ec009190 comp rx=0 tx=0).stop 2024-03-29T04:08:44.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.823+0000 7f01028e4640 1 -- 172.21.15.73:0/3996097686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00fc15c670 msgr2=0x7f00fc1f39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:44.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.823+0000 7f01028e4640 1 --2- 172.21.15.73:0/3996097686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00fc15c670 0x7f00fc1f39d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f00f400ef00 tx=0x7f00f400b480 comp rx=0 tx=0).stop 2024-03-29T04:08:44.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.823+0000 7f01028e4640 1 -- 172.21.15.73:0/3996097686 shutdown_connections 2024-03-29T04:08:44.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.823+0000 7f01028e4640 1 --2- 172.21.15.73:0/3996097686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00fc15c670 0x7f00fc1f39d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:44.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.823+0000 7f01028e4640 1 --2- 172.21.15.73:0/3996097686 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f00e806c530 0x7f00e806e9f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:44.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.823+0000 7f01028e4640 1 --2- 172.21.15.73:0/3996097686 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00fc0ad230 0x7f00fc144440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:44.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.823+0000 7f01028e4640 1 --2- 172.21.15.73:0/3996097686 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f00fc06f060 0x7f00fc072b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:44.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.823+0000 7f01028e4640 1 -- 172.21.15.73:0/3996097686 >> 172.21.15.73:0/3996097686 conn(0x7f00fc06b510 msgr2=0x7f00fc1434f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:44.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.823+0000 7f01028e4640 1 -- 172.21.15.73:0/3996097686 shutdown_connections 2024-03-29T04:08:44.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.823+0000 7f01028e4640 1 -- 172.21.15.73:0/3996097686 wait complete. 2024-03-29T04:08:44.814 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-29T04:07:59.537301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-29T04:08:09.570906+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-29T04:08:10.882349+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-29T04:08:44.814 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-29T04:08:44.917 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.938+0000 7f5d6a81b640 1 Processor -- start 2024-03-29T04:08:44.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.938+0000 7f5d6a81b640 1 -- start start 2024-03-29T04:08:44.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.938+0000 7f5d6a81b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5d640ca950 0x7f5d640b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:44.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.939+0000 7f5d6a81b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d640cade0 con 0x7f5d640b26f0 2024-03-29T04:08:44.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.939+0000 7f5d6a81b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d640c6470 con 0x7f5d6415b3d0 2024-03-29T04:08:44.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.939+0000 7f5d6a81b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f5d640b2b60 con 0x7f5d640ca950 2024-03-29T04:08:44.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.939+0000 7f5d68db8640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f5d640b26f0 0x7f5d6415be50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:46828/0 (socket says 172.21.15.73:46828) 2024-03-29T04:08:44.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.939+0000 7f5d68db8640 1 -- 172.21.15.73:0/3388322623 learned_addr learned my addr 172.21.15.73:0/3388322623 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:44.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.939+0000 7f5d637fe640 1 --2- 172.21.15.73:0/3388322623 >> v2:172.21.15.142:3300/0 conn(0x7f5d640ca950 0x7f5d640b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:44.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.939+0000 7f5d62ffd640 1 -- 172.21.15.73:0/3388322623 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2167183754 0 0) 0x7f5d640cade0 con 0x7f5d640b26f0 2024-03-29T04:08:44.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.939+0000 7f5d62ffd640 1 -- 172.21.15.73:0/3388322623 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d4c003520 con 0x7f5d640b26f0 2024-03-29T04:08:44.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.939+0000 7f5d62ffd640 1 -- 172.21.15.73:0/3388322623 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3104379941 0 0) 0x7f5d640c6470 con 0x7f5d6415b3d0 2024-03-29T04:08:44.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.939+0000 7f5d62ffd640 1 -- 172.21.15.73:0/3388322623 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d640cade0 con 0x7f5d6415b3d0 2024-03-29T04:08:44.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.939+0000 7f5d637fe640 1 -- 172.21.15.73:0/3388322623 >> v1:172.21.15.142:6789/0 conn(0x7f5d6415b3d0 legacy=0x7f5d640b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:44.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.939+0000 7f5d637fe640 1 -- 172.21.15.73:0/3388322623 >> v1:172.21.15.73:6789/0 conn(0x7f5d640b26f0 legacy=0x7f5d6415be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:44.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.939+0000 7f5d637fe640 1 -- 172.21.15.73:0/3388322623 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d640c6750 con 0x7f5d640ca950 2024-03-29T04:08:44.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.940+0000 7f5d637fe640 1 --2- 172.21.15.73:0/3388322623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d640ca950 0x7f5d640b21b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5d540097a0 tx=0x7f5d5402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=798af4153d1353b server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:44.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.940+0000 7f5d62ffd640 1 -- 172.21.15.73:0/3388322623 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d54034070 con 0x7f5d640ca950 2024-03-29T04:08:44.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.940+0000 7f5d62ffd640 1 -- 172.21.15.73:0/3388322623 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d54030610 con 0x7f5d640ca950 2024-03-29T04:08:44.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.940+0000 7f5d62ffd640 1 -- 172.21.15.73:0/3388322623 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d540309e0 con 0x7f5d640ca950 2024-03-29T04:08:44.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.940+0000 7f5d6a81b640 1 -- 172.21.15.73:0/3388322623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d640ca950 msgr2=0x7f5d640b21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:44.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.940+0000 7f5d6a81b640 1 --2- 172.21.15.73:0/3388322623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d640ca950 0x7f5d640b21b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5d540097a0 tx=0x7f5d5402b960 comp rx=0 tx=0).stop 2024-03-29T04:08:44.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.941+0000 7f5d6a81b640 1 -- 172.21.15.73:0/3388322623 shutdown_connections 2024-03-29T04:08:44.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.941+0000 7f5d6a81b640 1 --2- 172.21.15.73:0/3388322623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d640ca950 0x7f5d640b21b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:44.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.941+0000 7f5d6a81b640 1 -- 172.21.15.73:0/3388322623 >> 172.21.15.73:0/3388322623 conn(0x7f5d640d0450 msgr2=0x7f5d640d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:44.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.941+0000 7f5d6a81b640 1 -- 172.21.15.73:0/3388322623 shutdown_connections 2024-03-29T04:08:44.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.941+0000 7f5d6a81b640 1 -- 172.21.15.73:0/3388322623 wait complete. 2024-03-29T04:08:44.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.942+0000 7f5d6a81b640 1 Processor -- start 2024-03-29T04:08:44.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.942+0000 7f5d6a81b640 1 -- start start 2024-03-29T04:08:44.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.942+0000 7f5d6a81b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d640b26f0 0x7f5d641e5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:44.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.942+0000 7f5d6a81b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d640ca950 0x7f5d641f3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:44.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.943+0000 7f5d6a81b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d6415b3d0 0x7f5d64072820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:44.924 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.943+0000 7f5d6a81b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5d640c6d10 con 0x7f5d6415b3d0 2024-03-29T04:08:44.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.943+0000 7f5d6a81b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5d640c7080 con 0x7f5d640ca950 2024-03-29T04:08:44.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.943+0000 7f5d6a81b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f5d640b5100 con 0x7f5d640b26f0 2024-03-29T04:08:44.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.943+0000 7f5d68db8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d6415b3d0 0x7f5d64072820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:44.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.943+0000 7f5d68db8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d6415b3d0 0x7f5d64072820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36486/0 (socket says 172.21.15.73:36486) 2024-03-29T04:08:44.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.943+0000 7f5d68db8640 1 -- 172.21.15.73:0/3595232503 learned_addr learned my addr 172.21.15.73:0/3595232503 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:44.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.943+0000 7f5d63fff640 1 --2- 172.21.15.73:0/3595232503 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d640b26f0 0x7f5d641e5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:44.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.943+0000 7f5d637fe640 1 --2- 172.21.15.73:0/3595232503 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d640ca950 0x7f5d641f3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:44.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.943+0000 7f5d68db8640 1 -- 172.21.15.73:0/3595232503 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d640b26f0 msgr2=0x7f5d641e5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:44.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.943+0000 7f5d68db8640 1 --2- 172.21.15.73:0/3595232503 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d640b26f0 0x7f5d641e5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:44.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.943+0000 7f5d68db8640 1 -- 172.21.15.73:0/3595232503 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d640ca950 msgr2=0x7f5d641f3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:44.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.943+0000 7f5d68db8640 1 --2- 172.21.15.73:0/3595232503 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d640ca950 0x7f5d641f3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:44.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.943+0000 7f5d68db8640 1 -- 172.21.15.73:0/3595232503 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d6414d660 con 0x7f5d6415b3d0 2024-03-29T04:08:44.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.943+0000 7f5d68db8640 1 --2- 172.21.15.73:0/3595232503 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d6415b3d0 0x7f5d64072820 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c00caa0 tx=0x7f5d5c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:44.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.943+0000 7f5d60ff9640 1 -- 172.21.15.73:0/3595232503 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c017070 con 0x7f5d6415b3d0 2024-03-29T04:08:44.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.943+0000 7f5d60ff9640 1 -- 172.21.15.73:0/3595232503 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d5c00ac20 con 0x7f5d6415b3d0 2024-03-29T04:08:44.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.943+0000 7f5d6a81b640 1 -- 172.21.15.73:0/3595232503 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d641e5060 con 0x7f5d6415b3d0 2024-03-29T04:08:44.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.943+0000 7f5d60ff9640 1 -- 172.21.15.73:0/3595232503 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c012400 con 0x7f5d6415b3d0 2024-03-29T04:08:44.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.943+0000 7f5d6a81b640 1 -- 172.21.15.73:0/3595232503 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d641e5620 con 0x7f5d6415b3d0 2024-03-29T04:08:44.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.944+0000 7f5d6a81b640 1 -- 172.21.15.73:0/3595232503 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d6409e520 con 0x7f5d6415b3d0 2024-03-29T04:08:44.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.945+0000 7f5d60ff9640 1 -- 172.21.15.73:0/3595232503 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f5d5c01a070 con 0x7f5d6415b3d0 2024-03-29T04:08:44.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.945+0000 7f5d60ff9640 1 --2- 172.21.15.73:0/3595232503 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f5d5006c530 0x7f5d5006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:44.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.945+0000 7f5d60ff9640 1 -- 172.21.15.73:0/3595232503 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5d5c08b360 con 0x7f5d6415b3d0 2024-03-29T04:08:44.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.945+0000 7f5d63fff640 1 --2- 172.21.15.73:0/3595232503 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f5d5006c530 0x7f5d5006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:44.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.945+0000 7f5d63fff640 1 --2- 172.21.15.73:0/3595232503 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f5d5006c530 0x7f5d5006e9f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5d58007fd0 tx=0x7f5d58009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:44.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:44.949+0000 7f5d60ff9640 1 -- 172.21.15.73:0/3595232503 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f5d5c0593c0 con 0x7f5d6415b3d0 2024-03-29T04:08:45.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.125+0000 7f5d6a81b640 1 -- 172.21.15.73:0/3595232503 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5d6404f9d0 con 0x7f5d6415b3d0 2024-03-29T04:08:45.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.125+0000 7f5d60ff9640 1 -- 172.21.15.73:0/3595232503 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f5d5c05d6c0 con 0x7f5d6415b3d0 2024-03-29T04:08:45.105 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-03-29T04:08:45.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.128+0000 7f5d6a81b640 1 -- 172.21.15.73:0/3595232503 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f5d5006c530 msgr2=0x7f5d5006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:45.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.128+0000 7f5d6a81b640 1 --2- 172.21.15.73:0/3595232503 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f5d5006c530 0x7f5d5006e9f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5d58007fd0 tx=0x7f5d58009040 comp rx=0 tx=0).stop 2024-03-29T04:08:45.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.128+0000 7f5d6a81b640 1 -- 172.21.15.73:0/3595232503 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d6415b3d0 msgr2=0x7f5d64072820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:45.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.128+0000 7f5d6a81b640 1 --2- 172.21.15.73:0/3595232503 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d6415b3d0 0x7f5d64072820 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c00caa0 tx=0x7f5d5c00cf60 comp rx=0 tx=0).stop 2024-03-29T04:08:45.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.128+0000 7f5d6a81b640 1 -- 172.21.15.73:0/3595232503 shutdown_connections 2024-03-29T04:08:45.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.128+0000 7f5d6a81b640 1 --2- 172.21.15.73:0/3595232503 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d6415b3d0 0x7f5d64072820 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:45.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.128+0000 7f5d6a81b640 1 --2- 172.21.15.73:0/3595232503 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f5d5006c530 0x7f5d5006e9f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:45.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.128+0000 7f5d6a81b640 1 --2- 172.21.15.73:0/3595232503 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d640ca950 0x7f5d641f3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:45.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.128+0000 7f5d6a81b640 1 --2- 172.21.15.73:0/3595232503 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5d640b26f0 0x7f5d641e5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:45.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.128+0000 7f5d6a81b640 1 -- 172.21.15.73:0/3595232503 >> 172.21.15.73:0/3595232503 conn(0x7f5d640d0450 msgr2=0x7f5d640d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:45.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.128+0000 7f5d6a81b640 1 -- 172.21.15.73:0/3595232503 shutdown_connections 2024-03-29T04:08:45.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.128+0000 7f5d6a81b640 1 -- 172.21.15.73:0/3595232503 wait complete. 2024-03-29T04:08:45.119 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-29T04:08:45.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.242+0000 7f3fe78d3640 1 Processor -- start 2024-03-29T04:08:45.222 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.242+0000 7f3fe78d3640 1 -- start start 2024-03-29T04:08:45.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.243+0000 7f3fe78d3640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3fe00b6020 0x7f3fe00b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:45.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.243+0000 7f3fe78d3640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fe00b6500 con 0x7f3fe006b510 2024-03-29T04:08:45.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.243+0000 7f3fe78d3640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fe00b4470 con 0x7f3fe015e8b0 2024-03-29T04:08:45.223 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.243+0000 7f3fe78d3640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f3fe00b67e0 con 0x7f3fe00b6020 2024-03-29T04:08:45.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.243+0000 7f3fe4e6e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3fe00b6020 0x7f3fe00b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:45.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.243+0000 7f3fe5e70640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3fe006b510 0x7f3fe00ae320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:46836/0 (socket says 172.21.15.73:46836) 2024-03-29T04:08:45.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.243+0000 7f3fe5e70640 1 -- 172.21.15.73:0/905707085 learned_addr learned my addr 172.21.15.73:0/905707085 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:45.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.244+0000 7f3fe4e6e640 1 -- 172.21.15.73:0/905707085 >> v1:172.21.15.142:6789/0 conn(0x7f3fe015e8b0 legacy=0x7f3fe00b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:45.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.244+0000 7f3fe4e6e640 1 -- 172.21.15.73:0/905707085 >> v1:172.21.15.73:6789/0 conn(0x7f3fe006b510 legacy=0x7f3fe00ae320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:45.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.244+0000 7f3fd7fff640 1 -- 172.21.15.73:0/905707085 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2614347000 0 0) 0x7f3fe00b4470 con 0x7f3fe015e8b0 2024-03-29T04:08:45.224 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.244+0000 7f3fe4e6e640 1 -- 172.21.15.73:0/905707085 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe00b4750 con 0x7f3fe00b6020 2024-03-29T04:08:45.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.244+0000 7f3fe4e6e640 1 --2- 172.21.15.73:0/905707085 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fe00b6020 0x7f3fe00b2a40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3fd00097a0 tx=0x7f3fd002b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a1a3f9d9a25b11b server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:45.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.244+0000 7f3fd7fff640 1 -- 172.21.15.73:0/905707085 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0037070 con 0x7f3fe00b6020 2024-03-29T04:08:45.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.245+0000 7f3fd7fff640 1 -- 172.21.15.73:0/905707085 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fd0030710 con 0x7f3fe00b6020 2024-03-29T04:08:45.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.245+0000 7f3fd7fff640 1 -- 172.21.15.73:0/905707085 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0030ae0 con 0x7f3fe00b6020 2024-03-29T04:08:45.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.245+0000 7f3fe78d3640 1 -- 172.21.15.73:0/905707085 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fe00b6020 msgr2=0x7f3fe00b2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:45.225 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.245+0000 7f3fe78d3640 1 --2- 172.21.15.73:0/905707085 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fe00b6020 0x7f3fe00b2a40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3fd00097a0 tx=0x7f3fd002b710 comp rx=0 tx=0).stop 2024-03-29T04:08:45.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.245+0000 7f3fe78d3640 1 -- 172.21.15.73:0/905707085 shutdown_connections 2024-03-29T04:08:45.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.245+0000 7f3fe78d3640 1 --2- 172.21.15.73:0/905707085 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fe00b6020 0x7f3fe00b2a40 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:45.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.245+0000 7f3fe78d3640 1 -- 172.21.15.73:0/905707085 >> 172.21.15.73:0/905707085 conn(0x7f3fe0072e40 msgr2=0x7f3fe00b3040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:45.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.245+0000 7f3fe78d3640 1 -- 172.21.15.73:0/905707085 shutdown_connections 2024-03-29T04:08:45.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.245+0000 7f3fe78d3640 1 -- 172.21.15.73:0/905707085 wait complete. 2024-03-29T04:08:45.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.246+0000 7f3fe78d3640 1 Processor -- start 2024-03-29T04:08:45.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.246+0000 7f3fe78d3640 1 -- start start 2024-03-29T04:08:45.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.247+0000 7f3fe78d3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3fe006b510 0x7f3fe0145240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:45.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.247+0000 7f3fe78d3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fe00b6020 0x7f3fe0145a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:45.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.247+0000 7f3fe78d3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3fe015e8b0 0x7f3fe0160fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:45.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.247+0000 7f3fe78d3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe006c190 con 0x7f3fe00b6020 2024-03-29T04:08:45.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.247+0000 7f3fe78d3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe00b4b30 con 0x7f3fe006b510 2024-03-29T04:08:45.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.247+0000 7f3fe78d3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f3fe006c310 con 0x7f3fe015e8b0 2024-03-29T04:08:45.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.247+0000 7f3fe4e6e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fe00b6020 0x7f3fe0145a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:45.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.247+0000 7f3fe4e6e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fe00b6020 0x7f3fe0145a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36510/0 (socket says 172.21.15.73:36510) 2024-03-29T04:08:45.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.247+0000 7f3fe4e6e640 1 -- 172.21.15.73:0/4241927569 learned_addr learned my addr 172.21.15.73:0/4241927569 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:45.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.247+0000 7f3fe566f640 1 --2- 172.21.15.73:0/4241927569 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3fe006b510 0x7f3fe0145240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:45.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.247+0000 7f3fe5e70640 1 --2- 172.21.15.73:0/4241927569 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3fe015e8b0 0x7f3fe0160fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:45.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.247+0000 7f3fe4e6e640 1 -- 172.21.15.73:0/4241927569 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3fe015e8b0 msgr2=0x7f3fe0160fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:45.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.247+0000 7f3fe4e6e640 1 --2- 172.21.15.73:0/4241927569 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3fe015e8b0 0x7f3fe0160fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:45.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.247+0000 7f3fe4e6e640 1 -- 172.21.15.73:0/4241927569 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3fe006b510 msgr2=0x7f3fe0145240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:45.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.247+0000 7f3fe4e6e640 1 --2- 172.21.15.73:0/4241927569 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3fe006b510 0x7f3fe0145240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:45.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.247+0000 7f3fe4e6e640 1 -- 172.21.15.73:0/4241927569 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe0145780 con 0x7f3fe00b6020 2024-03-29T04:08:45.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.248+0000 7f3fe4e6e640 1 --2- 172.21.15.73:0/4241927569 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fe00b6020 0x7f3fe0145a80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0000c00 tx=0x7f3fd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:45.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.248+0000 7f3fd5ffb640 1 -- 172.21.15.73:0/4241927569 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0042070 con 0x7f3fe00b6020 2024-03-29T04:08:45.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.248+0000 7f3fd5ffb640 1 -- 172.21.15.73:0/4241927569 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fd0032a40 con 0x7f3fe00b6020 2024-03-29T04:08:45.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.248+0000 7f3fe78d3640 1 -- 172.21.15.73:0/4241927569 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fe01464d0 con 0x7f3fe00b6020 2024-03-29T04:08:45.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.248+0000 7f3fd5ffb640 1 -- 172.21.15.73:0/4241927569 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0037040 con 0x7f3fe00b6020 2024-03-29T04:08:45.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.248+0000 7f3fe78d3640 1 -- 172.21.15.73:0/4241927569 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fe0146a90 con 0x7f3fe00b6020 2024-03-29T04:08:45.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.249+0000 7f3fe78d3640 1 -- 172.21.15.73:0/4241927569 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fe009f6a0 con 0x7f3fe00b6020 2024-03-29T04:08:45.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.249+0000 7f3fd5ffb640 1 -- 172.21.15.73:0/4241927569 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f3fd0045070 con 0x7f3fe00b6020 2024-03-29T04:08:45.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.250+0000 7f3fd5ffb640 1 --2- 172.21.15.73:0/4241927569 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3fc406c560 0x7f3fc406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:45.230 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.250+0000 7f3fe566f640 1 --2- 172.21.15.73:0/4241927569 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3fc406c560 0x7f3fc406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:45.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.250+0000 7f3fd5ffb640 1 -- 172.21.15.73:0/4241927569 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3fd00ad500 con 0x7f3fe00b6020 2024-03-29T04:08:45.231 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.250+0000 7f3fe566f640 1 --2- 172.21.15.73:0/4241927569 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3fc406c560 0x7f3fc406ea20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc000f60 tx=0x7f3fdc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:45.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.254+0000 7f3fd5ffb640 1 -- 172.21.15.73:0/4241927569 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f3fd007b5f0 con 0x7f3fe00b6020 2024-03-29T04:08:45.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.430+0000 7f3fe78d3640 1 -- 172.21.15.73:0/4241927569 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3fe00af440 con 0x7f3fe00b6020 2024-03-29T04:08:45.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.430+0000 7f3fd5ffb640 1 -- 172.21.15.73:0/4241927569 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f3fd007f8f0 con 0x7f3fe00b6020 2024-03-29T04:08:45.410 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-03-29T04:08:45.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.432+0000 7f3fe78d3640 1 -- 172.21.15.73:0/4241927569 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3fc406c560 msgr2=0x7f3fc406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:45.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.432+0000 7f3fe78d3640 1 --2- 172.21.15.73:0/4241927569 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3fc406c560 0x7f3fc406ea20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc000f60 tx=0x7f3fdc009040 comp rx=0 tx=0).stop 2024-03-29T04:08:45.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.432+0000 7f3fe78d3640 1 -- 172.21.15.73:0/4241927569 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fe00b6020 msgr2=0x7f3fe0145a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:45.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.432+0000 7f3fe78d3640 1 --2- 172.21.15.73:0/4241927569 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fe00b6020 0x7f3fe0145a80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0000c00 tx=0x7f3fd00046c0 comp rx=0 tx=0).stop 2024-03-29T04:08:45.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.432+0000 7f3fe78d3640 1 -- 172.21.15.73:0/4241927569 shutdown_connections 2024-03-29T04:08:45.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.432+0000 7f3fe78d3640 1 --2- 172.21.15.73:0/4241927569 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3fe015e8b0 0x7f3fe0160fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:45.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.432+0000 7f3fe78d3640 1 --2- 172.21.15.73:0/4241927569 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fe00b6020 0x7f3fe0145a80 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:45.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.432+0000 7f3fe78d3640 1 --2- 172.21.15.73:0/4241927569 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3fc406c560 0x7f3fc406ea20 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:45.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.432+0000 7f3fe78d3640 1 --2- 172.21.15.73:0/4241927569 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3fe006b510 0x7f3fe0145240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:45.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.432+0000 7f3fe78d3640 1 -- 172.21.15.73:0/4241927569 >> 172.21.15.73:0/4241927569 conn(0x7f3fe0072e40 msgr2=0x7f3fe00afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:45.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.432+0000 7f3fe78d3640 1 -- 172.21.15.73:0/4241927569 shutdown_connections 2024-03-29T04:08:45.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.432+0000 7f3fe78d3640 1 -- 172.21.15.73:0/4241927569 wait complete. 2024-03-29T04:08:45.423 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-29T04:08:45.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.546+0000 7f2f1ad90640 1 Processor -- start 2024-03-29T04:08:45.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.546+0000 7f2f1ad90640 1 -- start start 2024-03-29T04:08:45.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.547+0000 7f2f1ad90640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f1415e8b0 0x7f2f140b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:45.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.547+0000 7f2f1ad90640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2f1406b510 0x7f2f1406b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:45.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.547+0000 7f2f1ad90640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f140b6500 con 0x7f2f140b6020 2024-03-29T04:08:45.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.547+0000 7f2f1ad90640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f2f140b67e0 con 0x7f2f1406b510 2024-03-29T04:08:45.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.547+0000 7f2f1ad90640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2f140b4470 con 0x7f2f1415e8b0 2024-03-29T04:08:45.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.547+0000 7f2f1932d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2f1406b510 0x7f2f1406b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:45.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.547+0000 7f2f13fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2f140b6020 0x7f2f140b2140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:46850/0 (socket says 172.21.15.73:46850) 2024-03-29T04:08:45.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.547+0000 7f2f1932d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2f1406b510 0x7f2f1406b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36520/0 (socket says 172.21.15.73:36520) 2024-03-29T04:08:45.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.547+0000 7f2f13fff640 1 -- 172.21.15.73:0/2424641639 learned_addr learned my addr 172.21.15.73:0/2424641639 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:45.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.547+0000 7f2f18b2c640 1 --2- 172.21.15.73:0/2424641639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f1415e8b0 0x7f2f140b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:45.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.547+0000 7f2f1932d640 1 -- 172.21.15.73:0/2424641639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f1415e8b0 msgr2=0x7f2f140b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:45.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.547+0000 7f2f1932d640 1 --2- 172.21.15.73:0/2424641639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f1415e8b0 0x7f2f140b2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:45.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.547+0000 7f2f1932d640 1 -- 172.21.15.73:0/2424641639 >> v1:172.21.15.73:6789/0 conn(0x7f2f140b6020 legacy=0x7f2f140b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:45.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.547+0000 7f2f1932d640 1 -- 172.21.15.73:0/2424641639 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f140b4750 con 0x7f2f1406b510 2024-03-29T04:08:45.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.547+0000 7f2f137fe640 1 -- 172.21.15.73:0/2424641639 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3419622778 0 0) 0x7f2f140b6500 con 0x7f2f140b6020 2024-03-29T04:08:45.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.548+0000 7f2f1932d640 1 --2- 172.21.15.73:0/2424641639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f1406b510 0x7f2f1406b9c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c009d90 tx=0x7f2f0c02be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e224740c084ad1 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:45.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.548+0000 7f2f137fe640 1 -- 172.21.15.73:0/2424641639 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c039070 con 0x7f2f1406b510 2024-03-29T04:08:45.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.548+0000 7f2f137fe640 1 -- 172.21.15.73:0/2424641639 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f0c02cbc0 con 0x7f2f1406b510 2024-03-29T04:08:45.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.548+0000 7f2f137fe640 1 -- 172.21.15.73:0/2424641639 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c034440 con 0x7f2f1406b510 2024-03-29T04:08:45.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.549+0000 7f2f1ad90640 1 -- 172.21.15.73:0/2424641639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f1406b510 msgr2=0x7f2f1406b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:45.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.549+0000 7f2f1ad90640 1 --2- 172.21.15.73:0/2424641639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f1406b510 0x7f2f1406b9c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c009d90 tx=0x7f2f0c02be10 comp rx=0 tx=0).stop 2024-03-29T04:08:45.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.549+0000 7f2f1ad90640 1 -- 172.21.15.73:0/2424641639 shutdown_connections 2024-03-29T04:08:45.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.549+0000 7f2f1ad90640 1 --2- 172.21.15.73:0/2424641639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f1406b510 0x7f2f1406b9c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:45.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.549+0000 7f2f1ad90640 1 --2- 172.21.15.73:0/2424641639 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f1415e8b0 0x7f2f140b2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:45.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.549+0000 7f2f1ad90640 1 -- 172.21.15.73:0/2424641639 >> 172.21.15.73:0/2424641639 conn(0x7f2f14072e40 msgr2=0x7f2f140b3040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:45.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.549+0000 7f2f1ad90640 1 -- 172.21.15.73:0/2424641639 shutdown_connections 2024-03-29T04:08:45.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.549+0000 7f2f1ad90640 1 -- 172.21.15.73:0/2424641639 wait complete. 2024-03-29T04:08:45.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.550+0000 7f2f1ad90640 1 Processor -- start 2024-03-29T04:08:45.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.550+0000 7f2f1ad90640 1 -- start start 2024-03-29T04:08:45.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.551+0000 7f2f1ad90640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f1406b510 0x7f2f140b3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:45.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.551+0000 7f2f1ad90640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f140b6020 0x7f2f14146970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:45.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.551+0000 7f2f1ad90640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f1415e8b0 0x7f2f14146eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:45.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.551+0000 7f2f1ad90640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1406c190 con 0x7f2f1406b510 2024-03-29T04:08:45.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.551+0000 7f2f1ad90640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2f140b4b30 con 0x7f2f140b6020 2024-03-29T04:08:45.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.551+0000 7f2f1ad90640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2f1406c310 con 0x7f2f1415e8b0 2024-03-29T04:08:45.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.551+0000 7f2f18b2c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f1406b510 0x7f2f140b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:45.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.551+0000 7f2f18b2c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f1406b510 0x7f2f140b3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36530/0 (socket says 172.21.15.73:36530) 2024-03-29T04:08:45.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.551+0000 7f2f18b2c640 1 -- 172.21.15.73:0/1191533863 learned_addr learned my addr 172.21.15.73:0/1191533863 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:45.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.551+0000 7f2f1932d640 1 --2- 172.21.15.73:0/1191533863 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f1415e8b0 0x7f2f14146eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:45.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.551+0000 7f2f13fff640 1 --2- 172.21.15.73:0/1191533863 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f140b6020 0x7f2f14146970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:45.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.551+0000 7f2f18b2c640 1 -- 172.21.15.73:0/1191533863 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f1415e8b0 msgr2=0x7f2f14146eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:45.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.551+0000 7f2f18b2c640 1 --2- 172.21.15.73:0/1191533863 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f1415e8b0 0x7f2f14146eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:45.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.551+0000 7f2f18b2c640 1 -- 172.21.15.73:0/1191533863 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f140b6020 msgr2=0x7f2f14146970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:45.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.551+0000 7f2f18b2c640 1 --2- 172.21.15.73:0/1191533863 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f140b6020 0x7f2f14146970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:45.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.551+0000 7f2f18b2c640 1 -- 172.21.15.73:0/1191533863 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f1409c620 con 0x7f2f1406b510 2024-03-29T04:08:45.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.552+0000 7f2f18b2c640 1 --2- 172.21.15.73:0/1191533863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f1406b510 0x7f2f140b3280 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2f0400e8a0 tx=0x7f2f0400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:45.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.552+0000 7f2f117fa640 1 -- 172.21.15.73:0/1191533863 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f04017070 con 0x7f2f1406b510 2024-03-29T04:08:45.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.552+0000 7f2f117fa640 1 -- 172.21.15.73:0/1191533863 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f0400c940 con 0x7f2f1406b510 2024-03-29T04:08:45.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.552+0000 7f2f1ad90640 1 -- 172.21.15.73:0/1191533863 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f1409c900 con 0x7f2f1406b510 2024-03-29T04:08:45.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.552+0000 7f2f117fa640 1 -- 172.21.15.73:0/1191533863 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0400cd30 con 0x7f2f1406b510 2024-03-29T04:08:45.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.552+0000 7f2f1ad90640 1 -- 172.21.15.73:0/1191533863 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f1409cec0 con 0x7f2f1406b510 2024-03-29T04:08:45.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.553+0000 7f2f1ad90640 1 -- 172.21.15.73:0/1191533863 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f1409f6a0 con 0x7f2f1406b510 2024-03-29T04:08:45.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.553+0000 7f2f117fa640 1 -- 172.21.15.73:0/1191533863 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f2f0401a070 con 0x7f2f1406b510 2024-03-29T04:08:45.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.553+0000 7f2f117fa640 1 --2- 172.21.15.73:0/1191533863 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2f0006c530 0x7f2f0006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:45.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.554+0000 7f2f117fa640 1 -- 172.21.15.73:0/1191533863 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2f0408b8a0 con 0x7f2f1406b510 2024-03-29T04:08:45.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.554+0000 7f2f13fff640 1 --2- 172.21.15.73:0/1191533863 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2f0006c530 0x7f2f0006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:45.536 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.554+0000 7f2f13fff640 1 --2- 172.21.15.73:0/1191533863 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2f0006c530 0x7f2f0006e9f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2f08007f70 tx=0x7f2f08007f00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:45.537 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.558+0000 7f2f117fa640 1 -- 172.21.15.73:0/1191533863 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f2f040597f0 con 0x7f2f1406b510 2024-03-29T04:08:45.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.734+0000 7f2f1ad90640 1 -- 172.21.15.73:0/1191533863 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2f1415e0b0 con 0x7f2f1406b510 2024-03-29T04:08:45.714 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.735+0000 7f2f117fa640 1 -- 172.21.15.73:0/1191533863 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f2f0405daf0 con 0x7f2f1406b510 2024-03-29T04:08:45.715 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-29T04:08:45.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.737+0000 7f2f1ad90640 1 -- 172.21.15.73:0/1191533863 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2f0006c530 msgr2=0x7f2f0006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:45.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.737+0000 7f2f1ad90640 1 --2- 172.21.15.73:0/1191533863 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2f0006c530 0x7f2f0006e9f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2f08007f70 tx=0x7f2f08007f00 comp rx=0 tx=0).stop 2024-03-29T04:08:45.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.737+0000 7f2f1ad90640 1 -- 172.21.15.73:0/1191533863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f1406b510 msgr2=0x7f2f140b3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:45.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.737+0000 7f2f1ad90640 1 --2- 172.21.15.73:0/1191533863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f1406b510 0x7f2f140b3280 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2f0400e8a0 tx=0x7f2f0400ed60 comp rx=0 tx=0).stop 2024-03-29T04:08:45.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.737+0000 7f2f1ad90640 1 -- 172.21.15.73:0/1191533863 shutdown_connections 2024-03-29T04:08:45.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.737+0000 7f2f1ad90640 1 --2- 172.21.15.73:0/1191533863 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2f1415e8b0 0x7f2f14146eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:45.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.737+0000 7f2f1ad90640 1 --2- 172.21.15.73:0/1191533863 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2f0006c530 0x7f2f0006e9f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:45.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.737+0000 7f2f1ad90640 1 --2- 172.21.15.73:0/1191533863 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f140b6020 0x7f2f14146970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:45.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.737+0000 7f2f1ad90640 1 --2- 172.21.15.73:0/1191533863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f1406b510 0x7f2f140b3280 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:45.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.737+0000 7f2f1ad90640 1 -- 172.21.15.73:0/1191533863 >> 172.21.15.73:0/1191533863 conn(0x7f2f14072e40 msgr2=0x7f2f1406b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:45.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.737+0000 7f2f1ad90640 1 -- 172.21.15.73:0/1191533863 shutdown_connections 2024-03-29T04:08:45.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.737+0000 7f2f1ad90640 1 -- 172.21.15.73:0/1191533863 wait complete. 2024-03-29T04:08:45.727 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-29T04:08:45.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.849+0000 7f070ea1b640 1 Processor -- start 2024-03-29T04:08:45.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.849+0000 7f070ea1b640 1 -- start start 2024-03-29T04:08:45.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.850+0000 7f070ea1b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f070815fca0 0x7f07080b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:45.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.850+0000 7f070ea1b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f070809b440 0x7f07080d0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:45.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.850+0000 7f070ea1b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f07080b12e0 0x7f07080d0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:45.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.850+0000 7f070ea1b640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f07080cd6c0 con 0x7f070815fca0 2024-03-29T04:08:45.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.850+0000 7f070ea1b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f070809b900 con 0x7f07080b12e0 2024-03-29T04:08:45.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.850+0000 7f070ea1b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f070809bbe0 con 0x7f070809b440 2024-03-29T04:08:45.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.850+0000 7f0707fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f070815fca0 0x7f07080b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:45.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.850+0000 7f0707fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f070815fca0 0x7f07080b1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36538/0 (socket says 172.21.15.73:36538) 2024-03-29T04:08:45.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.850+0000 7f0707fff640 1 -- 172.21.15.73:0/871551036 learned_addr learned my addr 172.21.15.73:0/871551036 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:45.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.850+0000 7f070cfb8640 1 --2- 172.21.15.73:0/871551036 >> v2:172.21.15.142:3300/0 conn(0x7f07080b12e0 0x7f07080d0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:45.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.850+0000 7f07077fe640 1 --2- 172.21.15.73:0/871551036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f070809b440 0x7f07080d0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:45.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.851+0000 7f0707fff640 1 -- 172.21.15.73:0/871551036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f070809b440 msgr2=0x7f07080d0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:45.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.851+0000 7f0707fff640 1 --2- 172.21.15.73:0/871551036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f070809b440 0x7f07080d0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:45.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.851+0000 7f0707fff640 1 -- 172.21.15.73:0/871551036 >> v2:172.21.15.142:3300/0 conn(0x7f07080b12e0 msgr2=0x7f07080d0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:45.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.851+0000 7f0707fff640 1 --2- 172.21.15.73:0/871551036 >> v2:172.21.15.142:3300/0 conn(0x7f07080b12e0 0x7f07080d0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:45.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.851+0000 7f0707fff640 1 -- 172.21.15.73:0/871551036 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07080cd350 con 0x7f070815fca0 2024-03-29T04:08:45.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.851+0000 7f0707fff640 1 --2- 172.21.15.73:0/871551036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f070815fca0 0x7f07080b1d70 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f070806c3f0 tx=0x7f06f802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62d7a103e9bb0324 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:45.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.852+0000 7f0706ffd640 1 -- 172.21.15.73:0/871551036 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8035020 con 0x7f070815fca0 2024-03-29T04:08:45.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.852+0000 7f0706ffd640 1 -- 172.21.15.73:0/871551036 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06f8031870 con 0x7f070815fca0 2024-03-29T04:08:45.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.852+0000 7f0706ffd640 1 -- 172.21.15.73:0/871551036 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8031c40 con 0x7f070815fca0 2024-03-29T04:08:45.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.852+0000 7f070ea1b640 1 -- 172.21.15.73:0/871551036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f070815fca0 msgr2=0x7f07080b1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:45.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.852+0000 7f070ea1b640 1 --2- 172.21.15.73:0/871551036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f070815fca0 0x7f07080b1d70 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f070806c3f0 tx=0x7f06f802b910 comp rx=0 tx=0).stop 2024-03-29T04:08:45.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.852+0000 7f070ea1b640 1 -- 172.21.15.73:0/871551036 shutdown_connections 2024-03-29T04:08:45.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.852+0000 7f070ea1b640 1 --2- 172.21.15.73:0/871551036 >> v2:172.21.15.142:3300/0 conn(0x7f07080b12e0 0x7f07080d0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:45.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.852+0000 7f070ea1b640 1 --2- 172.21.15.73:0/871551036 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f070809b440 0x7f07080d0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:45.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.852+0000 7f070ea1b640 1 --2- 172.21.15.73:0/871551036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f070815fca0 0x7f07080b1d70 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:45.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.852+0000 7f070ea1b640 1 -- 172.21.15.73:0/871551036 >> 172.21.15.73:0/871551036 conn(0x7f07080b3f00 msgr2=0x7f07080b4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:45.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.852+0000 7f070ea1b640 1 -- 172.21.15.73:0/871551036 shutdown_connections 2024-03-29T04:08:45.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.852+0000 7f070ea1b640 1 -- 172.21.15.73:0/871551036 wait complete. 2024-03-29T04:08:45.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.853+0000 7f070ea1b640 1 Processor -- start 2024-03-29T04:08:45.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.853+0000 7f070ea1b640 1 -- start start 2024-03-29T04:08:45.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.854+0000 7f070ea1b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f070809b440 0x7f07080c6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:45.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.854+0000 7f070ea1b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07080b12e0 0x7f0708159a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:45.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.854+0000 7f070ea1b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f070815fca0 0x7f070806e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:45.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.854+0000 7f070ea1b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f07080b4ca0 con 0x7f070809b440 2024-03-29T04:08:45.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.854+0000 7f070ea1b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f07080b22b0 con 0x7f07080b12e0 2024-03-29T04:08:45.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.854+0000 7f070ea1b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f07080b4e20 con 0x7f070815fca0 2024-03-29T04:08:45.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.854+0000 7f0707fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f070809b440 0x7f07080c6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:45.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.854+0000 7f0707fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f070809b440 0x7f07080c6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36544/0 (socket says 172.21.15.73:36544) 2024-03-29T04:08:45.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.854+0000 7f0707fff640 1 -- 172.21.15.73:0/1739766242 learned_addr learned my addr 172.21.15.73:0/1739766242 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:45.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.854+0000 7f070cfb8640 1 --2- 172.21.15.73:0/1739766242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f070815fca0 0x7f070806e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:45.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.854+0000 7f07077fe640 1 --2- 172.21.15.73:0/1739766242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07080b12e0 0x7f0708159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:45.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.855+0000 7f0707fff640 1 -- 172.21.15.73:0/1739766242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f070815fca0 msgr2=0x7f070806e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:45.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.855+0000 7f0707fff640 1 --2- 172.21.15.73:0/1739766242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f070815fca0 0x7f070806e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:45.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.855+0000 7f0707fff640 1 -- 172.21.15.73:0/1739766242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07080b12e0 msgr2=0x7f0708159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:45.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.855+0000 7f0707fff640 1 --2- 172.21.15.73:0/1739766242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07080b12e0 0x7f0708159a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:45.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.855+0000 7f0707fff640 1 -- 172.21.15.73:0/1739766242 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07080c7650 con 0x7f070809b440 2024-03-29T04:08:45.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.855+0000 7f07077fe640 1 --2- 172.21.15.73:0/1739766242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07080b12e0 0x7f0708159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:08:45.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.855+0000 7f0707fff640 1 --2- 172.21.15.73:0/1739766242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f070809b440 0x7f07080c6f90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f06f802b950 tx=0x7f06f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:45.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.855+0000 7f0704ff9640 1 -- 172.21.15.73:0/1739766242 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8040070 con 0x7f070809b440 2024-03-29T04:08:45.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.855+0000 7f0704ff9640 1 -- 172.21.15.73:0/1739766242 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06f8031e10 con 0x7f070809b440 2024-03-29T04:08:45.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.855+0000 7f070ea1b640 1 -- 172.21.15.73:0/1739766242 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07080c7930 con 0x7f070809b440 2024-03-29T04:08:45.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.855+0000 7f0704ff9640 1 -- 172.21.15.73:0/1739766242 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8035040 con 0x7f070809b440 2024-03-29T04:08:45.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.855+0000 7f070ea1b640 1 -- 172.21.15.73:0/1739766242 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07080c7ef0 con 0x7f070809b440 2024-03-29T04:08:45.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.856+0000 7f070ea1b640 1 -- 172.21.15.73:0/1739766242 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07080b47a0 con 0x7f070809b440 2024-03-29T04:08:45.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.856+0000 7f0704ff9640 1 -- 172.21.15.73:0/1739766242 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f06f804b060 con 0x7f070809b440 2024-03-29T04:08:45.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.857+0000 7f0704ff9640 1 --2- 172.21.15.73:0/1739766242 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f06f406c530 0x7f06f406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:45.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.857+0000 7f0704ff9640 1 -- 172.21.15.73:0/1739766242 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f06f80ad300 con 0x7f070809b440 2024-03-29T04:08:45.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.857+0000 7f07077fe640 1 --2- 172.21.15.73:0/1739766242 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f06f406c530 0x7f06f406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:45.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.857+0000 7f07077fe640 1 --2- 172.21.15.73:0/1739766242 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f06f406c530 0x7f06f406e9f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0708071610 tx=0x7f06fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:45.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:45.861+0000 7f0704ff9640 1 -- 172.21.15.73:0/1739766242 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f07080b47a0 con 0x7f070809b440 2024-03-29T04:08:46.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.047+0000 7f070ea1b640 1 -- 172.21.15.73:0/1739766242 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0708068640 con 0x7f070809b440 2024-03-29T04:08:46.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.047+0000 7f0704ff9640 1 -- 172.21.15.73:0/1739766242 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f06f807b890 con 0x7f070809b440 2024-03-29T04:08:46.027 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-03-29T04:08:46.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.049+0000 7f070ea1b640 1 -- 172.21.15.73:0/1739766242 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f06f406c530 msgr2=0x7f06f406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:46.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.049+0000 7f070ea1b640 1 --2- 172.21.15.73:0/1739766242 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f06f406c530 0x7f06f406e9f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0708071610 tx=0x7f06fc008040 comp rx=0 tx=0).stop 2024-03-29T04:08:46.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.049+0000 7f070ea1b640 1 -- 172.21.15.73:0/1739766242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f070809b440 msgr2=0x7f07080c6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:46.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.049+0000 7f070ea1b640 1 --2- 172.21.15.73:0/1739766242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f070809b440 0x7f07080c6f90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f06f802b950 tx=0x7f06f80046c0 comp rx=0 tx=0).stop 2024-03-29T04:08:46.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.049+0000 7f070ea1b640 1 -- 172.21.15.73:0/1739766242 shutdown_connections 2024-03-29T04:08:46.029 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.049+0000 7f070ea1b640 1 --2- 172.21.15.73:0/1739766242 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f070815fca0 0x7f070806e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:46.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.049+0000 7f070ea1b640 1 --2- 172.21.15.73:0/1739766242 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f06f406c530 0x7f06f406e9f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:46.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.049+0000 7f070ea1b640 1 --2- 172.21.15.73:0/1739766242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f07080b12e0 0x7f0708159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:46.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.049+0000 7f070ea1b640 1 --2- 172.21.15.73:0/1739766242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f070809b440 0x7f07080c6f90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:46.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.049+0000 7f070ea1b640 1 -- 172.21.15.73:0/1739766242 >> 172.21.15.73:0/1739766242 conn(0x7f07080b3f00 msgr2=0x7f070815edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:46.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.049+0000 7f070ea1b640 1 -- 172.21.15.73:0/1739766242 shutdown_connections 2024-03-29T04:08:46.030 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.049+0000 7f070ea1b640 1 -- 172.21.15.73:0/1739766242 wait complete. 2024-03-29T04:08:46.040 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-03-29T04:08:46.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:46.040 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-03-29T04:08:46.068 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2024-03-29T04:08:46.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:08:46.069 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-03-29T04:08:46.125 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-03-29T04:08:46.125 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-29T04:08:46.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.246+0000 7eff36214640 1 Processor -- start 2024-03-29T04:08:46.226 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.246+0000 7eff36214640 1 -- start start 2024-03-29T04:08:46.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.247+0000 7eff36214640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff300affc0 0x7eff3015cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:46.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.247+0000 7eff36214640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff30146260 con 0x7eff30145e80 2024-03-29T04:08:46.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.247+0000 7eff36214640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff300b0450 con 0x7eff3006b510 2024-03-29T04:08:46.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.247+0000 7eff36214640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7eff300b0730 con 0x7eff300affc0 2024-03-29T04:08:46.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.247+0000 7eff2f7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7eff30145e80 0x7eff300af8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:46852/0 (socket says 172.21.15.73:46852) 2024-03-29T04:08:46.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.247+0000 7eff2f7fe640 1 -- 172.21.15.73:0/2104296498 learned_addr learned my addr 172.21.15.73:0/2104296498 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:46.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.247+0000 7eff2effd640 1 --2- 172.21.15.73:0/2104296498 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff300affc0 0x7eff3015cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:46.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.247+0000 7eff2e7fc640 1 -- 172.21.15.73:0/2104296498 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 707582056 0 0) 0x7eff30146260 con 0x7eff30145e80 2024-03-29T04:08:46.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.247+0000 7eff2e7fc640 1 -- 172.21.15.73:0/2104296498 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff18003520 con 0x7eff30145e80 2024-03-29T04:08:46.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.247+0000 7eff2e7fc640 1 -- 172.21.15.73:0/2104296498 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1891125913 0 0) 0x7eff300b0450 con 0x7eff3006b510 2024-03-29T04:08:46.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.247+0000 7eff2e7fc640 1 -- 172.21.15.73:0/2104296498 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff30146260 con 0x7eff3006b510 2024-03-29T04:08:46.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.247+0000 7eff2e7fc640 1 -- 172.21.15.73:0/2104296498 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1423396277 0 0) 0x7eff18003520 con 0x7eff30145e80 2024-03-29T04:08:46.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.247+0000 7eff2effd640 1 -- 172.21.15.73:0/2104296498 >> v1:172.21.15.142:6789/0 conn(0x7eff3006b510 legacy=0x7eff300b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:46.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.247+0000 7eff2effd640 1 -- 172.21.15.73:0/2104296498 >> v1:172.21.15.73:6789/0 conn(0x7eff30145e80 legacy=0x7eff300af8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:46.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.247+0000 7eff2effd640 1 -- 172.21.15.73:0/2104296498 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff300b0a10 con 0x7eff300affc0 2024-03-29T04:08:46.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.248+0000 7eff2effd640 1 --2- 172.21.15.73:0/2104296498 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff300affc0 0x7eff3015cc70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7eff240097d0 tx=0x7eff2402b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea6cae75e0b492b5 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:46.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.248+0000 7eff2e7fc640 1 -- 172.21.15.73:0/2104296498 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff24037070 con 0x7eff300affc0 2024-03-29T04:08:46.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.248+0000 7eff2e7fc640 1 -- 172.21.15.73:0/2104296498 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff24030510 con 0x7eff300affc0 2024-03-29T04:08:46.229 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.248+0000 7eff2e7fc640 1 -- 172.21.15.73:0/2104296498 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff20001670 con 0x7eff300affc0 2024-03-29T04:08:46.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.249+0000 7eff36214640 1 -- 172.21.15.73:0/2104296498 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff300affc0 msgr2=0x7eff3015cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:46.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.249+0000 7eff36214640 1 --2- 172.21.15.73:0/2104296498 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff300affc0 0x7eff3015cc70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7eff240097d0 tx=0x7eff2402b800 comp rx=0 tx=0).stop 2024-03-29T04:08:46.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.249+0000 7eff36214640 1 -- 172.21.15.73:0/2104296498 shutdown_connections 2024-03-29T04:08:46.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.249+0000 7eff36214640 1 --2- 172.21.15.73:0/2104296498 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff300affc0 0x7eff3015cc70 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:46.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.249+0000 7eff36214640 1 -- 172.21.15.73:0/2104296498 >> 172.21.15.73:0/2104296498 conn(0x7eff300b66f0 msgr2=0x7eff300b6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:46.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.249+0000 7eff36214640 1 -- 172.21.15.73:0/2104296498 shutdown_connections 2024-03-29T04:08:46.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.249+0000 7eff36214640 1 -- 172.21.15.73:0/2104296498 wait complete. 2024-03-29T04:08:46.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.250+0000 7eff36214640 1 Processor -- start 2024-03-29T04:08:46.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.250+0000 7eff36214640 1 -- start start 2024-03-29T04:08:46.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.251+0000 7eff36214640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff3006b510 0x7eff300b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:46.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.251+0000 7eff36214640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff30145e80 0x7eff301f7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:46.232 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.251+0000 7eff36214640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff3015d680 0x7eff30140e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:46.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.251+0000 7eff36214640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7eff3006c270 con 0x7eff30145e80 2024-03-29T04:08:46.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.251+0000 7eff36214640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7eff300b0fd0 con 0x7eff3006b510 2024-03-29T04:08:46.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.251+0000 7eff36214640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7eff3006b960 con 0x7eff3015d680 2024-03-29T04:08:46.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.251+0000 7eff2effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff30145e80 0x7eff301f7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:46.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.251+0000 7eff2effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff30145e80 0x7eff301f7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36552/0 (socket says 172.21.15.73:36552) 2024-03-29T04:08:46.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.251+0000 7eff2effd640 1 -- 172.21.15.73:0/1689415905 learned_addr learned my addr 172.21.15.73:0/1689415905 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:46.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.251+0000 7eff2f7fe640 1 --2- 172.21.15.73:0/1689415905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff3006b510 0x7eff300b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:46.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.251+0000 7eff2ffff640 1 --2- 172.21.15.73:0/1689415905 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff3015d680 0x7eff30140e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:46.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.251+0000 7eff2effd640 1 -- 172.21.15.73:0/1689415905 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff3015d680 msgr2=0x7eff30140e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:46.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.251+0000 7eff2effd640 1 --2- 172.21.15.73:0/1689415905 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff3015d680 0x7eff30140e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:46.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.251+0000 7eff2effd640 1 -- 172.21.15.73:0/1689415905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff3006b510 msgr2=0x7eff300b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:46.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.251+0000 7eff2effd640 1 --2- 172.21.15.73:0/1689415905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff3006b510 0x7eff300b42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:46.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.251+0000 7eff2effd640 1 -- 172.21.15.73:0/1689415905 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff300b4810 con 0x7eff30145e80 2024-03-29T04:08:46.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.252+0000 7eff2effd640 1 --2- 172.21.15.73:0/1689415905 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff30145e80 0x7eff301f7740 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7eff2402b840 tx=0x7eff240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:46.233 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.252+0000 7eff17fff640 1 -- 172.21.15.73:0/1689415905 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff24041020 con 0x7eff30145e80 2024-03-29T04:08:46.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.252+0000 7eff17fff640 1 -- 172.21.15.73:0/1689415905 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff2403c870 con 0x7eff30145e80 2024-03-29T04:08:46.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.252+0000 7eff36214640 1 -- 172.21.15.73:0/1689415905 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff301f7c80 con 0x7eff30145e80 2024-03-29T04:08:46.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.252+0000 7eff17fff640 1 -- 172.21.15.73:0/1689415905 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff24037040 con 0x7eff30145e80 2024-03-29T04:08:46.234 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.252+0000 7eff36214640 1 -- 172.21.15.73:0/1689415905 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff3009dc00 con 0x7eff30145e80 2024-03-29T04:08:46.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.253+0000 7eff36214640 1 -- 172.21.15.73:0/1689415905 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff30068830 con 0x7eff30145e80 2024-03-29T04:08:46.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.253+0000 7eff17fff640 1 -- 172.21.15.73:0/1689415905 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7eff24044020 con 0x7eff30145e80 2024-03-29T04:08:46.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.253+0000 7eff17fff640 1 --2- 172.21.15.73:0/1689415905 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7eff1c06c530 0x7eff1c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:46.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.254+0000 7eff17fff640 1 -- 172.21.15.73:0/1689415905 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7eff240ad080 con 0x7eff30145e80 2024-03-29T04:08:46.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.254+0000 7eff2f7fe640 1 --2- 172.21.15.73:0/1689415905 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7eff1c06c530 0x7eff1c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:46.235 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.254+0000 7eff2f7fe640 1 --2- 172.21.15.73:0/1689415905 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7eff1c06c530 0x7eff1c06e9f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7eff20000fd0 tx=0x7eff20001150 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:46.237 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.258+0000 7eff17fff640 1 -- 172.21.15.73:0/1689415905 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7eff30068830 con 0x7eff30145e80 2024-03-29T04:08:46.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.469+0000 7eff36214640 1 -- 172.21.15.73:0/1689415905 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7eff30071e70 con 0x7eff30145e80 2024-03-29T04:08:46.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.469+0000 7eff17fff640 1 -- 172.21.15.73:0/1689415905 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5178 (secure 0 0 0) 0x7eff30071e70 con 0x7eff30145e80 2024-03-29T04:08:46.449 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:46.449 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2101608781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2101608781},{"type":"v1","addr":"172.21.15.142:6834","nonce":2101608781}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3626787216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":3626787216},{"type":"v1","addr":"172.21.15.73:6837","nonce":3626787216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1987252283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1987252283},{"type":"v1","addr":"172.21.15.73:6836","nonce":1987252283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-29T04:08:11.922090+0000","modified":"2024-03-29T04:08:13.918938+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6835/569863112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":569863112},{"type":"v1","addr":"172.21.15.142:6835","nonce":569863112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-03-29T04:08:46.450 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 6 2024-03-29T04:08:46.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.471+0000 7eff36214640 1 -- 172.21.15.73:0/1689415905 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7eff1c06c530 msgr2=0x7eff1c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:46.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.471+0000 7eff36214640 1 --2- 172.21.15.73:0/1689415905 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7eff1c06c530 0x7eff1c06e9f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7eff20000fd0 tx=0x7eff20001150 comp rx=0 tx=0).stop 2024-03-29T04:08:46.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.471+0000 7eff36214640 1 -- 172.21.15.73:0/1689415905 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff30145e80 msgr2=0x7eff301f7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:46.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.471+0000 7eff36214640 1 --2- 172.21.15.73:0/1689415905 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff30145e80 0x7eff301f7740 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7eff2402b840 tx=0x7eff240046c0 comp rx=0 tx=0).stop 2024-03-29T04:08:46.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.471+0000 7eff36214640 1 -- 172.21.15.73:0/1689415905 shutdown_connections 2024-03-29T04:08:46.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.471+0000 7eff36214640 1 --2- 172.21.15.73:0/1689415905 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7eff3015d680 0x7eff30140e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:46.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.471+0000 7eff36214640 1 --2- 172.21.15.73:0/1689415905 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff30145e80 0x7eff301f7740 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:46.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.471+0000 7eff36214640 1 --2- 172.21.15.73:0/1689415905 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7eff1c06c530 0x7eff1c06e9f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:46.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.471+0000 7eff36214640 1 --2- 172.21.15.73:0/1689415905 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff3006b510 0x7eff300b42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:46.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.471+0000 7eff36214640 1 -- 172.21.15.73:0/1689415905 >> 172.21.15.73:0/1689415905 conn(0x7eff300b66f0 msgr2=0x7eff30144fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:46.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.471+0000 7eff36214640 1 -- 172.21.15.73:0/1689415905 shutdown_connections 2024-03-29T04:08:46.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.471+0000 7eff36214640 1 -- 172.21.15.73:0/1689415905 wait complete. 2024-03-29T04:08:46.462 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-29T04:08:46.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.582+0000 7f6b2d129640 1 Processor -- start 2024-03-29T04:08:46.562 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.582+0000 7f6b2d129640 1 -- start start 2024-03-29T04:08:46.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.583+0000 7f6b2d129640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6b280b3c50 0x7f6b280d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:46.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.583+0000 7f6b2d129640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b280cfb30 con 0x7f6b280d3140 2024-03-29T04:08:46.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.583+0000 7f6b2d129640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b280cfe10 con 0x7f6b2815e930 2024-03-29T04:08:46.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.583+0000 7f6b2d129640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f6b280d3590 con 0x7f6b280b3c50 2024-03-29T04:08:46.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.583+0000 7f6b2659c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6b280b3c50 0x7f6b280d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:46.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.583+0000 7f6b2759e640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f6b280d3140 0x7f6b2806cc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:46866/0 (socket says 172.21.15.73:46866) 2024-03-29T04:08:46.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.583+0000 7f6b2759e640 1 -- 172.21.15.73:0/952179774 learned_addr learned my addr 172.21.15.73:0/952179774 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:46.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.584+0000 7f6b2659c640 1 -- 172.21.15.73:0/952179774 >> v1:172.21.15.142:6789/0 conn(0x7f6b2815e930 legacy=0x7f6b280cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:46.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.584+0000 7f6b2659c640 1 -- 172.21.15.73:0/952179774 >> v1:172.21.15.73:6789/0 conn(0x7f6b280d3140 legacy=0x7f6b2806cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:46.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.584+0000 7f6b2659c640 1 -- 172.21.15.73:0/952179774 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b280d00f0 con 0x7f6b280b3c50 2024-03-29T04:08:46.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.584+0000 7f6b25d9b640 1 -- 172.21.15.73:0/952179774 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1026995831 0 0) 0x7f6b280cfe10 con 0x7f6b2815e930 2024-03-29T04:08:46.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.584+0000 7f6b2659c640 1 --2- 172.21.15.73:0/952179774 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b280b3c50 0x7f6b280d2c00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c0097a0 tx=0x7f6b1c02b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b9ab10de3893af server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:46.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.584+0000 7f6b25d9b640 1 -- 172.21.15.73:0/952179774 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c037070 con 0x7f6b280b3c50 2024-03-29T04:08:46.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.584+0000 7f6b25d9b640 1 -- 172.21.15.73:0/952179774 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b1c030710 con 0x7f6b280b3c50 2024-03-29T04:08:46.565 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.584+0000 7f6b25d9b640 1 -- 172.21.15.73:0/952179774 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c030ae0 con 0x7f6b280b3c50 2024-03-29T04:08:46.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.585+0000 7f6b2d129640 1 -- 172.21.15.73:0/952179774 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b280b3c50 msgr2=0x7f6b280d2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:46.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.585+0000 7f6b2d129640 1 --2- 172.21.15.73:0/952179774 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b280b3c50 0x7f6b280d2c00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c0097a0 tx=0x7f6b1c02b710 comp rx=0 tx=0).stop 2024-03-29T04:08:46.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.585+0000 7f6b2d129640 1 -- 172.21.15.73:0/952179774 shutdown_connections 2024-03-29T04:08:46.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.585+0000 7f6b2d129640 1 --2- 172.21.15.73:0/952179774 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b280b3c50 0x7f6b280d2c00 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:46.566 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.585+0000 7f6b2d129640 1 -- 172.21.15.73:0/952179774 >> 172.21.15.73:0/952179774 conn(0x7f6b2808bfc0 msgr2=0x7f6b280d4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:46.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.585+0000 7f6b2d129640 1 -- 172.21.15.73:0/952179774 shutdown_connections 2024-03-29T04:08:46.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.585+0000 7f6b2d129640 1 -- 172.21.15.73:0/952179774 wait complete. 2024-03-29T04:08:46.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.586+0000 7f6b2d129640 1 Processor -- start 2024-03-29T04:08:46.567 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.586+0000 7f6b2d129640 1 -- start start 2024-03-29T04:08:46.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.587+0000 7f6b2d129640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b280b3c50 0x7f6b281568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:46.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.587+0000 7f6b2d129640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b280d3140 0x7f6b28157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:46.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.587+0000 7f6b2d129640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b2815e930 0x7f6b28157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:46.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.587+0000 7f6b2d129640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6b280cf840 con 0x7f6b2815e930 2024-03-29T04:08:46.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.587+0000 7f6b2d129640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6b2806c780 con 0x7f6b280d3140 2024-03-29T04:08:46.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.587+0000 7f6b2d129640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f6b2815ed10 con 0x7f6b280b3c50 2024-03-29T04:08:46.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.587+0000 7f6b2759e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b2815e930 0x7f6b28157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:46.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.587+0000 7f6b2759e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b2815e930 0x7f6b28157f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36574/0 (socket says 172.21.15.73:36574) 2024-03-29T04:08:46.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.587+0000 7f6b2759e640 1 -- 172.21.15.73:0/354890143 learned_addr learned my addr 172.21.15.73:0/354890143 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:46.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.587+0000 7f6b26d9d640 1 --2- 172.21.15.73:0/354890143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b280b3c50 0x7f6b281568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:46.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.587+0000 7f6b2659c640 1 --2- 172.21.15.73:0/354890143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b280d3140 0x7f6b28157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:46.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.588+0000 7f6b2759e640 1 -- 172.21.15.73:0/354890143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b280b3c50 msgr2=0x7f6b281568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:46.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.588+0000 7f6b2759e640 1 --2- 172.21.15.73:0/354890143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b280b3c50 0x7f6b281568e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:46.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.588+0000 7f6b2759e640 1 -- 172.21.15.73:0/354890143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b280d3140 msgr2=0x7f6b28157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:46.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.588+0000 7f6b2759e640 1 --2- 172.21.15.73:0/354890143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b280d3140 0x7f6b28157a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:46.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.588+0000 7f6b2759e640 1 -- 172.21.15.73:0/354890143 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b28155840 con 0x7f6b2815e930 2024-03-29T04:08:46.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.588+0000 7f6b2759e640 1 --2- 172.21.15.73:0/354890143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b2815e930 0x7f6b28157f40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6b2000c780 tx=0x7f6b2000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:46.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.588+0000 7f6b0f7fe640 1 -- 172.21.15.73:0/354890143 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b20018070 con 0x7f6b2815e930 2024-03-29T04:08:46.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.588+0000 7f6b0f7fe640 1 -- 172.21.15.73:0/354890143 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b200072d0 con 0x7f6b2815e930 2024-03-29T04:08:46.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.588+0000 7f6b2d129640 1 -- 172.21.15.73:0/354890143 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b28155b20 con 0x7f6b2815e930 2024-03-29T04:08:46.571 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.588+0000 7f6b0f7fe640 1 -- 172.21.15.73:0/354890143 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b200047e0 con 0x7f6b2815e930 2024-03-29T04:08:46.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.588+0000 7f6b2d129640 1 -- 172.21.15.73:0/354890143 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b281560e0 con 0x7f6b2815e930 2024-03-29T04:08:46.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.589+0000 7f6b2d129640 1 -- 172.21.15.73:0/354890143 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b28068640 con 0x7f6b2815e930 2024-03-29T04:08:46.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.589+0000 7f6b0f7fe640 1 -- 172.21.15.73:0/354890143 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f6b2001b070 con 0x7f6b2815e930 2024-03-29T04:08:46.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.590+0000 7f6b0f7fe640 1 --2- 172.21.15.73:0/354890143 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f6b1406c530 0x7f6b1406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:46.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.590+0000 7f6b0f7fe640 1 -- 172.21.15.73:0/354890143 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6b2008a9b0 con 0x7f6b2815e930 2024-03-29T04:08:46.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.590+0000 7f6b26d9d640 1 --2- 172.21.15.73:0/354890143 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f6b1406c530 0x7f6b1406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:46.572 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.590+0000 7f6b26d9d640 1 --2- 172.21.15.73:0/354890143 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f6b1406c530 0x7f6b1406e9f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6b180012e0 tx=0x7f6b18009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:46.574 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.594+0000 7f6b0f7fe640 1 -- 172.21.15.73:0/354890143 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f6b20058a10 con 0x7f6b2815e930 2024-03-29T04:08:46.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.769+0000 7f6b2d129640 1 -- 172.21.15.73:0/354890143 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6b2806db50 con 0x7f6b2815e930 2024-03-29T04:08:46.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.770+0000 7f6b0f7fe640 1 -- 172.21.15.73:0/354890143 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16605 (secure 0 0 0) 0x7f6b2005cd10 con 0x7f6b2815e930 2024-03-29T04:08:46.750 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:46.750 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"6bff1617-b138-4517-acca-3ecaae3f2bb3","created":"2024-03-29T04:07:47.346864+0000","modified":"2024-03-29T04:08:13.577603+0000","last_up_change":"2024-03-29T04:07:58.507139+0000","last_in_change":"2024-03-29T04:07:49.637816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-29T04:07:59.537301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-29T04:08:09.570906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-29T04:08:10.882349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"925d7de1-14ab-48c0-aebd-7bded108f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6820","nonce":2387335359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6824","nonce":2387335359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6831","nonce":2387335359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6828","nonce":2387335359}]},"public_addr":"172.21.15.73:6820/2387335359","cluster_addr":"172.21.15.73:6824/2387335359","heartbeat_back_addr":"172.21.15.73:6831/2387335359","heartbeat_front_addr":"172.21.15.73:6828/2387335359","state":["exists","up"]},{"osd":1,"uuid":"6b182102-882a-4e0c-99db-0afae5cfb38b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6801","nonce":2431315515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6803","nonce":2431315515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6807","nonce":2431315515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6805","nonce":2431315515}]},"public_addr":"172.21.15.73:6801/2431315515","cluster_addr":"172.21.15.73:6803/2431315515","heartbeat_back_addr":"172.21.15.73:6807/2431315515","heartbeat_front_addr":"172.21.15.73:6805/2431315515","state":["exists","up"]},{"osd":2,"uuid":"8040902e-b0b8-4a21-bf64-ce1c222115ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6809","nonce":407236597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6811","nonce":407236597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6815","nonce":407236597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6813","nonce":407236597}]},"public_addr":"172.21.15.73:6809/407236597","cluster_addr":"172.21.15.73:6811/407236597","heartbeat_back_addr":"172.21.15.73:6815/407236597","heartbeat_front_addr":"172.21.15.73:6813/407236597","state":["exists","up"]},{"osd":3,"uuid":"1bab19ee-3775-4ce1-a4ce-cf7cda3bbbf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6817","nonce":4291100709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6821","nonce":4291100709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6829","nonce":4291100709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6825","nonce":4291100709}]},"public_addr":"172.21.15.73:6817/4291100709","cluster_addr":"172.21.15.73:6821/4291100709","heartbeat_back_addr":"172.21.15.73:6829/4291100709","heartbeat_front_addr":"172.21.15.73:6825/4291100709","state":["exists","up"]},{"osd":4,"uuid":"b0c74337-8fe4-47dc-b3da-2d07591b1f6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6817","nonce":3703256194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6819","nonce":3703256194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6823","nonce":3703256194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6821","nonce":3703256194}]},"public_addr":"172.21.15.142:6817/3703256194","cluster_addr":"172.21.15.142:6819/3703256194","heartbeat_back_addr":"172.21.15.142:6823/3703256194","heartbeat_front_addr":"172.21.15.142:6821/3703256194","state":["exists","up"]},{"osd":5,"uuid":"9ce36410-a29a-42c6-99f4-f95d4afdd7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6825","nonce":4271575803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6827","nonce":4271575803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6831","nonce":4271575803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6829","nonce":4271575803}]},"public_addr":"172.21.15.142:6825/4271575803","cluster_addr":"172.21.15.142:6827/4271575803","heartbeat_back_addr":"172.21.15.142:6831/4271575803","heartbeat_front_addr":"172.21.15.142:6829/4271575803","state":["exists","up"]},{"osd":6,"uuid":"aec4264a-64ac-428e-a860-d2920a304019","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6801","nonce":1772722570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6803","nonce":1772722570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6807","nonce":1772722570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6805","nonce":1772722570}]},"public_addr":"172.21.15.142:6801/1772722570","cluster_addr":"172.21.15.142:6803/1772722570","heartbeat_back_addr":"172.21.15.142:6807/1772722570","heartbeat_front_addr":"172.21.15.142:6805/1772722570","state":["exists","up"]},{"osd":7,"uuid":"fe599052-8e5a-4c7a-91e7-52d1bae24a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6809","nonce":3910589675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6811","nonce":3910589675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6815","nonce":3910589675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6813","nonce":3910589675}]},"public_addr":"172.21.15.142:6809/3910589675","cluster_addr":"172.21.15.142:6811/3910589675","heartbeat_back_addr":"172.21.15.142:6815/3910589675","heartbeat_front_addr":"172.21.15.142:6813/3910589675","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.835096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.587210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.786547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.778004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.843740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.791160+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.837992+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.718722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:08:46.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.772+0000 7f6b2d129640 1 -- 172.21.15.73:0/354890143 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f6b1406c530 msgr2=0x7f6b1406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:46.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.772+0000 7f6b2d129640 1 --2- 172.21.15.73:0/354890143 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f6b1406c530 0x7f6b1406e9f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6b180012e0 tx=0x7f6b18009040 comp rx=0 tx=0).stop 2024-03-29T04:08:46.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.772+0000 7f6b2d129640 1 -- 172.21.15.73:0/354890143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b2815e930 msgr2=0x7f6b28157f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:46.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.772+0000 7f6b2d129640 1 --2- 172.21.15.73:0/354890143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b2815e930 0x7f6b28157f40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6b2000c780 tx=0x7f6b2000cc40 comp rx=0 tx=0).stop 2024-03-29T04:08:46.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.772+0000 7f6b2d129640 1 -- 172.21.15.73:0/354890143 shutdown_connections 2024-03-29T04:08:46.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.772+0000 7f6b2d129640 1 --2- 172.21.15.73:0/354890143 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b2815e930 0x7f6b28157f40 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:46.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.772+0000 7f6b2d129640 1 --2- 172.21.15.73:0/354890143 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f6b1406c530 0x7f6b1406e9f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:46.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.772+0000 7f6b2d129640 1 --2- 172.21.15.73:0/354890143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b280d3140 0x7f6b28157a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:46.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.772+0000 7f6b2d129640 1 --2- 172.21.15.73:0/354890143 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6b280b3c50 0x7f6b281568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:46.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.772+0000 7f6b2d129640 1 -- 172.21.15.73:0/354890143 >> 172.21.15.73:0/354890143 conn(0x7f6b2808bfc0 msgr2=0x7f6b280b1650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:46.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.772+0000 7f6b2d129640 1 -- 172.21.15.73:0/354890143 shutdown_connections 2024-03-29T04:08:46.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.772+0000 7f6b2d129640 1 -- 172.21.15.73:0/354890143 wait complete. 2024-03-29T04:08:46.763 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-29T04:07:59.537301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-29T04:08:09.570906+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-29T04:08:10.882349+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-29T04:08:46.764 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-29T04:08:46.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.887+0000 7f920c206640 1 Processor -- start 2024-03-29T04:08:46.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.887+0000 7f920c206640 1 -- start start 2024-03-29T04:08:46.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.888+0000 7f920c206640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f920415e920 0x7f92040d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:46.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.888+0000 7f920c206640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92040cfde0 0x7f92040d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:46.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.888+0000 7f920c206640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92040d3780 con 0x7f92040d0f90 2024-03-29T04:08:46.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.888+0000 7f920c206640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f920415ed00 con 0x7f920415e920 2024-03-29T04:08:46.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.888+0000 7f920c206640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f92040d21e0 con 0x7f92040cfde0 2024-03-29T04:08:46.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.888+0000 7f9209fa2640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f920415e920 0x7f92040d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:46.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.888+0000 7f920a7a3640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f92040d0f90 0x7f920406c6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:46882/0 (socket says 172.21.15.73:46882) 2024-03-29T04:08:46.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.888+0000 7f920a7a3640 1 -- 172.21.15.73:0/4076379009 learned_addr learned my addr 172.21.15.73:0/4076379009 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:46.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.889+0000 7f92097a1640 1 --2- 172.21.15.73:0/4076379009 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92040cfde0 0x7f92040d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:46.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.889+0000 7f9209fa2640 1 -- 172.21.15.73:0/4076379009 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92040cfde0 msgr2=0x7f92040d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:46.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.889+0000 7f9209fa2640 1 --2- 172.21.15.73:0/4076379009 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92040cfde0 0x7f92040d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:46.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.889+0000 7f9209fa2640 1 -- 172.21.15.73:0/4076379009 >> v1:172.21.15.73:6789/0 conn(0x7f92040d0f90 legacy=0x7f920406c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:46.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.889+0000 7f9209fa2640 1 -- 172.21.15.73:0/4076379009 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92040d2480 con 0x7f920415e920 2024-03-29T04:08:46.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.889+0000 7f9208fa0640 1 -- 172.21.15.73:0/4076379009 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4115254688 0 0) 0x7f91fc001490 con 0x7f92040d0f90 2024-03-29T04:08:46.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.889+0000 7f9209fa2640 1 --2- 172.21.15.73:0/4076379009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f920415e920 0x7f92040d3240 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f92000097d0 tx=0x7f920002b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e31cc5b95f93bc1 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:46.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.890+0000 7f9208fa0640 1 -- 172.21.15.73:0/4076379009 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9200035020 con 0x7f920415e920 2024-03-29T04:08:46.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.890+0000 7f9208fa0640 1 -- 172.21.15.73:0/4076379009 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9200031800 con 0x7f920415e920 2024-03-29T04:08:46.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.890+0000 7f9208fa0640 1 -- 172.21.15.73:0/4076379009 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9200031bd0 con 0x7f920415e920 2024-03-29T04:08:46.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.890+0000 7f920c206640 1 -- 172.21.15.73:0/4076379009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f920415e920 msgr2=0x7f92040d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:46.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.890+0000 7f920c206640 1 --2- 172.21.15.73:0/4076379009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f920415e920 0x7f92040d3240 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f92000097d0 tx=0x7f920002b8a0 comp rx=0 tx=0).stop 2024-03-29T04:08:46.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.890+0000 7f920c206640 1 -- 172.21.15.73:0/4076379009 shutdown_connections 2024-03-29T04:08:46.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.890+0000 7f920c206640 1 --2- 172.21.15.73:0/4076379009 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92040cfde0 0x7f92040d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:46.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.890+0000 7f920c206640 1 --2- 172.21.15.73:0/4076379009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f920415e920 0x7f92040d3240 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:46.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.890+0000 7f920c206640 1 -- 172.21.15.73:0/4076379009 >> 172.21.15.73:0/4076379009 conn(0x7f920408bfc0 msgr2=0x7f92040d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:46.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.890+0000 7f920c206640 1 -- 172.21.15.73:0/4076379009 shutdown_connections 2024-03-29T04:08:46.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.890+0000 7f920c206640 1 -- 172.21.15.73:0/4076379009 wait complete. 2024-03-29T04:08:46.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.891+0000 7f920c206640 1 Processor -- start 2024-03-29T04:08:46.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.891+0000 7f920c206640 1 -- start start 2024-03-29T04:08:46.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.892+0000 7f920c206640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92040cfde0 0x7f920414d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:46.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.892+0000 7f920c206640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92040d0f90 0x7f920414b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:46.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.892+0000 7f920c206640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f920415e920 0x7f920414b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:46.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.892+0000 7f920c206640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f92040d2d20 con 0x7f920415e920 2024-03-29T04:08:46.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.892+0000 7f920c206640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f92040d2a40 con 0x7f92040d0f90 2024-03-29T04:08:46.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.892+0000 7f920c206640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f92040d4ef0 con 0x7f92040cfde0 2024-03-29T04:08:46.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.892+0000 7f920a7a3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f920415e920 0x7f920414b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:46.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.892+0000 7f920a7a3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f920415e920 0x7f920414b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36588/0 (socket says 172.21.15.73:36588) 2024-03-29T04:08:46.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.892+0000 7f920a7a3640 1 -- 172.21.15.73:0/2995374828 learned_addr learned my addr 172.21.15.73:0/2995374828 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:46.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.892+0000 7f92097a1640 1 --2- 172.21.15.73:0/2995374828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92040d0f90 0x7f920414b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:46.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.892+0000 7f9209fa2640 1 --2- 172.21.15.73:0/2995374828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92040cfde0 0x7f920414d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:46.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.892+0000 7f920a7a3640 1 -- 172.21.15.73:0/2995374828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92040cfde0 msgr2=0x7f920414d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:46.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.892+0000 7f920a7a3640 1 --2- 172.21.15.73:0/2995374828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92040cfde0 0x7f920414d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:46.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.892+0000 7f920a7a3640 1 -- 172.21.15.73:0/2995374828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92040d0f90 msgr2=0x7f920414b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:46.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.892+0000 7f920a7a3640 1 --2- 172.21.15.73:0/2995374828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92040d0f90 0x7f920414b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:46.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.892+0000 7f920a7a3640 1 -- 172.21.15.73:0/2995374828 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f920415dd10 con 0x7f920415e920 2024-03-29T04:08:46.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.892+0000 7f92097a1640 1 --2- 172.21.15.73:0/2995374828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92040d0f90 0x7f920414b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:08:46.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.892+0000 7f9209fa2640 1 --2- 172.21.15.73:0/2995374828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92040cfde0 0x7f920414d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:08:46.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.893+0000 7f920a7a3640 1 --2- 172.21.15.73:0/2995374828 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f920415e920 0x7f920414b930 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f91fc00c780 tx=0x7f91fc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:46.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.893+0000 7f91fa7fc640 1 -- 172.21.15.73:0/2995374828 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91fc018070 con 0x7f920415e920 2024-03-29T04:08:46.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.893+0000 7f91fa7fc640 1 -- 172.21.15.73:0/2995374828 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91fc00a640 con 0x7f920415e920 2024-03-29T04:08:46.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.893+0000 7f920c206640 1 -- 172.21.15.73:0/2995374828 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f920414bfc0 con 0x7f920415e920 2024-03-29T04:08:46.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.893+0000 7f91fa7fc640 1 -- 172.21.15.73:0/2995374828 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91fc00aa30 con 0x7f920415e920 2024-03-29T04:08:46.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.893+0000 7f920c206640 1 -- 172.21.15.73:0/2995374828 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f920414c800 con 0x7f920415e920 2024-03-29T04:08:46.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.894+0000 7f920c206640 1 -- 172.21.15.73:0/2995374828 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92040a2560 con 0x7f920415e920 2024-03-29T04:08:46.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.894+0000 7f91fa7fc640 1 -- 172.21.15.73:0/2995374828 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f91fc01b070 con 0x7f920415e920 2024-03-29T04:08:46.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.894+0000 7f91fa7fc640 1 --2- 172.21.15.73:0/2995374828 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f91e806c530 0x7f91e806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:46.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.895+0000 7f91fa7fc640 1 -- 172.21.15.73:0/2995374828 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f91fc08ac60 con 0x7f920415e920 2024-03-29T04:08:46.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.895+0000 7f9209fa2640 1 --2- 172.21.15.73:0/2995374828 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f91e806c530 0x7f91e806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:46.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.895+0000 7f9209fa2640 1 --2- 172.21.15.73:0/2995374828 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f91e806c530 0x7f91e806e9f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9200036000 tx=0x7f9200008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:46.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:46.899+0000 7f91fa7fc640 1 -- 172.21.15.73:0/2995374828 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f920414bfc0 con 0x7f920415e920 2024-03-29T04:08:47.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.071+0000 7f920c206640 1 -- 172.21.15.73:0/2995374828 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f92040c7ee0 con 0x7f920415e920 2024-03-29T04:08:47.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.072+0000 7f91fa7fc640 1 -- 172.21.15.73:0/2995374828 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f92040d3780 con 0x7f920415e920 2024-03-29T04:08:47.052 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-03-29T04:08:47.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.074+0000 7f920c206640 1 -- 172.21.15.73:0/2995374828 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f91e806c530 msgr2=0x7f91e806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:47.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.074+0000 7f920c206640 1 --2- 172.21.15.73:0/2995374828 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f91e806c530 0x7f91e806e9f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9200036000 tx=0x7f9200008030 comp rx=0 tx=0).stop 2024-03-29T04:08:47.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.074+0000 7f920c206640 1 -- 172.21.15.73:0/2995374828 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f920415e920 msgr2=0x7f920414b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:47.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.074+0000 7f920c206640 1 --2- 172.21.15.73:0/2995374828 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f920415e920 0x7f920414b930 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f91fc00c780 tx=0x7f91fc00cc40 comp rx=0 tx=0).stop 2024-03-29T04:08:47.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.074+0000 7f920c206640 1 -- 172.21.15.73:0/2995374828 shutdown_connections 2024-03-29T04:08:47.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.074+0000 7f920c206640 1 --2- 172.21.15.73:0/2995374828 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f920415e920 0x7f920414b930 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:47.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.074+0000 7f920c206640 1 --2- 172.21.15.73:0/2995374828 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f91e806c530 0x7f91e806e9f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:47.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.074+0000 7f920c206640 1 --2- 172.21.15.73:0/2995374828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f92040d0f90 0x7f920414b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:47.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.074+0000 7f920c206640 1 --2- 172.21.15.73:0/2995374828 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f92040cfde0 0x7f920414d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:47.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.074+0000 7f920c206640 1 -- 172.21.15.73:0/2995374828 >> 172.21.15.73:0/2995374828 conn(0x7f920408bfc0 msgr2=0x7f92040cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:47.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.074+0000 7f920c206640 1 -- 172.21.15.73:0/2995374828 shutdown_connections 2024-03-29T04:08:47.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.074+0000 7f920c206640 1 -- 172.21.15.73:0/2995374828 wait complete. 2024-03-29T04:08:47.066 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-29T04:08:47.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.191+0000 7f6e95d46640 1 Processor -- start 2024-03-29T04:08:47.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.191+0000 7f6e95d46640 1 -- start start 2024-03-29T04:08:47.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.192+0000 7f6e95d46640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6e90145680 0x7f6e900701f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:47.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.192+0000 7f6e95d46640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e90145a60 con 0x7f6e90160220 2024-03-29T04:08:47.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.192+0000 7f6e95d46640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e90160a30 con 0x7f6e90071bd0 2024-03-29T04:08:47.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.192+0000 7f6e95d46640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f6e90160d10 con 0x7f6e90145680 2024-03-29T04:08:47.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.192+0000 7f6e8f7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6e90145680 0x7f6e900701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:47.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.192+0000 7f6e8effd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f6e90160220 0x7f6e900cfca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:46898/0 (socket says 172.21.15.73:46898) 2024-03-29T04:08:47.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.192+0000 7f6e8effd640 1 -- 172.21.15.73:0/2581127005 learned_addr learned my addr 172.21.15.73:0/2581127005 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:47.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.192+0000 7f6e8f7fe640 1 -- 172.21.15.73:0/2581127005 >> v1:172.21.15.142:6789/0 conn(0x7f6e90071bd0 legacy=0x7f6e900b3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:47.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.192+0000 7f6e8f7fe640 1 -- 172.21.15.73:0/2581127005 >> v1:172.21.15.73:6789/0 conn(0x7f6e90160220 legacy=0x7f6e900cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:47.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.192+0000 7f6e8f7fe640 1 -- 172.21.15.73:0/2581127005 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e90160ff0 con 0x7f6e90145680 2024-03-29T04:08:47.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.192+0000 7f6e8e7fc640 1 -- 172.21.15.73:0/2581127005 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3480410685 0 0) 0x7f6e90145a60 con 0x7f6e90160220 2024-03-29T04:08:47.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.193+0000 7f6e8f7fe640 1 --2- 172.21.15.73:0/2581127005 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e90145680 0x7f6e900701f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6e800097a0 tx=0x7f6e8002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b0f29bdb4bfbf56 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:47.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.193+0000 7f6e8e7fc640 1 -- 172.21.15.73:0/2581127005 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e80035020 con 0x7f6e90145680 2024-03-29T04:08:47.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.193+0000 7f6e8e7fc640 1 -- 172.21.15.73:0/2581127005 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e80031830 con 0x7f6e90145680 2024-03-29T04:08:47.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.193+0000 7f6e8e7fc640 1 -- 172.21.15.73:0/2581127005 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e80031c00 con 0x7f6e90145680 2024-03-29T04:08:47.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.193+0000 7f6e95d46640 1 -- 172.21.15.73:0/2581127005 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e90145680 msgr2=0x7f6e900701f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:47.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.193+0000 7f6e95d46640 1 --2- 172.21.15.73:0/2581127005 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e90145680 0x7f6e900701f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6e800097a0 tx=0x7f6e8002b8d0 comp rx=0 tx=0).stop 2024-03-29T04:08:47.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.193+0000 7f6e95d46640 1 -- 172.21.15.73:0/2581127005 shutdown_connections 2024-03-29T04:08:47.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.193+0000 7f6e95d46640 1 --2- 172.21.15.73:0/2581127005 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e90145680 0x7f6e900701f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:47.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.193+0000 7f6e95d46640 1 -- 172.21.15.73:0/2581127005 >> 172.21.15.73:0/2581127005 conn(0x7f6e900b2340 msgr2=0x7f6e900b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:47.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.193+0000 7f6e95d46640 1 -- 172.21.15.73:0/2581127005 shutdown_connections 2024-03-29T04:08:47.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.194+0000 7f6e95d46640 1 -- 172.21.15.73:0/2581127005 wait complete. 2024-03-29T04:08:47.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.195+0000 7f6e95d46640 1 Processor -- start 2024-03-29T04:08:47.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.195+0000 7f6e95d46640 1 -- start start 2024-03-29T04:08:47.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.195+0000 7f6e95d46640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e90071bd0 0x7f6e9006ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:47.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.195+0000 7f6e95d46640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e90145680 0x7f6e900aeb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:47.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.195+0000 7f6e95d46640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e90160220 0x7f6e9015b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:47.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.195+0000 7f6e95d46640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6e901606b0 con 0x7f6e90160220 2024-03-29T04:08:47.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.196+0000 7f6e95d46640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6e900d03b0 con 0x7f6e90145680 2024-03-29T04:08:47.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.196+0000 7f6e95d46640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f6e900cf3e0 con 0x7f6e90071bd0 2024-03-29T04:08:47.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.196+0000 7f6e8ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e90160220 0x7f6e9015b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:47.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.196+0000 7f6e8ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e90160220 0x7f6e9015b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:36618/0 (socket says 172.21.15.73:36618) 2024-03-29T04:08:47.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.196+0000 7f6e8ffff640 1 -- 172.21.15.73:0/3566651724 learned_addr learned my addr 172.21.15.73:0/3566651724 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:47.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.196+0000 7f6e8effd640 1 --2- 172.21.15.73:0/3566651724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e90145680 0x7f6e900aeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:47.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.196+0000 7f6e8f7fe640 1 --2- 172.21.15.73:0/3566651724 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e90071bd0 0x7f6e9006ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:47.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.196+0000 7f6e8ffff640 1 -- 172.21.15.73:0/3566651724 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e90071bd0 msgr2=0x7f6e9006ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:47.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.196+0000 7f6e8ffff640 1 --2- 172.21.15.73:0/3566651724 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e90071bd0 0x7f6e9006ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:47.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.196+0000 7f6e8ffff640 1 -- 172.21.15.73:0/3566651724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e90145680 msgr2=0x7f6e900aeb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:47.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.196+0000 7f6e8ffff640 1 --2- 172.21.15.73:0/3566651724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e90145680 0x7f6e900aeb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:47.178 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.196+0000 7f6e8ffff640 1 -- 172.21.15.73:0/3566651724 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e9006f360 con 0x7f6e90160220 2024-03-29T04:08:47.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.196+0000 7f6e8ffff640 1 --2- 172.21.15.73:0/3566651724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e90160220 0x7f6e9015b600 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6e8800c6b0 tx=0x7f6e8800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:47.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.196+0000 7f6e77fff640 1 -- 172.21.15.73:0/3566651724 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e88003b70 con 0x7f6e90160220 2024-03-29T04:08:47.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.196+0000 7f6e77fff640 1 -- 172.21.15.73:0/3566651724 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e88003d30 con 0x7f6e90160220 2024-03-29T04:08:47.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.196+0000 7f6e95d46640 1 -- 172.21.15.73:0/3566651724 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e900adaf0 con 0x7f6e90160220 2024-03-29T04:08:47.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.196+0000 7f6e77fff640 1 -- 172.21.15.73:0/3566651724 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e88005310 con 0x7f6e90160220 2024-03-29T04:08:47.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.196+0000 7f6e95d46640 1 -- 172.21.15.73:0/3566651724 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e900ae0b0 con 0x7f6e90160220 2024-03-29T04:08:47.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.197+0000 7f6e95d46640 1 -- 172.21.15.73:0/3566651724 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e90073580 con 0x7f6e90160220 2024-03-29T04:08:47.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.198+0000 7f6e77fff640 1 -- 172.21.15.73:0/3566651724 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f6e880054b0 con 0x7f6e90160220 2024-03-29T04:08:47.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.198+0000 7f6e77fff640 1 --2- 172.21.15.73:0/3566651724 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f6e7c06c530 0x7f6e7c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:47.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.198+0000 7f6e77fff640 1 -- 172.21.15.73:0/3566651724 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6e8808b330 con 0x7f6e90160220 2024-03-29T04:08:47.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.198+0000 7f6e8f7fe640 1 --2- 172.21.15.73:0/3566651724 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f6e7c06c530 0x7f6e7c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:47.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.198+0000 7f6e8f7fe640 1 --2- 172.21.15.73:0/3566651724 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f6e7c06c530 0x7f6e7c06e9f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6e80036000 tx=0x7f6e80008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:47.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.202+0000 7f6e77fff640 1 -- 172.21.15.73:0/3566651724 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f6e88059390 con 0x7f6e90160220 2024-03-29T04:08:47.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.376+0000 7f6e95d46640 1 -- 172.21.15.73:0/3566651724 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6e9004f9d0 con 0x7f6e90160220 2024-03-29T04:08:47.356 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.377+0000 7f6e77fff640 1 -- 172.21.15.73:0/3566651724 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f6e8805d690 con 0x7f6e90160220 2024-03-29T04:08:47.356 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-03-29T04:08:47.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.378+0000 7f6e95d46640 1 -- 172.21.15.73:0/3566651724 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f6e7c06c530 msgr2=0x7f6e7c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:47.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.378+0000 7f6e95d46640 1 --2- 172.21.15.73:0/3566651724 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f6e7c06c530 0x7f6e7c06e9f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6e80036000 tx=0x7f6e80008030 comp rx=0 tx=0).stop 2024-03-29T04:08:47.358 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.378+0000 7f6e95d46640 1 -- 172.21.15.73:0/3566651724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e90160220 msgr2=0x7f6e9015b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:47.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.378+0000 7f6e95d46640 1 --2- 172.21.15.73:0/3566651724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e90160220 0x7f6e9015b600 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6e8800c6b0 tx=0x7f6e8800cb70 comp rx=0 tx=0).stop 2024-03-29T04:08:47.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.379+0000 7f6e95d46640 1 -- 172.21.15.73:0/3566651724 shutdown_connections 2024-03-29T04:08:47.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.379+0000 7f6e95d46640 1 --2- 172.21.15.73:0/3566651724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e90160220 0x7f6e9015b600 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:47.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.379+0000 7f6e95d46640 1 --2- 172.21.15.73:0/3566651724 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f6e7c06c530 0x7f6e7c06e9f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:47.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.379+0000 7f6e95d46640 1 --2- 172.21.15.73:0/3566651724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e90145680 0x7f6e900aeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:47.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.379+0000 7f6e95d46640 1 --2- 172.21.15.73:0/3566651724 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6e90071bd0 0x7f6e9006ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:47.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.379+0000 7f6e95d46640 1 -- 172.21.15.73:0/3566651724 >> 172.21.15.73:0/3566651724 conn(0x7f6e900b2340 msgr2=0x7f6e900b16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:47.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.379+0000 7f6e95d46640 1 -- 172.21.15.73:0/3566651724 shutdown_connections 2024-03-29T04:08:47.359 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.379+0000 7f6e95d46640 1 -- 172.21.15.73:0/3566651724 wait complete. 2024-03-29T04:08:47.369 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-29T04:08:47.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.493+0000 7f4829b5f640 1 Processor -- start 2024-03-29T04:08:47.472 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.493+0000 7f4829b5f640 1 -- start start 2024-03-29T04:08:47.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.493+0000 7f4829b5f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f48240b4e40 0x7f48240c6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:47.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.493+0000 7f4829b5f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f48240b31c0 0x7f48240b2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:47.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.493+0000 7f4829b5f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48240b2a50 con 0x7f48240b2640 2024-03-29T04:08:47.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.493+0000 7f4829b5f640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f48240c6d60 con 0x7f48240b4e40 2024-03-29T04:08:47.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.493+0000 7f4829b5f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f48240cba20 con 0x7f48240b31c0 2024-03-29T04:08:47.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.493+0000 7f48237fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f48240b4e40 0x7f48240c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:47.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.493+0000 7f48237fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f48240b4e40 0x7f48240c6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54202/0 (socket says 172.21.15.73:54202) 2024-03-29T04:08:47.474 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.493+0000 7f48237fe640 1 -- 172.21.15.73:0/761359800 learned_addr learned my addr 172.21.15.73:0/761359800 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:47.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.494+0000 7f481affd640 1 --2- 172.21.15.73:0/761359800 >> v2:172.21.15.142:3300/0 conn(0x7f48240b31c0 0x7f48240b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:47.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.494+0000 7f48237fe640 1 -- 172.21.15.73:0/761359800 >> v2:172.21.15.142:3300/0 conn(0x7f48240b31c0 msgr2=0x7f48240b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:47.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.494+0000 7f48237fe640 1 --2- 172.21.15.73:0/761359800 >> v2:172.21.15.142:3300/0 conn(0x7f48240b31c0 0x7f48240b2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:47.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.494+0000 7f48237fe640 1 -- 172.21.15.73:0/761359800 >> v1:172.21.15.142:6789/0 conn(0x7f48240b2640 legacy=0x7f48240cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:47.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.494+0000 7f48237fe640 1 -- 172.21.15.73:0/761359800 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48241604d0 con 0x7f48240b4e40 2024-03-29T04:08:47.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.494+0000 7f48237fe640 1 --2- 172.21.15.73:0/761359800 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48240b4e40 0x7f48240c6820 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f48240c59c0 tx=0x7f481402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf32b5f837fda35 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:47.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.495+0000 7f4822ffd640 1 -- 172.21.15.73:0/761359800 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4814035020 con 0x7f48240b4e40 2024-03-29T04:08:47.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.495+0000 7f4822ffd640 1 -- 172.21.15.73:0/761359800 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4814031870 con 0x7f48240b4e40 2024-03-29T04:08:47.475 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.495+0000 7f4822ffd640 1 -- 172.21.15.73:0/761359800 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4814031c40 con 0x7f48240b4e40 2024-03-29T04:08:47.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.495+0000 7f4829b5f640 1 -- 172.21.15.73:0/761359800 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48240b4e40 msgr2=0x7f48240c6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:47.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.495+0000 7f4829b5f640 1 --2- 172.21.15.73:0/761359800 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48240b4e40 0x7f48240c6820 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f48240c59c0 tx=0x7f481402b910 comp rx=0 tx=0).stop 2024-03-29T04:08:47.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.495+0000 7f4829b5f640 1 -- 172.21.15.73:0/761359800 shutdown_connections 2024-03-29T04:08:47.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.495+0000 7f4829b5f640 1 --2- 172.21.15.73:0/761359800 >> v2:172.21.15.142:3300/0 conn(0x7f48240b31c0 0x7f48240b2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:47.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.495+0000 7f4829b5f640 1 --2- 172.21.15.73:0/761359800 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48240b4e40 0x7f48240c6820 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:47.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.495+0000 7f4829b5f640 1 -- 172.21.15.73:0/761359800 >> 172.21.15.73:0/761359800 conn(0x7f48240d0450 msgr2=0x7f48240d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:47.476 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.495+0000 7f4829b5f640 1 -- 172.21.15.73:0/761359800 shutdown_connections 2024-03-29T04:08:47.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.495+0000 7f4829b5f640 1 -- 172.21.15.73:0/761359800 wait complete. 2024-03-29T04:08:47.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.496+0000 7f4829b5f640 1 Processor -- start 2024-03-29T04:08:47.477 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.497+0000 7f4829b5f640 1 -- start start 2024-03-29T04:08:47.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.497+0000 7f4829b5f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48240b2640 0x7f4824155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:47.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.497+0000 7f4829b5f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48240b31c0 0x7f482414f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:47.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.497+0000 7f4829b5f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48240b4e40 0x7f4824072820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:47.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.497+0000 7f4829b5f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4824160d70 con 0x7f48240b31c0 2024-03-29T04:08:47.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.497+0000 7f4829b5f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4824160a90 con 0x7f48240b4e40 2024-03-29T04:08:47.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.497+0000 7f4829b5f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f48240b3650 con 0x7f48240b2640 2024-03-29T04:08:47.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.497+0000 7f481affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48240b31c0 0x7f482414f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:47.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.497+0000 7f481affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48240b31c0 0x7f482414f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54212/0 (socket says 172.21.15.73:54212) 2024-03-29T04:08:47.479 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.497+0000 7f481affd640 1 -- 172.21.15.73:0/1414859927 learned_addr learned my addr 172.21.15.73:0/1414859927 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:47.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.497+0000 7f4823fff640 1 --2- 172.21.15.73:0/1414859927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48240b4e40 0x7f4824072820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:47.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.497+0000 7f48237fe640 1 --2- 172.21.15.73:0/1414859927 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48240b2640 0x7f4824155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:47.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.498+0000 7f481affd640 1 -- 172.21.15.73:0/1414859927 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48240b2640 msgr2=0x7f4824155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:47.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.498+0000 7f481affd640 1 --2- 172.21.15.73:0/1414859927 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48240b2640 0x7f4824155870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:47.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.498+0000 7f481affd640 1 -- 172.21.15.73:0/1414859927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48240b4e40 msgr2=0x7f4824072820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:47.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.498+0000 7f481affd640 1 --2- 172.21.15.73:0/1414859927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48240b4e40 0x7f4824072820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:47.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.498+0000 7f481affd640 1 -- 172.21.15.73:0/1414859927 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f482406d970 con 0x7f48240b31c0 2024-03-29T04:08:47.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.498+0000 7f481affd640 1 --2- 172.21.15.73:0/1414859927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48240b31c0 0x7f482414f3a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f480c00e9b0 tx=0x7f480c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:47.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.498+0000 7f4820ff9640 1 -- 172.21.15.73:0/1414859927 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f480c017070 con 0x7f48240b31c0 2024-03-29T04:08:47.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.498+0000 7f4820ff9640 1 -- 172.21.15.73:0/1414859927 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f480c00c9a0 con 0x7f48240b31c0 2024-03-29T04:08:47.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.498+0000 7f4820ff9640 1 -- 172.21.15.73:0/1414859927 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f480c00cd90 con 0x7f48240b31c0 2024-03-29T04:08:47.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.498+0000 7f4829b5f640 1 -- 172.21.15.73:0/1414859927 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4824155db0 con 0x7f48240b31c0 2024-03-29T04:08:47.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.498+0000 7f4829b5f640 1 -- 172.21.15.73:0/1414859927 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4824156330 con 0x7f48240b31c0 2024-03-29T04:08:47.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.499+0000 7f4829b5f640 1 -- 172.21.15.73:0/1414859927 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f482404f9d0 con 0x7f48240b31c0 2024-03-29T04:08:47.480 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.500+0000 7f4820ff9640 1 -- 172.21.15.73:0/1414859927 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f480c01a070 con 0x7f48240b31c0 2024-03-29T04:08:47.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.500+0000 7f4820ff9640 1 --2- 172.21.15.73:0/1414859927 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f480406c560 0x7f480406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:47.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.500+0000 7f4820ff9640 1 -- 172.21.15.73:0/1414859927 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f480c08b610 con 0x7f48240b31c0 2024-03-29T04:08:47.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.500+0000 7f48237fe640 1 --2- 172.21.15.73:0/1414859927 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f480406c560 0x7f480406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:47.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.500+0000 7f48237fe640 1 --2- 172.21.15.73:0/1414859927 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f480406c560 0x7f480406ea20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4814036000 tx=0x7f481403c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:47.484 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.504+0000 7f4820ff9640 1 -- 172.21.15.73:0/1414859927 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f480c0595e0 con 0x7f48240b31c0 2024-03-29T04:08:47.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.678+0000 7f4829b5f640 1 -- 172.21.15.73:0/1414859927 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f48240c5cb0 con 0x7f48240b31c0 2024-03-29T04:08:47.658 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.678+0000 7f4820ff9640 1 -- 172.21.15.73:0/1414859927 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f480c05d8e0 con 0x7f48240b31c0 2024-03-29T04:08:47.658 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-29T04:08:47.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.680+0000 7f4829b5f640 1 -- 172.21.15.73:0/1414859927 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f480406c560 msgr2=0x7f480406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:47.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.680+0000 7f4829b5f640 1 --2- 172.21.15.73:0/1414859927 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f480406c560 0x7f480406ea20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4814036000 tx=0x7f481403c040 comp rx=0 tx=0).stop 2024-03-29T04:08:47.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.680+0000 7f4829b5f640 1 -- 172.21.15.73:0/1414859927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48240b31c0 msgr2=0x7f482414f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:47.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.680+0000 7f4829b5f640 1 --2- 172.21.15.73:0/1414859927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48240b31c0 0x7f482414f3a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f480c00e9b0 tx=0x7f480c00ee70 comp rx=0 tx=0).stop 2024-03-29T04:08:47.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.680+0000 7f4829b5f640 1 -- 172.21.15.73:0/1414859927 shutdown_connections 2024-03-29T04:08:47.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.680+0000 7f4829b5f640 1 --2- 172.21.15.73:0/1414859927 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f480406c560 0x7f480406ea20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:47.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.680+0000 7f4829b5f640 1 --2- 172.21.15.73:0/1414859927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48240b4e40 0x7f4824072820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:47.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.680+0000 7f4829b5f640 1 --2- 172.21.15.73:0/1414859927 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48240b31c0 0x7f482414f3a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:47.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.680+0000 7f4829b5f640 1 --2- 172.21.15.73:0/1414859927 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48240b2640 0x7f4824155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:47.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.680+0000 7f4829b5f640 1 -- 172.21.15.73:0/1414859927 >> 172.21.15.73:0/1414859927 conn(0x7f48240d0450 msgr2=0x7f48240ccc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:47.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.681+0000 7f4829b5f640 1 -- 172.21.15.73:0/1414859927 shutdown_connections 2024-03-29T04:08:47.661 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.681+0000 7f4829b5f640 1 -- 172.21.15.73:0/1414859927 wait complete. 2024-03-29T04:08:47.671 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-29T04:08:47.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.791+0000 7f488d5af640 1 Processor -- start 2024-03-29T04:08:47.771 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.791+0000 7f488d5af640 1 -- start start 2024-03-29T04:08:47.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.792+0000 7f488d5af640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f48880d3300 0x7f48880d0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:47.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.792+0000 7f488d5af640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48880d54f0 con 0x7f48880d4f30 2024-03-29T04:08:47.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.792+0000 7f488d5af640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48880cf3c0 con 0x7f488815e9b0 2024-03-29T04:08:47.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.792+0000 7f488d5af640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f48880cfcf0 con 0x7f48880d3300 2024-03-29T04:08:47.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.792+0000 7f48867fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f48880d3300 0x7f48880d0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:47.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.792+0000 7f48877fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f48880d4f30 0x7f488806c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57222/0 (socket says 172.21.15.73:57222) 2024-03-29T04:08:47.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.792+0000 7f48877fe640 1 -- 172.21.15.73:0/304933580 learned_addr learned my addr 172.21.15.73:0/304933580 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:47.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.792+0000 7f48867fc640 1 -- 172.21.15.73:0/304933580 >> v1:172.21.15.142:6789/0 conn(0x7f488815e9b0 legacy=0x7f48880d2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:47.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.792+0000 7f48867fc640 1 -- 172.21.15.73:0/304933580 >> v1:172.21.15.73:6789/0 conn(0x7f48880d4f30 legacy=0x7f488806c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:47.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.792+0000 7f4885ffb640 1 -- 172.21.15.73:0/304933580 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3181349408 0 0) 0x7f48880d54f0 con 0x7f48880d4f30 2024-03-29T04:08:47.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.792+0000 7f48867fc640 1 -- 172.21.15.73:0/304933580 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48880cf6a0 con 0x7f48880d3300 2024-03-29T04:08:47.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.793+0000 7f48867fc640 1 --2- 172.21.15.73:0/304933580 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48880d3300 0x7f48880d0180 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f487c0097a0 tx=0x7f487c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ffce5fd48cbe84d server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:47.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.793+0000 7f4885ffb640 1 -- 172.21.15.73:0/304933580 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487c034070 con 0x7f48880d3300 2024-03-29T04:08:47.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.793+0000 7f4885ffb640 1 -- 172.21.15.73:0/304933580 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f487c030610 con 0x7f48880d3300 2024-03-29T04:08:47.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.793+0000 7f4885ffb640 1 -- 172.21.15.73:0/304933580 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487c0309e0 con 0x7f48880d3300 2024-03-29T04:08:47.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.794+0000 7f488d5af640 1 -- 172.21.15.73:0/304933580 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48880d3300 msgr2=0x7f48880d0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:47.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.794+0000 7f488d5af640 1 --2- 172.21.15.73:0/304933580 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48880d3300 0x7f48880d0180 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f487c0097a0 tx=0x7f487c02b960 comp rx=0 tx=0).stop 2024-03-29T04:08:47.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.794+0000 7f488d5af640 1 -- 172.21.15.73:0/304933580 shutdown_connections 2024-03-29T04:08:47.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.794+0000 7f488d5af640 1 --2- 172.21.15.73:0/304933580 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48880d3300 0x7f48880d0180 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:47.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.794+0000 7f488d5af640 1 -- 172.21.15.73:0/304933580 >> 172.21.15.73:0/304933580 conn(0x7f488808bfc0 msgr2=0x7f48880d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:47.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.794+0000 7f488d5af640 1 -- 172.21.15.73:0/304933580 shutdown_connections 2024-03-29T04:08:47.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.794+0000 7f488d5af640 1 -- 172.21.15.73:0/304933580 wait complete. 2024-03-29T04:08:47.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.795+0000 7f488d5af640 1 Processor -- start 2024-03-29T04:08:47.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.795+0000 7f488d5af640 1 -- start start 2024-03-29T04:08:47.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.796+0000 7f488d5af640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48880d3300 0x7f488815cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:47.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.796+0000 7f488d5af640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48880d4f30 0x7f48880cd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:47.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.796+0000 7f488d5af640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f488815e9b0 0x7f48880b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:47.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.796+0000 7f488d5af640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4888162f70 con 0x7f48880d4f30 2024-03-29T04:08:47.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.796+0000 7f488d5af640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f488815ed90 con 0x7f488815e9b0 2024-03-29T04:08:47.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.796+0000 7f488d5af640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f48881630f0 con 0x7f48880d3300 2024-03-29T04:08:47.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.796+0000 7f48867fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48880d4f30 0x7f48880cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:47.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.796+0000 7f48867fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48880d4f30 0x7f48880cd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54222/0 (socket says 172.21.15.73:54222) 2024-03-29T04:08:47.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.796+0000 7f48867fc640 1 -- 172.21.15.73:0/2975360994 learned_addr learned my addr 172.21.15.73:0/2975360994 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:47.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.796+0000 7f4886ffd640 1 --2- 172.21.15.73:0/2975360994 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48880d3300 0x7f488815cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:47.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.796+0000 7f48877fe640 1 --2- 172.21.15.73:0/2975360994 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f488815e9b0 0x7f48880b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:47.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.796+0000 7f48867fc640 1 -- 172.21.15.73:0/2975360994 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48880d3300 msgr2=0x7f488815cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:47.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.796+0000 7f48867fc640 1 --2- 172.21.15.73:0/2975360994 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48880d3300 0x7f488815cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:47.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.796+0000 7f48867fc640 1 -- 172.21.15.73:0/2975360994 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f488815e9b0 msgr2=0x7f48880b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:47.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.796+0000 7f48867fc640 1 --2- 172.21.15.73:0/2975360994 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f488815e9b0 0x7f48880b93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:47.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.796+0000 7f48867fc640 1 -- 172.21.15.73:0/2975360994 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48880c8c80 con 0x7f48880d4f30 2024-03-29T04:08:47.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.796+0000 7f48867fc640 1 --2- 172.21.15.73:0/2975360994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48880d4f30 0x7f48880cd150 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f487c0098c0 tx=0x7f487c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:47.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.796+0000 7f486f7fe640 1 -- 172.21.15.73:0/2975360994 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487c034040 con 0x7f48880d4f30 2024-03-29T04:08:47.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.796+0000 7f486f7fe640 1 -- 172.21.15.73:0/2975360994 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f487c039a10 con 0x7f48880d4f30 2024-03-29T04:08:47.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.796+0000 7f486f7fe640 1 -- 172.21.15.73:0/2975360994 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487c039de0 con 0x7f48880d4f30 2024-03-29T04:08:47.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.797+0000 7f488d5af640 1 -- 172.21.15.73:0/2975360994 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48880c8f20 con 0x7f48880d4f30 2024-03-29T04:08:47.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.797+0000 7f488d5af640 1 -- 172.21.15.73:0/2975360994 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48880c94e0 con 0x7f48880d4f30 2024-03-29T04:08:47.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.797+0000 7f488d5af640 1 -- 172.21.15.73:0/2975360994 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4888068640 con 0x7f48880d4f30 2024-03-29T04:08:47.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.798+0000 7f486f7fe640 1 -- 172.21.15.73:0/2975360994 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f487c037070 con 0x7f48880d4f30 2024-03-29T04:08:47.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.798+0000 7f486f7fe640 1 --2- 172.21.15.73:0/2975360994 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f487406c530 0x7f487406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:47.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.798+0000 7f486f7fe640 1 -- 172.21.15.73:0/2975360994 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f487c0ad660 con 0x7f48880d4f30 2024-03-29T04:08:47.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.798+0000 7f4886ffd640 1 --2- 172.21.15.73:0/2975360994 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f487406c530 0x7f487406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:47.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.799+0000 7f4886ffd640 1 --2- 172.21.15.73:0/2975360994 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f487406c530 0x7f487406e9f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f48780012e0 tx=0x7f4878009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:47.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:47.803+0000 7f486f7fe640 1 -- 172.21.15.73:0/2975360994 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f487c07b7e0 con 0x7f48880d4f30 2024-03-29T04:08:47.994 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.015+0000 7f488d5af640 1 -- 172.21.15.73:0/2975360994 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f48880d1d00 con 0x7f48880d4f30 2024-03-29T04:08:47.995 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.016+0000 7f486f7fe640 1 -- 172.21.15.73:0/2975360994 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5178 (secure 0 0 0) 0x7f487c07fae0 con 0x7f48880d4f30 2024-03-29T04:08:47.995 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:47.995 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2101608781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2101608781},{"type":"v1","addr":"172.21.15.142:6834","nonce":2101608781}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3626787216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":3626787216},{"type":"v1","addr":"172.21.15.73:6837","nonce":3626787216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1987252283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1987252283},{"type":"v1","addr":"172.21.15.73:6836","nonce":1987252283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-29T04:08:11.922090+0000","modified":"2024-03-29T04:08:13.918938+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6835/569863112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":569863112},{"type":"v1","addr":"172.21.15.142:6835","nonce":569863112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-03-29T04:08:47.996 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 6 2024-03-29T04:08:47.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.018+0000 7f488d5af640 1 -- 172.21.15.73:0/2975360994 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f487406c530 msgr2=0x7f487406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:47.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.018+0000 7f488d5af640 1 --2- 172.21.15.73:0/2975360994 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f487406c530 0x7f487406e9f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f48780012e0 tx=0x7f4878009040 comp rx=0 tx=0).stop 2024-03-29T04:08:47.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.018+0000 7f488d5af640 1 -- 172.21.15.73:0/2975360994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48880d4f30 msgr2=0x7f48880cd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:47.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.018+0000 7f488d5af640 1 --2- 172.21.15.73:0/2975360994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48880d4f30 0x7f48880cd150 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f487c0098c0 tx=0x7f487c0046c0 comp rx=0 tx=0).stop 2024-03-29T04:08:47.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.018+0000 7f488d5af640 1 -- 172.21.15.73:0/2975360994 shutdown_connections 2024-03-29T04:08:47.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.018+0000 7f488d5af640 1 --2- 172.21.15.73:0/2975360994 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f487406c530 0x7f487406e9f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:47.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.018+0000 7f488d5af640 1 --2- 172.21.15.73:0/2975360994 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f488815e9b0 0x7f48880b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:47.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.018+0000 7f488d5af640 1 --2- 172.21.15.73:0/2975360994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48880d4f30 0x7f48880cd150 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:47.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.018+0000 7f488d5af640 1 --2- 172.21.15.73:0/2975360994 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48880d3300 0x7f488815cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:47.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.018+0000 7f488d5af640 1 -- 172.21.15.73:0/2975360994 >> 172.21.15.73:0/2975360994 conn(0x7f488808bfc0 msgr2=0x7f48881614e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:47.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.018+0000 7f488d5af640 1 -- 172.21.15.73:0/2975360994 shutdown_connections 2024-03-29T04:08:47.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.018+0000 7f488d5af640 1 -- 172.21.15.73:0/2975360994 wait complete. 2024-03-29T04:08:48.008 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-29T04:08:48.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.129+0000 7f2ce87f4640 1 Processor -- start 2024-03-29T04:08:48.109 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.129+0000 7f2ce87f4640 1 -- start start 2024-03-29T04:08:48.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.130+0000 7f2ce87f4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2ce015e870 0x7f2ce00b26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:48.110 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.130+0000 7f2ce87f4640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ce00b41d0 con 0x7f2ce00ae1b0 2024-03-29T04:08:48.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.130+0000 7f2ce87f4640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ce00b4470 con 0x7f2ce006bc20 2024-03-29T04:08:48.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.130+0000 7f2ce87f4640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f2ce00b6510 con 0x7f2ce015e870 2024-03-29T04:08:48.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.130+0000 7f2ce5d8f640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f2ce00ae1b0 0x7f2ce006b510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57238/0 (socket says 172.21.15.73:57238) 2024-03-29T04:08:48.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.130+0000 7f2ce5d8f640 1 -- 172.21.15.73:0/3169767617 learned_addr learned my addr 172.21.15.73:0/3169767617 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:48.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.131+0000 7f2ce6590640 1 --2- 172.21.15.73:0/3169767617 >> v2:172.21.15.142:3300/0 conn(0x7f2ce015e870 0x7f2ce00b26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:48.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.131+0000 7f2ce558e640 1 -- 172.21.15.73:0/3169767617 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 359904748 0 0) 0x7f2ce00b41d0 con 0x7f2ce00ae1b0 2024-03-29T04:08:48.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.131+0000 7f2ce558e640 1 -- 172.21.15.73:0/3169767617 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ccc003520 con 0x7f2ce00ae1b0 2024-03-29T04:08:48.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.131+0000 7f2ce558e640 1 -- 172.21.15.73:0/3169767617 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1137981006 0 0) 0x7f2ce00b4470 con 0x7f2ce006bc20 2024-03-29T04:08:48.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.131+0000 7f2ce6590640 1 -- 172.21.15.73:0/3169767617 >> v1:172.21.15.142:6789/0 conn(0x7f2ce006bc20 legacy=0x7f2ce00b16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:48.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.131+0000 7f2ce6590640 1 -- 172.21.15.73:0/3169767617 >> v1:172.21.15.73:6789/0 conn(0x7f2ce00ae1b0 legacy=0x7f2ce006b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:48.111 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.131+0000 7f2ce6590640 1 -- 172.21.15.73:0/3169767617 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ce00b4750 con 0x7f2ce015e870 2024-03-29T04:08:48.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.132+0000 7f2ce6590640 1 --2- 172.21.15.73:0/3169767617 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ce015e870 0x7f2ce00b26d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc009d90 tx=0x7f2cdc02beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ea5e94c625848c3 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:48.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.132+0000 7f2ce558e640 1 -- 172.21.15.73:0/3169767617 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc039070 con 0x7f2ce015e870 2024-03-29T04:08:48.112 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.132+0000 7f2ce558e640 1 -- 172.21.15.73:0/3169767617 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cdc02cc60 con 0x7f2ce015e870 2024-03-29T04:08:48.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.132+0000 7f2ce558e640 1 -- 172.21.15.73:0/3169767617 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc034660 con 0x7f2ce015e870 2024-03-29T04:08:48.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.132+0000 7f2ce87f4640 1 -- 172.21.15.73:0/3169767617 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ce015e870 msgr2=0x7f2ce00b26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:48.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.132+0000 7f2ce87f4640 1 --2- 172.21.15.73:0/3169767617 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ce015e870 0x7f2ce00b26d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc009d90 tx=0x7f2cdc02beb0 comp rx=0 tx=0).stop 2024-03-29T04:08:48.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.132+0000 7f2ce87f4640 1 -- 172.21.15.73:0/3169767617 shutdown_connections 2024-03-29T04:08:48.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.132+0000 7f2ce87f4640 1 --2- 172.21.15.73:0/3169767617 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ce015e870 0x7f2ce00b26d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:48.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.132+0000 7f2ce87f4640 1 -- 172.21.15.73:0/3169767617 >> 172.21.15.73:0/3169767617 conn(0x7f2ce00b66f0 msgr2=0x7f2ce00b6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:48.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.132+0000 7f2ce87f4640 1 -- 172.21.15.73:0/3169767617 shutdown_connections 2024-03-29T04:08:48.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.132+0000 7f2ce87f4640 1 -- 172.21.15.73:0/3169767617 wait complete. 2024-03-29T04:08:48.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.133+0000 7f2ce87f4640 1 Processor -- start 2024-03-29T04:08:48.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.134+0000 7f2ce87f4640 1 -- start start 2024-03-29T04:08:48.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.134+0000 7f2ce87f4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ce006bc20 0x7f2ce009d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:48.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.134+0000 7f2ce87f4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ce00ae1b0 0x7f2ce009ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:48.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.134+0000 7f2ce87f4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ce015e870 0x7f2ce01601c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:48.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.134+0000 7f2ce87f4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce00b04c0 con 0x7f2ce015e870 2024-03-29T04:08:48.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.134+0000 7f2ce87f4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce015ec50 con 0x7f2ce006bc20 2024-03-29T04:08:48.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.134+0000 7f2ce87f4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f2ce00b2c10 con 0x7f2ce00ae1b0 2024-03-29T04:08:48.115 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.134+0000 7f2ce6d91640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ce015e870 0x7f2ce01601c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:48.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.134+0000 7f2ce6d91640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ce015e870 0x7f2ce01601c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54234/0 (socket says 172.21.15.73:54234) 2024-03-29T04:08:48.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.134+0000 7f2ce6d91640 1 -- 172.21.15.73:0/3134045842 learned_addr learned my addr 172.21.15.73:0/3134045842 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:48.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.134+0000 7f2ce6590640 1 --2- 172.21.15.73:0/3134045842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ce006bc20 0x7f2ce009d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:48.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.134+0000 7f2ce5d8f640 1 --2- 172.21.15.73:0/3134045842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ce00ae1b0 0x7f2ce009ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:48.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.135+0000 7f2ce6d91640 1 -- 172.21.15.73:0/3134045842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ce00ae1b0 msgr2=0x7f2ce009ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:48.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.135+0000 7f2ce6d91640 1 --2- 172.21.15.73:0/3134045842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ce00ae1b0 0x7f2ce009ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:48.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.135+0000 7f2ce6d91640 1 -- 172.21.15.73:0/3134045842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ce006bc20 msgr2=0x7f2ce009d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:48.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.135+0000 7f2ce6d91640 1 --2- 172.21.15.73:0/3134045842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ce006bc20 0x7f2ce009d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:48.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.135+0000 7f2ce6d91640 1 -- 172.21.15.73:0/3134045842 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ce009f290 con 0x7f2ce015e870 2024-03-29T04:08:48.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.135+0000 7f2ce6590640 1 --2- 172.21.15.73:0/3134045842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ce006bc20 0x7f2ce009d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:08:48.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.135+0000 7f2ce6d91640 1 --2- 172.21.15.73:0/3134045842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ce015e870 0x7f2ce01601c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2cd800c410 tx=0x7f2cd800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:48.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.135+0000 7f2cd6ffd640 1 -- 172.21.15.73:0/3134045842 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd8017070 con 0x7f2ce015e870 2024-03-29T04:08:48.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.135+0000 7f2cd6ffd640 1 -- 172.21.15.73:0/3134045842 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cd80035f0 con 0x7f2ce015e870 2024-03-29T04:08:48.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.135+0000 7f2ce87f4640 1 -- 172.21.15.73:0/3134045842 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ce009d960 con 0x7f2ce015e870 2024-03-29T04:08:48.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.135+0000 7f2cd6ffd640 1 -- 172.21.15.73:0/3134045842 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd80039c0 con 0x7f2ce015e870 2024-03-29T04:08:48.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.135+0000 7f2ce87f4640 1 -- 172.21.15.73:0/3134045842 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ce009df20 con 0x7f2ce015e870 2024-03-29T04:08:48.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.136+0000 7f2ce87f4640 1 -- 172.21.15.73:0/3134045842 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ce0068d50 con 0x7f2ce015e870 2024-03-29T04:08:48.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.136+0000 7f2cd6ffd640 1 -- 172.21.15.73:0/3134045842 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f2cd801a070 con 0x7f2ce015e870 2024-03-29T04:08:48.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.137+0000 7f2cd6ffd640 1 --2- 172.21.15.73:0/3134045842 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2cc406c530 0x7f2cc406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:48.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.137+0000 7f2cd6ffd640 1 -- 172.21.15.73:0/3134045842 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2cd808a980 con 0x7f2ce015e870 2024-03-29T04:08:48.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.137+0000 7f2ce6590640 1 --2- 172.21.15.73:0/3134045842 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2cc406c530 0x7f2cc406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:48.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.137+0000 7f2ce6590640 1 --2- 172.21.15.73:0/3134045842 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2cc406c530 0x7f2cc406e9f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc036000 tx=0x7f2cdc030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:48.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.141+0000 7f2cd6ffd640 1 -- 172.21.15.73:0/3134045842 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f2cd8058950 con 0x7f2ce015e870 2024-03-29T04:08:48.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.316+0000 7f2ce87f4640 1 -- 172.21.15.73:0/3134045842 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2ce00aff70 con 0x7f2ce015e870 2024-03-29T04:08:48.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.317+0000 7f2cd6ffd640 1 -- 172.21.15.73:0/3134045842 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16605 (secure 0 0 0) 0x7f2cd805cc50 con 0x7f2ce015e870 2024-03-29T04:08:48.297 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:48.297 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"6bff1617-b138-4517-acca-3ecaae3f2bb3","created":"2024-03-29T04:07:47.346864+0000","modified":"2024-03-29T04:08:13.577603+0000","last_up_change":"2024-03-29T04:07:58.507139+0000","last_in_change":"2024-03-29T04:07:49.637816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-29T04:07:59.537301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-29T04:08:09.570906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-29T04:08:10.882349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"925d7de1-14ab-48c0-aebd-7bded108f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6820","nonce":2387335359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6824","nonce":2387335359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6831","nonce":2387335359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6828","nonce":2387335359}]},"public_addr":"172.21.15.73:6820/2387335359","cluster_addr":"172.21.15.73:6824/2387335359","heartbeat_back_addr":"172.21.15.73:6831/2387335359","heartbeat_front_addr":"172.21.15.73:6828/2387335359","state":["exists","up"]},{"osd":1,"uuid":"6b182102-882a-4e0c-99db-0afae5cfb38b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6801","nonce":2431315515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6803","nonce":2431315515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6807","nonce":2431315515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6805","nonce":2431315515}]},"public_addr":"172.21.15.73:6801/2431315515","cluster_addr":"172.21.15.73:6803/2431315515","heartbeat_back_addr":"172.21.15.73:6807/2431315515","heartbeat_front_addr":"172.21.15.73:6805/2431315515","state":["exists","up"]},{"osd":2,"uuid":"8040902e-b0b8-4a21-bf64-ce1c222115ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6809","nonce":407236597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6811","nonce":407236597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6815","nonce":407236597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6813","nonce":407236597}]},"public_addr":"172.21.15.73:6809/407236597","cluster_addr":"172.21.15.73:6811/407236597","heartbeat_back_addr":"172.21.15.73:6815/407236597","heartbeat_front_addr":"172.21.15.73:6813/407236597","state":["exists","up"]},{"osd":3,"uuid":"1bab19ee-3775-4ce1-a4ce-cf7cda3bbbf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6817","nonce":4291100709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6821","nonce":4291100709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6829","nonce":4291100709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6825","nonce":4291100709}]},"public_addr":"172.21.15.73:6817/4291100709","cluster_addr":"172.21.15.73:6821/4291100709","heartbeat_back_addr":"172.21.15.73:6829/4291100709","heartbeat_front_addr":"172.21.15.73:6825/4291100709","state":["exists","up"]},{"osd":4,"uuid":"b0c74337-8fe4-47dc-b3da-2d07591b1f6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6817","nonce":3703256194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6819","nonce":3703256194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6823","nonce":3703256194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6821","nonce":3703256194}]},"public_addr":"172.21.15.142:6817/3703256194","cluster_addr":"172.21.15.142:6819/3703256194","heartbeat_back_addr":"172.21.15.142:6823/3703256194","heartbeat_front_addr":"172.21.15.142:6821/3703256194","state":["exists","up"]},{"osd":5,"uuid":"9ce36410-a29a-42c6-99f4-f95d4afdd7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6825","nonce":4271575803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6827","nonce":4271575803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6831","nonce":4271575803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6829","nonce":4271575803}]},"public_addr":"172.21.15.142:6825/4271575803","cluster_addr":"172.21.15.142:6827/4271575803","heartbeat_back_addr":"172.21.15.142:6831/4271575803","heartbeat_front_addr":"172.21.15.142:6829/4271575803","state":["exists","up"]},{"osd":6,"uuid":"aec4264a-64ac-428e-a860-d2920a304019","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6801","nonce":1772722570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6803","nonce":1772722570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6807","nonce":1772722570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6805","nonce":1772722570}]},"public_addr":"172.21.15.142:6801/1772722570","cluster_addr":"172.21.15.142:6803/1772722570","heartbeat_back_addr":"172.21.15.142:6807/1772722570","heartbeat_front_addr":"172.21.15.142:6805/1772722570","state":["exists","up"]},{"osd":7,"uuid":"fe599052-8e5a-4c7a-91e7-52d1bae24a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6809","nonce":3910589675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6811","nonce":3910589675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6815","nonce":3910589675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6813","nonce":3910589675}]},"public_addr":"172.21.15.142:6809/3910589675","cluster_addr":"172.21.15.142:6811/3910589675","heartbeat_back_addr":"172.21.15.142:6815/3910589675","heartbeat_front_addr":"172.21.15.142:6813/3910589675","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.835096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.587210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.786547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.778004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.843740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.791160+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.837992+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.718722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:08:48.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.319+0000 7f2ce87f4640 1 -- 172.21.15.73:0/3134045842 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2cc406c530 msgr2=0x7f2cc406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:48.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.319+0000 7f2ce87f4640 1 --2- 172.21.15.73:0/3134045842 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2cc406c530 0x7f2cc406e9f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc036000 tx=0x7f2cdc030000 comp rx=0 tx=0).stop 2024-03-29T04:08:48.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.319+0000 7f2ce87f4640 1 -- 172.21.15.73:0/3134045842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ce015e870 msgr2=0x7f2ce01601c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:48.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.319+0000 7f2ce87f4640 1 --2- 172.21.15.73:0/3134045842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ce015e870 0x7f2ce01601c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2cd800c410 tx=0x7f2cd800c8d0 comp rx=0 tx=0).stop 2024-03-29T04:08:48.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.319+0000 7f2ce87f4640 1 -- 172.21.15.73:0/3134045842 shutdown_connections 2024-03-29T04:08:48.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.319+0000 7f2ce87f4640 1 --2- 172.21.15.73:0/3134045842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ce015e870 0x7f2ce01601c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:48.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.319+0000 7f2ce87f4640 1 --2- 172.21.15.73:0/3134045842 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2ce00ae1b0 0x7f2ce009ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:48.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.319+0000 7f2ce87f4640 1 --2- 172.21.15.73:0/3134045842 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f2cc406c530 0x7f2cc406e9f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:48.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.319+0000 7f2ce87f4640 1 --2- 172.21.15.73:0/3134045842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ce006bc20 0x7f2ce009d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:48.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.319+0000 7f2ce87f4640 1 -- 172.21.15.73:0/3134045842 >> 172.21.15.73:0/3134045842 conn(0x7f2ce00b66f0 msgr2=0x7f2ce006f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:48.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.319+0000 7f2ce87f4640 1 -- 172.21.15.73:0/3134045842 shutdown_connections 2024-03-29T04:08:48.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.320+0000 7f2ce87f4640 1 -- 172.21.15.73:0/3134045842 wait complete. 2024-03-29T04:08:48.310 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-29T04:08:48.311 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-29T04:08:48.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.431+0000 7f9aab196640 1 Processor -- start 2024-03-29T04:08:48.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.431+0000 7f9aab196640 1 -- start start 2024-03-29T04:08:48.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.432+0000 7f9aab196640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9aa40ad940 0x7f9aa406c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:48.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.432+0000 7f9aab196640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9aa4146230 con 0x7f9aa406f060 2024-03-29T04:08:48.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.432+0000 7f9aab196640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9aa406dfc0 con 0x7f9aa415c670 2024-03-29T04:08:48.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.432+0000 7f9aab196640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f9aa406e2a0 con 0x7f9aa40ad940 2024-03-29T04:08:48.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.432+0000 7f9aa3fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9aa40ad940 0x7f9aa406c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:48.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.432+0000 7f9aa9733640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9aa406f060 0x7f9aa40b32c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57246/0 (socket says 172.21.15.73:57246) 2024-03-29T04:08:48.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.432+0000 7f9aa9733640 1 -- 172.21.15.73:0/728591041 learned_addr learned my addr 172.21.15.73:0/728591041 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:48.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.432+0000 7f9aa3fff640 1 -- 172.21.15.73:0/728591041 >> v1:172.21.15.142:6789/0 conn(0x7f9aa415c670 legacy=0x7f9aa40ad230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:48.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.432+0000 7f9aa3fff640 1 -- 172.21.15.73:0/728591041 >> v1:172.21.15.73:6789/0 conn(0x7f9aa406f060 legacy=0x7f9aa40b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:48.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.432+0000 7f9aa3fff640 1 -- 172.21.15.73:0/728591041 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aa406e580 con 0x7f9aa40ad940 2024-03-29T04:08:48.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.432+0000 7f9aa37fe640 1 -- 172.21.15.73:0/728591041 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3288651429 0 0) 0x7f9a9c001490 con 0x7f9aa406f060 2024-03-29T04:08:48.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.433+0000 7f9aa3fff640 1 --2- 172.21.15.73:0/728591041 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9aa40ad940 0x7f9aa406c030 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9a980097a0 tx=0x7f9a9802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=746b84d2ac0ddc02 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:48.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.433+0000 7f9aa37fe640 1 -- 172.21.15.73:0/728591041 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a98035020 con 0x7f9aa40ad940 2024-03-29T04:08:48.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.433+0000 7f9aa37fe640 1 -- 172.21.15.73:0/728591041 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a98031830 con 0x7f9aa40ad940 2024-03-29T04:08:48.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.433+0000 7f9aa37fe640 1 -- 172.21.15.73:0/728591041 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a98031c00 con 0x7f9aa40ad940 2024-03-29T04:08:48.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.434+0000 7f9aab196640 1 -- 172.21.15.73:0/728591041 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9aa40ad940 msgr2=0x7f9aa406c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:48.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.434+0000 7f9aab196640 1 --2- 172.21.15.73:0/728591041 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9aa40ad940 0x7f9aa406c030 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9a980097a0 tx=0x7f9a9802b8d0 comp rx=0 tx=0).stop 2024-03-29T04:08:48.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.434+0000 7f9aab196640 1 -- 172.21.15.73:0/728591041 shutdown_connections 2024-03-29T04:08:48.415 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.434+0000 7f9aab196640 1 --2- 172.21.15.73:0/728591041 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9aa40ad940 0x7f9aa406c030 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:48.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.434+0000 7f9aab196640 1 -- 172.21.15.73:0/728591041 >> 172.21.15.73:0/728591041 conn(0x7f9aa406b510 msgr2=0x7f9aa406b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:48.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.434+0000 7f9aab196640 1 -- 172.21.15.73:0/728591041 shutdown_connections 2024-03-29T04:08:48.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.434+0000 7f9aab196640 1 -- 172.21.15.73:0/728591041 wait complete. 2024-03-29T04:08:48.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.435+0000 7f9aab196640 1 Processor -- start 2024-03-29T04:08:48.416 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.435+0000 7f9aab196640 1 -- start start 2024-03-29T04:08:48.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.436+0000 7f9aab196640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9aa406f060 0x7f9aa415b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:48.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.436+0000 7f9aab196640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9aa40ad940 0x7f9aa40718d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:48.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.436+0000 7f9aab196640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9aa415c670 0x7f9aa40b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:48.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.436+0000 7f9aab196640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa406d930 con 0x7f9aa415c670 2024-03-29T04:08:48.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.436+0000 7f9aab196640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa415ca50 con 0x7f9aa40ad940 2024-03-29T04:08:48.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.436+0000 7f9aab196640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9aa406dab0 con 0x7f9aa406f060 2024-03-29T04:08:48.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.436+0000 7f9aa9733640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9aa415c670 0x7f9aa40b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:48.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.436+0000 7f9aa9733640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9aa415c670 0x7f9aa40b40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54260/0 (socket says 172.21.15.73:54260) 2024-03-29T04:08:48.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.436+0000 7f9aa9733640 1 -- 172.21.15.73:0/110148834 learned_addr learned my addr 172.21.15.73:0/110148834 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:48.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.436+0000 7f9aa3fff640 1 --2- 172.21.15.73:0/110148834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9aa40ad940 0x7f9aa40718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:48.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.436+0000 7f9aa8f32640 1 --2- 172.21.15.73:0/110148834 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9aa406f060 0x7f9aa415b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:48.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.436+0000 7f9aa9733640 1 -- 172.21.15.73:0/110148834 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9aa406f060 msgr2=0x7f9aa415b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:48.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.436+0000 7f9aa9733640 1 --2- 172.21.15.73:0/110148834 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9aa406f060 0x7f9aa415b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:48.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.436+0000 7f9aa9733640 1 -- 172.21.15.73:0/110148834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9aa40ad940 msgr2=0x7f9aa40718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:48.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.436+0000 7f9aa9733640 1 --2- 172.21.15.73:0/110148834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9aa40ad940 0x7f9aa40718d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:48.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.436+0000 7f9aa9733640 1 -- 172.21.15.73:0/110148834 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aa415b2f0 con 0x7f9aa415c670 2024-03-29T04:08:48.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.436+0000 7f9aa9733640 1 --2- 172.21.15.73:0/110148834 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9aa415c670 0x7f9aa40b40d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c00c7f0 tx=0x7f9a9c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:48.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.437+0000 7f9aa17fa640 1 -- 172.21.15.73:0/110148834 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c018070 con 0x7f9aa415c670 2024-03-29T04:08:48.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.437+0000 7f9aa17fa640 1 -- 172.21.15.73:0/110148834 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a9c00a5e0 con 0x7f9aa415c670 2024-03-29T04:08:48.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.437+0000 7f9aab196640 1 -- 172.21.15.73:0/110148834 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9aa40cb9c0 con 0x7f9aa415c670 2024-03-29T04:08:48.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.437+0000 7f9aa17fa640 1 -- 172.21.15.73:0/110148834 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c00a9d0 con 0x7f9aa415c670 2024-03-29T04:08:48.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.437+0000 7f9aab196640 1 -- 172.21.15.73:0/110148834 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9aa40cbf80 con 0x7f9aa415c670 2024-03-29T04:08:48.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.438+0000 7f9aab196640 1 -- 172.21.15.73:0/110148834 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9aa4068640 con 0x7f9aa415c670 2024-03-29T04:08:48.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.438+0000 7f9aa17fa640 1 -- 172.21.15.73:0/110148834 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f9a9c01b070 con 0x7f9aa415c670 2024-03-29T04:08:48.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.439+0000 7f9aa17fa640 1 --2- 172.21.15.73:0/110148834 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9a9006c530 0x7f9a9006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:48.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.439+0000 7f9aa17fa640 1 -- 172.21.15.73:0/110148834 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9a9c08ab40 con 0x7f9aa415c670 2024-03-29T04:08:48.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.439+0000 7f9aa8f32640 1 --2- 172.21.15.73:0/110148834 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9a9006c530 0x7f9a9006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:48.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.439+0000 7f9aa8f32640 1 --2- 172.21.15.73:0/110148834 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9a9006c530 0x7f9a9006e9f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9a94000f60 tx=0x7f9a94009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:48.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.443+0000 7f9aa17fa640 1 -- 172.21.15.73:0/110148834 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f9aa4146230 con 0x7f9aa415c670 2024-03-29T04:08:48.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.655+0000 7f9aab196640 1 -- 172.21.15.73:0/110148834 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9aa406f570 con 0x7f9aa415c670 2024-03-29T04:08:48.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.655+0000 7f9aa17fa640 1 -- 172.21.15.73:0/110148834 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5178 (secure 0 0 0) 0x7f9a9c059e20 con 0x7f9aa415c670 2024-03-29T04:08:48.638 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:48.638 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2101608781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2101608781},{"type":"v1","addr":"172.21.15.142:6834","nonce":2101608781}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3626787216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":3626787216},{"type":"v1","addr":"172.21.15.73:6837","nonce":3626787216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1987252283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1987252283},{"type":"v1","addr":"172.21.15.73:6836","nonce":1987252283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-29T04:08:11.922090+0000","modified":"2024-03-29T04:08:13.918938+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6835/569863112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":569863112},{"type":"v1","addr":"172.21.15.142:6835","nonce":569863112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-03-29T04:08:48.639 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 6 2024-03-29T04:08:48.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.657+0000 7f9aab196640 1 -- 172.21.15.73:0/110148834 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9a9006c530 msgr2=0x7f9a9006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:48.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.657+0000 7f9aab196640 1 --2- 172.21.15.73:0/110148834 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9a9006c530 0x7f9a9006e9f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9a94000f60 tx=0x7f9a94009040 comp rx=0 tx=0).stop 2024-03-29T04:08:48.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.657+0000 7f9aab196640 1 -- 172.21.15.73:0/110148834 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9aa415c670 msgr2=0x7f9aa40b40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:48.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.657+0000 7f9aab196640 1 --2- 172.21.15.73:0/110148834 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9aa415c670 0x7f9aa40b40d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c00c7f0 tx=0x7f9a9c00ccb0 comp rx=0 tx=0).stop 2024-03-29T04:08:48.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.657+0000 7f9aab196640 1 -- 172.21.15.73:0/110148834 shutdown_connections 2024-03-29T04:08:48.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.657+0000 7f9aab196640 1 --2- 172.21.15.73:0/110148834 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9aa415c670 0x7f9aa40b40d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:48.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.657+0000 7f9aab196640 1 --2- 172.21.15.73:0/110148834 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9a9006c530 0x7f9a9006e9f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:48.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.657+0000 7f9aab196640 1 --2- 172.21.15.73:0/110148834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9aa40ad940 0x7f9aa40718d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:48.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.657+0000 7f9aab196640 1 --2- 172.21.15.73:0/110148834 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9aa406f060 0x7f9aa415b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:48.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.657+0000 7f9aab196640 1 -- 172.21.15.73:0/110148834 >> 172.21.15.73:0/110148834 conn(0x7f9aa406b510 msgr2=0x7f9aa4160090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:48.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.657+0000 7f9aab196640 1 -- 172.21.15.73:0/110148834 shutdown_connections 2024-03-29T04:08:48.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.657+0000 7f9aab196640 1 -- 172.21.15.73:0/110148834 wait complete. 2024-03-29T04:08:48.648 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-29T04:08:48.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.768+0000 7fac9cbaf640 1 Processor -- start 2024-03-29T04:08:48.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.768+0000 7fac9cbaf640 1 -- start start 2024-03-29T04:08:48.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.769+0000 7fac9cbaf640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac98070990 0x7fac9809b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:48.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.769+0000 7fac9cbaf640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac980d0e10 con 0x7fac980d05c0 2024-03-29T04:08:48.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.769+0000 7fac9cbaf640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac980d10f0 con 0x7fac9809b140 2024-03-29T04:08:48.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.769+0000 7fac9cbaf640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fac980d13d0 con 0x7fac98070990 2024-03-29T04:08:48.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.769+0000 7fac95d9b640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fac980d05c0 0x7fac9809aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57250/0 (socket says 172.21.15.73:57250) 2024-03-29T04:08:48.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.769+0000 7fac95d9b640 1 -- 172.21.15.73:0/3406858647 learned_addr learned my addr 172.21.15.73:0/3406858647 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:48.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.769+0000 7fac9659c640 1 --2- 172.21.15.73:0/3406858647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac98070990 0x7fac9809b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:48.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.770+0000 7fac9559a640 1 -- 172.21.15.73:0/3406858647 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1251571362 0 0) 0x7fac980d0e10 con 0x7fac980d05c0 2024-03-29T04:08:48.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.770+0000 7fac9559a640 1 -- 172.21.15.73:0/3406858647 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac80003520 con 0x7fac980d05c0 2024-03-29T04:08:48.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.770+0000 7fac9559a640 1 -- 172.21.15.73:0/3406858647 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 233422101 0 0) 0x7fac980d10f0 con 0x7fac9809b140 2024-03-29T04:08:48.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.770+0000 7fac9559a640 1 -- 172.21.15.73:0/3406858647 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac980d0e10 con 0x7fac9809b140 2024-03-29T04:08:48.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.770+0000 7fac9659c640 1 -- 172.21.15.73:0/3406858647 >> v1:172.21.15.142:6789/0 conn(0x7fac9809b140 legacy=0x7fac9815e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:48.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.770+0000 7fac9659c640 1 -- 172.21.15.73:0/3406858647 >> v1:172.21.15.73:6789/0 conn(0x7fac980d05c0 legacy=0x7fac9809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:48.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.770+0000 7fac9659c640 1 -- 172.21.15.73:0/3406858647 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac980d16b0 con 0x7fac98070990 2024-03-29T04:08:48.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.771+0000 7fac9659c640 1 --2- 172.21.15.73:0/3406858647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac98070990 0x7fac9809b930 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fac88009dc0 tx=0x7fac8802bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a59560434d7356c server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:48.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.771+0000 7fac9559a640 1 -- 172.21.15.73:0/3406858647 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac88039070 con 0x7fac98070990 2024-03-29T04:08:48.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.771+0000 7fac9559a640 1 -- 172.21.15.73:0/3406858647 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac8802ccd0 con 0x7fac98070990 2024-03-29T04:08:48.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.771+0000 7fac9559a640 1 -- 172.21.15.73:0/3406858647 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac88034640 con 0x7fac98070990 2024-03-29T04:08:48.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.771+0000 7fac9cbaf640 1 -- 172.21.15.73:0/3406858647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac98070990 msgr2=0x7fac9809b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:48.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.771+0000 7fac9cbaf640 1 --2- 172.21.15.73:0/3406858647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac98070990 0x7fac9809b930 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fac88009dc0 tx=0x7fac8802bf20 comp rx=0 tx=0).stop 2024-03-29T04:08:48.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.771+0000 7fac9cbaf640 1 -- 172.21.15.73:0/3406858647 shutdown_connections 2024-03-29T04:08:48.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.771+0000 7fac9cbaf640 1 --2- 172.21.15.73:0/3406858647 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac98070990 0x7fac9809b930 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:48.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.771+0000 7fac9cbaf640 1 -- 172.21.15.73:0/3406858647 >> 172.21.15.73:0/3406858647 conn(0x7fac980d2430 msgr2=0x7fac980d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:48.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.771+0000 7fac9cbaf640 1 -- 172.21.15.73:0/3406858647 shutdown_connections 2024-03-29T04:08:48.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.771+0000 7fac9cbaf640 1 -- 172.21.15.73:0/3406858647 wait complete. 2024-03-29T04:08:48.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.773+0000 7fac9cbaf640 1 Processor -- start 2024-03-29T04:08:48.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.773+0000 7fac9cbaf640 1 -- start start 2024-03-29T04:08:48.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.773+0000 7fac9cbaf640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac98070990 0x7fac981f3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:48.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.773+0000 7fac9cbaf640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac9809b140 0x7fac980b71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:48.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.773+0000 7fac9cbaf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac980d05c0 0x7fac9809f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:48.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.773+0000 7fac9cbaf640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fac980d0ba0 con 0x7fac980d05c0 2024-03-29T04:08:48.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.773+0000 7fac9cbaf640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fac980d0a20 con 0x7fac9809b140 2024-03-29T04:08:48.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.773+0000 7fac9cbaf640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fac98070d70 con 0x7fac98070990 2024-03-29T04:08:48.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.773+0000 7fac96d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac980d05c0 0x7fac9809f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:48.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.774+0000 7fac96d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac980d05c0 0x7fac9809f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54276/0 (socket says 172.21.15.73:54276) 2024-03-29T04:08:48.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.774+0000 7fac96d9d640 1 -- 172.21.15.73:0/1340979107 learned_addr learned my addr 172.21.15.73:0/1340979107 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:48.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.774+0000 7fac95d9b640 1 --2- 172.21.15.73:0/1340979107 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac9809b140 0x7fac980b71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:48.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.774+0000 7fac9659c640 1 --2- 172.21.15.73:0/1340979107 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac98070990 0x7fac981f3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:48.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.774+0000 7fac96d9d640 1 -- 172.21.15.73:0/1340979107 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac98070990 msgr2=0x7fac981f3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:48.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.774+0000 7fac96d9d640 1 --2- 172.21.15.73:0/1340979107 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac98070990 0x7fac981f3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:48.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.774+0000 7fac96d9d640 1 -- 172.21.15.73:0/1340979107 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac9809b140 msgr2=0x7fac980b71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:48.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.774+0000 7fac96d9d640 1 --2- 172.21.15.73:0/1340979107 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac9809b140 0x7fac980b71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:48.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.774+0000 7fac96d9d640 1 -- 172.21.15.73:0/1340979107 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac9809cf50 con 0x7fac980d05c0 2024-03-29T04:08:48.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.774+0000 7fac96d9d640 1 --2- 172.21.15.73:0/1340979107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac980d05c0 0x7fac9809f4b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fac9000c460 tx=0x7fac9000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:48.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.774+0000 7fac86ffd640 1 -- 172.21.15.73:0/1340979107 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac90017070 con 0x7fac980d05c0 2024-03-29T04:08:48.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.774+0000 7fac86ffd640 1 -- 172.21.15.73:0/1340979107 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac900052d0 con 0x7fac980d05c0 2024-03-29T04:08:48.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.774+0000 7fac86ffd640 1 -- 172.21.15.73:0/1340979107 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac90012870 con 0x7fac980d05c0 2024-03-29T04:08:48.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.774+0000 7fac9cbaf640 1 -- 172.21.15.73:0/1340979107 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac9809d230 con 0x7fac980d05c0 2024-03-29T04:08:48.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.774+0000 7fac9cbaf640 1 -- 172.21.15.73:0/1340979107 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac9809d7f0 con 0x7fac980d05c0 2024-03-29T04:08:48.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.775+0000 7fac9cbaf640 1 -- 172.21.15.73:0/1340979107 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac98068640 con 0x7fac980d05c0 2024-03-29T04:08:48.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.776+0000 7fac86ffd640 1 -- 172.21.15.73:0/1340979107 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fac9001a070 con 0x7fac980d05c0 2024-03-29T04:08:48.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.776+0000 7fac86ffd640 1 --2- 172.21.15.73:0/1340979107 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fac7806c530 0x7fac7806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:48.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.776+0000 7fac86ffd640 1 -- 172.21.15.73:0/1340979107 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fac9008a810 con 0x7fac980d05c0 2024-03-29T04:08:48.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.776+0000 7fac9659c640 1 --2- 172.21.15.73:0/1340979107 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fac7806c530 0x7fac7806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:48.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.777+0000 7fac9659c640 1 --2- 172.21.15.73:0/1340979107 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fac7806c530 0x7fac7806e9f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fac88036000 tx=0x7fac88030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:48.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.781+0000 7fac86ffd640 1 -- 172.21.15.73:0/1340979107 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fac90058870 con 0x7fac980d05c0 2024-03-29T04:08:48.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.990+0000 7fac9cbaf640 1 -- 172.21.15.73:0/1340979107 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fac980d32f0 con 0x7fac980d05c0 2024-03-29T04:08:48.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.991+0000 7fac86ffd640 1 -- 172.21.15.73:0/1340979107 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5178 (secure 0 0 0) 0x7fac9005cb70 con 0x7fac980d05c0 2024-03-29T04:08:48.971 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:48.971 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/2101608781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":2101608781},{"type":"v1","addr":"172.21.15.142:6834","nonce":2101608781}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3626787216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":3626787216},{"type":"v1","addr":"172.21.15.73:6837","nonce":3626787216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1987252283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1987252283},{"type":"v1","addr":"172.21.15.73:6836","nonce":1987252283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-29T04:08:11.922090+0000","modified":"2024-03-29T04:08:13.918938+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.142:6835/569863112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":569863112},{"type":"v1","addr":"172.21.15.142:6835","nonce":569863112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-03-29T04:08:48.971 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 6 2024-03-29T04:08:48.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.993+0000 7fac9cbaf640 1 -- 172.21.15.73:0/1340979107 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fac7806c530 msgr2=0x7fac7806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:48.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.993+0000 7fac9cbaf640 1 --2- 172.21.15.73:0/1340979107 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fac7806c530 0x7fac7806e9f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fac88036000 tx=0x7fac88030000 comp rx=0 tx=0).stop 2024-03-29T04:08:48.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.993+0000 7fac9cbaf640 1 -- 172.21.15.73:0/1340979107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac980d05c0 msgr2=0x7fac9809f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:48.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.993+0000 7fac9cbaf640 1 --2- 172.21.15.73:0/1340979107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac980d05c0 0x7fac9809f4b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fac9000c460 tx=0x7fac9000c920 comp rx=0 tx=0).stop 2024-03-29T04:08:48.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.993+0000 7fac9cbaf640 1 -- 172.21.15.73:0/1340979107 shutdown_connections 2024-03-29T04:08:48.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.993+0000 7fac9cbaf640 1 --2- 172.21.15.73:0/1340979107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac980d05c0 0x7fac9809f4b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:48.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.993+0000 7fac9cbaf640 1 --2- 172.21.15.73:0/1340979107 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fac7806c530 0x7fac7806e9f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:48.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.993+0000 7fac9cbaf640 1 --2- 172.21.15.73:0/1340979107 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac9809b140 0x7fac980b71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:48.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.993+0000 7fac9cbaf640 1 --2- 172.21.15.73:0/1340979107 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac98070990 0x7fac981f3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:48.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.993+0000 7fac9cbaf640 1 -- 172.21.15.73:0/1340979107 >> 172.21.15.73:0/1340979107 conn(0x7fac980d2430 msgr2=0x7fac980af220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:48.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.993+0000 7fac9cbaf640 1 -- 172.21.15.73:0/1340979107 shutdown_connections 2024-03-29T04:08:48.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:48.993+0000 7fac9cbaf640 1 -- 172.21.15.73:0/1340979107 wait complete. 2024-03-29T04:08:48.983 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-29T04:08:49.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.103+0000 7f27804c1640 1 Processor -- start 2024-03-29T04:08:49.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.103+0000 7f27804c1640 1 -- start start 2024-03-29T04:08:49.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.104+0000 7f27804c1640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2778144790 0x7f27780b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:49.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.104+0000 7f27804c1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f277806e1c0 0x7f277806e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:49.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.104+0000 7f27804c1640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27780b3c10 con 0x7f277806f1e0 2024-03-29T04:08:49.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.104+0000 7f27804c1640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f27780b39d0 con 0x7f2778144790 2024-03-29T04:08:49.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.104+0000 7f27804c1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f27780b3ef0 con 0x7f277806e1c0 2024-03-29T04:08:49.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.105+0000 7f277e25d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2778144790 0x7f27780b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:49.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.105+0000 7f277da5c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f277806f1e0 0x7f27780b32c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57264/0 (socket says 172.21.15.73:57264) 2024-03-29T04:08:49.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.105+0000 7f277da5c640 1 -- 172.21.15.73:0/402657231 learned_addr learned my addr 172.21.15.73:0/402657231 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:49.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.105+0000 7f277ea5e640 1 --2- 172.21.15.73:0/402657231 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f277806e1c0 0x7f277806e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:49.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.105+0000 7f277e25d640 1 -- 172.21.15.73:0/402657231 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f277806e1c0 msgr2=0x7f277806e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:49.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.105+0000 7f277e25d640 1 --2- 172.21.15.73:0/402657231 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f277806e1c0 0x7f277806e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:49.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.105+0000 7f277e25d640 1 -- 172.21.15.73:0/402657231 >> v1:172.21.15.73:6789/0 conn(0x7f277806f1e0 legacy=0x7f27780b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:49.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.105+0000 7f277d25b640 1 -- 172.21.15.73:0/402657231 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3771374343 0 0) 0x7f27780b3c10 con 0x7f277806f1e0 2024-03-29T04:08:49.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.105+0000 7f277e25d640 1 -- 172.21.15.73:0/402657231 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27780b41d0 con 0x7f2778144790 2024-03-29T04:08:49.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.106+0000 7f277e25d640 1 --2- 172.21.15.73:0/402657231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2778144790 0x7f27780b4cb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f27700097a0 tx=0x7f277002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c8ee4d9206b3b62 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:49.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.106+0000 7f277d25b640 1 -- 172.21.15.73:0/402657231 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2770035020 con 0x7f2778144790 2024-03-29T04:08:49.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.106+0000 7f277d25b640 1 -- 172.21.15.73:0/402657231 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2770031830 con 0x7f2778144790 2024-03-29T04:08:49.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.106+0000 7f277d25b640 1 -- 172.21.15.73:0/402657231 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2770031c00 con 0x7f2778144790 2024-03-29T04:08:49.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.106+0000 7f27804c1640 1 -- 172.21.15.73:0/402657231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2778144790 msgr2=0x7f27780b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:49.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.106+0000 7f27804c1640 1 --2- 172.21.15.73:0/402657231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2778144790 0x7f27780b4cb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f27700097a0 tx=0x7f277002b8d0 comp rx=0 tx=0).stop 2024-03-29T04:08:49.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.106+0000 7f27804c1640 1 -- 172.21.15.73:0/402657231 shutdown_connections 2024-03-29T04:08:49.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.106+0000 7f27804c1640 1 --2- 172.21.15.73:0/402657231 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f277806e1c0 0x7f277806e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:49.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.106+0000 7f27804c1640 1 --2- 172.21.15.73:0/402657231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2778144790 0x7f27780b4cb0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:49.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.106+0000 7f27804c1640 1 -- 172.21.15.73:0/402657231 >> 172.21.15.73:0/402657231 conn(0x7f277806b510 msgr2=0x7f277806b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:49.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.106+0000 7f27804c1640 1 -- 172.21.15.73:0/402657231 shutdown_connections 2024-03-29T04:08:49.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.106+0000 7f27804c1640 1 -- 172.21.15.73:0/402657231 wait complete. 2024-03-29T04:08:49.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.107+0000 7f27804c1640 1 Processor -- start 2024-03-29T04:08:49.088 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.108+0000 7f27804c1640 1 -- start start 2024-03-29T04:08:49.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.108+0000 7f27804c1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f277806e1c0 0x7f27780cf780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:49.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.108+0000 7f27804c1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f277806f1e0 0x7f277815d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:49.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.108+0000 7f27804c1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2778144790 0x7f2778153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:49.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.108+0000 7f27804c1640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f27780b51f0 con 0x7f277806e1c0 2024-03-29T04:08:49.092 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.108+0000 7f27804c1640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f27780b4790 con 0x7f277806f1e0 2024-03-29T04:08:49.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.108+0000 7f27804c1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f277815db70 con 0x7f2778144790 2024-03-29T04:08:49.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.108+0000 7f277e25d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f277806e1c0 0x7f27780cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:49.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.108+0000 7f277e25d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f277806e1c0 0x7f27780cf780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54294/0 (socket says 172.21.15.73:54294) 2024-03-29T04:08:49.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.108+0000 7f277e25d640 1 -- 172.21.15.73:0/4168363977 learned_addr learned my addr 172.21.15.73:0/4168363977 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:49.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.108+0000 7f277da5c640 1 --2- 172.21.15.73:0/4168363977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f277806f1e0 0x7f277815d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:49.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.108+0000 7f277ea5e640 1 --2- 172.21.15.73:0/4168363977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2778144790 0x7f2778153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:49.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.109+0000 7f277e25d640 1 -- 172.21.15.73:0/4168363977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2778144790 msgr2=0x7f2778153700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:49.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.109+0000 7f277e25d640 1 --2- 172.21.15.73:0/4168363977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2778144790 0x7f2778153700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:49.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.109+0000 7f277e25d640 1 -- 172.21.15.73:0/4168363977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f277806f1e0 msgr2=0x7f277815d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:49.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.109+0000 7f277e25d640 1 --2- 172.21.15.73:0/4168363977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f277806f1e0 0x7f277815d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:49.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.109+0000 7f277e25d640 1 -- 172.21.15.73:0/4168363977 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27781529e0 con 0x7f277806e1c0 2024-03-29T04:08:49.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.109+0000 7f277da5c640 1 --2- 172.21.15.73:0/4168363977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f277806f1e0 0x7f277815d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:08:49.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.109+0000 7f277e25d640 1 --2- 172.21.15.73:0/4168363977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f277806e1c0 0x7f27780cf780 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2770034040 tx=0x7f27700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:49.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.109+0000 7f2776ffd640 1 -- 172.21.15.73:0/4168363977 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2770040070 con 0x7f277806e1c0 2024-03-29T04:08:49.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.109+0000 7f2776ffd640 1 -- 172.21.15.73:0/4168363977 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f277003a910 con 0x7f277806e1c0 2024-03-29T04:08:49.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.109+0000 7f27804c1640 1 -- 172.21.15.73:0/4168363977 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2778152700 con 0x7f277806e1c0 2024-03-29T04:08:49.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.109+0000 7f2776ffd640 1 -- 172.21.15.73:0/4168363977 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2770035040 con 0x7f277806e1c0 2024-03-29T04:08:49.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.109+0000 7f27804c1640 1 -- 172.21.15.73:0/4168363977 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f277815ce30 con 0x7f277806e1c0 2024-03-29T04:08:49.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.110+0000 7f27804c1640 1 -- 172.21.15.73:0/4168363977 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2778068640 con 0x7f277806e1c0 2024-03-29T04:08:49.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.110+0000 7f2776ffd640 1 -- 172.21.15.73:0/4168363977 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f2770038020 con 0x7f277806e1c0 2024-03-29T04:08:49.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.111+0000 7f2776ffd640 1 --2- 172.21.15.73:0/4168363977 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f276406c530 0x7f276406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:49.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.111+0000 7f2776ffd640 1 -- 172.21.15.73:0/4168363977 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f27700acee0 con 0x7f277806e1c0 2024-03-29T04:08:49.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.111+0000 7f277da5c640 1 --2- 172.21.15.73:0/4168363977 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f276406c530 0x7f276406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:49.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.111+0000 7f277da5c640 1 --2- 172.21.15.73:0/4168363977 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f276406c530 0x7f276406e9f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f27780725b0 tx=0x7f276c007f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:49.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.115+0000 7f2776ffd640 1 -- 172.21.15.73:0/4168363977 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f2770031800 con 0x7f277806e1c0 2024-03-29T04:08:49.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.289+0000 7f27804c1640 1 -- 172.21.15.73:0/4168363977 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f27780b3550 con 0x7f277806e1c0 2024-03-29T04:08:49.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.290+0000 7f2776ffd640 1 -- 172.21.15.73:0/4168363977 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16605 (secure 0 0 0) 0x7f277007b590 con 0x7f277806e1c0 2024-03-29T04:08:49.270 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:49.270 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":21,"fsid":"6bff1617-b138-4517-acca-3ecaae3f2bb3","created":"2024-03-29T04:07:47.346864+0000","modified":"2024-03-29T04:08:13.577603+0000","last_up_change":"2024-03-29T04:07:58.507139+0000","last_in_change":"2024-03-29T04:07:49.637816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-29T04:07:59.537301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-29T04:08:09.570906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-29T04:08:10.882349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"925d7de1-14ab-48c0-aebd-7bded108f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6820","nonce":2387335359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6824","nonce":2387335359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6831","nonce":2387335359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6828","nonce":2387335359}]},"public_addr":"172.21.15.73:6820/2387335359","cluster_addr":"172.21.15.73:6824/2387335359","heartbeat_back_addr":"172.21.15.73:6831/2387335359","heartbeat_front_addr":"172.21.15.73:6828/2387335359","state":["exists","up"]},{"osd":1,"uuid":"6b182102-882a-4e0c-99db-0afae5cfb38b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6801","nonce":2431315515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6803","nonce":2431315515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6807","nonce":2431315515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6805","nonce":2431315515}]},"public_addr":"172.21.15.73:6801/2431315515","cluster_addr":"172.21.15.73:6803/2431315515","heartbeat_back_addr":"172.21.15.73:6807/2431315515","heartbeat_front_addr":"172.21.15.73:6805/2431315515","state":["exists","up"]},{"osd":2,"uuid":"8040902e-b0b8-4a21-bf64-ce1c222115ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6809","nonce":407236597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6811","nonce":407236597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6815","nonce":407236597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6813","nonce":407236597}]},"public_addr":"172.21.15.73:6809/407236597","cluster_addr":"172.21.15.73:6811/407236597","heartbeat_back_addr":"172.21.15.73:6815/407236597","heartbeat_front_addr":"172.21.15.73:6813/407236597","state":["exists","up"]},{"osd":3,"uuid":"1bab19ee-3775-4ce1-a4ce-cf7cda3bbbf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6817","nonce":4291100709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6821","nonce":4291100709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6829","nonce":4291100709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6825","nonce":4291100709}]},"public_addr":"172.21.15.73:6817/4291100709","cluster_addr":"172.21.15.73:6821/4291100709","heartbeat_back_addr":"172.21.15.73:6829/4291100709","heartbeat_front_addr":"172.21.15.73:6825/4291100709","state":["exists","up"]},{"osd":4,"uuid":"b0c74337-8fe4-47dc-b3da-2d07591b1f6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6817","nonce":3703256194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6819","nonce":3703256194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6823","nonce":3703256194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6821","nonce":3703256194}]},"public_addr":"172.21.15.142:6817/3703256194","cluster_addr":"172.21.15.142:6819/3703256194","heartbeat_back_addr":"172.21.15.142:6823/3703256194","heartbeat_front_addr":"172.21.15.142:6821/3703256194","state":["exists","up"]},{"osd":5,"uuid":"9ce36410-a29a-42c6-99f4-f95d4afdd7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6825","nonce":4271575803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6827","nonce":4271575803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6831","nonce":4271575803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6829","nonce":4271575803}]},"public_addr":"172.21.15.142:6825/4271575803","cluster_addr":"172.21.15.142:6827/4271575803","heartbeat_back_addr":"172.21.15.142:6831/4271575803","heartbeat_front_addr":"172.21.15.142:6829/4271575803","state":["exists","up"]},{"osd":6,"uuid":"aec4264a-64ac-428e-a860-d2920a304019","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6801","nonce":1772722570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6803","nonce":1772722570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6807","nonce":1772722570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6805","nonce":1772722570}]},"public_addr":"172.21.15.142:6801/1772722570","cluster_addr":"172.21.15.142:6803/1772722570","heartbeat_back_addr":"172.21.15.142:6807/1772722570","heartbeat_front_addr":"172.21.15.142:6805/1772722570","state":["exists","up"]},{"osd":7,"uuid":"fe599052-8e5a-4c7a-91e7-52d1bae24a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6809","nonce":3910589675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6811","nonce":3910589675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6815","nonce":3910589675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6813","nonce":3910589675}]},"public_addr":"172.21.15.142:6809/3910589675","cluster_addr":"172.21.15.142:6811/3910589675","heartbeat_back_addr":"172.21.15.142:6815/3910589675","heartbeat_front_addr":"172.21.15.142:6813/3910589675","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.835096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.587210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.786547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.778004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.843740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.791160+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.837992+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.718722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:08:49.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.292+0000 7f27804c1640 1 -- 172.21.15.73:0/4168363977 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f276406c530 msgr2=0x7f276406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:49.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.292+0000 7f27804c1640 1 --2- 172.21.15.73:0/4168363977 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f276406c530 0x7f276406e9f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f27780725b0 tx=0x7f276c007f90 comp rx=0 tx=0).stop 2024-03-29T04:08:49.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.292+0000 7f27804c1640 1 -- 172.21.15.73:0/4168363977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f277806e1c0 msgr2=0x7f27780cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:49.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.292+0000 7f27804c1640 1 --2- 172.21.15.73:0/4168363977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f277806e1c0 0x7f27780cf780 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2770034040 tx=0x7f27700046c0 comp rx=0 tx=0).stop 2024-03-29T04:08:49.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.292+0000 7f27804c1640 1 -- 172.21.15.73:0/4168363977 shutdown_connections 2024-03-29T04:08:49.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.292+0000 7f27804c1640 1 --2- 172.21.15.73:0/4168363977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f2778144790 0x7f2778153700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:49.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.292+0000 7f27804c1640 1 --2- 172.21.15.73:0/4168363977 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f276406c530 0x7f276406e9f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:49.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.292+0000 7f27804c1640 1 --2- 172.21.15.73:0/4168363977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f277806f1e0 0x7f277815d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:49.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.292+0000 7f27804c1640 1 --2- 172.21.15.73:0/4168363977 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f277806e1c0 0x7f27780cf780 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:49.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.292+0000 7f27804c1640 1 -- 172.21.15.73:0/4168363977 >> 172.21.15.73:0/4168363977 conn(0x7f277806b510 msgr2=0x7f27780af7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:49.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.293+0000 7f27804c1640 1 -- 172.21.15.73:0/4168363977 shutdown_connections 2024-03-29T04:08:49.274 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.293+0000 7f27804c1640 1 -- 172.21.15.73:0/4168363977 wait complete. 2024-03-29T04:08:49.284 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-29T04:08:49.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.406+0000 7f94fbca5640 1 Processor -- start 2024-03-29T04:08:49.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.406+0000 7f94fbca5640 1 -- start start 2024-03-29T04:08:49.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.407+0000 7f94fbca5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94f415ec10 0x7f94f40c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:49.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.407+0000 7f94fbca5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f94f40d0730 0x7f94f40b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:49.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.407+0000 7f94fbca5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94f415f100 con 0x7f94f40ce740 2024-03-29T04:08:49.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.407+0000 7f94fbca5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f94f40ceba0 con 0x7f94f40d0730 2024-03-29T04:08:49.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.407+0000 7f94fbca5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f94f415f370 con 0x7f94f415ec10 2024-03-29T04:08:49.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.407+0000 7f94fa242640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f94f40d0730 0x7f94f40b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:49.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.407+0000 7f94fa242640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f94f40d0730 0x7f94f40b30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:53114/0 (socket says 172.21.15.73:53114) 2024-03-29T04:08:49.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.407+0000 7f94f9240640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f94f40ce740 0x7f94f40d0020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.73:35056/0 (socket says 172.21.15.73:35056) 2024-03-29T04:08:49.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.407+0000 7f94f9a41640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94f415ec10 0x7f94f40c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:49.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.407+0000 7f94fa242640 1 -- 172.21.15.73:0/241738555 learned_addr learned my addr 172.21.15.73:0/241738555 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:49.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.407+0000 7f94fa242640 1 -- 172.21.15.73:0/241738555 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94f415ec10 msgr2=0x7f94f40c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:49.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.407+0000 7f94fa242640 1 --2- 172.21.15.73:0/241738555 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94f415ec10 0x7f94f40c67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:49.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.407+0000 7f94fa242640 1 -- 172.21.15.73:0/241738555 >> v1:172.21.15.142:6789/0 conn(0x7f94f40ce740 legacy=0x7f94f40d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:49.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.407+0000 7f94f8a3f640 1 -- 172.21.15.73:0/241738555 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2916447621 0 0) 0x7f94f415f100 con 0x7f94f40ce740 2024-03-29T04:08:49.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.407+0000 7f94fa242640 1 -- 172.21.15.73:0/241738555 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94f415f650 con 0x7f94f40d0730 2024-03-29T04:08:49.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.408+0000 7f94fa242640 1 --2- 172.21.15.73:0/241738555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94f40d0730 0x7f94f40b30b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f94ec009e50 tx=0x7f94ec02bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa30dcd7332496e9 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:49.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.408+0000 7f94f8a3f640 1 -- 172.21.15.73:0/241738555 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ec02ca70 con 0x7f94f40d0730 2024-03-29T04:08:49.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.408+0000 7f94f8a3f640 1 -- 172.21.15.73:0/241738555 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94ec02cc10 con 0x7f94f40d0730 2024-03-29T04:08:49.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.408+0000 7f94f8a3f640 1 -- 172.21.15.73:0/241738555 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ec0343f0 con 0x7f94f40d0730 2024-03-29T04:08:49.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.409+0000 7f94fbca5640 1 -- 172.21.15.73:0/241738555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94f40d0730 msgr2=0x7f94f40b30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:49.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.409+0000 7f94fbca5640 1 --2- 172.21.15.73:0/241738555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94f40d0730 0x7f94f40b30b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f94ec009e50 tx=0x7f94ec02bed0 comp rx=0 tx=0).stop 2024-03-29T04:08:49.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.409+0000 7f94fbca5640 1 -- 172.21.15.73:0/241738555 shutdown_connections 2024-03-29T04:08:49.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.409+0000 7f94fbca5640 1 --2- 172.21.15.73:0/241738555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94f40d0730 0x7f94f40b30b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:49.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.409+0000 7f94fbca5640 1 --2- 172.21.15.73:0/241738555 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94f415ec10 0x7f94f40c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:49.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.409+0000 7f94fbca5640 1 -- 172.21.15.73:0/241738555 >> 172.21.15.73:0/241738555 conn(0x7f94f406b510 msgr2=0x7f94f406b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:49.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.409+0000 7f94fbca5640 1 -- 172.21.15.73:0/241738555 shutdown_connections 2024-03-29T04:08:49.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.409+0000 7f94fbca5640 1 -- 172.21.15.73:0/241738555 wait complete. 2024-03-29T04:08:49.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.410+0000 7f94fbca5640 1 Processor -- start 2024-03-29T04:08:49.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.410+0000 7f94fbca5640 1 -- start start 2024-03-29T04:08:49.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.411+0000 7f94fbca5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94f40ce740 0x7f94f4156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:49.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.411+0000 7f94fbca5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94f40d0730 0x7f94f4159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:49.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.411+0000 7f94fbca5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94f415ec10 0x7f94f41557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:49.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.411+0000 7f94fbca5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f94f415fe50 con 0x7f94f40ce740 2024-03-29T04:08:49.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.411+0000 7f94fbca5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f94f40c6ee0 con 0x7f94f415ec10 2024-03-29T04:08:49.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.411+0000 7f94fbca5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f94f415ffd0 con 0x7f94f40d0730 2024-03-29T04:08:49.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.411+0000 7f94f9a41640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94f40ce740 0x7f94f4156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:49.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.411+0000 7f94f9a41640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94f40ce740 0x7f94f4156060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54310/0 (socket says 172.21.15.73:54310) 2024-03-29T04:08:49.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.411+0000 7f94f9a41640 1 -- 172.21.15.73:0/2571366097 learned_addr learned my addr 172.21.15.73:0/2571366097 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:49.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.411+0000 7f94fa242640 1 --2- 172.21.15.73:0/2571366097 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94f415ec10 0x7f94f41557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:49.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.411+0000 7f94f9240640 1 --2- 172.21.15.73:0/2571366097 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94f40d0730 0x7f94f4159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:49.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.411+0000 7f94f9a41640 1 -- 172.21.15.73:0/2571366097 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94f40d0730 msgr2=0x7f94f4159230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:49.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.411+0000 7f94f9a41640 1 --2- 172.21.15.73:0/2571366097 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94f40d0730 0x7f94f4159230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:49.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.411+0000 7f94f9a41640 1 -- 172.21.15.73:0/2571366097 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94f415ec10 msgr2=0x7f94f41557b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:49.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.411+0000 7f94f9a41640 1 --2- 172.21.15.73:0/2571366097 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94f415ec10 0x7f94f41557b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:49.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.411+0000 7f94f9a41640 1 -- 172.21.15.73:0/2571366097 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94f4158470 con 0x7f94f40ce740 2024-03-29T04:08:49.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.411+0000 7f94f9a41640 1 --2- 172.21.15.73:0/2571366097 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94f40ce740 0x7f94f4156060 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f94f0010dc0 tx=0x7f94f000e730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:49.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.411+0000 7f94ea7fc640 1 -- 172.21.15.73:0/2571366097 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f001e070 con 0x7f94f40ce740 2024-03-29T04:08:49.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.411+0000 7f94ea7fc640 1 -- 172.21.15.73:0/2571366097 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94f0011860 con 0x7f94f40ce740 2024-03-29T04:08:49.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.411+0000 7f94ea7fc640 1 -- 172.21.15.73:0/2571366097 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f0011c50 con 0x7f94f40ce740 2024-03-29T04:08:49.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.411+0000 7f94fbca5640 1 -- 172.21.15.73:0/2571366097 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94f4158750 con 0x7f94f40ce740 2024-03-29T04:08:49.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.411+0000 7f94fbca5640 1 -- 172.21.15.73:0/2571366097 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94f4159770 con 0x7f94f40ce740 2024-03-29T04:08:49.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.412+0000 7f94fbca5640 1 -- 172.21.15.73:0/2571366097 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94f4068640 con 0x7f94f40ce740 2024-03-29T04:08:49.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.413+0000 7f94ea7fc640 1 -- 172.21.15.73:0/2571366097 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f94f0021070 con 0x7f94f40ce740 2024-03-29T04:08:49.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.413+0000 7f94ea7fc640 1 --2- 172.21.15.73:0/2571366097 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f94d806c530 0x7f94d806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:49.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.413+0000 7f94ea7fc640 1 -- 172.21.15.73:0/2571366097 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f94f008e200 con 0x7f94f40ce740 2024-03-29T04:08:49.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.413+0000 7f94f9240640 1 --2- 172.21.15.73:0/2571366097 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f94d806c530 0x7f94d806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:49.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.414+0000 7f94f9240640 1 --2- 172.21.15.73:0/2571366097 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f94d806c530 0x7f94d806e9f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f94f406f700 tx=0x7f94e4007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:49.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.418+0000 7f94ea7fc640 1 -- 172.21.15.73:0/2571366097 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f94f005c260 con 0x7f94f40ce740 2024-03-29T04:08:49.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.629+0000 7f94fbca5640 1 -- 172.21.15.73:0/2571366097 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f94f40c67e0 con 0x7f94f40ce740 2024-03-29T04:08:49.609 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-03-29T04:08:49.630+0000 7f73858c4640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-29T04:08:49.610 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.631+0000 7f94ea7fc640 1 -- 172.21.15.73:0/2571366097 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) ==== 161+0+0 (secure 0 0 0) 0x7f94f0060560 con 0x7f94f40ce740 2024-03-29T04:08:49.610 INFO:teuthology.orchestra.run.smithi073.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-29T04:08:49.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.633+0000 7f94fbca5640 1 -- 172.21.15.73:0/2571366097 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f94d806c530 msgr2=0x7f94d806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:49.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.633+0000 7f94fbca5640 1 --2- 172.21.15.73:0/2571366097 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f94d806c530 0x7f94d806e9f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f94f406f700 tx=0x7f94e4007de0 comp rx=0 tx=0).stop 2024-03-29T04:08:49.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.633+0000 7f94fbca5640 1 -- 172.21.15.73:0/2571366097 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94f40ce740 msgr2=0x7f94f4156060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:49.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.633+0000 7f94fbca5640 1 --2- 172.21.15.73:0/2571366097 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94f40ce740 0x7f94f4156060 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f94f0010dc0 tx=0x7f94f000e730 comp rx=0 tx=0).stop 2024-03-29T04:08:49.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.633+0000 7f94fbca5640 1 -- 172.21.15.73:0/2571366097 shutdown_connections 2024-03-29T04:08:49.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.633+0000 7f94fbca5640 1 --2- 172.21.15.73:0/2571366097 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f94d806c530 0x7f94d806e9f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:49.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.633+0000 7f94fbca5640 1 --2- 172.21.15.73:0/2571366097 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94f415ec10 0x7f94f41557b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:49.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.633+0000 7f94fbca5640 1 --2- 172.21.15.73:0/2571366097 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f94f40d0730 0x7f94f4159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:49.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.633+0000 7f94fbca5640 1 --2- 172.21.15.73:0/2571366097 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94f40ce740 0x7f94f4156060 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:49.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.633+0000 7f94fbca5640 1 -- 172.21.15.73:0/2571366097 >> 172.21.15.73:0/2571366097 conn(0x7f94f406b510 msgr2=0x7f94f406b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:49.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.633+0000 7f94fbca5640 1 -- 172.21.15.73:0/2571366097 shutdown_connections 2024-03-29T04:08:49.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.633+0000 7f94fbca5640 1 -- 172.21.15.73:0/2571366097 wait complete. 2024-03-29T04:08:49.617 INFO:tasks.ceph.mds.b.smithi142.stderr: -7408> 2024-03-29T04:08:16.157+0000 7ff3a2a82640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-29T04:08:49.624 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-29T04:08:49.648 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2024-03-29T04:08:49.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.748+0000 7f41c96d3640 1 Processor -- start 2024-03-29T04:08:49.728 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.748+0000 7f41c96d3640 1 -- start start 2024-03-29T04:08:49.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.749+0000 7f41c96d3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f41c415e920 0x7f41c40d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:49.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.749+0000 7f41c96d3640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41c415ed00 con 0x7f41c40d16a0 2024-03-29T04:08:49.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.749+0000 7f41c96d3640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41c40d21e0 con 0x7f41c40cfde0 2024-03-29T04:08:49.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.749+0000 7f41c96d3640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f41c40d37c0 con 0x7f41c415e920 2024-03-29T04:08:49.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.749+0000 7f41c37fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f41c40d16a0 0x7f41c406c6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57266/0 (socket says 172.21.15.73:57266) 2024-03-29T04:08:49.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.749+0000 7f41c37fe640 1 -- 172.21.15.73:0/1029079065 learned_addr learned my addr 172.21.15.73:0/1029079065 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:49.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.749+0000 7f41c2ffd640 1 --2- 172.21.15.73:0/1029079065 >> v2:172.21.15.142:3300/0 conn(0x7f41c415e920 0x7f41c40d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:49.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.749+0000 7f41c1ffb640 1 -- 172.21.15.73:0/1029079065 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3004343715 0 0) 0x7f41c415ed00 con 0x7f41c40d16a0 2024-03-29T04:08:49.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.749+0000 7f41c1ffb640 1 -- 172.21.15.73:0/1029079065 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41ac003520 con 0x7f41c40d16a0 2024-03-29T04:08:49.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.749+0000 7f41c1ffb640 1 -- 172.21.15.73:0/1029079065 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1785782593 0 0) 0x7f41c40d21e0 con 0x7f41c40cfde0 2024-03-29T04:08:49.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.749+0000 7f41c1ffb640 1 -- 172.21.15.73:0/1029079065 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41c415ed00 con 0x7f41c40cfde0 2024-03-29T04:08:49.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.749+0000 7f41c2ffd640 1 -- 172.21.15.73:0/1029079065 >> v1:172.21.15.142:6789/0 conn(0x7f41c40cfde0 legacy=0x7f41c40d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:49.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.749+0000 7f41c2ffd640 1 -- 172.21.15.73:0/1029079065 >> v1:172.21.15.73:6789/0 conn(0x7f41c40d16a0 legacy=0x7f41c406c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:49.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.749+0000 7f41c2ffd640 1 -- 172.21.15.73:0/1029079065 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41c40d24c0 con 0x7f41c415e920 2024-03-29T04:08:49.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.750+0000 7f41c2ffd640 1 --2- 172.21.15.73:0/1029079065 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41c415e920 0x7f41c40d3280 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f41b40097a0 tx=0x7f41b402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=583c6652e9d36e19 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:49.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.750+0000 7f41c1ffb640 1 -- 172.21.15.73:0/1029079065 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b4034070 con 0x7f41c415e920 2024-03-29T04:08:49.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.750+0000 7f41c1ffb640 1 -- 172.21.15.73:0/1029079065 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41b4030610 con 0x7f41c415e920 2024-03-29T04:08:49.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.750+0000 7f41c1ffb640 1 -- 172.21.15.73:0/1029079065 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b40309e0 con 0x7f41c415e920 2024-03-29T04:08:49.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.751+0000 7f41c96d3640 1 -- 172.21.15.73:0/1029079065 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41c415e920 msgr2=0x7f41c40d3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:49.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.751+0000 7f41c96d3640 1 --2- 172.21.15.73:0/1029079065 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41c415e920 0x7f41c40d3280 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f41b40097a0 tx=0x7f41b402b960 comp rx=0 tx=0).stop 2024-03-29T04:08:49.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.751+0000 7f41c96d3640 1 -- 172.21.15.73:0/1029079065 shutdown_connections 2024-03-29T04:08:49.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.751+0000 7f41c96d3640 1 --2- 172.21.15.73:0/1029079065 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41c415e920 0x7f41c40d3280 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:49.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.751+0000 7f41c96d3640 1 -- 172.21.15.73:0/1029079065 >> 172.21.15.73:0/1029079065 conn(0x7f41c408bfc0 msgr2=0x7f41c40d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:49.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.751+0000 7f41c96d3640 1 -- 172.21.15.73:0/1029079065 shutdown_connections 2024-03-29T04:08:49.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.751+0000 7f41c96d3640 1 -- 172.21.15.73:0/1029079065 wait complete. 2024-03-29T04:08:49.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.752+0000 7f41c96d3640 1 Processor -- start 2024-03-29T04:08:49.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.752+0000 7f41c96d3640 1 -- start start 2024-03-29T04:08:49.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.753+0000 7f41c96d3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41c40cfde0 0x7f41c4161300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:49.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.753+0000 7f41c96d3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41c40d16a0 0x7f41c415eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:49.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.753+0000 7f41c96d3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41c415e920 0x7f41c415f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:49.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.753+0000 7f41c96d3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f41c40d2d60 con 0x7f41c40d16a0 2024-03-29T04:08:49.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.753+0000 7f41c96d3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f41c40d2a80 con 0x7f41c415e920 2024-03-29T04:08:49.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.753+0000 7f41c96d3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f41c40d4f50 con 0x7f41c40cfde0 2024-03-29T04:08:49.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.753+0000 7f41c27fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41c40d16a0 0x7f41c415eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:49.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.753+0000 7f41c27fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41c40d16a0 0x7f41c415eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54316/0 (socket says 172.21.15.73:54316) 2024-03-29T04:08:49.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.753+0000 7f41c27fc640 1 -- 172.21.15.73:0/1016218576 learned_addr learned my addr 172.21.15.73:0/1016218576 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:49.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.753+0000 7f41c37fe640 1 --2- 172.21.15.73:0/1016218576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41c415e920 0x7f41c415f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:49.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.753+0000 7f41c2ffd640 1 --2- 172.21.15.73:0/1016218576 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41c40cfde0 0x7f41c4161300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:49.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.753+0000 7f41c27fc640 1 -- 172.21.15.73:0/1016218576 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41c40cfde0 msgr2=0x7f41c4161300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:49.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.753+0000 7f41c27fc640 1 --2- 172.21.15.73:0/1016218576 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41c40cfde0 0x7f41c4161300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:49.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.753+0000 7f41c27fc640 1 -- 172.21.15.73:0/1016218576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41c415e920 msgr2=0x7f41c415f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:49.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.753+0000 7f41c27fc640 1 --2- 172.21.15.73:0/1016218576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41c415e920 0x7f41c415f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:49.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.753+0000 7f41c27fc640 1 -- 172.21.15.73:0/1016218576 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41c40cce30 con 0x7f41c40d16a0 2024-03-29T04:08:49.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.753+0000 7f41c2ffd640 1 --2- 172.21.15.73:0/1016218576 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41c40cfde0 0x7f41c4161300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:08:49.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.754+0000 7f41c27fc640 1 --2- 172.21.15.73:0/1016218576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41c40d16a0 0x7f41c415eef0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f41b800c4c0 tx=0x7f41b800c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:49.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.754+0000 7f41ab7fe640 1 -- 172.21.15.73:0/1016218576 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b80052d0 con 0x7f41c40d16a0 2024-03-29T04:08:49.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.754+0000 7f41ab7fe640 1 -- 172.21.15.73:0/1016218576 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41b8005470 con 0x7f41c40d16a0 2024-03-29T04:08:49.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.754+0000 7f41ab7fe640 1 -- 172.21.15.73:0/1016218576 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b8012870 con 0x7f41c40d16a0 2024-03-29T04:08:49.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.754+0000 7f41c96d3640 1 -- 172.21.15.73:0/1016218576 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41c415fa60 con 0x7f41c40d16a0 2024-03-29T04:08:49.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.754+0000 7f41c96d3640 1 -- 172.21.15.73:0/1016218576 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41c4160020 con 0x7f41c40d16a0 2024-03-29T04:08:49.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.755+0000 7f41c96d3640 1 -- 172.21.15.73:0/1016218576 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41c40a2560 con 0x7f41c40d16a0 2024-03-29T04:08:49.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.755+0000 7f41ab7fe640 1 -- 172.21.15.73:0/1016218576 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f41b8012a10 con 0x7f41c40d16a0 2024-03-29T04:08:49.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.756+0000 7f41ab7fe640 1 --2- 172.21.15.73:0/1016218576 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f41b006c530 0x7f41b006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:49.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.756+0000 7f41c2ffd640 1 --2- 172.21.15.73:0/1016218576 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f41b006c530 0x7f41b006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:49.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.756+0000 7f41ab7fe640 1 -- 172.21.15.73:0/1016218576 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5795+0+0 (secure 0 0 0) 0x7f41b808b300 con 0x7f41c40d16a0 2024-03-29T04:08:49.737 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.756+0000 7f41c2ffd640 1 --2- 172.21.15.73:0/1016218576 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f41b006c530 0x7f41b006e9f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f41b4036000 tx=0x7f41b403b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:49.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.760+0000 7f41ab7fe640 1 -- 172.21.15.73:0/1016218576 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f41b80598c0 con 0x7f41c40d16a0 2024-03-29T04:08:49.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:49.970+0000 7f41c96d3640 1 -- 172.21.15.73:0/1016218576 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f41c415e0d0 con 0x7f41c40d16a0 2024-03-29T04:08:50.612 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.632+0000 7f41ab7fe640 1 -- 172.21.15.73:0/1016218576 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) ==== 104+0+0 (secure 0 0 0) 0x7f41b80591c0 con 0x7f41c40d16a0 2024-03-29T04:08:50.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.635+0000 7f41c96d3640 1 -- 172.21.15.73:0/1016218576 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f41b006c530 msgr2=0x7f41b006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:50.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.635+0000 7f41c96d3640 1 --2- 172.21.15.73:0/1016218576 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f41b006c530 0x7f41b006e9f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f41b4036000 tx=0x7f41b403b040 comp rx=0 tx=0).stop 2024-03-29T04:08:50.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.635+0000 7f41c96d3640 1 -- 172.21.15.73:0/1016218576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41c40d16a0 msgr2=0x7f41c415eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:50.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.635+0000 7f41c96d3640 1 --2- 172.21.15.73:0/1016218576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41c40d16a0 0x7f41c415eef0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f41b800c4c0 tx=0x7f41b800c980 comp rx=0 tx=0).stop 2024-03-29T04:08:50.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.635+0000 7f41c96d3640 1 -- 172.21.15.73:0/1016218576 shutdown_connections 2024-03-29T04:08:50.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.635+0000 7f41c96d3640 1 --2- 172.21.15.73:0/1016218576 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f41b006c530 0x7f41b006e9f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:50.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.635+0000 7f41c96d3640 1 --2- 172.21.15.73:0/1016218576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41c415e920 0x7f41c415f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:50.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.635+0000 7f41c96d3640 1 --2- 172.21.15.73:0/1016218576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41c40d16a0 0x7f41c415eef0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:50.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.635+0000 7f41c96d3640 1 --2- 172.21.15.73:0/1016218576 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f41c40cfde0 0x7f41c4161300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:50.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.635+0000 7f41c96d3640 1 -- 172.21.15.73:0/1016218576 >> 172.21.15.73:0/1016218576 conn(0x7f41c408bfc0 msgr2=0x7f41c40b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:50.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.635+0000 7f41c96d3640 1 -- 172.21.15.73:0/1016218576 shutdown_connections 2024-03-29T04:08:50.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.635+0000 7f41c96d3640 1 -- 172.21.15.73:0/1016218576 wait complete. 2024-03-29T04:08:50.628 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-29T04:08:50.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.756+0000 7f3c0ff8d640 1 Processor -- start 2024-03-29T04:08:50.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.756+0000 7f3c0ff8d640 1 -- start start 2024-03-29T04:08:50.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.757+0000 7f3c0ff8d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3c080b4ce0 0x7f3c0806bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:50.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.757+0000 7f3c0ff8d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c0806ff60 con 0x7f3c080b4850 2024-03-29T04:08:50.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.757+0000 7f3c0ff8d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c0806f3e0 con 0x7f3c081587d0 2024-03-29T04:08:50.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.757+0000 7f3c0ff8d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f3c0806f6c0 con 0x7f3c080b4ce0 2024-03-29T04:08:50.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.757+0000 7f3c0d528640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3c080b4850 0x7f3c0806b840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57280/0 (socket says 172.21.15.73:57280) 2024-03-29T04:08:50.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.757+0000 7f3c0d528640 1 -- 172.21.15.73:0/3197751039 learned_addr learned my addr 172.21.15.73:0/3197751039 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:50.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.757+0000 7f3c0cd27640 1 -- 172.21.15.73:0/3197751039 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3285505129 0 0) 0x7f3c0806ff60 con 0x7f3c080b4850 2024-03-29T04:08:50.739 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.757+0000 7f3c0cd27640 1 -- 172.21.15.73:0/3197751039 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3bf4003520 con 0x7f3c080b4850 2024-03-29T04:08:50.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.757+0000 7f3c0e52a640 1 --2- 172.21.15.73:0/3197751039 >> v2:172.21.15.142:3300/0 conn(0x7f3c080b4ce0 0x7f3c0806bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:50.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.757+0000 7f3c0cd27640 1 -- 172.21.15.73:0/3197751039 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3140519176 0 0) 0x7f3bf4003520 con 0x7f3c080b4850 2024-03-29T04:08:50.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.757+0000 7f3c0cd27640 1 -- 172.21.15.73:0/3197751039 >> v2:172.21.15.142:3300/0 conn(0x7f3c080b4ce0 msgr2=0x7f3c0806bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:50.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.757+0000 7f3c0cd27640 1 --2- 172.21.15.73:0/3197751039 >> v2:172.21.15.142:3300/0 conn(0x7f3c080b4ce0 0x7f3c0806bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:50.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.757+0000 7f3c0cd27640 1 -- 172.21.15.73:0/3197751039 >> v1:172.21.15.142:6789/0 conn(0x7f3c081587d0 legacy=0x7f3c0806e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:50.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.757+0000 7f3c0cd27640 1 -- 172.21.15.73:0/3197751039 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c0806f9a0 con 0x7f3c080b4850 2024-03-29T04:08:50.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.757+0000 7f3c0cd27640 1 -- 172.21.15.73:0/3197751039 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1290421750 0 0) 0x7f3bf8001670 con 0x7f3c080b4850 2024-03-29T04:08:50.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.757+0000 7f3c0e52a640 1 --2- 172.21.15.73:0/3197751039 >> v2:172.21.15.142:3300/0 conn(0x7f3c080b4ce0 0x7f3c0806bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:08:50.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.757+0000 7f3c0cd27640 1 -- 172.21.15.73:0/3197751039 >> v1:172.21.15.73:6789/0 conn(0x7f3c080b4850 legacy=0x7f3c0806b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:50.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.757+0000 7f3c0cd27640 1 --2- 172.21.15.73:0/3197751039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bf40039b0 0x7f3bf4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:50.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.757+0000 7f3c0cd27640 1 --2- 172.21.15.73:0/3197751039 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bf4004800 0x7f3bf4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:50.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.758+0000 7f3c0cd27640 1 --2- 172.21.15.73:0/3197751039 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bf40053c0 0x7f3bf400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:50.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.758+0000 7f3c0cd27640 1 -- 172.21.15.73:0/3197751039 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0806f6c0 con 0x7f3bf40039b0 2024-03-29T04:08:50.740 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.758+0000 7f3c0cd27640 1 -- 172.21.15.73:0/3197751039 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf400d360 con 0x7f3bf40053c0 2024-03-29T04:08:50.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.758+0000 7f3c0cd27640 1 -- 172.21.15.73:0/3197751039 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f3bf400c2a0 con 0x7f3bf4004800 2024-03-29T04:08:50.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.758+0000 7f3c0dd29640 1 --2- 172.21.15.73:0/3197751039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bf40039b0 0x7f3bf4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:50.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.758+0000 7f3c0e52a640 1 --2- 172.21.15.73:0/3197751039 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bf40053c0 0x7f3bf400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:50.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.758+0000 7f3c0d528640 1 --2- 172.21.15.73:0/3197751039 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bf4004800 0x7f3bf4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:50.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.758+0000 7f3c0dd29640 1 -- 172.21.15.73:0/3197751039 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bf4004800 msgr2=0x7f3bf4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:50.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.758+0000 7f3c0dd29640 1 --2- 172.21.15.73:0/3197751039 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bf4004800 0x7f3bf4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:50.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.758+0000 7f3c0dd29640 1 -- 172.21.15.73:0/3197751039 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bf40053c0 msgr2=0x7f3bf400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:50.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.758+0000 7f3c0dd29640 1 --2- 172.21.15.73:0/3197751039 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bf40053c0 0x7f3bf400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:50.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.758+0000 7f3c0dd29640 1 -- 172.21.15.73:0/3197751039 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bf4003520 con 0x7f3bf40039b0 2024-03-29T04:08:50.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.758+0000 7f3c0e52a640 1 -- 172.21.15.73:0/3197751039 reap_dead start 2024-03-29T04:08:50.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.759+0000 7f3c0dd29640 1 --2- 172.21.15.73:0/3197751039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bf40039b0 0x7f3bf4003dd0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3c04001750 tx=0x7f3bf4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b646d412ef01cea7 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:50.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.759+0000 7f3c0cd27640 1 -- 172.21.15.73:0/3197751039 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c04001370 con 0x7f3bf40039b0 2024-03-29T04:08:50.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.759+0000 7f3c0cd27640 1 -- 172.21.15.73:0/3197751039 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c040052d0 con 0x7f3bf40039b0 2024-03-29T04:08:50.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.759+0000 7f3c0cd27640 1 -- 172.21.15.73:0/3197751039 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c04003830 con 0x7f3bf40039b0 2024-03-29T04:08:50.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.759+0000 7f3c0ff8d640 1 -- 172.21.15.73:0/3197751039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bf40039b0 msgr2=0x7f3bf4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:50.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.759+0000 7f3c0ff8d640 1 --2- 172.21.15.73:0/3197751039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bf40039b0 0x7f3bf4003dd0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3c04001750 tx=0x7f3bf4005830 comp rx=0 tx=0).stop 2024-03-29T04:08:50.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.759+0000 7f3c0ff8d640 1 -- 172.21.15.73:0/3197751039 shutdown_connections 2024-03-29T04:08:50.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.759+0000 7f3c0ff8d640 1 --2- 172.21.15.73:0/3197751039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bf40039b0 0x7f3bf4003dd0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:50.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.759+0000 7f3c0ff8d640 1 -- 172.21.15.73:0/3197751039 >> 172.21.15.73:0/3197751039 conn(0x7f3c080d0ae0 msgr2=0x7f3c080d0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:50.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.759+0000 7f3c0ff8d640 1 -- 172.21.15.73:0/3197751039 shutdown_connections 2024-03-29T04:08:50.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.759+0000 7f3c0ff8d640 1 -- 172.21.15.73:0/3197751039 wait complete. 2024-03-29T04:08:50.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.760+0000 7f3c0ff8d640 1 Processor -- start 2024-03-29T04:08:50.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.760+0000 7f3c0ff8d640 1 -- start start 2024-03-29T04:08:50.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.761+0000 7f3c0ff8d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bf40039b0 0x7f3c08149c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:50.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.761+0000 7f3c0ff8d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c0814a170 0x7f3c081554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:50.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.761+0000 7f3c0ff8d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c08155a10 0x7f3c080aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:50.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.761+0000 7f3c0ff8d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0815b310 con 0x7f3c08155a10 2024-03-29T04:08:50.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.761+0000 7f3c0ff8d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3c080b5130 con 0x7f3c0814a170 2024-03-29T04:08:50.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.761+0000 7f3c0ff8d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f3c0815b490 con 0x7f3bf40039b0 2024-03-29T04:08:50.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.761+0000 7f3c0e52a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c08155a10 0x7f3c080aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:50.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.761+0000 7f3c0e52a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c08155a10 0x7f3c080aeca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54334/0 (socket says 172.21.15.73:54334) 2024-03-29T04:08:50.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.761+0000 7f3c0e52a640 1 -- 172.21.15.73:0/3317052113 learned_addr learned my addr 172.21.15.73:0/3317052113 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:50.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.762+0000 7f3c0d528640 1 --2- 172.21.15.73:0/3317052113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c0814a170 0x7f3c081554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:50.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.762+0000 7f3c0e52a640 1 -- 172.21.15.73:0/3317052113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bf40039b0 msgr2=0x7f3c08149c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:50.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.762+0000 7f3c0dd29640 1 --2- 172.21.15.73:0/3317052113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bf40039b0 0x7f3c08149c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:50.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.762+0000 7f3c0e52a640 1 --2- 172.21.15.73:0/3317052113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bf40039b0 0x7f3c08149c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:50.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.762+0000 7f3c0e52a640 1 -- 172.21.15.73:0/3317052113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c0814a170 msgr2=0x7f3c081554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:50.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.762+0000 7f3c0e52a640 1 --2- 172.21.15.73:0/3317052113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c0814a170 0x7f3c081554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:50.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.762+0000 7f3c0e52a640 1 -- 172.21.15.73:0/3317052113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c081529e0 con 0x7f3c08155a10 2024-03-29T04:08:50.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.762+0000 7f3c0d528640 1 --2- 172.21.15.73:0/3317052113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c0814a170 0x7f3c081554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:08:50.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.762+0000 7f3c0e52a640 1 --2- 172.21.15.73:0/3317052113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c08155a10 0x7f3c080aeca0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3c0815b0f0 tx=0x7f3c00004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:50.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.762+0000 7f3bfe7fc640 1 -- 172.21.15.73:0/3317052113 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c00007d60 con 0x7f3c08155a10 2024-03-29T04:08:50.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.762+0000 7f3bfe7fc640 1 -- 172.21.15.73:0/3317052113 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c00019070 con 0x7f3c08155a10 2024-03-29T04:08:50.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.762+0000 7f3bfe7fc640 1 -- 172.21.15.73:0/3317052113 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c00014630 con 0x7f3c08155a10 2024-03-29T04:08:50.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.762+0000 7f3c0ff8d640 1 -- 172.21.15.73:0/3317052113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c080ad940 con 0x7f3c08155a10 2024-03-29T04:08:50.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.762+0000 7f3c0ff8d640 1 -- 172.21.15.73:0/3317052113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c080adf00 con 0x7f3c08155a10 2024-03-29T04:08:50.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.763+0000 7f3c0ff8d640 1 -- 172.21.15.73:0/3317052113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c08155e70 con 0x7f3c08155a10 2024-03-29T04:08:50.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.763+0000 7f3bfe7fc640 1 -- 172.21.15.73:0/3317052113 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f3c000147d0 con 0x7f3c08155a10 2024-03-29T04:08:50.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.764+0000 7f3bfe7fc640 1 --2- 172.21.15.73:0/3317052113 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3bec06c560 0x7f3bec06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:50.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.764+0000 7f3bfe7fc640 1 -- 172.21.15.73:0/3317052113 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5795+0+0 (secure 0 0 0) 0x7f3c0008bce0 con 0x7f3c08155a10 2024-03-29T04:08:50.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.764+0000 7f3c0dd29640 1 --2- 172.21.15.73:0/3317052113 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3bec06c560 0x7f3bec06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:50.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.764+0000 7f3c0dd29640 1 --2- 172.21.15.73:0/3317052113 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3bec06c560 0x7f3bec06ea20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3c04033000 tx=0x7f3c04009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:50.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.768+0000 7f3bfe7fc640 1 -- 172.21.15.73:0/3317052113 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f3c0005a210 con 0x7f3c08155a10 2024-03-29T04:08:50.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:50.944+0000 7f3c0ff8d640 1 -- 172.21.15.73:0/3317052113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3c08068640 con 0x7f3c08155a10 2024-03-29T04:08:51.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.687+0000 7f3bfe7fc640 1 -- 172.21.15.73:0/3317052113 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) ==== 181+0+0 (secure 0 0 0) 0x7f3c00059b10 con 0x7f3c08155a10 2024-03-29T04:08:51.667 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' removed 2024-03-29T04:08:51.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.691+0000 7f3c0ff8d640 1 -- 172.21.15.73:0/3317052113 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3bec06c560 msgr2=0x7f3bec06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:51.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.691+0000 7f3c0ff8d640 1 --2- 172.21.15.73:0/3317052113 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3bec06c560 0x7f3bec06ea20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3c04033000 tx=0x7f3c04009030 comp rx=0 tx=0).stop 2024-03-29T04:08:51.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.691+0000 7f3c0ff8d640 1 -- 172.21.15.73:0/3317052113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c08155a10 msgr2=0x7f3c080aeca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:51.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.691+0000 7f3c0ff8d640 1 --2- 172.21.15.73:0/3317052113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c08155a10 0x7f3c080aeca0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3c0815b0f0 tx=0x7f3c00004840 comp rx=0 tx=0).stop 2024-03-29T04:08:51.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.691+0000 7f3c0ff8d640 1 -- 172.21.15.73:0/3317052113 shutdown_connections 2024-03-29T04:08:51.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.691+0000 7f3c0ff8d640 1 --2- 172.21.15.73:0/3317052113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c08155a10 0x7f3c080aeca0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:51.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.691+0000 7f3c0ff8d640 1 --2- 172.21.15.73:0/3317052113 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3bec06c560 0x7f3bec06ea20 secure :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3c04033000 tx=0x7f3c04009030 comp rx=0 tx=0).stop 2024-03-29T04:08:51.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.691+0000 7f3c0ff8d640 1 --2- 172.21.15.73:0/3317052113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c0814a170 0x7f3c081554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:51.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.692+0000 7f3c0ff8d640 1 --2- 172.21.15.73:0/3317052113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bf40039b0 0x7f3c08149c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:51.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.692+0000 7f3c0ff8d640 1 -- 172.21.15.73:0/3317052113 >> 172.21.15.73:0/3317052113 conn(0x7f3c080d0ae0 msgr2=0x7f3c080b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:51.673 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.694+0000 7f3c0ff8d640 1 -- 172.21.15.73:0/3317052113 shutdown_connections 2024-03-29T04:08:51.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.695+0000 7f3c0ff8d640 1 -- 172.21.15.73:0/3317052113 wait complete. 2024-03-29T04:08:51.693 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-29T04:08:51.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.818+0000 7fa946dba640 1 Processor -- start 2024-03-29T04:08:51.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.819+0000 7fa946dba640 1 -- start start 2024-03-29T04:08:51.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.819+0000 7fa946dba640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa94015e780 0x7fa940162ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:51.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.819+0000 7fa946dba640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa9400d4f20 0x7fa9400b1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:51.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.819+0000 7fa946dba640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa94015eb60 0x7fa9400d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:51.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.819+0000 7fa946dba640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fa940163430 con 0x7fa94015e780 2024-03-29T04:08:51.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.819+0000 7fa946dba640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fa9400cfde0 con 0x7fa9400d4f20 2024-03-29T04:08:51.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.819+0000 7fa946dba640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa9400b37c0 con 0x7fa94015eb60 2024-03-29T04:08:51.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.819+0000 7fa944b56640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa94015e780 0x7fa940162ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:51.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.820+0000 7fa944b56640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa94015e780 0x7fa940162ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54336/0 (socket says 172.21.15.73:54336) 2024-03-29T04:08:51.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.820+0000 7fa944b56640 1 -- 172.21.15.73:0/4182886235 learned_addr learned my addr 172.21.15.73:0/4182886235 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:51.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.820+0000 7fa945357640 1 --2- 172.21.15.73:0/4182886235 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa94015eb60 0x7fa9400d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:51.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.820+0000 7fa93ffff640 1 --2- 172.21.15.73:0/4182886235 >> v2:172.21.15.142:3300/0 conn(0x7fa9400d4f20 0x7fa9400b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:51.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.820+0000 7fa944b56640 1 -- 172.21.15.73:0/4182886235 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa94015eb60 msgr2=0x7fa9400d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:51.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.820+0000 7fa944b56640 1 --2- 172.21.15.73:0/4182886235 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa94015eb60 0x7fa9400d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:51.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.820+0000 7fa944b56640 1 -- 172.21.15.73:0/4182886235 >> v2:172.21.15.142:3300/0 conn(0x7fa9400d4f20 msgr2=0x7fa9400b1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:51.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.820+0000 7fa944b56640 1 --2- 172.21.15.73:0/4182886235 >> v2:172.21.15.142:3300/0 conn(0x7fa9400d4f20 0x7fa9400b1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:51.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.820+0000 7fa944b56640 1 -- 172.21.15.73:0/4182886235 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9400d53e0 con 0x7fa94015e780 2024-03-29T04:08:51.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.821+0000 7fa944b56640 1 --2- 172.21.15.73:0/4182886235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa94015e780 0x7fa940162ef0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa9400d1dc0 tx=0x7fa93402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d13303a593b988a server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:51.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.821+0000 7fa93f7fe640 1 -- 172.21.15.73:0/4182886235 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa934035020 con 0x7fa94015e780 2024-03-29T04:08:51.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.821+0000 7fa93f7fe640 1 -- 172.21.15.73:0/4182886235 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa934031870 con 0x7fa94015e780 2024-03-29T04:08:51.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.821+0000 7fa93f7fe640 1 -- 172.21.15.73:0/4182886235 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa934031c40 con 0x7fa94015e780 2024-03-29T04:08:51.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.821+0000 7fa946dba640 1 -- 172.21.15.73:0/4182886235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa94015e780 msgr2=0x7fa940162ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:51.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.821+0000 7fa946dba640 1 --2- 172.21.15.73:0/4182886235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa94015e780 0x7fa940162ef0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa9400d1dc0 tx=0x7fa93402b910 comp rx=0 tx=0).stop 2024-03-29T04:08:51.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.821+0000 7fa946dba640 1 -- 172.21.15.73:0/4182886235 shutdown_connections 2024-03-29T04:08:51.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.821+0000 7fa946dba640 1 --2- 172.21.15.73:0/4182886235 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa94015eb60 0x7fa9400d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:51.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.821+0000 7fa946dba640 1 --2- 172.21.15.73:0/4182886235 >> v2:172.21.15.142:3300/0 conn(0x7fa9400d4f20 0x7fa9400b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:51.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.821+0000 7fa946dba640 1 --2- 172.21.15.73:0/4182886235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa94015e780 0x7fa940162ef0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:51.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.821+0000 7fa946dba640 1 -- 172.21.15.73:0/4182886235 >> 172.21.15.73:0/4182886235 conn(0x7fa94008bfc0 msgr2=0x7fa9400d4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:51.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.821+0000 7fa946dba640 1 -- 172.21.15.73:0/4182886235 shutdown_connections 2024-03-29T04:08:51.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.821+0000 7fa946dba640 1 -- 172.21.15.73:0/4182886235 wait complete. 2024-03-29T04:08:51.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.822+0000 7fa946dba640 1 Processor -- start 2024-03-29T04:08:51.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.822+0000 7fa946dba640 1 -- start start 2024-03-29T04:08:51.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.823+0000 7fa946dba640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9400d4f20 0x7fa9400cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:51.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.823+0000 7fa946dba640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa94015e780 0x7fa9400cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:51.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.823+0000 7fa946dba640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa94015eb60 0x7fa940158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:51.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.823+0000 7fa946dba640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa9400cf440 con 0x7fa94015eb60 2024-03-29T04:08:51.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.823+0000 7fa946dba640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa9400cfa70 con 0x7fa9400d4f20 2024-03-29T04:08:51.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.823+0000 7fa946dba640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa9400b16b0 con 0x7fa94015e780 2024-03-29T04:08:51.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.823+0000 7fa945357640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa94015eb60 0x7fa940158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:51.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.824+0000 7fa945357640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa94015eb60 0x7fa940158830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54352/0 (socket says 172.21.15.73:54352) 2024-03-29T04:08:51.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.824+0000 7fa945357640 1 -- 172.21.15.73:0/2748614116 learned_addr learned my addr 172.21.15.73:0/2748614116 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:51.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.824+0000 7fa93ffff640 1 --2- 172.21.15.73:0/2748614116 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa94015e780 0x7fa9400cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:51.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.824+0000 7fa944b56640 1 --2- 172.21.15.73:0/2748614116 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9400d4f20 0x7fa9400cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:51.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.824+0000 7fa945357640 1 -- 172.21.15.73:0/2748614116 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa94015e780 msgr2=0x7fa9400cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:51.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.824+0000 7fa945357640 1 --2- 172.21.15.73:0/2748614116 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa94015e780 0x7fa9400cdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:51.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.824+0000 7fa945357640 1 -- 172.21.15.73:0/2748614116 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9400d4f20 msgr2=0x7fa9400cb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:51.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.824+0000 7fa945357640 1 --2- 172.21.15.73:0/2748614116 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9400d4f20 0x7fa9400cb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:51.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.824+0000 7fa945357640 1 -- 172.21.15.73:0/2748614116 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9400b3c40 con 0x7fa94015eb60 2024-03-29T04:08:51.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.824+0000 7fa945357640 1 --2- 172.21.15.73:0/2748614116 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa94015eb60 0x7fa940158830 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa938007e90 tx=0x7fa93800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:51.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.824+0000 7fa93d7fa640 1 -- 172.21.15.73:0/2748614116 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa938014420 con 0x7fa94015eb60 2024-03-29T04:08:51.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.824+0000 7fa93d7fa640 1 -- 172.21.15.73:0/2748614116 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa938019070 con 0x7fa94015eb60 2024-03-29T04:08:51.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.824+0000 7fa946dba640 1 -- 172.21.15.73:0/2748614116 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9400cc030 con 0x7fa94015eb60 2024-03-29T04:08:51.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.824+0000 7fa93d7fa640 1 -- 172.21.15.73:0/2748614116 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa938014800 con 0x7fa94015eb60 2024-03-29T04:08:51.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.824+0000 7fa946dba640 1 -- 172.21.15.73:0/2748614116 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9400cbc10 con 0x7fa94015eb60 2024-03-29T04:08:51.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.825+0000 7fa946dba640 1 -- 172.21.15.73:0/2748614116 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa940068640 con 0x7fa94015eb60 2024-03-29T04:08:51.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.826+0000 7fa93d7fa640 1 -- 172.21.15.73:0/2748614116 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fa9380149a0 con 0x7fa94015eb60 2024-03-29T04:08:51.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.826+0000 7fa93d7fa640 1 --2- 172.21.15.73:0/2748614116 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa92406c530 0x7fa92406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:51.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.826+0000 7fa944b56640 1 --2- 172.21.15.73:0/2748614116 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa92406c530 0x7fa92406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:51.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.826+0000 7fa93d7fa640 1 -- 172.21.15.73:0/2748614116 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5560+0+0 (secure 0 0 0) 0x7fa93808bce0 con 0x7fa94015eb60 2024-03-29T04:08:51.808 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.826+0000 7fa944b56640 1 --2- 172.21.15.73:0/2748614116 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa92406c530 0x7fa92406e9f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa934036000 tx=0x7fa93403c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:51.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:51.831+0000 7fa93d7fa640 1 -- 172.21.15.73:0/2748614116 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fa9400cc030 con 0x7fa94015eb60 2024-03-29T04:08:51.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.005+0000 7fa946dba640 1 -- 172.21.15.73:0/2748614116 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa9400d1e10 con 0x7fa94015eb60 2024-03-29T04:08:52.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.692+0000 7fa93d7fa640 1 -- 172.21.15.73:0/2748614116 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) ==== 169+0+0 (secure 0 0 0) 0x7fa938059d40 con 0x7fa94015eb60 2024-03-29T04:08:52.672 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' removed 2024-03-29T04:08:52.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.697+0000 7fa946dba640 1 -- 172.21.15.73:0/2748614116 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa92406c530 msgr2=0x7fa92406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:52.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.697+0000 7fa946dba640 1 --2- 172.21.15.73:0/2748614116 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa92406c530 0x7fa92406e9f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa934036000 tx=0x7fa93403c040 comp rx=0 tx=0).stop 2024-03-29T04:08:52.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.697+0000 7fa946dba640 1 -- 172.21.15.73:0/2748614116 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa94015eb60 msgr2=0x7fa940158830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:52.677 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.697+0000 7fa946dba640 1 --2- 172.21.15.73:0/2748614116 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa94015eb60 0x7fa940158830 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa938007e90 tx=0x7fa93800e4b0 comp rx=0 tx=0).stop 2024-03-29T04:08:52.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.701+0000 7fa946dba640 1 -- 172.21.15.73:0/2748614116 shutdown_connections 2024-03-29T04:08:52.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.701+0000 7fa946dba640 1 --2- 172.21.15.73:0/2748614116 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa94015eb60 0x7fa940158830 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:52.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.701+0000 7fa946dba640 1 --2- 172.21.15.73:0/2748614116 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa94015e780 0x7fa9400cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:52.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.701+0000 7fa946dba640 1 --2- 172.21.15.73:0/2748614116 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa92406c530 0x7fa92406e9f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:52.680 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.701+0000 7fa946dba640 1 --2- 172.21.15.73:0/2748614116 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa9400d4f20 0x7fa9400cb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:52.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.701+0000 7fa946dba640 1 -- 172.21.15.73:0/2748614116 >> 172.21.15.73:0/2748614116 conn(0x7fa94008bfc0 msgr2=0x7fa94006c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:52.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.701+0000 7fa946dba640 1 -- 172.21.15.73:0/2748614116 shutdown_connections 2024-03-29T04:08:52.681 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.701+0000 7fa946dba640 1 -- 172.21.15.73:0/2748614116 wait complete. 2024-03-29T04:08:52.697 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-29T04:08:52.697 INFO:tasks.ceph.mds.a:Stopping old one... 2024-03-29T04:08:52.697 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-29T04:08:52.697 INFO:teuthology.orchestra.run:waiting for 300 2024-03-29T04:08:52.697 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-29T04:08:52.698 INFO:tasks.ceph.mds.c:Stopping old one... 2024-03-29T04:08:52.698 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-29T04:08:52.698 INFO:teuthology.orchestra.run:waiting for 300 2024-03-29T04:08:52.698 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-29T04:08:52.698 INFO:tasks.ceph.mds.b:Stopping old one... 2024-03-29T04:08:52.699 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-29T04:08:52.699 INFO:teuthology.orchestra.run:waiting for 300 2024-03-29T04:08:52.699 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-29T04:08:52.699 INFO:tasks.ceph.mds.d:Stopping old one... 2024-03-29T04:08:52.699 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-29T04:08:52.699 INFO:teuthology.orchestra.run:waiting for 300 2024-03-29T04:08:52.707 INFO:tasks.ceph.mds.a:Stopped 2024-03-29T04:08:52.708 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-29T04:08:52.709 INFO:tasks.ceph.mds.c:Stopped 2024-03-29T04:08:52.709 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-29T04:08:52.711 INFO:tasks.ceph.mds.d:Stopped 2024-03-29T04:08:52.711 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-29T04:08:52.712 INFO:tasks.ceph.mds.b:Stopped 2024-03-29T04:08:52.712 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-29T04:08:52.750 INFO:tasks.ceph.mds.a:Started 2024-03-29T04:08:52.750 DEBUG:teuthology.parallel:result is None 2024-03-29T04:08:52.751 INFO:tasks.ceph.mds.c:Started 2024-03-29T04:08:52.751 DEBUG:teuthology.parallel:result is None 2024-03-29T04:08:52.753 INFO:tasks.ceph.mds.d:Started 2024-03-29T04:08:52.753 DEBUG:teuthology.parallel:result is None 2024-03-29T04:08:52.754 INFO:tasks.ceph.mds.b:Started 2024-03-29T04:08:52.754 DEBUG:teuthology.parallel:result is None 2024-03-29T04:08:52.754 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-03-29T04:08:52.829 INFO:tasks.ceph.mds.c.smithi073.stdout:starting mds.c at 2024-03-29T04:08:52.830 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2024-03-29T04:08:52.834 INFO:tasks.ceph.mds.d.smithi142.stdout:starting mds.d at 2024-03-29T04:08:52.834 INFO:tasks.ceph.mds.b.smithi142.stdout:starting mds.b at 2024-03-29T04:08:52.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.882+0000 7f1765f00640 1 Processor -- start 2024-03-29T04:08:52.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.882+0000 7f1765f00640 1 -- start start 2024-03-29T04:08:52.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.883+0000 7f1765f00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f176015e780 0x7f17600cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:52.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.883+0000 7f1765f00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f176015eb60 0x7f17600cf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:52.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.883+0000 7f1765f00640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17600cfe70 con 0x7f17600cf640 2024-03-29T04:08:52.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.883+0000 7f1765f00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f17600b7f50 con 0x7f176015e780 2024-03-29T04:08:52.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.883+0000 7f1765f00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f17600b8230 con 0x7f176015eb60 2024-03-29T04:08:52.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.883+0000 7f175f7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f176015e780 0x7f17600cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:52.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.883+0000 7f175ffff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f17600cf640 0x7f17600b8ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57302/0 (socket says 172.21.15.73:57302) 2024-03-29T04:08:52.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.883+0000 7f175ffff640 1 -- 172.21.15.73:0/1769541857 learned_addr learned my addr 172.21.15.73:0/1769541857 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:52.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.883+0000 7f175f7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f176015e780 0x7f17600cebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54378/0 (socket says 172.21.15.73:54378) 2024-03-29T04:08:52.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.883+0000 7f175effd640 1 --2- 172.21.15.73:0/1769541857 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f176015eb60 0x7f17600cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:52.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.883+0000 7f175f7fe640 1 -- 172.21.15.73:0/1769541857 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f176015eb60 msgr2=0x7f17600cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:52.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.883+0000 7f175f7fe640 1 --2- 172.21.15.73:0/1769541857 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f176015eb60 0x7f17600cf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:52.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.883+0000 7f175e7fc640 1 -- 172.21.15.73:0/1769541857 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2397347273 0 0) 0x7f17600cfe70 con 0x7f17600cf640 2024-03-29T04:08:52.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.883+0000 7f175f7fe640 1 -- 172.21.15.73:0/1769541857 >> v1:172.21.15.73:6789/0 conn(0x7f17600cf640 legacy=0x7f17600b8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:52.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.883+0000 7f175f7fe640 1 -- 172.21.15.73:0/1769541857 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17600b8510 con 0x7f176015e780 2024-03-29T04:08:52.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.883+0000 7f175effd640 1 --2- 172.21.15.73:0/1769541857 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f176015eb60 0x7f17600cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:08:52.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.884+0000 7f175f7fe640 1 --2- 172.21.15.73:0/1769541857 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f176015e780 0x7f17600cebc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f17500097a0 tx=0x7f175002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5584c901ab698d4 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:52.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.884+0000 7f175e7fc640 1 -- 172.21.15.73:0/1769541857 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1750035020 con 0x7f176015e780 2024-03-29T04:08:52.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.884+0000 7f175e7fc640 1 -- 172.21.15.73:0/1769541857 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1750031830 con 0x7f176015e780 2024-03-29T04:08:52.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.884+0000 7f175e7fc640 1 -- 172.21.15.73:0/1769541857 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1750031c00 con 0x7f176015e780 2024-03-29T04:08:52.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.885+0000 7f1765f00640 1 -- 172.21.15.73:0/1769541857 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f176015e780 msgr2=0x7f17600cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:52.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.885+0000 7f1765f00640 1 --2- 172.21.15.73:0/1769541857 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f176015e780 0x7f17600cebc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f17500097a0 tx=0x7f175002b8d0 comp rx=0 tx=0).stop 2024-03-29T04:08:52.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.885+0000 7f1765f00640 1 -- 172.21.15.73:0/1769541857 shutdown_connections 2024-03-29T04:08:52.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.885+0000 7f1765f00640 1 --2- 172.21.15.73:0/1769541857 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f176015eb60 0x7f17600cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:52.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.885+0000 7f1765f00640 1 --2- 172.21.15.73:0/1769541857 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f176015e780 0x7f17600cebc0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:52.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.885+0000 7f1765f00640 1 -- 172.21.15.73:0/1769541857 >> 172.21.15.73:0/1769541857 conn(0x7f176008bfc0 msgr2=0x7f17600d4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:52.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.885+0000 7f1765f00640 1 -- 172.21.15.73:0/1769541857 shutdown_connections 2024-03-29T04:08:52.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.885+0000 7f1765f00640 1 -- 172.21.15.73:0/1769541857 wait complete. 2024-03-29T04:08:52.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.886+0000 7f1765f00640 1 Processor -- start 2024-03-29T04:08:52.866 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.886+0000 7f1765f00640 1 -- start start 2024-03-29T04:08:52.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.887+0000 7f1765f00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17600cf640 0x7f17600b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:52.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.887+0000 7f1765f00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f176015e780 0x7f17600ce290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:52.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.887+0000 7f1765f00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17600ce7d0 0x7f17600cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:52.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.887+0000 7f1765f00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f17600d3580 con 0x7f17600ce7d0 2024-03-29T04:08:52.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.887+0000 7f1765f00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f17600b8ad0 con 0x7f17600cf640 2024-03-29T04:08:52.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.887+0000 7f1765f00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f17600d3700 con 0x7f176015e780 2024-03-29T04:08:52.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.887+0000 7f175ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17600ce7d0 0x7f17600cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:52.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.887+0000 7f175ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17600ce7d0 0x7f17600cb6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54384/0 (socket says 172.21.15.73:54384) 2024-03-29T04:08:52.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.887+0000 7f175ffff640 1 -- 172.21.15.73:0/3569123377 learned_addr learned my addr 172.21.15.73:0/3569123377 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:52.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.887+0000 7f175effd640 1 --2- 172.21.15.73:0/3569123377 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f176015e780 0x7f17600ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:52.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.887+0000 7f175f7fe640 1 --2- 172.21.15.73:0/3569123377 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17600cf640 0x7f17600b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:52.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.887+0000 7f175ffff640 1 -- 172.21.15.73:0/3569123377 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f176015e780 msgr2=0x7f17600ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:52.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.887+0000 7f175ffff640 1 --2- 172.21.15.73:0/3569123377 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f176015e780 0x7f17600ce290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:52.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.887+0000 7f175ffff640 1 -- 172.21.15.73:0/3569123377 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17600cf640 msgr2=0x7f17600b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:52.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.887+0000 7f175ffff640 1 --2- 172.21.15.73:0/3569123377 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17600cf640 0x7f17600b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:52.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.887+0000 7f175ffff640 1 -- 172.21.15.73:0/3569123377 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17600cc3e0 con 0x7f17600ce7d0 2024-03-29T04:08:52.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.887+0000 7f175ffff640 1 --2- 172.21.15.73:0/3569123377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17600ce7d0 0x7f17600cb6b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f175800c7a0 tx=0x7f175800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:52.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.888+0000 7f1747fff640 1 -- 172.21.15.73:0/3569123377 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1758018070 con 0x7f17600ce7d0 2024-03-29T04:08:52.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.888+0000 7f1747fff640 1 -- 172.21.15.73:0/3569123377 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f175800a640 con 0x7f17600ce7d0 2024-03-29T04:08:52.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.888+0000 7f1765f00640 1 -- 172.21.15.73:0/3569123377 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17600cc6c0 con 0x7f17600ce7d0 2024-03-29T04:08:52.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.888+0000 7f1747fff640 1 -- 172.21.15.73:0/3569123377 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f175800aab0 con 0x7f17600ce7d0 2024-03-29T04:08:52.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.888+0000 7f1765f00640 1 -- 172.21.15.73:0/3569123377 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17600ccc80 con 0x7f17600ce7d0 2024-03-29T04:08:52.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.889+0000 7f1765f00640 1 -- 172.21.15.73:0/3569123377 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1760068640 con 0x7f17600ce7d0 2024-03-29T04:08:52.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.889+0000 7f1747fff640 1 -- 172.21.15.73:0/3569123377 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f175801b070 con 0x7f17600ce7d0 2024-03-29T04:08:52.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.889+0000 7f1747fff640 1 --2- 172.21.15.73:0/3569123377 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f174c06c530 0x7f174c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:52.870 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.890+0000 7f175f7fe640 1 --2- 172.21.15.73:0/3569123377 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f174c06c530 0x7f174c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:52.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.890+0000 7f1747fff640 1 -- 172.21.15.73:0/3569123377 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 4943+0+0 (secure 0 0 0) 0x7f175808a990 con 0x7f17600ce7d0 2024-03-29T04:08:52.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.890+0000 7f175f7fe640 1 --2- 172.21.15.73:0/3569123377 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f174c06c530 0x7f174c06e9f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1750036000 tx=0x7f1750008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:52.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:52.894+0000 7f1747fff640 1 -- 172.21.15.73:0/3569123377 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f1758059340 con 0x7f17600ce7d0 2024-03-29T04:08:53.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.079+0000 7f1765f00640 1 -- 172.21.15.73:0/3569123377 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f17600b69c0 con 0x7f17600ce7d0 2024-03-29T04:08:53.685 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.705+0000 7f1747fff640 1 -- 172.21.15.73:0/3569123377 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) ==== 97+0+0 (secure 0 0 0) 0x7f1758058c40 con 0x7f17600ce7d0 2024-03-29T04:08:53.685 INFO:teuthology.orchestra.run.smithi073.stderr: removed all blocklist entries 2024-03-29T04:08:53.687 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.708+0000 7f1765f00640 1 -- 172.21.15.73:0/3569123377 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f174c06c530 msgr2=0x7f174c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:53.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.708+0000 7f1765f00640 1 --2- 172.21.15.73:0/3569123377 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f174c06c530 0x7f174c06e9f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1750036000 tx=0x7f1750008030 comp rx=0 tx=0).stop 2024-03-29T04:08:53.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.708+0000 7f1765f00640 1 -- 172.21.15.73:0/3569123377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17600ce7d0 msgr2=0x7f17600cb6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:53.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.708+0000 7f1765f00640 1 --2- 172.21.15.73:0/3569123377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17600ce7d0 0x7f17600cb6b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f175800c7a0 tx=0x7f175800cc60 comp rx=0 tx=0).stop 2024-03-29T04:08:53.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.708+0000 7f1765f00640 1 -- 172.21.15.73:0/3569123377 shutdown_connections 2024-03-29T04:08:53.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.708+0000 7f1765f00640 1 --2- 172.21.15.73:0/3569123377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17600ce7d0 0x7f17600cb6b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:53.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.708+0000 7f1765f00640 1 --2- 172.21.15.73:0/3569123377 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f176015e780 0x7f17600ce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:53.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.708+0000 7f1765f00640 1 --2- 172.21.15.73:0/3569123377 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f174c06c530 0x7f174c06e9f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:53.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.708+0000 7f1765f00640 1 --2- 172.21.15.73:0/3569123377 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17600cf640 0x7f17600b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:53.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.708+0000 7f1765f00640 1 -- 172.21.15.73:0/3569123377 >> 172.21.15.73:0/3569123377 conn(0x7f176008bfc0 msgr2=0x7f17600d0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:53.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.708+0000 7f1765f00640 1 -- 172.21.15.73:0/3569123377 shutdown_connections 2024-03-29T04:08:53.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.708+0000 7f1765f00640 1 -- 172.21.15.73:0/3569123377 wait complete. 2024-03-29T04:08:53.700 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-03-29T04:08:53.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.820+0000 7f7a78c14640 1 Processor -- start 2024-03-29T04:08:53.800 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.820+0000 7f7a78c14640 1 -- start start 2024-03-29T04:08:53.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.821+0000 7f7a78c14640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a740ad940 0x7f7a7406c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:53.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.821+0000 7f7a78c14640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a74146230 con 0x7f7a7415c670 2024-03-29T04:08:53.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.821+0000 7f7a78c14640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a7406dfc0 con 0x7f7a7406f060 2024-03-29T04:08:53.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.821+0000 7f7a78c14640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7a7406e2a0 con 0x7f7a740ad940 2024-03-29T04:08:53.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.821+0000 7f7a7259c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7a7415c670 0x7f7a740ad230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57310/0 (socket says 172.21.15.73:57310) 2024-03-29T04:08:53.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.821+0000 7f7a7259c640 1 -- 172.21.15.73:0/2534366138 learned_addr learned my addr 172.21.15.73:0/2534366138 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:53.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.822+0000 7f7a71d9b640 1 --2- 172.21.15.73:0/2534366138 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a740ad940 0x7f7a7406c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:53.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.822+0000 7f7a7159a640 1 -- 172.21.15.73:0/2534366138 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 434128577 0 0) 0x7f7a6c001490 con 0x7f7a7415c670 2024-03-29T04:08:53.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.822+0000 7f7a7159a640 1 -- 172.21.15.73:0/2534366138 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a5c003520 con 0x7f7a7415c670 2024-03-29T04:08:53.804 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.822+0000 7f7a7159a640 1 -- 172.21.15.73:0/2534366138 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1381340704 0 0) 0x7f7a5c003520 con 0x7f7a7415c670 2024-03-29T04:08:53.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.822+0000 7f7a7159a640 1 -- 172.21.15.73:0/2534366138 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a740ad940 msgr2=0x7f7a7406c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:53.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.822+0000 7f7a7159a640 1 --2- 172.21.15.73:0/2534366138 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a740ad940 0x7f7a7406c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:53.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.822+0000 7f7a7159a640 1 -- 172.21.15.73:0/2534366138 >> v1:172.21.15.142:6789/0 conn(0x7f7a7406f060 legacy=0x7f7a740b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:53.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.822+0000 7f7a7159a640 1 -- 172.21.15.73:0/2534366138 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a7406e580 con 0x7f7a7415c670 2024-03-29T04:08:53.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.822+0000 7f7a7159a640 1 -- 172.21.15.73:0/2534366138 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1290421750 0 0) 0x7f7a6c001bc0 con 0x7f7a7415c670 2024-03-29T04:08:53.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.822+0000 7f7a7159a640 1 -- 172.21.15.73:0/2534366138 >> v1:172.21.15.73:6789/0 conn(0x7f7a7415c670 legacy=0x7f7a740ad230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:53.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.822+0000 7f7a7159a640 1 --2- 172.21.15.73:0/2534366138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a5c0039e0 0x7f7a5c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:53.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.822+0000 7f7a7159a640 1 --2- 172.21.15.73:0/2534366138 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a740ad940 0x7f7a5c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:53.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.822+0000 7f7a7159a640 1 --2- 172.21.15.73:0/2534366138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a5c004d40 0x7f7a5c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:53.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.822+0000 7f7a7159a640 1 -- 172.21.15.73:0/2534366138 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7406e2a0 con 0x7f7a5c004d40 2024-03-29T04:08:53.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.822+0000 7f7a7159a640 1 -- 172.21.15.73:0/2534366138 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7a5c00bad0 con 0x7f7a5c0039e0 2024-03-29T04:08:53.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.822+0000 7f7a7159a640 1 -- 172.21.15.73:0/2534366138 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7a5c00bcd0 con 0x7f7a740ad940 2024-03-29T04:08:53.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.822+0000 7f7a72d9d640 1 --2- 172.21.15.73:0/2534366138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a5c004d40 0x7f7a5c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:53.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.822+0000 7f7a7259c640 1 --2- 172.21.15.73:0/2534366138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a5c0039e0 0x7f7a5c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:53.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.822+0000 7f7a71d9b640 1 --2- 172.21.15.73:0/2534366138 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a740ad940 0x7f7a5c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:53.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.822+0000 7f7a72d9d640 1 -- 172.21.15.73:0/2534366138 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a740ad940 msgr2=0x7f7a5c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:53.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.822+0000 7f7a72d9d640 1 --2- 172.21.15.73:0/2534366138 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a740ad940 0x7f7a5c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:53.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.822+0000 7f7a72d9d640 1 -- 172.21.15.73:0/2534366138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a5c0039e0 msgr2=0x7f7a5c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:53.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.822+0000 7f7a72d9d640 1 --2- 172.21.15.73:0/2534366138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a5c0039e0 0x7f7a5c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:53.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.822+0000 7f7a72d9d640 1 -- 172.21.15.73:0/2534366138 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a5c003520 con 0x7f7a5c004d40 2024-03-29T04:08:53.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.822+0000 7f7a71d9b640 1 --2- 172.21.15.73:0/2534366138 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a740ad940 0x7f7a5c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:08:53.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.823+0000 7f7a72d9d640 1 --2- 172.21.15.73:0/2534366138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a5c004d40 0x7f7a5c0051c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7a64001860 tx=0x7f7a5c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2bce6fc14d1217f server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:53.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.823+0000 7f7a7159a640 1 -- 172.21.15.73:0/2534366138 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a64038070 con 0x7f7a5c004d40 2024-03-29T04:08:53.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.823+0000 7f7a7159a640 1 -- 172.21.15.73:0/2534366138 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a64033410 con 0x7f7a5c004d40 2024-03-29T04:08:53.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.823+0000 7f7a7159a640 1 -- 172.21.15.73:0/2534366138 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a64001430 con 0x7f7a5c004d40 2024-03-29T04:08:53.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.824+0000 7f7a78c14640 1 -- 172.21.15.73:0/2534366138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a5c004d40 msgr2=0x7f7a5c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:53.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.824+0000 7f7a78c14640 1 --2- 172.21.15.73:0/2534366138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a5c004d40 0x7f7a5c0051c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7a64001860 tx=0x7f7a5c005830 comp rx=0 tx=0).stop 2024-03-29T04:08:53.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.824+0000 7f7a72d9d640 1 -- 172.21.15.73:0/2534366138 reap_dead start 2024-03-29T04:08:53.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.824+0000 7f7a78c14640 1 -- 172.21.15.73:0/2534366138 shutdown_connections 2024-03-29T04:08:53.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.824+0000 7f7a78c14640 1 -- 172.21.15.73:0/2534366138 >> 172.21.15.73:0/2534366138 conn(0x7f7a7406b510 msgr2=0x7f7a7406b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:53.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.824+0000 7f7a78c14640 1 -- 172.21.15.73:0/2534366138 shutdown_connections 2024-03-29T04:08:53.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.824+0000 7f7a78c14640 1 -- 172.21.15.73:0/2534366138 wait complete. 2024-03-29T04:08:53.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.825+0000 7f7a78c14640 1 Processor -- start 2024-03-29T04:08:53.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.825+0000 7f7a78c14640 1 -- start start 2024-03-29T04:08:53.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.826+0000 7f7a78c14640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a5c004d40 0x7f7a7415b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:53.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.826+0000 7f7a78c14640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a7409a3b0 0x7f7a74099910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:53.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.826+0000 7f7a78c14640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a7409afe0 0x7f7a7409b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:53.809 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.826+0000 7f7a78c14640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7406c030 con 0x7f7a7409a3b0 2024-03-29T04:08:53.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.826+0000 7f7a78c14640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7415ca50 con 0x7f7a7409afe0 2024-03-29T04:08:53.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.826+0000 7f7a78c14640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7a7406c1b0 con 0x7f7a5c004d40 2024-03-29T04:08:53.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.826+0000 7f7a71d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a7409a3b0 0x7f7a74099910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:53.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.826+0000 7f7a71d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a7409a3b0 0x7f7a74099910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54408/0 (socket says 172.21.15.73:54408) 2024-03-29T04:08:53.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.826+0000 7f7a71d9b640 1 -- 172.21.15.73:0/518082052 learned_addr learned my addr 172.21.15.73:0/518082052 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:53.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.826+0000 7f7a71d9b640 1 -- 172.21.15.73:0/518082052 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a5c004d40 msgr2=0x7f7a7415b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:53.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.826+0000 7f7a71d9b640 1 --2- 172.21.15.73:0/518082052 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a5c004d40 0x7f7a7415b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:53.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.826+0000 7f7a71d9b640 1 -- 172.21.15.73:0/518082052 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a7409afe0 msgr2=0x7f7a7409b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:53.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.826+0000 7f7a71d9b640 1 --2- 172.21.15.73:0/518082052 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a7409afe0 0x7f7a7409b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:53.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.826+0000 7f7a71d9b640 1 -- 172.21.15.73:0/518082052 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a7409a920 con 0x7f7a7409a3b0 2024-03-29T04:08:53.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.826+0000 7f7a71d9b640 1 --2- 172.21.15.73:0/518082052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a7409a3b0 0x7f7a74099910 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7a680116d0 tx=0x7f7a68011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:53.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.827+0000 7f7a62ffd640 1 -- 172.21.15.73:0/518082052 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6800f8e0 con 0x7f7a7409a3b0 2024-03-29T04:08:53.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.827+0000 7f7a62ffd640 1 -- 172.21.15.73:0/518082052 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a6800fa80 con 0x7f7a7409a3b0 2024-03-29T04:08:53.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.827+0000 7f7a78c14640 1 -- 172.21.15.73:0/518082052 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a74147250 con 0x7f7a7409a3b0 2024-03-29T04:08:53.810 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.827+0000 7f7a62ffd640 1 -- 172.21.15.73:0/518082052 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6800fe70 con 0x7f7a7409a3b0 2024-03-29T04:08:53.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.827+0000 7f7a78c14640 1 -- 172.21.15.73:0/518082052 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a74099e50 con 0x7f7a7409a3b0 2024-03-29T04:08:53.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.828+0000 7f7a78c14640 1 -- 172.21.15.73:0/518082052 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a74068640 con 0x7f7a7409a3b0 2024-03-29T04:08:53.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.828+0000 7f7a62ffd640 1 -- 172.21.15.73:0/518082052 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f7a68015460 con 0x7f7a7409a3b0 2024-03-29T04:08:53.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.828+0000 7f7a62ffd640 1 --2- 172.21.15.73:0/518082052 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7a5406c530 0x7f7a5406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:53.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.828+0000 7f7a62ffd640 1 -- 172.21.15.73:0/518082052 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f7a6808bd90 con 0x7f7a7409a3b0 2024-03-29T04:08:53.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.828+0000 7f7a7259c640 1 --2- 172.21.15.73:0/518082052 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7a5406c530 0x7f7a5406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:53.811 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.829+0000 7f7a7259c640 1 --2- 172.21.15.73:0/518082052 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7a5406c530 0x7f7a5406e9f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c001730 tx=0x7f7a6c0016a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:53.812 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:53.833+0000 7f7a62ffd640 1 -- 172.21.15.73:0/518082052 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f7a68019030 con 0x7f7a7409a3b0 2024-03-29T04:08:54.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.075+0000 7f7a78c14640 1 -- 172.21.15.73:0/518082052 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f7a741594e0 con 0x7f7a7409a3b0 2024-03-29T04:08:54.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.076+0000 7f7a62ffd640 1 -- 172.21.15.73:0/518082052 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) ==== 80+0+6645 (secure 0 0 0) 0x7f7a6805a670 con 0x7f7a7409a3b0 2024-03-29T04:08:54.055 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:54.055 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-29T04:08:54.056 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_dump": [ 2024-03-29T04:08:54.056 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-29T04:08:54.056 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.a", 2024-03-29T04:08:54.056 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQBsPgZmbtrWIBAAmGRwkJNfTBMaITR8H8NhHw==", 2024-03-29T04:08:54.056 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-03-29T04:08:54.056 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-03-29T04:08:54.056 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-03-29T04:08:54.056 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-03-29T04:08:54.056 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-03-29T04:08:54.056 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-29T04:08:54.056 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-29T04:08:54.056 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-29T04:08:54.056 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.b", 2024-03-29T04:08:54.057 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQBsPgZmoKE0LRAAH+HRzN4Dv6qWaNe1jpgteQ==", 2024-03-29T04:08:54.057 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-03-29T04:08:54.057 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-03-29T04:08:54.057 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-03-29T04:08:54.057 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-03-29T04:08:54.057 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-03-29T04:08:54.057 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-29T04:08:54.057 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-29T04:08:54.057 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-29T04:08:54.057 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.c", 2024-03-29T04:08:54.057 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQBsPgZmuTk1KBAAYLpWNId/qCOTs2lezhvi2g==", 2024-03-29T04:08:54.057 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-03-29T04:08:54.057 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-03-29T04:08:54.057 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-03-29T04:08:54.057 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-03-29T04:08:54.058 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-03-29T04:08:54.058 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-29T04:08:54.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-29T04:08:54.058 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-29T04:08:54.058 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mds.d", 2024-03-29T04:08:54.058 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQBsPgZm556YNBAABXBNlnBVlX+xrqxiVIgwHg==", 2024-03-29T04:08:54.058 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-03-29T04:08:54.058 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-03-29T04:08:54.058 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-03-29T04:08:54.058 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-03-29T04:08:54.058 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-03-29T04:08:54.058 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-29T04:08:54.058 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-29T04:08:54.058 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-29T04:08:54.058 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.0", 2024-03-29T04:08:54.059 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQBwPgZmCjcOHBAA/unr5MXeoszbia8j49R+FQ==", 2024-03-29T04:08:54.059 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-03-29T04:08:54.059 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-03-29T04:08:54.059 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-03-29T04:08:54.059 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-03-29T04:08:54.059 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-29T04:08:54.059 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-29T04:08:54.059 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-29T04:08:54.059 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.1", 2024-03-29T04:08:54.059 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQBzPgZmCZP/GhAAZHP2KwvOJbcqbDAPylV1Vg==", 2024-03-29T04:08:54.059 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-03-29T04:08:54.060 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-03-29T04:08:54.060 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-03-29T04:08:54.060 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-03-29T04:08:54.060 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-29T04:08:54.060 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-29T04:08:54.060 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-29T04:08:54.060 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.2", 2024-03-29T04:08:54.060 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQB2PgZmArgIGRAAmVnKN0lm0flaVX5Ffh2bfw==", 2024-03-29T04:08:54.060 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-03-29T04:08:54.061 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-03-29T04:08:54.061 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-03-29T04:08:54.061 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-03-29T04:08:54.061 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-29T04:08:54.061 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-29T04:08:54.061 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-29T04:08:54.061 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.3", 2024-03-29T04:08:54.061 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQB5PgZmCBzxFxAARl70C8xea/p0m/EUbu2wKg==", 2024-03-29T04:08:54.061 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-03-29T04:08:54.062 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-03-29T04:08:54.062 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-03-29T04:08:54.062 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-03-29T04:08:54.062 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-29T04:08:54.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-29T04:08:54.062 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-29T04:08:54.062 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.4", 2024-03-29T04:08:54.062 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQB/PgZmgF8SHhAAtBYaoMvuQyvvuzrleZqVqw==", 2024-03-29T04:08:54.062 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-03-29T04:08:54.062 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-03-29T04:08:54.062 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-03-29T04:08:54.062 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-03-29T04:08:54.062 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-29T04:08:54.062 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-29T04:08:54.063 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-29T04:08:54.063 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.5", 2024-03-29T04:08:54.063 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQCCPgZmhBxbHRAA6BHSen4zRfZRdnmacUQ4bg==", 2024-03-29T04:08:54.063 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-03-29T04:08:54.063 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-03-29T04:08:54.063 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-03-29T04:08:54.063 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-03-29T04:08:54.063 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-29T04:08:54.063 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-29T04:08:54.063 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-29T04:08:54.063 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.6", 2024-03-29T04:08:54.063 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQCFPgZmPDfgGxAAsxeU6LMQGc4EVgKPHq+pyQ==", 2024-03-29T04:08:54.063 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-03-29T04:08:54.063 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-03-29T04:08:54.064 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-03-29T04:08:54.064 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-03-29T04:08:54.064 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-29T04:08:54.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-29T04:08:54.064 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-29T04:08:54.064 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "osd.7", 2024-03-29T04:08:54.064 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQCIPgZmtBeCGhAAUI+egjXzjuruPlLnEEf7MA==", 2024-03-29T04:08:54.064 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-03-29T04:08:54.064 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow profile osd", 2024-03-29T04:08:54.064 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile osd", 2024-03-29T04:08:54.064 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-03-29T04:08:54.064 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-29T04:08:54.064 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-29T04:08:54.064 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-29T04:08:54.064 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.0", 2024-03-29T04:08:54.065 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQBsPgZm/zLXOBAAAojJQ+pg3lyn0+VyZVyLKw==", 2024-03-29T04:08:54.065 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-03-29T04:08:54.065 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-03-29T04:08:54.065 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow r", 2024-03-29T04:08:54.065 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow rw", 2024-03-29T04:08:54.065 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rwx" 2024-03-29T04:08:54.065 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-29T04:08:54.065 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-29T04:08:54.065 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-29T04:08:54.065 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.1", 2024-03-29T04:08:54.065 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQBtPgZmSCKOBhAA4YXl0zs1aLQ+bnawYPPBUw==", 2024-03-29T04:08:54.065 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-03-29T04:08:54.065 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-03-29T04:08:54.066 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow r", 2024-03-29T04:08:54.066 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow rw", 2024-03-29T04:08:54.066 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rwx" 2024-03-29T04:08:54.066 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-29T04:08:54.066 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-29T04:08:54.066 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-29T04:08:54.066 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.2", 2024-03-29T04:08:54.066 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQBtPgZmtMcKAxAAxRLI4wRGUT3ts8OUVrxPWQ==", 2024-03-29T04:08:54.066 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-03-29T04:08:54.066 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-03-29T04:08:54.066 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow r", 2024-03-29T04:08:54.066 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow rw", 2024-03-29T04:08:54.066 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rwx" 2024-03-29T04:08:54.067 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-29T04:08:54.067 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-29T04:08:54.067 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-29T04:08:54.067 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.3", 2024-03-29T04:08:54.067 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQBtPgZmlKfwCRAAsXfKUvhO/pyIrMUMcoeJqg==", 2024-03-29T04:08:54.067 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-03-29T04:08:54.067 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow", 2024-03-29T04:08:54.067 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow r", 2024-03-29T04:08:54.067 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow rw", 2024-03-29T04:08:54.067 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow rwx" 2024-03-29T04:08:54.067 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-29T04:08:54.067 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-29T04:08:54.067 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-29T04:08:54.067 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.admin", 2024-03-29T04:08:54.068 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQBsPgZmlWkSBBAAn/teP8A6est4SJokJfZA3A==", 2024-03-29T04:08:54.068 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-03-29T04:08:54.068 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2024-03-29T04:08:54.068 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": "allow *", 2024-03-29T04:08:54.068 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow *", 2024-03-29T04:08:54.068 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-03-29T04:08:54.068 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-29T04:08:54.068 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-29T04:08:54.068 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-29T04:08:54.068 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.bootstrap-mds", 2024-03-29T04:08:54.068 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQCTPgZmQe63FBAAQRI7a66aS8DgaqpVg/KE9w==", 2024-03-29T04:08:54.068 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-03-29T04:08:54.068 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile bootstrap-mds" 2024-03-29T04:08:54.069 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-29T04:08:54.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-29T04:08:54.069 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-29T04:08:54.069 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.bootstrap-mgr", 2024-03-29T04:08:54.069 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQCTPgZmIPa3FBAAysTk4qklROq/A+CXzlvZ5A==", 2024-03-29T04:08:54.069 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-03-29T04:08:54.069 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile bootstrap-mgr" 2024-03-29T04:08:54.069 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-29T04:08:54.069 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-29T04:08:54.069 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-29T04:08:54.069 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.bootstrap-osd", 2024-03-29T04:08:54.069 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQCTPgZmLf23FBAAUg005naUPY8TzAuy/JzzwQ==", 2024-03-29T04:08:54.069 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-03-29T04:08:54.070 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile bootstrap-osd" 2024-03-29T04:08:54.070 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-29T04:08:54.070 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-29T04:08:54.070 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-29T04:08:54.070 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.bootstrap-rbd", 2024-03-29T04:08:54.070 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQCTPgZmSgS4FBAAMdfLwO+RjWiRvk9FuWbGjA==", 2024-03-29T04:08:54.070 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-03-29T04:08:54.070 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile bootstrap-rbd" 2024-03-29T04:08:54.070 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-29T04:08:54.070 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-29T04:08:54.070 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-29T04:08:54.070 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-03-29T04:08:54.070 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQCTPgZmLAu4FBAAU1lI2SHCc9XYspZkTNh8bA==", 2024-03-29T04:08:54.071 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-03-29T04:08:54.071 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-03-29T04:08:54.071 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-29T04:08:54.071 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-29T04:08:54.071 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-29T04:08:54.071 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "client.bootstrap-rgw", 2024-03-29T04:08:54.071 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQCTPgZmNRK4FBAAAy+HqI5sUk8XmuvBfo8Fdg==", 2024-03-29T04:08:54.071 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-03-29T04:08:54.071 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile bootstrap-rgw" 2024-03-29T04:08:54.071 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-29T04:08:54.071 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-29T04:08:54.071 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-29T04:08:54.071 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mgr.x", 2024-03-29T04:08:54.072 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQBsPgZmScduHRAAHZaC0AXkDLCLjbgq/b+kRA==", 2024-03-29T04:08:54.072 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-03-29T04:08:54.072 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2024-03-29T04:08:54.072 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile mgr", 2024-03-29T04:08:54.072 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-03-29T04:08:54.072 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-29T04:08:54.072 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-29T04:08:54.072 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-29T04:08:54.072 INFO:teuthology.orchestra.run.smithi073.stdout: "entity": "mgr.y", 2024-03-29T04:08:54.072 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "AQBsPgZmk+9wGRAANXyu+CsicjdtWrrcdyNsSw==", 2024-03-29T04:08:54.072 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": { 2024-03-29T04:08:54.072 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": "allow *", 2024-03-29T04:08:54.072 INFO:teuthology.orchestra.run.smithi073.stdout: "mon": "allow profile mgr", 2024-03-29T04:08:54.073 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": "allow *" 2024-03-29T04:08:54.073 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-29T04:08:54.073 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-29T04:08:54.073 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-03-29T04:08:54.073 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-29T04:08:54.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.077+0000 7f7a78c14640 1 -- 172.21.15.73:0/518082052 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7a5406c530 msgr2=0x7f7a5406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:54.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.077+0000 7f7a78c14640 1 --2- 172.21.15.73:0/518082052 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7a5406c530 0x7f7a5406e9f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c001730 tx=0x7f7a6c0016a0 comp rx=0 tx=0).stop 2024-03-29T04:08:54.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.077+0000 7f7a78c14640 1 -- 172.21.15.73:0/518082052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a7409a3b0 msgr2=0x7f7a74099910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:54.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.077+0000 7f7a78c14640 1 --2- 172.21.15.73:0/518082052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a7409a3b0 0x7f7a74099910 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7a680116d0 tx=0x7f7a68011b90 comp rx=0 tx=0).stop 2024-03-29T04:08:54.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.077+0000 7f7a78c14640 1 -- 172.21.15.73:0/518082052 shutdown_connections 2024-03-29T04:08:54.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.078+0000 7f7a78c14640 1 --2- 172.21.15.73:0/518082052 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7a5406c530 0x7f7a5406e9f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:54.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.078+0000 7f7a78c14640 1 --2- 172.21.15.73:0/518082052 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a7409afe0 0x7f7a7409b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:54.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.078+0000 7f7a78c14640 1 --2- 172.21.15.73:0/518082052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a7409a3b0 0x7f7a74099910 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:54.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.078+0000 7f7a78c14640 1 --2- 172.21.15.73:0/518082052 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7a5c004d40 0x7f7a7415b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:54.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.078+0000 7f7a78c14640 1 -- 172.21.15.73:0/518082052 >> 172.21.15.73:0/518082052 conn(0x7f7a7406b510 msgr2=0x7f7a740b38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:54.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.078+0000 7f7a78c14640 1 -- 172.21.15.73:0/518082052 shutdown_connections 2024-03-29T04:08:54.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.078+0000 7f7a78c14640 1 -- 172.21.15.73:0/518082052 wait complete. 2024-03-29T04:08:54.076 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-03-29T04:08:54.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.197+0000 7f34d4b7c640 1 Processor -- start 2024-03-29T04:08:54.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.197+0000 7f34d4b7c640 1 -- start start 2024-03-29T04:08:54.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.198+0000 7f34d4b7c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f34d015ec10 0x7f34d00c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:54.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.198+0000 7f34d4b7c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f34d00ce740 0x7f34d00d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:54.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.198+0000 7f34d4b7c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34d015f100 con 0x7f34d00d0560 2024-03-29T04:08:54.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.198+0000 7f34d4b7c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f34d00b40c0 con 0x7f34d00ce740 2024-03-29T04:08:54.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.198+0000 7f34d4b7c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f34d015f370 con 0x7f34d015ec10 2024-03-29T04:08:54.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.198+0000 7f34cdd9b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f34d00ce740 0x7f34d00d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:54.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.198+0000 7f34cdd9b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f34d00ce740 0x7f34d00d0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54422/0 (socket says 172.21.15.73:54422) 2024-03-29T04:08:54.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.198+0000 7f34cdd9b640 1 -- 172.21.15.73:0/1291392431 learned_addr learned my addr 172.21.15.73:0/1291392431 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:54.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.198+0000 7f34ce59c640 1 --2- 172.21.15.73:0/1291392431 >> v2:172.21.15.142:3300/0 conn(0x7f34d015ec10 0x7f34d00c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:54.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.198+0000 7f34cdd9b640 1 -- 172.21.15.73:0/1291392431 >> v2:172.21.15.142:3300/0 conn(0x7f34d015ec10 msgr2=0x7f34d00c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:54.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.198+0000 7f34cdd9b640 1 --2- 172.21.15.73:0/1291392431 >> v2:172.21.15.142:3300/0 conn(0x7f34d015ec10 0x7f34d00c67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:54.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.198+0000 7f34cdd9b640 1 -- 172.21.15.73:0/1291392431 >> v1:172.21.15.142:6789/0 conn(0x7f34d00d0560 legacy=0x7f34d00c54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:54.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.198+0000 7f34cdd9b640 1 -- 172.21.15.73:0/1291392431 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d00d09f0 con 0x7f34d00ce740 2024-03-29T04:08:54.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.198+0000 7f34ce59c640 1 --2- 172.21.15.73:0/1291392431 >> v2:172.21.15.142:3300/0 conn(0x7f34d015ec10 0x7f34d00c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:08:54.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.199+0000 7f34cdd9b640 1 --2- 172.21.15.73:0/1291392431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34d00ce740 0x7f34d00d0020 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f34d00d0f50 tx=0x7f34c402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=267b0a7d15efa9e7 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:54.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.199+0000 7f34cd59a640 1 -- 172.21.15.73:0/1291392431 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c402e070 con 0x7f34d00ce740 2024-03-29T04:08:54.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.199+0000 7f34cd59a640 1 -- 172.21.15.73:0/1291392431 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34c4037070 con 0x7f34d00ce740 2024-03-29T04:08:54.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.199+0000 7f34cd59a640 1 -- 172.21.15.73:0/1291392431 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c4031a00 con 0x7f34d00ce740 2024-03-29T04:08:54.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.200+0000 7f34d4b7c640 1 -- 172.21.15.73:0/1291392431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34d00ce740 msgr2=0x7f34d00d0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:54.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.200+0000 7f34d4b7c640 1 --2- 172.21.15.73:0/1291392431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34d00ce740 0x7f34d00d0020 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f34d00d0f50 tx=0x7f34c402b880 comp rx=0 tx=0).stop 2024-03-29T04:08:54.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.200+0000 7f34d4b7c640 1 -- 172.21.15.73:0/1291392431 shutdown_connections 2024-03-29T04:08:54.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.200+0000 7f34d4b7c640 1 --2- 172.21.15.73:0/1291392431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34d00ce740 0x7f34d00d0020 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:54.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.200+0000 7f34d4b7c640 1 --2- 172.21.15.73:0/1291392431 >> v2:172.21.15.142:3300/0 conn(0x7f34d015ec10 0x7f34d00c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:54.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.200+0000 7f34d4b7c640 1 -- 172.21.15.73:0/1291392431 >> 172.21.15.73:0/1291392431 conn(0x7f34d006b510 msgr2=0x7f34d006b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:54.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.200+0000 7f34d4b7c640 1 -- 172.21.15.73:0/1291392431 shutdown_connections 2024-03-29T04:08:54.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.200+0000 7f34d4b7c640 1 -- 172.21.15.73:0/1291392431 wait complete. 2024-03-29T04:08:54.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.201+0000 7f34d4b7c640 1 Processor -- start 2024-03-29T04:08:54.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.201+0000 7f34d4b7c640 1 -- start start 2024-03-29T04:08:54.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.202+0000 7f34d4b7c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34d00ce740 0x7f34d015a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:54.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.202+0000 7f34d4b7c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34d00d0560 0x7f34d0154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:54.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.202+0000 7f34d4b7c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34d015ec10 0x7f34d00ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:54.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.202+0000 7f34d4b7c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f34d00c6ee0 con 0x7f34d015ec10 2024-03-29T04:08:54.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.202+0000 7f34d4b7c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f34d015f930 con 0x7f34d00d0560 2024-03-29T04:08:54.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.202+0000 7f34d4b7c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f34d015fe50 con 0x7f34d00ce740 2024-03-29T04:08:54.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.202+0000 7f34ced9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34d015ec10 0x7f34d00ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:54.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.202+0000 7f34ced9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34d015ec10 0x7f34d00ccbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54426/0 (socket says 172.21.15.73:54426) 2024-03-29T04:08:54.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.202+0000 7f34ced9d640 1 -- 172.21.15.73:0/4053046396 learned_addr learned my addr 172.21.15.73:0/4053046396 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:54.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.202+0000 7f34cdd9b640 1 --2- 172.21.15.73:0/4053046396 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34d00d0560 0x7f34d0154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:54.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.202+0000 7f34ce59c640 1 --2- 172.21.15.73:0/4053046396 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34d00ce740 0x7f34d015a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:54.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.202+0000 7f34ced9d640 1 -- 172.21.15.73:0/4053046396 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34d00ce740 msgr2=0x7f34d015a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:54.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.202+0000 7f34ced9d640 1 --2- 172.21.15.73:0/4053046396 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34d00ce740 0x7f34d015a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:54.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.202+0000 7f34ced9d640 1 -- 172.21.15.73:0/4053046396 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34d00d0560 msgr2=0x7f34d0154420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:54.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.202+0000 7f34ced9d640 1 --2- 172.21.15.73:0/4053046396 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34d00d0560 0x7f34d0154420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:54.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.202+0000 7f34ced9d640 1 -- 172.21.15.73:0/4053046396 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d00cebd0 con 0x7f34d015ec10 2024-03-29T04:08:54.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.203+0000 7f34ced9d640 1 --2- 172.21.15.73:0/4053046396 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34d015ec10 0x7f34d00ccbe0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f34c800b970 tx=0x7f34c800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:54.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.203+0000 7f34beffd640 1 -- 172.21.15.73:0/4053046396 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c8019070 con 0x7f34d015ec10 2024-03-29T04:08:54.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.203+0000 7f34beffd640 1 -- 172.21.15.73:0/4053046396 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34c800cb40 con 0x7f34d015ec10 2024-03-29T04:08:54.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.203+0000 7f34d4b7c640 1 -- 172.21.15.73:0/4053046396 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34d01e4ea0 con 0x7f34d015ec10 2024-03-29T04:08:54.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.203+0000 7f34beffd640 1 -- 172.21.15.73:0/4053046396 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c8014440 con 0x7f34d015ec10 2024-03-29T04:08:54.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.203+0000 7f34d4b7c640 1 -- 172.21.15.73:0/4053046396 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34d01f66b0 con 0x7f34d015ec10 2024-03-29T04:08:54.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.204+0000 7f34d4b7c640 1 -- 172.21.15.73:0/4053046396 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34d01e5070 con 0x7f34d015ec10 2024-03-29T04:08:54.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.204+0000 7f34beffd640 1 -- 172.21.15.73:0/4053046396 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f34c801c070 con 0x7f34d015ec10 2024-03-29T04:08:54.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.204+0000 7f34beffd640 1 --2- 172.21.15.73:0/4053046396 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f34b006c530 0x7f34b006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:54.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.205+0000 7f34beffd640 1 -- 172.21.15.73:0/4053046396 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f34c808af30 con 0x7f34d015ec10 2024-03-29T04:08:54.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.205+0000 7f34ce59c640 1 --2- 172.21.15.73:0/4053046396 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f34b006c530 0x7f34b006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:54.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.205+0000 7f34ce59c640 1 --2- 172.21.15.73:0/4053046396 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f34b006c530 0x7f34b006e9f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f34c000a990 tx=0x7f34c0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:54.188 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.209+0000 7f34beffd640 1 -- 172.21.15.73:0/4053046396 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f34c8059930 con 0x7f34d015ec10 2024-03-29T04:08:54.431 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.452+0000 7f34d4b7c640 1 -- 172.21.15.73:0/4053046396 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f34d00cf080 con 0x7f34d015ec10 2024-03-29T04:08:54.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.453+0000 7f34beffd640 1 -- 172.21.15.73:0/4053046396 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7f34d00cf080 con 0x7f34d015ec10 2024-03-29T04:08:54.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.455+0000 7f34d4b7c640 1 -- 172.21.15.73:0/4053046396 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f34b006c530 msgr2=0x7f34b006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:54.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.455+0000 7f34d4b7c640 1 --2- 172.21.15.73:0/4053046396 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f34b006c530 0x7f34b006e9f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f34c000a990 tx=0x7f34c0008040 comp rx=0 tx=0).stop 2024-03-29T04:08:54.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.455+0000 7f34d4b7c640 1 -- 172.21.15.73:0/4053046396 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34d015ec10 msgr2=0x7f34d00ccbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:54.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.455+0000 7f34d4b7c640 1 --2- 172.21.15.73:0/4053046396 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34d015ec10 0x7f34d00ccbe0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f34c800b970 tx=0x7f34c800be30 comp rx=0 tx=0).stop 2024-03-29T04:08:54.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.455+0000 7f34d4b7c640 1 -- 172.21.15.73:0/4053046396 shutdown_connections 2024-03-29T04:08:54.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.455+0000 7f34d4b7c640 1 --2- 172.21.15.73:0/4053046396 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34d015ec10 0x7f34d00ccbe0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:54.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.455+0000 7f34d4b7c640 1 --2- 172.21.15.73:0/4053046396 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f34b006c530 0x7f34b006e9f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:54.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.455+0000 7f34d4b7c640 1 --2- 172.21.15.73:0/4053046396 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f34d00d0560 0x7f34d0154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:54.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.455+0000 7f34d4b7c640 1 --2- 172.21.15.73:0/4053046396 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f34d00ce740 0x7f34d015a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:54.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.455+0000 7f34d4b7c640 1 -- 172.21.15.73:0/4053046396 >> 172.21.15.73:0/4053046396 conn(0x7f34d006b510 msgr2=0x7f34d00ad120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:54.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.456+0000 7f34d4b7c640 1 -- 172.21.15.73:0/4053046396 shutdown_connections 2024-03-29T04:08:54.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.456+0000 7f34d4b7c640 1 -- 172.21.15.73:0/4053046396 wait complete. 2024-03-29T04:08:54.446 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-03-29T04:08:54.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.567+0000 7f3f9e0c8640 1 Processor -- start 2024-03-29T04:08:54.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.567+0000 7f3f9e0c8640 1 -- start start 2024-03-29T04:08:54.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.568+0000 7f3f9e0c8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f9815fc90 0x7f3f980b53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:54.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.568+0000 7f3f9e0c8640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3f981603c0 0x7f3f980d4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:54.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.568+0000 7f3f9e0c8640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f980d32f0 con 0x7f3f980b5ea0 2024-03-29T04:08:54.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.568+0000 7f3f9e0c8640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f3f980d3590 con 0x7f3f981603c0 2024-03-29T04:08:54.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.568+0000 7f3f9e0c8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f3f980d3870 con 0x7f3f9815fc90 2024-03-29T04:08:54.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.568+0000 7f3f97fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3f980b5ea0 0x7f3f981624c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57322/0 (socket says 172.21.15.73:57322) 2024-03-29T04:08:54.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.568+0000 7f3f97fff640 1 -- 172.21.15.73:0/4210357328 learned_addr learned my addr 172.21.15.73:0/4210357328 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:54.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.569+0000 7f3f977fe640 1 --2- 172.21.15.73:0/4210357328 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f9815fc90 0x7f3f980b53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:54.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.569+0000 7f3f967fc640 1 -- 172.21.15.73:0/4210357328 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3827237070 0 0) 0x7f3f980d32f0 con 0x7f3f980b5ea0 2024-03-29T04:08:54.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.569+0000 7f3f96ffd640 1 --2- 172.21.15.73:0/4210357328 >> v2:172.21.15.142:3300/0 conn(0x7f3f981603c0 0x7f3f980d4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:54.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.569+0000 7f3f967fc640 1 -- 172.21.15.73:0/4210357328 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f80003520 con 0x7f3f980b5ea0 2024-03-29T04:08:54.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.569+0000 7f3f967fc640 1 -- 172.21.15.73:0/4210357328 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3802584780 0 0) 0x7f3f80003520 con 0x7f3f980b5ea0 2024-03-29T04:08:54.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.569+0000 7f3f967fc640 1 -- 172.21.15.73:0/4210357328 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f9815fc90 msgr2=0x7f3f980b53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:54.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.569+0000 7f3f967fc640 1 --2- 172.21.15.73:0/4210357328 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f9815fc90 0x7f3f980b53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:54.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.569+0000 7f3f967fc640 1 -- 172.21.15.73:0/4210357328 >> v2:172.21.15.142:3300/0 conn(0x7f3f981603c0 msgr2=0x7f3f980d4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:54.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.569+0000 7f3f967fc640 1 --2- 172.21.15.73:0/4210357328 >> v2:172.21.15.142:3300/0 conn(0x7f3f981603c0 0x7f3f980d4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:54.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.569+0000 7f3f967fc640 1 -- 172.21.15.73:0/4210357328 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f980cecc0 con 0x7f3f980b5ea0 2024-03-29T04:08:54.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.569+0000 7f3f967fc640 1 -- 172.21.15.73:0/4210357328 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1290421750 0 0) 0x7f3f900019f0 con 0x7f3f980b5ea0 2024-03-29T04:08:54.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.569+0000 7f3f967fc640 1 -- 172.21.15.73:0/4210357328 >> v1:172.21.15.73:6789/0 conn(0x7f3f980b5ea0 legacy=0x7f3f981624c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:54.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.569+0000 7f3f967fc640 1 --2- 172.21.15.73:0/4210357328 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f800039b0 0x7f3f80003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:54.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.569+0000 7f3f967fc640 1 --2- 172.21.15.73:0/4210357328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f80004800 0x7f3f80004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:54.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.569+0000 7f3f967fc640 1 --2- 172.21.15.73:0/4210357328 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f9815fc90 0x7f3f800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:54.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.569+0000 7f3f967fc640 1 -- 172.21.15.73:0/4210357328 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3f980d3590 con 0x7f3f80004800 2024-03-29T04:08:54.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.569+0000 7f3f967fc640 1 -- 172.21.15.73:0/4210357328 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3f980d3870 con 0x7f3f800039b0 2024-03-29T04:08:54.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.569+0000 7f3f967fc640 1 -- 172.21.15.73:0/4210357328 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f3f8000b9c0 con 0x7f3f9815fc90 2024-03-29T04:08:54.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.569+0000 7f3f96ffd640 1 --2- 172.21.15.73:0/4210357328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f80004800 0x7f3f80004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:54.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.569+0000 7f3f977fe640 1 --2- 172.21.15.73:0/4210357328 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f800039b0 0x7f3f80003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:54.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.569+0000 7f3f97fff640 1 --2- 172.21.15.73:0/4210357328 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f9815fc90 0x7f3f800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:54.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.569+0000 7f3f96ffd640 1 -- 172.21.15.73:0/4210357328 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f9815fc90 msgr2=0x7f3f800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:54.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.569+0000 7f3f96ffd640 1 --2- 172.21.15.73:0/4210357328 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f9815fc90 0x7f3f800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:54.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.569+0000 7f3f96ffd640 1 -- 172.21.15.73:0/4210357328 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f800039b0 msgr2=0x7f3f80003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:54.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.569+0000 7f3f96ffd640 1 --2- 172.21.15.73:0/4210357328 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f800039b0 0x7f3f80003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:54.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.569+0000 7f3f96ffd640 1 -- 172.21.15.73:0/4210357328 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f80003520 con 0x7f3f80004800 2024-03-29T04:08:54.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.569+0000 7f3f977fe640 1 --2- 172.21.15.73:0/4210357328 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f800039b0 0x7f3f80003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:08:54.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.570+0000 7f3f96ffd640 1 --2- 172.21.15.73:0/4210357328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f80004800 0x7f3f80004c80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c009ac0 tx=0x7f3f80005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef040d82aa197687 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:54.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.570+0000 7f3f967fc640 1 -- 172.21.15.73:0/4210357328 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c039070 con 0x7f3f80004800 2024-03-29T04:08:54.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.570+0000 7f3f967fc640 1 -- 172.21.15.73:0/4210357328 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f8c02c6b0 con 0x7f3f80004800 2024-03-29T04:08:54.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.570+0000 7f3f967fc640 1 -- 172.21.15.73:0/4210357328 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c009690 con 0x7f3f80004800 2024-03-29T04:08:54.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.571+0000 7f3f9e0c8640 1 -- 172.21.15.73:0/4210357328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f80004800 msgr2=0x7f3f80004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:54.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.571+0000 7f3f9e0c8640 1 --2- 172.21.15.73:0/4210357328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f80004800 0x7f3f80004c80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c009ac0 tx=0x7f3f80005830 comp rx=0 tx=0).stop 2024-03-29T04:08:54.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.571+0000 7f3f97fff640 1 -- 172.21.15.73:0/4210357328 reap_dead start 2024-03-29T04:08:54.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.571+0000 7f3f9e0c8640 1 -- 172.21.15.73:0/4210357328 shutdown_connections 2024-03-29T04:08:54.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.571+0000 7f3f9e0c8640 1 -- 172.21.15.73:0/4210357328 >> 172.21.15.73:0/4210357328 conn(0x7f3f9808bfc0 msgr2=0x7f3f980d4540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:54.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.571+0000 7f3f9e0c8640 1 -- 172.21.15.73:0/4210357328 shutdown_connections 2024-03-29T04:08:54.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.571+0000 7f3f9e0c8640 1 -- 172.21.15.73:0/4210357328 wait complete. 2024-03-29T04:08:54.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.572+0000 7f3f9e0c8640 1 Processor -- start 2024-03-29T04:08:54.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.572+0000 7f3f9e0c8640 1 -- start start 2024-03-29T04:08:54.556 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.573+0000 7f3f9e0c8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f80004800 0x7f3f98157580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:54.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.573+0000 7f3f9e0c8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f980cc660 0x7f3f980ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:54.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.573+0000 7f3f9e0c8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f980c7e10 0x7f3f980c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:54.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.573+0000 7f3f9e0c8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3f980b5520 con 0x7f3f980cc660 2024-03-29T04:08:54.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.573+0000 7f3f9e0c8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3f980b53a0 con 0x7f3f980c7e10 2024-03-29T04:08:54.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.573+0000 7f3f9e0c8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f3f980b56a0 con 0x7f3f80004800 2024-03-29T04:08:54.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.573+0000 7f3f96ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f980cc660 0x7f3f980ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:54.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.573+0000 7f3f96ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f980cc660 0x7f3f980ccae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54442/0 (socket says 172.21.15.73:54442) 2024-03-29T04:08:54.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.573+0000 7f3f96ffd640 1 -- 172.21.15.73:0/2866496861 learned_addr learned my addr 172.21.15.73:0/2866496861 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:54.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.573+0000 7f3f977fe640 1 --2- 172.21.15.73:0/2866496861 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f80004800 0x7f3f98157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:54.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.573+0000 7f3f97fff640 1 --2- 172.21.15.73:0/2866496861 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f980c7e10 0x7f3f980c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:54.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.573+0000 7f3f96ffd640 1 -- 172.21.15.73:0/2866496861 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f80004800 msgr2=0x7f3f98157580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:54.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.573+0000 7f3f96ffd640 1 --2- 172.21.15.73:0/2866496861 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f80004800 0x7f3f98157580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:54.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.573+0000 7f3f96ffd640 1 -- 172.21.15.73:0/2866496861 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f980c7e10 msgr2=0x7f3f980c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:54.557 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.573+0000 7f3f96ffd640 1 --2- 172.21.15.73:0/2866496861 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f980c7e10 0x7f3f980c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:54.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.573+0000 7f3f96ffd640 1 -- 172.21.15.73:0/2866496861 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f980cd1d0 con 0x7f3f980cc660 2024-03-29T04:08:54.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.573+0000 7f3f96ffd640 1 --2- 172.21.15.73:0/2866496861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f980cc660 0x7f3f980ccae0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c037040 tx=0x7f3f8c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:54.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.573+0000 7f3f7ffff640 1 -- 172.21.15.73:0/2866496861 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c042020 con 0x7f3f980cc660 2024-03-29T04:08:54.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.573+0000 7f3f7ffff640 1 -- 172.21.15.73:0/2866496861 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f8c03a040 con 0x7f3f980cc660 2024-03-29T04:08:54.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.573+0000 7f3f9e0c8640 1 -- 172.21.15.73:0/2866496861 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f980cd4b0 con 0x7f3f980cc660 2024-03-29T04:08:54.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.573+0000 7f3f7ffff640 1 -- 172.21.15.73:0/2866496861 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c039070 con 0x7f3f980cc660 2024-03-29T04:08:54.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.573+0000 7f3f9e0c8640 1 -- 172.21.15.73:0/2866496861 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f980cda70 con 0x7f3f980cc660 2024-03-29T04:08:54.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.574+0000 7f3f9e0c8640 1 -- 172.21.15.73:0/2866496861 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f98068640 con 0x7f3f980cc660 2024-03-29T04:08:54.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.575+0000 7f3f7ffff640 1 -- 172.21.15.73:0/2866496861 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f3f8c045020 con 0x7f3f980cc660 2024-03-29T04:08:54.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.575+0000 7f3f7ffff640 1 --2- 172.21.15.73:0/2866496861 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3f8406c530 0x7f3f8406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:54.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.575+0000 7f3f7ffff640 1 -- 172.21.15.73:0/2866496861 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f3f8c0ac800 con 0x7f3f980cc660 2024-03-29T04:08:54.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.575+0000 7f3f977fe640 1 --2- 172.21.15.73:0/2866496861 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3f8406c530 0x7f3f8406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:54.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.576+0000 7f3f977fe640 1 --2- 172.21.15.73:0/2866496861 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3f8406c530 0x7f3f8406e9f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3f880099b0 tx=0x7f3f88008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:54.559 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.580+0000 7f3f7ffff640 1 -- 172.21.15.73:0/2866496861 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f3f8c04c070 con 0x7f3f980cc660 2024-03-29T04:08:54.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.822+0000 7f3f9e0c8640 1 -- 172.21.15.73:0/2866496861 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f3f980b67b0 con 0x7f3f980cc660 2024-03-29T04:08:54.803 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.824+0000 7f3f7ffff640 1 -- 172.21.15.73:0/2866496861 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f3f8c07b200 con 0x7f3f980cc660 2024-03-29T04:08:54.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.826+0000 7f3f9e0c8640 1 -- 172.21.15.73:0/2866496861 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3f8406c530 msgr2=0x7f3f8406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:54.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.826+0000 7f3f9e0c8640 1 --2- 172.21.15.73:0/2866496861 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3f8406c530 0x7f3f8406e9f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3f880099b0 tx=0x7f3f88008040 comp rx=0 tx=0).stop 2024-03-29T04:08:54.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.826+0000 7f3f9e0c8640 1 -- 172.21.15.73:0/2866496861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f980cc660 msgr2=0x7f3f980ccae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:54.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.826+0000 7f3f9e0c8640 1 --2- 172.21.15.73:0/2866496861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f980cc660 0x7f3f980ccae0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c037040 tx=0x7f3f8c004730 comp rx=0 tx=0).stop 2024-03-29T04:08:54.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.826+0000 7f3f9e0c8640 1 -- 172.21.15.73:0/2866496861 shutdown_connections 2024-03-29T04:08:54.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.826+0000 7f3f9e0c8640 1 --2- 172.21.15.73:0/2866496861 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3f8406c530 0x7f3f8406e9f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:54.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.826+0000 7f3f9e0c8640 1 --2- 172.21.15.73:0/2866496861 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f980c7e10 0x7f3f980c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:54.806 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.826+0000 7f3f9e0c8640 1 --2- 172.21.15.73:0/2866496861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3f980cc660 0x7f3f980ccae0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:54.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.826+0000 7f3f9e0c8640 1 --2- 172.21.15.73:0/2866496861 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3f80004800 0x7f3f98157580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:54.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.826+0000 7f3f9e0c8640 1 -- 172.21.15.73:0/2866496861 >> 172.21.15.73:0/2866496861 conn(0x7f3f9808bfc0 msgr2=0x7f3f9806c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:54.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.826+0000 7f3f9e0c8640 1 -- 172.21.15.73:0/2866496861 shutdown_connections 2024-03-29T04:08:54.807 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.826+0000 7f3f9e0c8640 1 -- 172.21.15.73:0/2866496861 wait complete. 2024-03-29T04:08:54.817 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-03-29T04:08:54.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.939+0000 7ff64bc1b640 1 Processor -- start 2024-03-29T04:08:54.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.940+0000 7ff64bc1b640 1 -- start start 2024-03-29T04:08:54.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.940+0000 7ff64bc1b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff6440d0730 0x7ff6440c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:54.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.940+0000 7ff64bc1b640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff64415f100 con 0x7ff64415ec10 2024-03-29T04:08:54.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.940+0000 7ff64bc1b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6440cebd0 con 0x7ff6440ce740 2024-03-29T04:08:54.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.940+0000 7ff64bc1b640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7ff64415f370 con 0x7ff6440d0730 2024-03-29T04:08:54.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.940+0000 7ff6499b7640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff64415ec10 0x7ff6440d0020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57338/0 (socket says 172.21.15.73:57338) 2024-03-29T04:08:54.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.940+0000 7ff6491b6640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff6440d0730 0x7ff6440c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:54.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.940+0000 7ff6499b7640 1 -- 172.21.15.73:0/3322617104 learned_addr learned my addr 172.21.15.73:0/3322617104 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:54.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.941+0000 7ff6491b6640 1 -- 172.21.15.73:0/3322617104 >> v1:172.21.15.142:6789/0 conn(0x7ff6440ce740 legacy=0x7ff6440b30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:54.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.941+0000 7ff6491b6640 1 -- 172.21.15.73:0/3322617104 >> v1:172.21.15.73:6789/0 conn(0x7ff64415ec10 legacy=0x7ff6440d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:54.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.941+0000 7ff6491b6640 1 -- 172.21.15.73:0/3322617104 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff64415f650 con 0x7ff6440d0730 2024-03-29T04:08:54.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.941+0000 7ff6489b5640 1 -- 172.21.15.73:0/3322617104 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 823275907 0 0) 0x7ff64415f100 con 0x7ff64415ec10 2024-03-29T04:08:54.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.942+0000 7ff6491b6640 1 --2- 172.21.15.73:0/3322617104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6440d0730 0x7ff6440c67e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff6340097a0 tx=0x7ff63402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3fd3f555ea07927 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:54.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.942+0000 7ff6489b5640 1 -- 172.21.15.73:0/3322617104 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6340315a0 con 0x7ff6440d0730 2024-03-29T04:08:54.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.942+0000 7ff6489b5640 1 -- 172.21.15.73:0/3322617104 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff634037070 con 0x7ff6440d0730 2024-03-29T04:08:54.922 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.942+0000 7ff6489b5640 1 -- 172.21.15.73:0/3322617104 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff634031960 con 0x7ff6440d0730 2024-03-29T04:08:54.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.942+0000 7ff64bc1b640 1 -- 172.21.15.73:0/3322617104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6440d0730 msgr2=0x7ff6440c67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:54.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.942+0000 7ff64bc1b640 1 --2- 172.21.15.73:0/3322617104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6440d0730 0x7ff6440c67e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff6340097a0 tx=0x7ff63402b840 comp rx=0 tx=0).stop 2024-03-29T04:08:54.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.942+0000 7ff64bc1b640 1 -- 172.21.15.73:0/3322617104 shutdown_connections 2024-03-29T04:08:54.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.942+0000 7ff64bc1b640 1 --2- 172.21.15.73:0/3322617104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6440d0730 0x7ff6440c67e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:54.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.942+0000 7ff64bc1b640 1 -- 172.21.15.73:0/3322617104 >> 172.21.15.73:0/3322617104 conn(0x7ff64406b510 msgr2=0x7ff64406b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:54.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.942+0000 7ff64bc1b640 1 -- 172.21.15.73:0/3322617104 shutdown_connections 2024-03-29T04:08:54.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.942+0000 7ff64bc1b640 1 -- 172.21.15.73:0/3322617104 wait complete. 2024-03-29T04:08:54.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.943+0000 7ff64bc1b640 1 Processor -- start 2024-03-29T04:08:54.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.943+0000 7ff64bc1b640 1 -- start start 2024-03-29T04:08:54.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.944+0000 7ff64bc1b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6440ce740 0x7ff64414fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:54.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.944+0000 7ff64bc1b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6440d0730 0x7ff644072eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:54.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.944+0000 7ff64bc1b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff64415ec10 0x7ff64415d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:54.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.944+0000 7ff64bc1b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff64415fe50 con 0x7ff64415ec10 2024-03-29T04:08:54.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.944+0000 7ff64bc1b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff6440c6ee0 con 0x7ff6440ce740 2024-03-29T04:08:54.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.944+0000 7ff64bc1b640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff64415ffd0 con 0x7ff6440d0730 2024-03-29T04:08:54.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.944+0000 7ff64a1b8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff64415ec10 0x7ff64415d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:54.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.944+0000 7ff64a1b8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff64415ec10 0x7ff64415d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54468/0 (socket says 172.21.15.73:54468) 2024-03-29T04:08:54.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.944+0000 7ff64a1b8640 1 -- 172.21.15.73:0/234958268 learned_addr learned my addr 172.21.15.73:0/234958268 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:54.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.945+0000 7ff64a1b8640 1 -- 172.21.15.73:0/234958268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6440d0730 msgr2=0x7ff644072eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:54.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.945+0000 7ff64a1b8640 1 --2- 172.21.15.73:0/234958268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6440d0730 0x7ff644072eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:54.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.945+0000 7ff64a1b8640 1 -- 172.21.15.73:0/234958268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6440ce740 msgr2=0x7ff64414fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:54.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.945+0000 7ff6499b7640 1 --2- 172.21.15.73:0/234958268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6440ce740 0x7ff64414fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:54.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.945+0000 7ff64a1b8640 1 --2- 172.21.15.73:0/234958268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6440ce740 0x7ff64414fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:54.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.945+0000 7ff64a1b8640 1 -- 172.21.15.73:0/234958268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6440716b0 con 0x7ff64415ec10 2024-03-29T04:08:54.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.945+0000 7ff64a1b8640 1 --2- 172.21.15.73:0/234958268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff64415ec10 0x7ff64415d250 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff64000c780 tx=0x7ff64000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:54.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.945+0000 7ff63a7fc640 1 -- 172.21.15.73:0/234958268 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff640004b60 con 0x7ff64415ec10 2024-03-29T04:08:54.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.945+0000 7ff63a7fc640 1 -- 172.21.15.73:0/234958268 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff640004d00 con 0x7ff64415ec10 2024-03-29T04:08:54.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.945+0000 7ff64bc1b640 1 -- 172.21.15.73:0/234958268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff644071990 con 0x7ff64415ec10 2024-03-29T04:08:54.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.945+0000 7ff63a7fc640 1 -- 172.21.15.73:0/234958268 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64000aa90 con 0x7ff64415ec10 2024-03-29T04:08:54.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.945+0000 7ff64bc1b640 1 -- 172.21.15.73:0/234958268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff644071f50 con 0x7ff64415ec10 2024-03-29T04:08:54.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.946+0000 7ff64bc1b640 1 -- 172.21.15.73:0/234958268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff644068640 con 0x7ff64415ec10 2024-03-29T04:08:54.927 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.946+0000 7ff63a7fc640 1 -- 172.21.15.73:0/234958268 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff64000ac30 con 0x7ff64415ec10 2024-03-29T04:08:54.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.947+0000 7ff63a7fc640 1 --2- 172.21.15.73:0/234958268 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff62806c530 0x7ff62806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:54.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.947+0000 7ff63a7fc640 1 -- 172.21.15.73:0/234958268 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7ff64008b620 con 0x7ff64415ec10 2024-03-29T04:08:54.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.947+0000 7ff6499b7640 1 --2- 172.21.15.73:0/234958268 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff62806c530 0x7ff62806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:54.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.947+0000 7ff6499b7640 1 --2- 172.21.15.73:0/234958268 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff62806c530 0x7ff62806e9f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff63c000f60 tx=0x7ff63c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:54.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:54.951+0000 7ff63a7fc640 1 -- 172.21.15.73:0/234958268 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7ff640020070 con 0x7ff64415ec10 2024-03-29T04:08:55.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.191+0000 7ff64bc1b640 1 -- 172.21.15.73:0/234958268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7ff64415e430 con 0x7ff64415ec10 2024-03-29T04:08:55.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.193+0000 7ff63a7fc640 1 -- 172.21.15.73:0/234958268 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) ==== 90+0+0 (secure 0 0 0) 0x7ff64005a020 con 0x7ff64415ec10 2024-03-29T04:08:55.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.195+0000 7ff64bc1b640 1 -- 172.21.15.73:0/234958268 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff62806c530 msgr2=0x7ff62806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:55.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.195+0000 7ff64bc1b640 1 --2- 172.21.15.73:0/234958268 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff62806c530 0x7ff62806e9f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff63c000f60 tx=0x7ff63c009040 comp rx=0 tx=0).stop 2024-03-29T04:08:55.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.195+0000 7ff64bc1b640 1 -- 172.21.15.73:0/234958268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff64415ec10 msgr2=0x7ff64415d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:55.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.195+0000 7ff64bc1b640 1 --2- 172.21.15.73:0/234958268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff64415ec10 0x7ff64415d250 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff64000c780 tx=0x7ff64000cc40 comp rx=0 tx=0).stop 2024-03-29T04:08:55.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.195+0000 7ff64bc1b640 1 -- 172.21.15.73:0/234958268 shutdown_connections 2024-03-29T04:08:55.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.195+0000 7ff64bc1b640 1 --2- 172.21.15.73:0/234958268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff64415ec10 0x7ff64415d250 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:55.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.195+0000 7ff64bc1b640 1 --2- 172.21.15.73:0/234958268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff6440d0730 0x7ff644072eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:55.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.195+0000 7ff64bc1b640 1 --2- 172.21.15.73:0/234958268 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff62806c530 0x7ff62806e9f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:55.175 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.195+0000 7ff64bc1b640 1 --2- 172.21.15.73:0/234958268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6440ce740 0x7ff64414fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:55.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.195+0000 7ff64bc1b640 1 -- 172.21.15.73:0/234958268 >> 172.21.15.73:0/234958268 conn(0x7ff64406b510 msgr2=0x7ff6440c5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:55.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.195+0000 7ff64bc1b640 1 -- 172.21.15.73:0/234958268 shutdown_connections 2024-03-29T04:08:55.176 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.195+0000 7ff64bc1b640 1 -- 172.21.15.73:0/234958268 wait complete. 2024-03-29T04:08:55.185 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-03-29T04:08:55.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.307+0000 7f5077f7c640 1 Processor -- start 2024-03-29T04:08:55.287 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.307+0000 7f5077f7c640 1 -- start start 2024-03-29T04:08:55.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.308+0000 7f5077f7c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f507015ec10 0x7f50700c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:55.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.308+0000 7f5077f7c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f50700ce740 0x7f50700d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:55.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.308+0000 7f5077f7c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f507015f100 con 0x7f50700d0560 2024-03-29T04:08:55.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.308+0000 7f5077f7c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f50700ceba0 con 0x7f50700ce740 2024-03-29T04:08:55.293 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.308+0000 7f5077f7c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f50700b40c0 con 0x7f507015ec10 2024-03-29T04:08:55.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.308+0000 7f5076519640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f50700d0560 0x7f50700c54f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57342/0 (socket says 172.21.15.73:57342) 2024-03-29T04:08:55.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.308+0000 7f5076519640 1 -- 172.21.15.73:0/1145100544 learned_addr learned my addr 172.21.15.73:0/1145100544 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:55.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.308+0000 7f5074d16640 1 -- 172.21.15.73:0/1145100544 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3633499658 0 0) 0x7f507015f100 con 0x7f50700d0560 2024-03-29T04:08:55.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.308+0000 7f5074d16640 1 -- 172.21.15.73:0/1145100544 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f505c003520 con 0x7f50700d0560 2024-03-29T04:08:55.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.308+0000 7f5075517640 1 --2- 172.21.15.73:0/1145100544 >> v2:172.21.15.142:3300/0 conn(0x7f50700ce740 0x7f50700d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:55.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.308+0000 7f5075d18640 1 --2- 172.21.15.73:0/1145100544 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f507015ec10 0x7f50700c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:55.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.309+0000 7f5074d16640 1 -- 172.21.15.73:0/1145100544 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2053962090 0 0) 0x7f505c003520 con 0x7f50700d0560 2024-03-29T04:08:55.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.309+0000 7f5074d16640 1 -- 172.21.15.73:0/1145100544 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f507015ec10 msgr2=0x7f50700c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:55.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.309+0000 7f5074d16640 1 --2- 172.21.15.73:0/1145100544 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f507015ec10 0x7f50700c67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:55.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.309+0000 7f5074d16640 1 -- 172.21.15.73:0/1145100544 >> v2:172.21.15.142:3300/0 conn(0x7f50700ce740 msgr2=0x7f50700d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:55.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.309+0000 7f5074d16640 1 --2- 172.21.15.73:0/1145100544 >> v2:172.21.15.142:3300/0 conn(0x7f50700ce740 0x7f50700d0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:55.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.309+0000 7f5074d16640 1 -- 172.21.15.73:0/1145100544 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50700d09f0 con 0x7f50700d0560 2024-03-29T04:08:55.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.309+0000 7f5074d16640 1 -- 172.21.15.73:0/1145100544 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1290421750 0 0) 0x7f50680019f0 con 0x7f50700d0560 2024-03-29T04:08:55.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.309+0000 7f5075517640 1 --2- 172.21.15.73:0/1145100544 >> v2:172.21.15.142:3300/0 conn(0x7f50700ce740 0x7f50700d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:08:55.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.309+0000 7f5075d18640 1 --2- 172.21.15.73:0/1145100544 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f507015ec10 0x7f50700c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:08:55.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.309+0000 7f5074d16640 1 -- 172.21.15.73:0/1145100544 >> v1:172.21.15.73:6789/0 conn(0x7f50700d0560 legacy=0x7f50700c54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:55.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.309+0000 7f5074d16640 1 --2- 172.21.15.73:0/1145100544 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f505c0039b0 0x7f505c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:55.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.309+0000 7f5074d16640 1 --2- 172.21.15.73:0/1145100544 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f507015ec10 0x7f505c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:55.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.309+0000 7f5074d16640 1 --2- 172.21.15.73:0/1145100544 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f505c004d40 0x7f505c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:55.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.309+0000 7f5074d16640 1 -- 172.21.15.73:0/1145100544 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f50700ceba0 con 0x7f505c004d40 2024-03-29T04:08:55.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.309+0000 7f5074d16640 1 -- 172.21.15.73:0/1145100544 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f50700b40c0 con 0x7f505c0039b0 2024-03-29T04:08:55.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.309+0000 7f5074d16640 1 -- 172.21.15.73:0/1145100544 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f505c00bb20 con 0x7f507015ec10 2024-03-29T04:08:55.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.309+0000 7f5076519640 1 --2- 172.21.15.73:0/1145100544 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f505c004d40 0x7f505c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:55.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.309+0000 7f5075d18640 1 --2- 172.21.15.73:0/1145100544 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f505c0039b0 0x7f505c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:55.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.309+0000 7f5075517640 1 --2- 172.21.15.73:0/1145100544 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f507015ec10 0x7f505c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:55.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.309+0000 7f5076519640 1 -- 172.21.15.73:0/1145100544 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f507015ec10 msgr2=0x7f505c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:55.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.309+0000 7f5076519640 1 --2- 172.21.15.73:0/1145100544 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f507015ec10 0x7f505c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:55.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.309+0000 7f5076519640 1 -- 172.21.15.73:0/1145100544 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f505c0039b0 msgr2=0x7f505c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:55.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.309+0000 7f5076519640 1 --2- 172.21.15.73:0/1145100544 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f505c0039b0 0x7f505c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:55.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.309+0000 7f5076519640 1 -- 172.21.15.73:0/1145100544 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f505c003520 con 0x7f505c004d40 2024-03-29T04:08:55.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.309+0000 7f5075517640 1 --2- 172.21.15.73:0/1145100544 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f507015ec10 0x7f505c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:08:55.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.310+0000 7f5076519640 1 --2- 172.21.15.73:0/1145100544 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f505c004d40 0x7f505c0051c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f506800a7a0 tx=0x7f505c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98646c1f705dc777 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:55.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.310+0000 7f5074d16640 1 -- 172.21.15.73:0/1145100544 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f506800a3f0 con 0x7f505c004d40 2024-03-29T04:08:55.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.310+0000 7f5074d16640 1 -- 172.21.15.73:0/1145100544 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5068034630 con 0x7f505c004d40 2024-03-29T04:08:55.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.310+0000 7f5074d16640 1 -- 172.21.15.73:0/1145100544 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5068034a40 con 0x7f505c004d40 2024-03-29T04:08:55.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.310+0000 7f5077f7c640 1 -- 172.21.15.73:0/1145100544 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f505c004d40 msgr2=0x7f505c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:55.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.310+0000 7f5077f7c640 1 --2- 172.21.15.73:0/1145100544 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f505c004d40 0x7f505c0051c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f506800a7a0 tx=0x7f505c005830 comp rx=0 tx=0).stop 2024-03-29T04:08:55.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.310+0000 7f5076519640 1 -- 172.21.15.73:0/1145100544 reap_dead start 2024-03-29T04:08:55.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.311+0000 7f5077f7c640 1 -- 172.21.15.73:0/1145100544 shutdown_connections 2024-03-29T04:08:55.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.311+0000 7f5077f7c640 1 -- 172.21.15.73:0/1145100544 >> 172.21.15.73:0/1145100544 conn(0x7f507006b510 msgr2=0x7f507006b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:55.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.311+0000 7f5077f7c640 1 -- 172.21.15.73:0/1145100544 shutdown_connections 2024-03-29T04:08:55.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.311+0000 7f5077f7c640 1 -- 172.21.15.73:0/1145100544 wait complete. 2024-03-29T04:08:55.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.312+0000 7f5077f7c640 1 Processor -- start 2024-03-29T04:08:55.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.312+0000 7f5077f7c640 1 -- start start 2024-03-29T04:08:55.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.312+0000 7f5077f7c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5070159570 0x7f5070159950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:55.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.312+0000 7f5077f7c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50701f6400 0x7f507014b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:55.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.312+0000 7f5077f7c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5070072700 0x7f5070072bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:55.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.312+0000 7f5077f7c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f507015f930 con 0x7f50701f6400 2024-03-29T04:08:55.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.312+0000 7f5077f7c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f507015f650 con 0x7f5070072700 2024-03-29T04:08:55.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.312+0000 7f5077f7c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f50700c6ee0 con 0x7f5070159570 2024-03-29T04:08:55.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.313+0000 7f5075517640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50701f6400 0x7f507014b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:55.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.313+0000 7f5075517640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50701f6400 0x7f507014b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54478/0 (socket says 172.21.15.73:54478) 2024-03-29T04:08:55.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.313+0000 7f5075517640 1 -- 172.21.15.73:0/2016003113 learned_addr learned my addr 172.21.15.73:0/2016003113 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:55.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.313+0000 7f5075d18640 1 --2- 172.21.15.73:0/2016003113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5070159570 0x7f5070159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:55.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.313+0000 7f5076519640 1 --2- 172.21.15.73:0/2016003113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5070072700 0x7f5070072bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:55.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.313+0000 7f5075517640 1 -- 172.21.15.73:0/2016003113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5070159570 msgr2=0x7f5070159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:55.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.313+0000 7f5075517640 1 --2- 172.21.15.73:0/2016003113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5070159570 0x7f5070159950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:55.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.313+0000 7f5075517640 1 -- 172.21.15.73:0/2016003113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5070072700 msgr2=0x7f5070072bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:55.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.313+0000 7f5075517640 1 --2- 172.21.15.73:0/2016003113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5070072700 0x7f5070072bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:55.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.313+0000 7f5075517640 1 -- 172.21.15.73:0/2016003113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f507014c350 con 0x7f50701f6400 2024-03-29T04:08:55.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.313+0000 7f5075517640 1 --2- 172.21.15.73:0/2016003113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50701f6400 0x7f507014b420 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5060010890 tx=0x7f5060010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:55.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.313+0000 7f50667fc640 1 -- 172.21.15.73:0/2016003113 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f506001a020 con 0x7f50701f6400 2024-03-29T04:08:55.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.313+0000 7f50667fc640 1 -- 172.21.15.73:0/2016003113 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f506000eb00 con 0x7f50701f6400 2024-03-29T04:08:55.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.313+0000 7f50667fc640 1 -- 172.21.15.73:0/2016003113 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f506000f040 con 0x7f50701f6400 2024-03-29T04:08:55.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.313+0000 7f5077f7c640 1 -- 172.21.15.73:0/2016003113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5070159e90 con 0x7f50701f6400 2024-03-29T04:08:55.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.313+0000 7f5077f7c640 1 -- 172.21.15.73:0/2016003113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f507014c070 con 0x7f50701f6400 2024-03-29T04:08:55.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.314+0000 7f5077f7c640 1 -- 172.21.15.73:0/2016003113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5070068640 con 0x7f50701f6400 2024-03-29T04:08:55.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.314+0000 7f50667fc640 1 -- 172.21.15.73:0/2016003113 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f506001d020 con 0x7f50701f6400 2024-03-29T04:08:55.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.315+0000 7f50667fc640 1 --2- 172.21.15.73:0/2016003113 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f505406c560 0x7f505406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:55.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.315+0000 7f50667fc640 1 -- 172.21.15.73:0/2016003113 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f506008bc60 con 0x7f50701f6400 2024-03-29T04:08:55.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.315+0000 7f5075d18640 1 --2- 172.21.15.73:0/2016003113 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f505406c560 0x7f505406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:55.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.315+0000 7f5075d18640 1 --2- 172.21.15.73:0/2016003113 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f505406c560 0x7f505406ea20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f50700d0530 tx=0x7f506c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:55.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.319+0000 7f50667fc640 1 -- 172.21.15.73:0/2016003113 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f5060024020 con 0x7f50701f6400 2024-03-29T04:08:55.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.563+0000 7f5077f7c640 1 -- 172.21.15.73:0/2016003113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f50700c74e0 con 0x7f50701f6400 2024-03-29T04:08:55.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.565+0000 7f50667fc640 1 -- 172.21.15.73:0/2016003113 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7f5060027350 con 0x7f50701f6400 2024-03-29T04:08:55.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.567+0000 7f5077f7c640 1 -- 172.21.15.73:0/2016003113 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f505406c560 msgr2=0x7f505406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:55.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.567+0000 7f5077f7c640 1 --2- 172.21.15.73:0/2016003113 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f505406c560 0x7f505406ea20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f50700d0530 tx=0x7f506c008040 comp rx=0 tx=0).stop 2024-03-29T04:08:55.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.567+0000 7f5077f7c640 1 -- 172.21.15.73:0/2016003113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50701f6400 msgr2=0x7f507014b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:55.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.567+0000 7f5077f7c640 1 --2- 172.21.15.73:0/2016003113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50701f6400 0x7f507014b420 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5060010890 tx=0x7f5060010d50 comp rx=0 tx=0).stop 2024-03-29T04:08:55.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.567+0000 7f5077f7c640 1 -- 172.21.15.73:0/2016003113 shutdown_connections 2024-03-29T04:08:55.547 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.567+0000 7f5077f7c640 1 --2- 172.21.15.73:0/2016003113 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f505406c560 0x7f505406ea20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:55.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.567+0000 7f5077f7c640 1 --2- 172.21.15.73:0/2016003113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5070072700 0x7f5070072bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:55.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.567+0000 7f5077f7c640 1 --2- 172.21.15.73:0/2016003113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50701f6400 0x7f507014b420 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:55.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.567+0000 7f5077f7c640 1 --2- 172.21.15.73:0/2016003113 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5070159570 0x7f5070159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:55.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.567+0000 7f5077f7c640 1 -- 172.21.15.73:0/2016003113 >> 172.21.15.73:0/2016003113 conn(0x7f507006b510 msgr2=0x7f50700cad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:55.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.567+0000 7f5077f7c640 1 -- 172.21.15.73:0/2016003113 shutdown_connections 2024-03-29T04:08:55.548 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.567+0000 7f5077f7c640 1 -- 172.21.15.73:0/2016003113 wait complete. 2024-03-29T04:08:55.558 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-03-29T04:08:55.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.680+0000 7f3be1ee4640 1 Processor -- start 2024-03-29T04:08:55.660 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.680+0000 7f3be1ee4640 1 -- start start 2024-03-29T04:08:55.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.680+0000 7f3be1ee4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bdc06e440 0x7f3bdc0ad9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:55.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.680+0000 7f3be1ee4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3bdc0b3af0 0x7f3bdc06e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:55.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.680+0000 7f3be1ee4640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bdc15ec50 con 0x7f3bdc06fb60 2024-03-29T04:08:55.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.681+0000 7f3be1ee4640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f3bdc0b4070 con 0x7f3bdc0b3af0 2024-03-29T04:08:55.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.681+0000 7f3be1ee4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f3bdc06b5b0 con 0x7f3bdc06e440 2024-03-29T04:08:55.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.681+0000 7f3bdbfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3bdc06fb60 0x7f3bdc06ed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57348/0 (socket says 172.21.15.73:57348) 2024-03-29T04:08:55.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.681+0000 7f3bdbfff640 1 -- 172.21.15.73:0/3333875338 learned_addr learned my addr 172.21.15.73:0/3333875338 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:55.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.681+0000 7f3bda7fc640 1 -- 172.21.15.73:0/3333875338 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3637756149 0 0) 0x7f3bdc15ec50 con 0x7f3bdc06fb60 2024-03-29T04:08:55.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.681+0000 7f3bda7fc640 1 -- 172.21.15.73:0/3333875338 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3bc4003520 con 0x7f3bdc06fb60 2024-03-29T04:08:55.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.681+0000 7f3bdb7fe640 1 --2- 172.21.15.73:0/3333875338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bdc06e440 0x7f3bdc0ad9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:55.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.681+0000 7f3bdaffd640 1 --2- 172.21.15.73:0/3333875338 >> v2:172.21.15.142:3300/0 conn(0x7f3bdc0b3af0 0x7f3bdc06e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:55.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.681+0000 7f3bda7fc640 1 -- 172.21.15.73:0/3333875338 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4198346395 0 0) 0x7f3bc4003520 con 0x7f3bdc06fb60 2024-03-29T04:08:55.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.681+0000 7f3bda7fc640 1 -- 172.21.15.73:0/3333875338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bdc06e440 msgr2=0x7f3bdc0ad9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:55.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.681+0000 7f3bda7fc640 1 --2- 172.21.15.73:0/3333875338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bdc06e440 0x7f3bdc0ad9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:55.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.681+0000 7f3bda7fc640 1 -- 172.21.15.73:0/3333875338 >> v2:172.21.15.142:3300/0 conn(0x7f3bdc0b3af0 msgr2=0x7f3bdc06e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:55.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.681+0000 7f3bda7fc640 1 --2- 172.21.15.73:0/3333875338 >> v2:172.21.15.142:3300/0 conn(0x7f3bdc0b3af0 0x7f3bdc06e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:55.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.681+0000 7f3bda7fc640 1 -- 172.21.15.73:0/3333875338 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bdc06b890 con 0x7f3bdc06fb60 2024-03-29T04:08:55.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.681+0000 7f3bda7fc640 1 -- 172.21.15.73:0/3333875338 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1290421750 0 0) 0x7f3bd40019f0 con 0x7f3bdc06fb60 2024-03-29T04:08:55.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.681+0000 7f3bda7fc640 1 -- 172.21.15.73:0/3333875338 >> v1:172.21.15.73:6789/0 conn(0x7f3bdc06fb60 legacy=0x7f3bdc06ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:55.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.681+0000 7f3bda7fc640 1 --2- 172.21.15.73:0/3333875338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bdc06e440 0x7f3bc40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:55.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.681+0000 7f3bda7fc640 1 --2- 172.21.15.73:0/3333875338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bc4003f30 0x7f3bc4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:55.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.681+0000 7f3bda7fc640 1 --2- 172.21.15.73:0/3333875338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bc4004d40 0x7f3bc40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:55.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.681+0000 7f3bda7fc640 1 -- 172.21.15.73:0/3333875338 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3bdc0b4070 con 0x7f3bc4003f30 2024-03-29T04:08:55.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.681+0000 7f3bda7fc640 1 -- 172.21.15.73:0/3333875338 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3bdc06b5b0 con 0x7f3bc4004d40 2024-03-29T04:08:55.664 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.681+0000 7f3bda7fc640 1 -- 172.21.15.73:0/3333875338 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f3bc400b9c0 con 0x7f3bdc06e440 2024-03-29T04:08:55.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.681+0000 7f3bdaffd640 1 --2- 172.21.15.73:0/3333875338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bc4003f30 0x7f3bc4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:55.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.681+0000 7f3bdb7fe640 1 --2- 172.21.15.73:0/3333875338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bdc06e440 0x7f3bc40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:55.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.682+0000 7f3bdbfff640 1 --2- 172.21.15.73:0/3333875338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bc4004d40 0x7f3bc40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:55.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.682+0000 7f3bdaffd640 1 -- 172.21.15.73:0/3333875338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bdc06e440 msgr2=0x7f3bc40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:55.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.682+0000 7f3bdaffd640 1 --2- 172.21.15.73:0/3333875338 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bdc06e440 0x7f3bc40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:55.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.682+0000 7f3bdaffd640 1 -- 172.21.15.73:0/3333875338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bc4004d40 msgr2=0x7f3bc40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:55.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.682+0000 7f3bdaffd640 1 --2- 172.21.15.73:0/3333875338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bc4004d40 0x7f3bc40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:55.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.682+0000 7f3bdaffd640 1 -- 172.21.15.73:0/3333875338 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bc4003520 con 0x7f3bc4003f30 2024-03-29T04:08:55.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.682+0000 7f3bdaffd640 1 --2- 172.21.15.73:0/3333875338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bc4003f30 0x7f3bc4004800 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0009ac0 tx=0x7f3bc4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=753cfa1017983920 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:55.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.683+0000 7f3bda7fc640 1 -- 172.21.15.73:0/3333875338 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd0039070 con 0x7f3bc4003f30 2024-03-29T04:08:55.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.683+0000 7f3bda7fc640 1 -- 172.21.15.73:0/3333875338 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bd002c6d0 con 0x7f3bc4003f30 2024-03-29T04:08:55.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.683+0000 7f3bda7fc640 1 -- 172.21.15.73:0/3333875338 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd0009690 con 0x7f3bc4003f30 2024-03-29T04:08:55.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.683+0000 7f3be1ee4640 1 -- 172.21.15.73:0/3333875338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bc4003f30 msgr2=0x7f3bc4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:55.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.683+0000 7f3be1ee4640 1 --2- 172.21.15.73:0/3333875338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bc4003f30 0x7f3bc4004800 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0009ac0 tx=0x7f3bc4005830 comp rx=0 tx=0).stop 2024-03-29T04:08:55.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.683+0000 7f3bdbfff640 1 -- 172.21.15.73:0/3333875338 reap_dead start 2024-03-29T04:08:55.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.683+0000 7f3be1ee4640 1 -- 172.21.15.73:0/3333875338 shutdown_connections 2024-03-29T04:08:55.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.683+0000 7f3be1ee4640 1 -- 172.21.15.73:0/3333875338 >> 172.21.15.73:0/3333875338 conn(0x7f3bdc0d0b20 msgr2=0x7f3bdc0d0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:55.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.683+0000 7f3be1ee4640 1 -- 172.21.15.73:0/3333875338 shutdown_connections 2024-03-29T04:08:55.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.683+0000 7f3be1ee4640 1 -- 172.21.15.73:0/3333875338 wait complete. 2024-03-29T04:08:55.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.684+0000 7f3be1ee4640 1 Processor -- start 2024-03-29T04:08:55.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.684+0000 7f3be1ee4640 1 -- start start 2024-03-29T04:08:55.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.685+0000 7f3be1ee4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bc4003f30 0x7f3bdc0cf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:55.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.685+0000 7f3be1ee4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bdc1470a0 0x7f3bdc147520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:55.668 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.685+0000 7f3be1ee4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bdc0ce200 0x7f3bdc0ce640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:55.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.685+0000 7f3be1ee4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3bdc0d1760 con 0x7f3bdc1470a0 2024-03-29T04:08:55.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.685+0000 7f3be1ee4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3bdc06be50 con 0x7f3bdc0ce200 2024-03-29T04:08:55.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.685+0000 7f3be1ee4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f3bdc0ad9e0 con 0x7f3bc4003f30 2024-03-29T04:08:55.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.685+0000 7f3bdaffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bdc1470a0 0x7f3bdc147520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:55.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.685+0000 7f3bdaffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bdc1470a0 0x7f3bdc147520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54498/0 (socket says 172.21.15.73:54498) 2024-03-29T04:08:55.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.685+0000 7f3bdaffd640 1 -- 172.21.15.73:0/3041598472 learned_addr learned my addr 172.21.15.73:0/3041598472 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:55.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.685+0000 7f3bdaffd640 1 -- 172.21.15.73:0/3041598472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bc4003f30 msgr2=0x7f3bdc0cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:55.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.685+0000 7f3bdaffd640 1 --2- 172.21.15.73:0/3041598472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bc4003f30 0x7f3bdc0cf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:55.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.685+0000 7f3bdaffd640 1 -- 172.21.15.73:0/3041598472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bdc0ce200 msgr2=0x7f3bdc0ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:55.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.685+0000 7f3bdaffd640 1 --2- 172.21.15.73:0/3041598472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bdc0ce200 0x7f3bdc0ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:55.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.686+0000 7f3bdaffd640 1 -- 172.21.15.73:0/3041598472 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bdc0cef70 con 0x7f3bdc1470a0 2024-03-29T04:08:55.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.686+0000 7f3bdaffd640 1 --2- 172.21.15.73:0/3041598472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bdc1470a0 0x7f3bdc147520 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0037040 tx=0x7f3bd0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:55.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.686+0000 7f3bc3fff640 1 -- 172.21.15.73:0/3041598472 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd0042020 con 0x7f3bdc1470a0 2024-03-29T04:08:55.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.686+0000 7f3bc3fff640 1 -- 172.21.15.73:0/3041598472 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bd003a040 con 0x7f3bdc1470a0 2024-03-29T04:08:55.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.686+0000 7f3be1ee4640 1 -- 172.21.15.73:0/3041598472 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bdc1549d0 con 0x7f3bdc1470a0 2024-03-29T04:08:55.669 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.686+0000 7f3bc3fff640 1 -- 172.21.15.73:0/3041598472 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd0039070 con 0x7f3bdc1470a0 2024-03-29T04:08:55.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.686+0000 7f3be1ee4640 1 -- 172.21.15.73:0/3041598472 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bdc147a60 con 0x7f3bdc1470a0 2024-03-29T04:08:55.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.687+0000 7f3be1ee4640 1 -- 172.21.15.73:0/3041598472 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bdc068640 con 0x7f3bdc1470a0 2024-03-29T04:08:55.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.687+0000 7f3bc3fff640 1 -- 172.21.15.73:0/3041598472 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f3bd0045020 con 0x7f3bdc1470a0 2024-03-29T04:08:55.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.687+0000 7f3bc3fff640 1 --2- 172.21.15.73:0/3041598472 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3bc806c530 0x7f3bc806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:55.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.688+0000 7f3bc3fff640 1 -- 172.21.15.73:0/3041598472 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f3bd00ac850 con 0x7f3bdc1470a0 2024-03-29T04:08:55.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.688+0000 7f3bdb7fe640 1 --2- 172.21.15.73:0/3041598472 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3bc806c530 0x7f3bc806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:55.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.688+0000 7f3bdb7fe640 1 --2- 172.21.15.73:0/3041598472 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3bc806c530 0x7f3bc806e9f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc0099e0 tx=0x7f3bcc006c30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:55.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.692+0000 7f3bc3fff640 1 -- 172.21.15.73:0/3041598472 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f3bd004c070 con 0x7f3bdc1470a0 2024-03-29T04:08:55.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.933+0000 7f3be1ee4640 1 -- 172.21.15.73:0/3041598472 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f3bdc0726b0 con 0x7f3bdc1470a0 2024-03-29T04:08:55.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.935+0000 7f3bc3fff640 1 -- 172.21.15.73:0/3041598472 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) ==== 97+0+0 (secure 0 0 0) 0x7f3bd007b1c0 con 0x7f3bdc1470a0 2024-03-29T04:08:55.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.937+0000 7f3be1ee4640 1 -- 172.21.15.73:0/3041598472 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3bc806c530 msgr2=0x7f3bc806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:55.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.937+0000 7f3be1ee4640 1 --2- 172.21.15.73:0/3041598472 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3bc806c530 0x7f3bc806e9f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc0099e0 tx=0x7f3bcc006c30 comp rx=0 tx=0).stop 2024-03-29T04:08:55.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.937+0000 7f3be1ee4640 1 -- 172.21.15.73:0/3041598472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bdc1470a0 msgr2=0x7f3bdc147520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:55.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.937+0000 7f3be1ee4640 1 --2- 172.21.15.73:0/3041598472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bdc1470a0 0x7f3bdc147520 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0037040 tx=0x7f3bd0004730 comp rx=0 tx=0).stop 2024-03-29T04:08:55.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.937+0000 7f3be1ee4640 1 -- 172.21.15.73:0/3041598472 shutdown_connections 2024-03-29T04:08:55.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.937+0000 7f3be1ee4640 1 --2- 172.21.15.73:0/3041598472 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3bc806c530 0x7f3bc806e9f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:55.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.937+0000 7f3be1ee4640 1 --2- 172.21.15.73:0/3041598472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3bdc0ce200 0x7f3bdc0ce640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:55.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.937+0000 7f3be1ee4640 1 --2- 172.21.15.73:0/3041598472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3bdc1470a0 0x7f3bdc147520 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:55.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.937+0000 7f3be1ee4640 1 --2- 172.21.15.73:0/3041598472 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3bc4003f30 0x7f3bdc0cf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:55.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.937+0000 7f3be1ee4640 1 -- 172.21.15.73:0/3041598472 >> 172.21.15.73:0/3041598472 conn(0x7f3bdc0d0b20 msgr2=0x7f3bdc0ae880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:55.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.937+0000 7f3be1ee4640 1 -- 172.21.15.73:0/3041598472 shutdown_connections 2024-03-29T04:08:55.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:55.937+0000 7f3be1ee4640 1 -- 172.21.15.73:0/3041598472 wait complete. 2024-03-29T04:08:55.927 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-03-29T04:08:56.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.049+0000 7f09e59af640 1 Processor -- start 2024-03-29T04:08:56.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.049+0000 7f09e59af640 1 -- start start 2024-03-29T04:08:56.032 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.050+0000 7f09e59af640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09e015e780 0x7f09e00cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:56.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.050+0000 7f09e59af640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f09e00ba000 0x7f09e00d2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:56.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.050+0000 7f09e59af640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09e00cfe70 con 0x7f09e015eb60 2024-03-29T04:08:56.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.050+0000 7f09e59af640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f09e00b7f50 con 0x7f09e00ba000 2024-03-29T04:08:56.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.050+0000 7f09e59af640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f09e00b8230 con 0x7f09e015e780 2024-03-29T04:08:56.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.050+0000 7f09de7fc640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f09e015eb60 0x7f09e00cf100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57362/0 (socket says 172.21.15.73:57362) 2024-03-29T04:08:56.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.050+0000 7f09de7fc640 1 -- 172.21.15.73:0/3429532108 learned_addr learned my addr 172.21.15.73:0/3429532108 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:56.033 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.050+0000 7f09ddffb640 1 -- 172.21.15.73:0/3429532108 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3185079998 0 0) 0x7f09e00cfe70 con 0x7f09e015eb60 2024-03-29T04:08:56.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.050+0000 7f09ddffb640 1 -- 172.21.15.73:0/3429532108 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09c8003520 con 0x7f09e015eb60 2024-03-29T04:08:56.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.050+0000 7f09deffd640 1 --2- 172.21.15.73:0/3429532108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09e015e780 0x7f09e00cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:56.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.050+0000 7f09df7fe640 1 --2- 172.21.15.73:0/3429532108 >> v2:172.21.15.142:3300/0 conn(0x7f09e00ba000 0x7f09e00d2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:56.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.050+0000 7f09ddffb640 1 -- 172.21.15.73:0/3429532108 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3518035927 0 0) 0x7f09c8003520 con 0x7f09e015eb60 2024-03-29T04:08:56.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.050+0000 7f09ddffb640 1 -- 172.21.15.73:0/3429532108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09e015e780 msgr2=0x7f09e00cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:56.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.050+0000 7f09ddffb640 1 --2- 172.21.15.73:0/3429532108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09e015e780 0x7f09e00cebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.050+0000 7f09ddffb640 1 -- 172.21.15.73:0/3429532108 >> v2:172.21.15.142:3300/0 conn(0x7f09e00ba000 msgr2=0x7f09e00d2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.050+0000 7f09ddffb640 1 --2- 172.21.15.73:0/3429532108 >> v2:172.21.15.142:3300/0 conn(0x7f09e00ba000 0x7f09e00d2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.050+0000 7f09ddffb640 1 -- 172.21.15.73:0/3429532108 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09e00b8510 con 0x7f09e015eb60 2024-03-29T04:08:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.050+0000 7f09ddffb640 1 -- 172.21.15.73:0/3429532108 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1290421750 0 0) 0x7f09d4001670 con 0x7f09e015eb60 2024-03-29T04:08:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.050+0000 7f09ddffb640 1 -- 172.21.15.73:0/3429532108 >> v1:172.21.15.73:6789/0 conn(0x7f09e015eb60 legacy=0x7f09e00cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:56.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.050+0000 7f09ddffb640 1 --2- 172.21.15.73:0/3429532108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09c80039b0 0x7f09c8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.051+0000 7f09ddffb640 1 --2- 172.21.15.73:0/3429532108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09e015e780 0x7f09c8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.051+0000 7f09ddffb640 1 --2- 172.21.15.73:0/3429532108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09c8004d40 0x7f09c80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.051+0000 7f09ddffb640 1 -- 172.21.15.73:0/3429532108 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f09e00b7f50 con 0x7f09c80039b0 2024-03-29T04:08:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.051+0000 7f09ddffb640 1 -- 172.21.15.73:0/3429532108 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f09e00b8230 con 0x7f09c8004d40 2024-03-29T04:08:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.051+0000 7f09ddffb640 1 -- 172.21.15.73:0/3429532108 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f09c800ba70 con 0x7f09e015e780 2024-03-29T04:08:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.051+0000 7f09deffd640 1 --2- 172.21.15.73:0/3429532108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09c80039b0 0x7f09c8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:56.036 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.051+0000 7f09de7fc640 1 --2- 172.21.15.73:0/3429532108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09e015e780 0x7f09c8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:56.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.051+0000 7f09df7fe640 1 --2- 172.21.15.73:0/3429532108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09c8004d40 0x7f09c80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:56.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.051+0000 7f09deffd640 1 -- 172.21.15.73:0/3429532108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09e015e780 msgr2=0x7f09c8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:56.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.051+0000 7f09deffd640 1 --2- 172.21.15.73:0/3429532108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09e015e780 0x7f09c8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:56.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.051+0000 7f09deffd640 1 -- 172.21.15.73:0/3429532108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09c8004d40 msgr2=0x7f09c80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:56.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.051+0000 7f09deffd640 1 --2- 172.21.15.73:0/3429532108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09c8004d40 0x7f09c80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:56.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.051+0000 7f09deffd640 1 -- 172.21.15.73:0/3429532108 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c8003520 con 0x7f09c80039b0 2024-03-29T04:08:56.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.051+0000 7f09de7fc640 1 --2- 172.21.15.73:0/3429532108 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09e015e780 0x7f09c8004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:08:56.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.052+0000 7f09deffd640 1 --2- 172.21.15.73:0/3429532108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09c80039b0 0x7f09c8003dd0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f09d000ba60 tx=0x7f09c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac33ec5ed8f9ae4a server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.052+0000 7f09ddffb640 1 -- 172.21.15.73:0/3429532108 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d0036020 con 0x7f09c80039b0 2024-03-29T04:08:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.052+0000 7f09ddffb640 1 -- 172.21.15.73:0/3429532108 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09d0032630 con 0x7f09c80039b0 2024-03-29T04:08:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.052+0000 7f09ddffb640 1 -- 172.21.15.73:0/3429532108 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d000b600 con 0x7f09c80039b0 2024-03-29T04:08:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.052+0000 7f09e59af640 1 -- 172.21.15.73:0/3429532108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09c80039b0 msgr2=0x7f09c8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.052+0000 7f09e59af640 1 --2- 172.21.15.73:0/3429532108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09c80039b0 0x7f09c8003dd0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f09d000ba60 tx=0x7f09c8005830 comp rx=0 tx=0).stop 2024-03-29T04:08:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.052+0000 7f09df7fe640 1 -- 172.21.15.73:0/3429532108 reap_dead start 2024-03-29T04:08:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.052+0000 7f09e59af640 1 -- 172.21.15.73:0/3429532108 shutdown_connections 2024-03-29T04:08:56.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.052+0000 7f09e59af640 1 -- 172.21.15.73:0/3429532108 >> 172.21.15.73:0/3429532108 conn(0x7f09e008bfc0 msgr2=0x7f09e00d4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.052+0000 7f09e59af640 1 -- 172.21.15.73:0/3429532108 shutdown_connections 2024-03-29T04:08:56.039 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.052+0000 7f09e59af640 1 -- 172.21.15.73:0/3429532108 wait complete. 2024-03-29T04:08:56.043 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.053+0000 7f09e59af640 1 Processor -- start 2024-03-29T04:08:56.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.054+0000 7f09e59af640 1 -- start start 2024-03-29T04:08:56.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.054+0000 7f09e59af640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09c80039b0 0x7f09e01606a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:56.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.054+0000 7f09e59af640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09e014e8d0 0x7f09e014e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:56.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.054+0000 7f09e59af640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09e015f650 0x7f09e015fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:56.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.054+0000 7f09e59af640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f09e00cf810 con 0x7f09e014e8d0 2024-03-29T04:08:56.044 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.054+0000 7f09e59af640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f09e00b8ad0 con 0x7f09e015f650 2024-03-29T04:08:56.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.054+0000 7f09e59af640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f09e00cf990 con 0x7f09c80039b0 2024-03-29T04:08:56.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.054+0000 7f09de7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09e014e8d0 0x7f09e014e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:56.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.054+0000 7f09de7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09e014e8d0 0x7f09e014e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54524/0 (socket says 172.21.15.73:54524) 2024-03-29T04:08:56.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.054+0000 7f09de7fc640 1 -- 172.21.15.73:0/331387310 learned_addr learned my addr 172.21.15.73:0/331387310 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:56.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.055+0000 7f09df7fe640 1 --2- 172.21.15.73:0/331387310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09e015f650 0x7f09e015fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:56.045 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.055+0000 7f09deffd640 1 --2- 172.21.15.73:0/331387310 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09c80039b0 0x7f09e01606a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:56.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.055+0000 7f09de7fc640 1 -- 172.21.15.73:0/331387310 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09c80039b0 msgr2=0x7f09e01606a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:56.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.055+0000 7f09de7fc640 1 --2- 172.21.15.73:0/331387310 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09c80039b0 0x7f09e01606a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:56.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.055+0000 7f09de7fc640 1 -- 172.21.15.73:0/331387310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09e015f650 msgr2=0x7f09e015fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:56.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.055+0000 7f09de7fc640 1 --2- 172.21.15.73:0/331387310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09e015f650 0x7f09e015fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:56.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.055+0000 7f09de7fc640 1 -- 172.21.15.73:0/331387310 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09e0159900 con 0x7f09e014e8d0 2024-03-29T04:08:56.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.055+0000 7f09df7fe640 1 --2- 172.21.15.73:0/331387310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09e015f650 0x7f09e015fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:08:56.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.055+0000 7f09de7fc640 1 --2- 172.21.15.73:0/331387310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09e014e8d0 0x7f09e014e0c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f09d400e7f0 tx=0x7f09d400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:56.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.055+0000 7f09c7fff640 1 -- 172.21.15.73:0/331387310 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d400c8d0 con 0x7f09e014e8d0 2024-03-29T04:08:56.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.055+0000 7f09c7fff640 1 -- 172.21.15.73:0/331387310 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09d4018070 con 0x7f09e014e8d0 2024-03-29T04:08:56.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.055+0000 7f09c7fff640 1 -- 172.21.15.73:0/331387310 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d400ccb0 con 0x7f09e014e8d0 2024-03-29T04:08:56.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.055+0000 7f09e59af640 1 -- 172.21.15.73:0/331387310 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09e0159be0 con 0x7f09e014e8d0 2024-03-29T04:08:56.047 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.055+0000 7f09e59af640 1 -- 172.21.15.73:0/331387310 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09e015f130 con 0x7f09e014e8d0 2024-03-29T04:08:56.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.056+0000 7f09e59af640 1 -- 172.21.15.73:0/331387310 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09e015ef50 con 0x7f09e014e8d0 2024-03-29T04:08:56.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.057+0000 7f09c7fff640 1 -- 172.21.15.73:0/331387310 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f09d401d460 con 0x7f09e014e8d0 2024-03-29T04:08:56.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.057+0000 7f09c7fff640 1 --2- 172.21.15.73:0/331387310 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f09cc06c530 0x7f09cc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:56.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.057+0000 7f09deffd640 1 --2- 172.21.15.73:0/331387310 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f09cc06c530 0x7f09cc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:56.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.057+0000 7f09c7fff640 1 -- 172.21.15.73:0/331387310 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f09d408b290 con 0x7f09e014e8d0 2024-03-29T04:08:56.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.057+0000 7f09deffd640 1 --2- 172.21.15.73:0/331387310 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f09cc06c530 0x7f09cc06e9f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f09d000ba30 tx=0x7f09d0030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:56.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.061+0000 7f09c7fff640 1 -- 172.21.15.73:0/331387310 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f09e015ef50 con 0x7f09e014e8d0 2024-03-29T04:08:56.286 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.307+0000 7f09e59af640 1 -- 172.21.15.73:0/331387310 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f09e015f330 con 0x7f09e014e8d0 2024-03-29T04:08:56.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.309+0000 7f09c7fff640 1 -- 172.21.15.73:0/331387310 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) ==== 90+0+0 (secure 0 0 0) 0x7f09e015f330 con 0x7f09e014e8d0 2024-03-29T04:08:56.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.311+0000 7f09e59af640 1 -- 172.21.15.73:0/331387310 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f09cc06c530 msgr2=0x7f09cc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:56.291 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.311+0000 7f09e59af640 1 --2- 172.21.15.73:0/331387310 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f09cc06c530 0x7f09cc06e9f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f09d000ba30 tx=0x7f09d0030000 comp rx=0 tx=0).stop 2024-03-29T04:08:56.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.311+0000 7f09e59af640 1 -- 172.21.15.73:0/331387310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09e014e8d0 msgr2=0x7f09e014e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:56.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.312+0000 7f09e59af640 1 --2- 172.21.15.73:0/331387310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09e014e8d0 0x7f09e014e0c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f09d400e7f0 tx=0x7f09d400ecb0 comp rx=0 tx=0).stop 2024-03-29T04:08:56.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.312+0000 7f09e59af640 1 -- 172.21.15.73:0/331387310 shutdown_connections 2024-03-29T04:08:56.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.312+0000 7f09e59af640 1 --2- 172.21.15.73:0/331387310 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f09cc06c530 0x7f09cc06e9f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:56.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.312+0000 7f09e59af640 1 --2- 172.21.15.73:0/331387310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09e015f650 0x7f09e015fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:56.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.312+0000 7f09e59af640 1 --2- 172.21.15.73:0/331387310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09e014e8d0 0x7f09e014e0c0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:56.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.312+0000 7f09e59af640 1 --2- 172.21.15.73:0/331387310 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09c80039b0 0x7f09e01606a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:56.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.312+0000 7f09e59af640 1 -- 172.21.15.73:0/331387310 >> 172.21.15.73:0/331387310 conn(0x7f09e008bfc0 msgr2=0x7f09e006c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:56.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.312+0000 7f09e59af640 1 -- 172.21.15.73:0/331387310 shutdown_connections 2024-03-29T04:08:56.292 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.312+0000 7f09e59af640 1 -- 172.21.15.73:0/331387310 wait complete. 2024-03-29T04:08:56.303 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-29T04:08:56.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.424+0000 7f47b1d72640 1 Processor -- start 2024-03-29T04:08:56.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.424+0000 7f47b1d72640 1 -- start start 2024-03-29T04:08:56.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.424+0000 7f47b1d72640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f47ac0b3c50 0x7f47ac0d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:56.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.424+0000 7f47b1d72640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47ac0d3140 0x7f47ac06cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:56.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.424+0000 7f47b1d72640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47ac0cfb30 con 0x7f47ac15e930 2024-03-29T04:08:56.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.424+0000 7f47b1d72640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f47ac06c780 con 0x7f47ac0b3c50 2024-03-29T04:08:56.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.424+0000 7f47b1d72640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f47ac0cfe10 con 0x7f47ac0d3140 2024-03-29T04:08:56.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.424+0000 7f47aaffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f47ac0b3c50 0x7f47ac0d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:56.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.425+0000 7f47aaffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f47ac0b3c50 0x7f47ac0d2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54526/0 (socket says 172.21.15.73:54526) 2024-03-29T04:08:56.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.425+0000 7f47ab7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f47ac15e930 0x7f47ac0cf130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57370/0 (socket says 172.21.15.73:57370) 2024-03-29T04:08:56.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.425+0000 7f47aaffd640 1 -- 172.21.15.73:0/1278869314 learned_addr learned my addr 172.21.15.73:0/1278869314 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:56.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.425+0000 7f47abfff640 1 --2- 172.21.15.73:0/1278869314 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47ac0d3140 0x7f47ac06cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:56.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.425+0000 7f47aaffd640 1 -- 172.21.15.73:0/1278869314 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47ac0d3140 msgr2=0x7f47ac06cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:56.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.425+0000 7f47aa7fc640 1 -- 172.21.15.73:0/1278869314 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 41685753 0 0) 0x7f47ac0cfb30 con 0x7f47ac15e930 2024-03-29T04:08:56.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.425+0000 7f47aaffd640 1 --2- 172.21.15.73:0/1278869314 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47ac0d3140 0x7f47ac06cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:56.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.425+0000 7f47aaffd640 1 -- 172.21.15.73:0/1278869314 >> v1:172.21.15.73:6789/0 conn(0x7f47ac15e930 legacy=0x7f47ac0cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:56.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.425+0000 7f47aaffd640 1 -- 172.21.15.73:0/1278869314 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47ac0d00f0 con 0x7f47ac0b3c50 2024-03-29T04:08:56.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.425+0000 7f47abfff640 1 --2- 172.21.15.73:0/1278869314 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47ac0d3140 0x7f47ac06cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:08:56.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.426+0000 7f47aaffd640 1 --2- 172.21.15.73:0/1278869314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47ac0b3c50 0x7f47ac0d2c00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f47a0009e50 tx=0x7f47a002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4bc78e150596e54 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:56.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.426+0000 7f47aa7fc640 1 -- 172.21.15.73:0/1278869314 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a002ca70 con 0x7f47ac0b3c50 2024-03-29T04:08:56.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.426+0000 7f47aa7fc640 1 -- 172.21.15.73:0/1278869314 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47a002cc10 con 0x7f47ac0b3c50 2024-03-29T04:08:56.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.426+0000 7f47aa7fc640 1 -- 172.21.15.73:0/1278869314 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a00343f0 con 0x7f47ac0b3c50 2024-03-29T04:08:56.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.426+0000 7f47b1d72640 1 -- 172.21.15.73:0/1278869314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47ac0b3c50 msgr2=0x7f47ac0d2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:56.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.426+0000 7f47b1d72640 1 --2- 172.21.15.73:0/1278869314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47ac0b3c50 0x7f47ac0d2c00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f47a0009e50 tx=0x7f47a002bed0 comp rx=0 tx=0).stop 2024-03-29T04:08:56.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.426+0000 7f47b1d72640 1 -- 172.21.15.73:0/1278869314 shutdown_connections 2024-03-29T04:08:56.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.426+0000 7f47b1d72640 1 --2- 172.21.15.73:0/1278869314 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47ac0d3140 0x7f47ac06cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:56.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.426+0000 7f47b1d72640 1 --2- 172.21.15.73:0/1278869314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47ac0b3c50 0x7f47ac0d2c00 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:56.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.426+0000 7f47b1d72640 1 -- 172.21.15.73:0/1278869314 >> 172.21.15.73:0/1278869314 conn(0x7f47ac08bfc0 msgr2=0x7f47ac0d4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:56.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.426+0000 7f47b1d72640 1 -- 172.21.15.73:0/1278869314 shutdown_connections 2024-03-29T04:08:56.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.426+0000 7f47b1d72640 1 -- 172.21.15.73:0/1278869314 wait complete. 2024-03-29T04:08:56.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.427+0000 7f47b1d72640 1 Processor -- start 2024-03-29T04:08:56.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.428+0000 7f47b1d72640 1 -- start start 2024-03-29T04:08:56.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.428+0000 7f47b1d72640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47ac0b3c50 0x7f47ac1550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:56.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.428+0000 7f47b1d72640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47ac0d3140 0x7f47ac157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:56.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.428+0000 7f47b1d72640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47ac15e930 0x7f47ac160c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:56.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.428+0000 7f47b1d72640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f47ac15ed10 con 0x7f47ac0b3c50 2024-03-29T04:08:56.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.428+0000 7f47b1d72640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f47ac0cf840 con 0x7f47ac15e930 2024-03-29T04:08:56.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.428+0000 7f47b1d72640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f47ac15ee90 con 0x7f47ac0d3140 2024-03-29T04:08:56.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.428+0000 7f47ab7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47ac0b3c50 0x7f47ac1550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:56.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.428+0000 7f47ab7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47ac0b3c50 0x7f47ac1550d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54530/0 (socket says 172.21.15.73:54530) 2024-03-29T04:08:56.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.428+0000 7f47ab7fe640 1 -- 172.21.15.73:0/1013261398 learned_addr learned my addr 172.21.15.73:0/1013261398 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:56.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.429+0000 7f47aaffd640 1 --2- 172.21.15.73:0/1013261398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47ac0d3140 0x7f47ac157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:56.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.429+0000 7f47abfff640 1 --2- 172.21.15.73:0/1013261398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47ac15e930 0x7f47ac160c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:56.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.429+0000 7f47ab7fe640 1 -- 172.21.15.73:0/1013261398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47ac0d3140 msgr2=0x7f47ac157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:56.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.429+0000 7f47ab7fe640 1 --2- 172.21.15.73:0/1013261398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47ac0d3140 0x7f47ac157d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:56.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.429+0000 7f47ab7fe640 1 -- 172.21.15.73:0/1013261398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47ac15e930 msgr2=0x7f47ac160c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:56.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.429+0000 7f47ab7fe640 1 --2- 172.21.15.73:0/1013261398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47ac15e930 0x7f47ac160c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:56.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.429+0000 7f47ab7fe640 1 -- 172.21.15.73:0/1013261398 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47ac160160 con 0x7f47ac0b3c50 2024-03-29T04:08:56.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.429+0000 7f47abfff640 1 --2- 172.21.15.73:0/1013261398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47ac15e930 0x7f47ac160c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:08:56.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.429+0000 7f47ab7fe640 1 --2- 172.21.15.73:0/1013261398 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47ac0b3c50 0x7f47ac1550d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f479c00c500 tx=0x7f479c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:56.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.429+0000 7f4793fff640 1 -- 172.21.15.73:0/1013261398 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f479c018070 con 0x7f47ac0b3c50 2024-03-29T04:08:56.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.429+0000 7f4793fff640 1 -- 172.21.15.73:0/1013261398 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f479c007580 con 0x7f47ac0b3c50 2024-03-29T04:08:56.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.429+0000 7f47b1d72640 1 -- 172.21.15.73:0/1013261398 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47ac15aaa0 con 0x7f47ac0b3c50 2024-03-29T04:08:56.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.429+0000 7f4793fff640 1 -- 172.21.15.73:0/1013261398 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f479c004a20 con 0x7f47ac0b3c50 2024-03-29T04:08:56.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.429+0000 7f47b1d72640 1 -- 172.21.15.73:0/1013261398 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47ac1606e0 con 0x7f47ac0b3c50 2024-03-29T04:08:56.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.430+0000 7f47b1d72640 1 -- 172.21.15.73:0/1013261398 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47ac068640 con 0x7f47ac0b3c50 2024-03-29T04:08:56.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.430+0000 7f4793fff640 1 -- 172.21.15.73:0/1013261398 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f479c01b070 con 0x7f47ac0b3c50 2024-03-29T04:08:56.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.431+0000 7f4793fff640 1 --2- 172.21.15.73:0/1013261398 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f479806c530 0x7f479806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:56.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.431+0000 7f4793fff640 1 -- 172.21.15.73:0/1013261398 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f479c08a650 con 0x7f47ac0b3c50 2024-03-29T04:08:56.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.431+0000 7f47aaffd640 1 --2- 172.21.15.73:0/1013261398 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f479806c530 0x7f479806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:56.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.431+0000 7f47aaffd640 1 --2- 172.21.15.73:0/1013261398 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f479806c530 0x7f479806e9f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f47a0035000 tx=0x7f47a0030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:56.417 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.435+0000 7f4793fff640 1 -- 172.21.15.73:0/1013261398 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f479c059050 con 0x7f47ac0b3c50 2024-03-29T04:08:56.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.610+0000 7f47b1d72640 1 -- 172.21.15.73:0/1013261398 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f47ac06db50 con 0x7f47ac0b3c50 2024-03-29T04:08:56.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.610+0000 7f4793fff640 1 -- 172.21.15.73:0/1013261398 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+12891 (secure 0 0 0) 0x7f479c058950 con 0x7f47ac0b3c50 2024-03-29T04:08:56.590 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:56.590 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":28,"fsid":"6bff1617-b138-4517-acca-3ecaae3f2bb3","created":"2024-03-29T04:07:47.346864+0000","modified":"2024-03-29T04:08:53.715990+0000","last_up_change":"2024-03-29T04:07:58.507139+0000","last_in_change":"2024-03-29T04:07:49.637816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-29T04:07:59.537301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"925d7de1-14ab-48c0-aebd-7bded108f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6820","nonce":2387335359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6824","nonce":2387335359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6831","nonce":2387335359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6828","nonce":2387335359}]},"public_addr":"172.21.15.73:6820/2387335359","cluster_addr":"172.21.15.73:6824/2387335359","heartbeat_back_addr":"172.21.15.73:6831/2387335359","heartbeat_front_addr":"172.21.15.73:6828/2387335359","state":["exists","up"]},{"osd":1,"uuid":"6b182102-882a-4e0c-99db-0afae5cfb38b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6801","nonce":2431315515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6803","nonce":2431315515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6807","nonce":2431315515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6805","nonce":2431315515}]},"public_addr":"172.21.15.73:6801/2431315515","cluster_addr":"172.21.15.73:6803/2431315515","heartbeat_back_addr":"172.21.15.73:6807/2431315515","heartbeat_front_addr":"172.21.15.73:6805/2431315515","state":["exists","up"]},{"osd":2,"uuid":"8040902e-b0b8-4a21-bf64-ce1c222115ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6809","nonce":407236597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6811","nonce":407236597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6815","nonce":407236597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6813","nonce":407236597}]},"public_addr":"172.21.15.73:6809/407236597","cluster_addr":"172.21.15.73:6811/407236597","heartbeat_back_addr":"172.21.15.73:6815/407236597","heartbeat_front_addr":"172.21.15.73:6813/407236597","state":["exists","up"]},{"osd":3,"uuid":"1bab19ee-3775-4ce1-a4ce-cf7cda3bbbf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6817","nonce":4291100709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6821","nonce":4291100709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6829","nonce":4291100709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6825","nonce":4291100709}]},"public_addr":"172.21.15.73:6817/4291100709","cluster_addr":"172.21.15.73:6821/4291100709","heartbeat_back_addr":"172.21.15.73:6829/4291100709","heartbeat_front_addr":"172.21.15.73:6825/4291100709","state":["exists","up"]},{"osd":4,"uuid":"b0c74337-8fe4-47dc-b3da-2d07591b1f6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6817","nonce":3703256194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6819","nonce":3703256194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6823","nonce":3703256194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6821","nonce":3703256194}]},"public_addr":"172.21.15.142:6817/3703256194","cluster_addr":"172.21.15.142:6819/3703256194","heartbeat_back_addr":"172.21.15.142:6823/3703256194","heartbeat_front_addr":"172.21.15.142:6821/3703256194","state":["exists","up"]},{"osd":5,"uuid":"9ce36410-a29a-42c6-99f4-f95d4afdd7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6825","nonce":4271575803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6827","nonce":4271575803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6831","nonce":4271575803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6829","nonce":4271575803}]},"public_addr":"172.21.15.142:6825/4271575803","cluster_addr":"172.21.15.142:6827/4271575803","heartbeat_back_addr":"172.21.15.142:6831/4271575803","heartbeat_front_addr":"172.21.15.142:6829/4271575803","state":["exists","up"]},{"osd":6,"uuid":"aec4264a-64ac-428e-a860-d2920a304019","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6801","nonce":1772722570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6803","nonce":1772722570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6807","nonce":1772722570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6805","nonce":1772722570}]},"public_addr":"172.21.15.142:6801/1772722570","cluster_addr":"172.21.15.142:6803/1772722570","heartbeat_back_addr":"172.21.15.142:6807/1772722570","heartbeat_front_addr":"172.21.15.142:6805/1772722570","state":["exists","up"]},{"osd":7,"uuid":"fe599052-8e5a-4c7a-91e7-52d1bae24a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6809","nonce":3910589675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6811","nonce":3910589675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6815","nonce":3910589675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6813","nonce":3910589675}]},"public_addr":"172.21.15.142:6809/3910589675","cluster_addr":"172.21.15.142:6811/3910589675","heartbeat_back_addr":"172.21.15.142:6815/3910589675","heartbeat_front_addr":"172.21.15.142:6813/3910589675","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.835096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.587210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.786547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.778004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.843740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.791160+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.837992+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.718722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:08:56.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.613+0000 7f47b1d72640 1 -- 172.21.15.73:0/1013261398 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f479806c530 msgr2=0x7f479806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:56.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.613+0000 7f47b1d72640 1 --2- 172.21.15.73:0/1013261398 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f479806c530 0x7f479806e9f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f47a0035000 tx=0x7f47a0030000 comp rx=0 tx=0).stop 2024-03-29T04:08:56.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.613+0000 7f47b1d72640 1 -- 172.21.15.73:0/1013261398 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47ac0b3c50 msgr2=0x7f47ac1550d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:56.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.613+0000 7f47b1d72640 1 --2- 172.21.15.73:0/1013261398 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47ac0b3c50 0x7f47ac1550d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f479c00c500 tx=0x7f479c00c9c0 comp rx=0 tx=0).stop 2024-03-29T04:08:56.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.613+0000 7f47b1d72640 1 -- 172.21.15.73:0/1013261398 shutdown_connections 2024-03-29T04:08:56.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.613+0000 7f47b1d72640 1 --2- 172.21.15.73:0/1013261398 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f479806c530 0x7f479806e9f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:56.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.613+0000 7f47b1d72640 1 --2- 172.21.15.73:0/1013261398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47ac15e930 0x7f47ac160c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:56.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.613+0000 7f47b1d72640 1 --2- 172.21.15.73:0/1013261398 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47ac0d3140 0x7f47ac157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:56.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.613+0000 7f47b1d72640 1 --2- 172.21.15.73:0/1013261398 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47ac0b3c50 0x7f47ac1550d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:56.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.613+0000 7f47b1d72640 1 -- 172.21.15.73:0/1013261398 >> 172.21.15.73:0/1013261398 conn(0x7f47ac08bfc0 msgr2=0x7f47ac0cab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:56.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.613+0000 7f47b1d72640 1 -- 172.21.15.73:0/1013261398 shutdown_connections 2024-03-29T04:08:56.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.613+0000 7f47b1d72640 1 -- 172.21.15.73:0/1013261398 wait complete. 2024-03-29T04:08:56.603 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-29T04:07:59.537301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-29T04:08:56.604 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-29T04:08:56.707 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.728+0000 7f3a4c40d640 1 Processor -- start 2024-03-29T04:08:56.708 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.728+0000 7f3a4c40d640 1 -- start start 2024-03-29T04:08:56.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.729+0000 7f3a4c40d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3a4415b3d0 0x7f3a440ca950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:56.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.729+0000 7f3a4c40d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3a440b28c0 0x7f3a440b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:56.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.729+0000 7f3a4c40d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a440c6470 con 0x7f3a440b49f0 2024-03-29T04:08:56.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.729+0000 7f3a4c40d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f3a440c6240 con 0x7f3a4415b3d0 2024-03-29T04:08:56.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.729+0000 7f3a4c40d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f3a440c7080 con 0x7f3a440b28c0 2024-03-29T04:08:56.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.729+0000 7f3a4a1a9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3a4415b3d0 0x7f3a440ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:56.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.729+0000 7f3a4a1a9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3a4415b3d0 0x7f3a440ca950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54536/0 (socket says 172.21.15.73:54536) 2024-03-29T04:08:56.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.729+0000 7f3a4a1a9640 1 -- 172.21.15.73:0/362373968 learned_addr learned my addr 172.21.15.73:0/362373968 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:56.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.729+0000 7f3a4a9aa640 1 --2- 172.21.15.73:0/362373968 >> v2:172.21.15.142:3300/0 conn(0x7f3a440b28c0 0x7f3a440b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:56.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.729+0000 7f3a4a1a9640 1 -- 172.21.15.73:0/362373968 >> v2:172.21.15.142:3300/0 conn(0x7f3a440b28c0 msgr2=0x7f3a440b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:56.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.729+0000 7f3a4a1a9640 1 --2- 172.21.15.73:0/362373968 >> v2:172.21.15.142:3300/0 conn(0x7f3a440b28c0 0x7f3a440b4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:56.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.729+0000 7f3a4a1a9640 1 -- 172.21.15.73:0/362373968 >> v1:172.21.15.142:6789/0 conn(0x7f3a440b49f0 legacy=0x7f3a440b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:56.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.729+0000 7f3a4a1a9640 1 -- 172.21.15.73:0/362373968 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a440c6750 con 0x7f3a4415b3d0 2024-03-29T04:08:56.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.730+0000 7f3a4a1a9640 1 --2- 172.21.15.73:0/362373968 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a4415b3d0 0x7f3a440ca950 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3a440b3700 tx=0x7f3a4002e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1cd117e553d8da3 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:56.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.730+0000 7f3a491a7640 1 -- 172.21.15.73:0/362373968 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4003b070 con 0x7f3a4415b3d0 2024-03-29T04:08:56.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.730+0000 7f3a491a7640 1 -- 172.21.15.73:0/362373968 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a40036440 con 0x7f3a4415b3d0 2024-03-29T04:08:56.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.730+0000 7f3a491a7640 1 -- 172.21.15.73:0/362373968 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a40036810 con 0x7f3a4415b3d0 2024-03-29T04:08:56.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.730+0000 7f3a4c40d640 1 -- 172.21.15.73:0/362373968 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a4415b3d0 msgr2=0x7f3a440ca950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:56.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.730+0000 7f3a4c40d640 1 --2- 172.21.15.73:0/362373968 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a4415b3d0 0x7f3a440ca950 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3a440b3700 tx=0x7f3a4002e0e0 comp rx=0 tx=0).stop 2024-03-29T04:08:56.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.731+0000 7f3a4c40d640 1 -- 172.21.15.73:0/362373968 shutdown_connections 2024-03-29T04:08:56.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.731+0000 7f3a4c40d640 1 --2- 172.21.15.73:0/362373968 >> v2:172.21.15.142:3300/0 conn(0x7f3a440b28c0 0x7f3a440b4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:56.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.731+0000 7f3a4c40d640 1 --2- 172.21.15.73:0/362373968 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a4415b3d0 0x7f3a440ca950 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:56.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.731+0000 7f3a4c40d640 1 -- 172.21.15.73:0/362373968 >> 172.21.15.73:0/362373968 conn(0x7f3a440d0450 msgr2=0x7f3a440d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:56.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.731+0000 7f3a4c40d640 1 -- 172.21.15.73:0/362373968 shutdown_connections 2024-03-29T04:08:56.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.731+0000 7f3a4c40d640 1 -- 172.21.15.73:0/362373968 wait complete. 2024-03-29T04:08:56.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.732+0000 7f3a4c40d640 1 Processor -- start 2024-03-29T04:08:56.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.732+0000 7f3a4c40d640 1 -- start start 2024-03-29T04:08:56.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.732+0000 7f3a4c40d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a440b28c0 0x7f3a441f8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:56.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.732+0000 7f3a4c40d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a440b49f0 0x7f3a440ae460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:56.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.732+0000 7f3a4c40d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a4415b3d0 0x7f3a441592f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:56.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.732+0000 7f3a4c40d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4415b7b0 con 0x7f3a440b28c0 2024-03-29T04:08:56.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.732+0000 7f3a4c40d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3a440c6d10 con 0x7f3a440b49f0 2024-03-29T04:08:56.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.732+0000 7f3a4c40d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f3a4415b930 con 0x7f3a4415b3d0 2024-03-29T04:08:56.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.733+0000 7f3a4a1a9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a440b28c0 0x7f3a441f8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:56.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.733+0000 7f3a4a1a9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a440b28c0 0x7f3a441f8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54550/0 (socket says 172.21.15.73:54550) 2024-03-29T04:08:56.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.733+0000 7f3a4a1a9640 1 -- 172.21.15.73:0/670231218 learned_addr learned my addr 172.21.15.73:0/670231218 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:56.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.733+0000 7f3a4a1a9640 1 -- 172.21.15.73:0/670231218 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a4415b3d0 msgr2=0x7f3a441592f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:56.715 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.733+0000 7f3a4a9aa640 1 --2- 172.21.15.73:0/670231218 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a4415b3d0 0x7f3a441592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:56.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.733+0000 7f3a499a8640 1 --2- 172.21.15.73:0/670231218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a440b49f0 0x7f3a440ae460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:56.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.733+0000 7f3a4a1a9640 1 --2- 172.21.15.73:0/670231218 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a4415b3d0 0x7f3a441592f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:56.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.733+0000 7f3a4a1a9640 1 -- 172.21.15.73:0/670231218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a440b49f0 msgr2=0x7f3a440ae460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:56.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.733+0000 7f3a4a1a9640 1 --2- 172.21.15.73:0/670231218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a440b49f0 0x7f3a440ae460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:56.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.733+0000 7f3a4a1a9640 1 -- 172.21.15.73:0/670231218 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a440c75e0 con 0x7f3a440b28c0 2024-03-29T04:08:56.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.733+0000 7f3a4a9aa640 1 --2- 172.21.15.73:0/670231218 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a4415b3d0 0x7f3a441592f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:08:56.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.733+0000 7f3a499a8640 1 --2- 172.21.15.73:0/670231218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a440b49f0 0x7f3a440ae460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:08:56.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.733+0000 7f3a4a1a9640 1 --2- 172.21.15.73:0/670231218 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a440b28c0 0x7f3a441f8620 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3a4002e120 tx=0x7f3a400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:56.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.733+0000 7f3a3affd640 1 -- 172.21.15.73:0/670231218 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a40046070 con 0x7f3a440b28c0 2024-03-29T04:08:56.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.733+0000 7f3a3affd640 1 -- 172.21.15.73:0/670231218 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a4003d050 con 0x7f3a440b28c0 2024-03-29T04:08:56.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.733+0000 7f3a4c40d640 1 -- 172.21.15.73:0/670231218 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a440c9930 con 0x7f3a440b28c0 2024-03-29T04:08:56.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.733+0000 7f3a3affd640 1 -- 172.21.15.73:0/670231218 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4003b030 con 0x7f3a440b28c0 2024-03-29T04:08:56.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.733+0000 7f3a4c40d640 1 -- 172.21.15.73:0/670231218 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a440c72b0 con 0x7f3a440b28c0 2024-03-29T04:08:56.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.734+0000 7f3a4c40d640 1 -- 172.21.15.73:0/670231218 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a4409e520 con 0x7f3a440b28c0 2024-03-29T04:08:56.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.735+0000 7f3a3affd640 1 -- 172.21.15.73:0/670231218 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f3a400348f0 con 0x7f3a440b28c0 2024-03-29T04:08:56.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.735+0000 7f3a3affd640 1 --2- 172.21.15.73:0/670231218 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3a2806c530 0x7f3a2806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:56.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.735+0000 7f3a3affd640 1 -- 172.21.15.73:0/670231218 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f3a400ad070 con 0x7f3a440b28c0 2024-03-29T04:08:56.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.735+0000 7f3a499a8640 1 --2- 172.21.15.73:0/670231218 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3a2806c530 0x7f3a2806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:56.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.735+0000 7f3a499a8640 1 --2- 172.21.15.73:0/670231218 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3a2806c530 0x7f3a2806e9f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3a440b2740 tx=0x7f3a34009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:56.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.739+0000 7f3a3affd640 1 -- 172.21.15.73:0/670231218 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f3a4007b960 con 0x7f3a440b28c0 2024-03-29T04:08:56.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.912+0000 7f3a4c40d640 1 -- 172.21.15.73:0/670231218 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3a4404f9d0 con 0x7f3a440b28c0 2024-03-29T04:08:56.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.912+0000 7f3a3affd640 1 -- 172.21.15.73:0/670231218 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) ==== 93+0+10 (secure 0 0 0) 0x7f3a4007b260 con 0x7f3a440b28c0 2024-03-29T04:08:56.892 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-03-29T04:08:56.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.914+0000 7f3a4c40d640 1 -- 172.21.15.73:0/670231218 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3a2806c530 msgr2=0x7f3a2806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:56.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.914+0000 7f3a4c40d640 1 --2- 172.21.15.73:0/670231218 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3a2806c530 0x7f3a2806e9f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3a440b2740 tx=0x7f3a34009040 comp rx=0 tx=0).stop 2024-03-29T04:08:56.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.914+0000 7f3a4c40d640 1 -- 172.21.15.73:0/670231218 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a440b28c0 msgr2=0x7f3a441f8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:56.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.914+0000 7f3a4c40d640 1 --2- 172.21.15.73:0/670231218 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a440b28c0 0x7f3a441f8620 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3a4002e120 tx=0x7f3a400046c0 comp rx=0 tx=0).stop 2024-03-29T04:08:56.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.914+0000 7f3a4c40d640 1 -- 172.21.15.73:0/670231218 shutdown_connections 2024-03-29T04:08:56.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.914+0000 7f3a4c40d640 1 --2- 172.21.15.73:0/670231218 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a4415b3d0 0x7f3a441592f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:56.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.914+0000 7f3a4c40d640 1 --2- 172.21.15.73:0/670231218 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3a2806c530 0x7f3a2806e9f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:56.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.914+0000 7f3a4c40d640 1 --2- 172.21.15.73:0/670231218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a440b49f0 0x7f3a440ae460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:56.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.914+0000 7f3a4c40d640 1 --2- 172.21.15.73:0/670231218 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a440b28c0 0x7f3a441f8620 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:56.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.914+0000 7f3a4c40d640 1 -- 172.21.15.73:0/670231218 >> 172.21.15.73:0/670231218 conn(0x7f3a440d0450 msgr2=0x7f3a440c5880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:56.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.914+0000 7f3a4c40d640 1 -- 172.21.15.73:0/670231218 shutdown_connections 2024-03-29T04:08:56.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:56.914+0000 7f3a4c40d640 1 -- 172.21.15.73:0/670231218 wait complete. 2024-03-29T04:08:56.904 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-29T04:08:57.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.026+0000 7ff9e1e7e640 1 Processor -- start 2024-03-29T04:08:57.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.026+0000 7ff9e1e7e640 1 -- start start 2024-03-29T04:08:57.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.027+0000 7ff9e1e7e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff9dc161c70 0x7ff9dc0d3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:57.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.027+0000 7ff9e1e7e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff9dc0d15e0 0x7ff9dc0b3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:57.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.027+0000 7ff9e1e7e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9dc0d2350 con 0x7ff9dc0cfcb0 2024-03-29T04:08:57.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.027+0000 7ff9e1e7e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7ff9dc0d2c80 con 0x7ff9dc0d15e0 2024-03-29T04:08:57.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.027+0000 7ff9e1e7e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7ff9dc0d2630 con 0x7ff9dc161c70 2024-03-29T04:08:57.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.027+0000 7ff9dbfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff9dc0d15e0 0x7ff9dc0b3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:57.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.027+0000 7ff9dbfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff9dc0d15e0 0x7ff9dc0b3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54560/0 (socket says 172.21.15.73:54560) 2024-03-29T04:08:57.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.027+0000 7ff9daffd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff9dc0cfcb0 0x7ff9dc0d0ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57374/0 (socket says 172.21.15.73:57374) 2024-03-29T04:08:57.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.027+0000 7ff9dbfff640 1 -- 172.21.15.73:0/3215922885 learned_addr learned my addr 172.21.15.73:0/3215922885 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:57.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.027+0000 7ff9db7fe640 1 --2- 172.21.15.73:0/3215922885 >> v2:172.21.15.142:3300/0 conn(0x7ff9dc161c70 0x7ff9dc0d3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:57.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.028+0000 7ff9dbfff640 1 -- 172.21.15.73:0/3215922885 >> v2:172.21.15.142:3300/0 conn(0x7ff9dc161c70 msgr2=0x7ff9dc0d3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:57.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.028+0000 7ff9dbfff640 1 --2- 172.21.15.73:0/3215922885 >> v2:172.21.15.142:3300/0 conn(0x7ff9dc161c70 0x7ff9dc0d3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:57.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.028+0000 7ff9dbfff640 1 -- 172.21.15.73:0/3215922885 >> v1:172.21.15.73:6789/0 conn(0x7ff9dc0cfcb0 legacy=0x7ff9dc0d0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:57.008 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.028+0000 7ff9dbfff640 1 -- 172.21.15.73:0/3215922885 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9dc0d2910 con 0x7ff9dc0d15e0 2024-03-29T04:08:57.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.028+0000 7ff9dbfff640 1 --2- 172.21.15.73:0/3215922885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9dc0d15e0 0x7ff9dc0b3f40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc08ce80 tx=0x7ff9d402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1164ea59ab42f2d server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:57.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.028+0000 7ff9da7fc640 1 -- 172.21.15.73:0/3215922885 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d402cb20 con 0x7ff9dc0d15e0 2024-03-29T04:08:57.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.028+0000 7ff9da7fc640 1 -- 172.21.15.73:0/3215922885 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9d402ccc0 con 0x7ff9dc0d15e0 2024-03-29T04:08:57.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.028+0000 7ff9da7fc640 1 -- 172.21.15.73:0/3215922885 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d4034610 con 0x7ff9dc0d15e0 2024-03-29T04:08:57.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.029+0000 7ff9e1e7e640 1 -- 172.21.15.73:0/3215922885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9dc0d15e0 msgr2=0x7ff9dc0b3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:57.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.029+0000 7ff9e1e7e640 1 --2- 172.21.15.73:0/3215922885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9dc0d15e0 0x7ff9dc0b3f40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc08ce80 tx=0x7ff9d402bf80 comp rx=0 tx=0).stop 2024-03-29T04:08:57.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.029+0000 7ff9e1e7e640 1 -- 172.21.15.73:0/3215922885 shutdown_connections 2024-03-29T04:08:57.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.029+0000 7ff9e1e7e640 1 --2- 172.21.15.73:0/3215922885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9dc0d15e0 0x7ff9dc0b3f40 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:57.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.029+0000 7ff9e1e7e640 1 --2- 172.21.15.73:0/3215922885 >> v2:172.21.15.142:3300/0 conn(0x7ff9dc161c70 0x7ff9dc0d3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:57.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.029+0000 7ff9e1e7e640 1 -- 172.21.15.73:0/3215922885 >> 172.21.15.73:0/3215922885 conn(0x7ff9dc08bfc0 msgr2=0x7ff9dc0d4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:57.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.029+0000 7ff9e1e7e640 1 -- 172.21.15.73:0/3215922885 shutdown_connections 2024-03-29T04:08:57.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.029+0000 7ff9e1e7e640 1 -- 172.21.15.73:0/3215922885 wait complete. 2024-03-29T04:08:57.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.030+0000 7ff9e1e7e640 1 Processor -- start 2024-03-29T04:08:57.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.030+0000 7ff9e1e7e640 1 -- start start 2024-03-29T04:08:57.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.031+0000 7ff9e1e7e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9dc0cfcb0 0x7ff9dc152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:57.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.031+0000 7ff9e1e7e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9dc0d15e0 0x7ff9dc0a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:57.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.031+0000 7ff9e1e7e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9dc161c70 0x7ff9dc0b8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:57.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.031+0000 7ff9e1e7e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff9dc0d53a0 con 0x7ff9dc0cfcb0 2024-03-29T04:08:57.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.031+0000 7ff9e1e7e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff9dc0d5220 con 0x7ff9dc161c70 2024-03-29T04:08:57.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.031+0000 7ff9e1e7e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff9dc0d0110 con 0x7ff9dc0d15e0 2024-03-29T04:08:57.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.031+0000 7ff9db7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9dc0cfcb0 0x7ff9dc152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:57.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.031+0000 7ff9db7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9dc0cfcb0 0x7ff9dc152b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54562/0 (socket says 172.21.15.73:54562) 2024-03-29T04:08:57.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.031+0000 7ff9db7fe640 1 -- 172.21.15.73:0/2450652200 learned_addr learned my addr 172.21.15.73:0/2450652200 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:57.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.031+0000 7ff9dbfff640 1 --2- 172.21.15.73:0/2450652200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9dc161c70 0x7ff9dc0b8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:57.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.031+0000 7ff9daffd640 1 --2- 172.21.15.73:0/2450652200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9dc0d15e0 0x7ff9dc0a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:57.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.031+0000 7ff9db7fe640 1 -- 172.21.15.73:0/2450652200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9dc0d15e0 msgr2=0x7ff9dc0a12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:57.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.031+0000 7ff9db7fe640 1 --2- 172.21.15.73:0/2450652200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9dc0d15e0 0x7ff9dc0a12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:57.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.031+0000 7ff9db7fe640 1 -- 172.21.15.73:0/2450652200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9dc161c70 msgr2=0x7ff9dc0b8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:57.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.031+0000 7ff9db7fe640 1 --2- 172.21.15.73:0/2450652200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9dc161c70 0x7ff9dc0b8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:57.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.031+0000 7ff9db7fe640 1 -- 172.21.15.73:0/2450652200 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9dc0a1cd0 con 0x7ff9dc0cfcb0 2024-03-29T04:08:57.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.031+0000 7ff9dbfff640 1 --2- 172.21.15.73:0/2450652200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9dc161c70 0x7ff9dc0b8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:08:57.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.032+0000 7ff9db7fe640 1 --2- 172.21.15.73:0/2450652200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9dc0cfcb0 0x7ff9dc152b10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc00d5f0 tx=0x7ff9cc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:57.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.032+0000 7ff9c3fff640 1 -- 172.21.15.73:0/2450652200 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc0125f0 con 0x7ff9dc0cfcb0 2024-03-29T04:08:57.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.032+0000 7ff9c3fff640 1 -- 172.21.15.73:0/2450652200 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9cc019070 con 0x7ff9dc0cfcb0 2024-03-29T04:08:57.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.032+0000 7ff9e1e7e640 1 -- 172.21.15.73:0/2450652200 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9dc0a1fb0 con 0x7ff9dc0cfcb0 2024-03-29T04:08:57.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.032+0000 7ff9c3fff640 1 -- 172.21.15.73:0/2450652200 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc0129d0 con 0x7ff9dc0cfcb0 2024-03-29T04:08:57.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.032+0000 7ff9e1e7e640 1 -- 172.21.15.73:0/2450652200 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9dc0a2290 con 0x7ff9dc0cfcb0 2024-03-29T04:08:57.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.033+0000 7ff9e1e7e640 1 -- 172.21.15.73:0/2450652200 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9dc068640 con 0x7ff9dc0cfcb0 2024-03-29T04:08:57.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.033+0000 7ff9c3fff640 1 -- 172.21.15.73:0/2450652200 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff9cc012b70 con 0x7ff9dc0cfcb0 2024-03-29T04:08:57.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.034+0000 7ff9c3fff640 1 --2- 172.21.15.73:0/2450652200 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff9c806c530 0x7ff9c806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:57.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.034+0000 7ff9c3fff640 1 -- 172.21.15.73:0/2450652200 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7ff9cc08b700 con 0x7ff9dc0cfcb0 2024-03-29T04:08:57.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.034+0000 7ff9daffd640 1 --2- 172.21.15.73:0/2450652200 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff9c806c530 0x7ff9c806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:57.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.034+0000 7ff9daffd640 1 --2- 172.21.15.73:0/2450652200 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff9c806c530 0x7ff9c806e9f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc0b2e10 tx=0x7ff9d0007cc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:57.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.038+0000 7ff9c3fff640 1 -- 172.21.15.73:0/2450652200 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7ff9cc05a100 con 0x7ff9dc0cfcb0 2024-03-29T04:08:57.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.214+0000 7ff9e1e7e640 1 -- 172.21.15.73:0/2450652200 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff9dc0d1cf0 con 0x7ff9dc0cfcb0 2024-03-29T04:08:57.194 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.215+0000 7ff9c3fff640 1 -- 172.21.15.73:0/2450652200 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) ==== 84+0+65 (secure 0 0 0) 0x7ff9cc059a00 con 0x7ff9dc0cfcb0 2024-03-29T04:08:57.195 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:08:57.195 INFO:teuthology.orchestra.run.smithi073.stdout:[ 2024-03-29T04:08:57.195 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-03-29T04:08:57.195 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 1, 2024-03-29T04:08:57.195 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": ".mgr" 2024-03-29T04:08:57.195 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-29T04:08:57.195 INFO:teuthology.orchestra.run.smithi073.stdout:] 2024-03-29T04:08:57.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.217+0000 7ff9e1e7e640 1 -- 172.21.15.73:0/2450652200 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff9c806c530 msgr2=0x7ff9c806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:57.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.217+0000 7ff9e1e7e640 1 --2- 172.21.15.73:0/2450652200 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff9c806c530 0x7ff9c806e9f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc0b2e10 tx=0x7ff9d0007cc0 comp rx=0 tx=0).stop 2024-03-29T04:08:57.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.217+0000 7ff9e1e7e640 1 -- 172.21.15.73:0/2450652200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9dc0cfcb0 msgr2=0x7ff9dc152b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:57.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.217+0000 7ff9e1e7e640 1 --2- 172.21.15.73:0/2450652200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9dc0cfcb0 0x7ff9dc152b10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc00d5f0 tx=0x7ff9cc00dab0 comp rx=0 tx=0).stop 2024-03-29T04:08:57.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.217+0000 7ff9e1e7e640 1 -- 172.21.15.73:0/2450652200 shutdown_connections 2024-03-29T04:08:57.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.217+0000 7ff9e1e7e640 1 --2- 172.21.15.73:0/2450652200 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff9c806c530 0x7ff9c806e9f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:57.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.217+0000 7ff9e1e7e640 1 --2- 172.21.15.73:0/2450652200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9dc161c70 0x7ff9dc0b8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:57.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.217+0000 7ff9e1e7e640 1 --2- 172.21.15.73:0/2450652200 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff9dc0d15e0 0x7ff9dc0a12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:57.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.217+0000 7ff9e1e7e640 1 --2- 172.21.15.73:0/2450652200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9dc0cfcb0 0x7ff9dc152b10 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:57.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.217+0000 7ff9e1e7e640 1 -- 172.21.15.73:0/2450652200 >> 172.21.15.73:0/2450652200 conn(0x7ff9dc08bfc0 msgr2=0x7ff9dc0b5900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:57.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.217+0000 7ff9e1e7e640 1 -- 172.21.15.73:0/2450652200 shutdown_connections 2024-03-29T04:08:57.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.217+0000 7ff9e1e7e640 1 -- 172.21.15.73:0/2450652200 wait complete. 2024-03-29T04:08:57.207 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-29T04:08:57.207 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-29T04:08:57.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.331+0000 7f0b9c670640 1 Processor -- start 2024-03-29T04:08:57.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.332+0000 7f0b9c670640 1 -- start start 2024-03-29T04:08:57.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.332+0000 7f0b9c670640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0b940b4cf0 0x7f0b9415c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:57.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.332+0000 7f0b9c670640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0b940d0490 0x7f0b940d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:57.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.332+0000 7f0b9c670640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b9415bad0 con 0x7f0b9415b350 2024-03-29T04:08:57.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.332+0000 7f0b9c670640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f0b940d0e20 con 0x7f0b940b4cf0 2024-03-29T04:08:57.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.332+0000 7f0b9c670640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f0b9415bdd0 con 0x7f0b940d0490 2024-03-29T04:08:57.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.333+0000 7f0b99c0b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0b940b4cf0 0x7f0b9415c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:57.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.333+0000 7f0b99c0b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0b940b4cf0 0x7f0b9415c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54576/0 (socket says 172.21.15.73:54576) 2024-03-29T04:08:57.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.333+0000 7f0b9a40c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0b9415b350 0x7f0b9415efb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57386/0 (socket says 172.21.15.73:57386) 2024-03-29T04:08:57.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.333+0000 7f0b99c0b640 1 -- 172.21.15.73:0/4095356172 learned_addr learned my addr 172.21.15.73:0/4095356172 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:57.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.333+0000 7f0b9ac0d640 1 --2- 172.21.15.73:0/4095356172 >> v2:172.21.15.142:3300/0 conn(0x7f0b940d0490 0x7f0b940d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:57.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.333+0000 7f0b99c0b640 1 -- 172.21.15.73:0/4095356172 >> v2:172.21.15.142:3300/0 conn(0x7f0b940d0490 msgr2=0x7f0b940d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:57.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.333+0000 7f0b99c0b640 1 --2- 172.21.15.73:0/4095356172 >> v2:172.21.15.142:3300/0 conn(0x7f0b940d0490 0x7f0b940d08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:57.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.333+0000 7f0b99c0b640 1 -- 172.21.15.73:0/4095356172 >> v1:172.21.15.73:6789/0 conn(0x7f0b9415b350 legacy=0x7f0b9415efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:57.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.333+0000 7f0b99c0b640 1 -- 172.21.15.73:0/4095356172 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b9415f7e0 con 0x7f0b940b4cf0 2024-03-29T04:08:57.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.333+0000 7f0b9940a640 1 -- 172.21.15.73:0/4095356172 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3789548975 0 0) 0x7f0b9415bad0 con 0x7f0b9415b350 2024-03-29T04:08:57.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.334+0000 7f0b99c0b640 1 --2- 172.21.15.73:0/4095356172 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b940b4cf0 0x7f0b9415c260 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0b9406fd50 tx=0x7f0b8402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2750205d5de19eb server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:57.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.334+0000 7f0b9940a640 1 -- 172.21.15.73:0/4095356172 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b84034070 con 0x7f0b940b4cf0 2024-03-29T04:08:57.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.334+0000 7f0b9940a640 1 -- 172.21.15.73:0/4095356172 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b84030860 con 0x7f0b940b4cf0 2024-03-29T04:08:57.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.334+0000 7f0b9940a640 1 -- 172.21.15.73:0/4095356172 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b84030c30 con 0x7f0b940b4cf0 2024-03-29T04:08:57.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.334+0000 7f0b9c670640 1 -- 172.21.15.73:0/4095356172 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b940b4cf0 msgr2=0x7f0b9415c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:57.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.334+0000 7f0b9c670640 1 --2- 172.21.15.73:0/4095356172 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b940b4cf0 0x7f0b9415c260 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0b9406fd50 tx=0x7f0b8402b9a0 comp rx=0 tx=0).stop 2024-03-29T04:08:57.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.334+0000 7f0b9c670640 1 -- 172.21.15.73:0/4095356172 shutdown_connections 2024-03-29T04:08:57.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.334+0000 7f0b9c670640 1 --2- 172.21.15.73:0/4095356172 >> v2:172.21.15.142:3300/0 conn(0x7f0b940d0490 0x7f0b940d08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:57.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.334+0000 7f0b9c670640 1 --2- 172.21.15.73:0/4095356172 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b940b4cf0 0x7f0b9415c260 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:57.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.334+0000 7f0b9c670640 1 -- 172.21.15.73:0/4095356172 >> 172.21.15.73:0/4095356172 conn(0x7f0b9406b6f0 msgr2=0x7f0b9406bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:57.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.334+0000 7f0b9c670640 1 -- 172.21.15.73:0/4095356172 shutdown_connections 2024-03-29T04:08:57.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.334+0000 7f0b9c670640 1 -- 172.21.15.73:0/4095356172 wait complete. 2024-03-29T04:08:57.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.336+0000 7f0b9c670640 1 Processor -- start 2024-03-29T04:08:57.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.336+0000 7f0b9c670640 1 -- start start 2024-03-29T04:08:57.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.336+0000 7f0b9c670640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b940b4cf0 0x7f0b9414fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:57.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.336+0000 7f0b9c670640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b940d0490 0x7f0b941f84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:57.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.336+0000 7f0b9c670640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b9415b350 0x7f0b9406d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:57.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.336+0000 7f0b9c670640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9415b730 con 0x7f0b940d0490 2024-03-29T04:08:57.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.336+0000 7f0b9c670640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9415fda0 con 0x7f0b9415b350 2024-03-29T04:08:57.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.336+0000 7f0b9c670640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f0b9415b8b0 con 0x7f0b940b4cf0 2024-03-29T04:08:57.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.336+0000 7f0b99c0b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b940d0490 0x7f0b941f84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:57.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.336+0000 7f0b99c0b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b940d0490 0x7f0b941f84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54590/0 (socket says 172.21.15.73:54590) 2024-03-29T04:08:57.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.336+0000 7f0b99c0b640 1 -- 172.21.15.73:0/1246962039 learned_addr learned my addr 172.21.15.73:0/1246962039 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:57.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.337+0000 7f0b9ac0d640 1 --2- 172.21.15.73:0/1246962039 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b9415b350 0x7f0b9406d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:57.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.337+0000 7f0b9a40c640 1 --2- 172.21.15.73:0/1246962039 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b940b4cf0 0x7f0b9414fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:57.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.337+0000 7f0b99c0b640 1 -- 172.21.15.73:0/1246962039 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b940b4cf0 msgr2=0x7f0b9414fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:57.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.337+0000 7f0b99c0b640 1 --2- 172.21.15.73:0/1246962039 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b940b4cf0 0x7f0b9414fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:57.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.337+0000 7f0b99c0b640 1 -- 172.21.15.73:0/1246962039 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b9415b350 msgr2=0x7f0b9406d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:57.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.337+0000 7f0b99c0b640 1 --2- 172.21.15.73:0/1246962039 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b9415b350 0x7f0b9406d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:57.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.337+0000 7f0b99c0b640 1 -- 172.21.15.73:0/1246962039 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b941f89f0 con 0x7f0b940d0490 2024-03-29T04:08:57.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.337+0000 7f0b9ac0d640 1 --2- 172.21.15.73:0/1246962039 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b9415b350 0x7f0b9406d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:08:57.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.337+0000 7f0b99c0b640 1 --2- 172.21.15.73:0/1246962039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b940d0490 0x7f0b941f84b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0b8402b9e0 tx=0x7f0b84004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:57.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.337+0000 7f0b8affd640 1 -- 172.21.15.73:0/1246962039 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b84048070 con 0x7f0b940d0490 2024-03-29T04:08:57.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.337+0000 7f0b8affd640 1 -- 172.21.15.73:0/1246962039 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b84030660 con 0x7f0b940d0490 2024-03-29T04:08:57.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.337+0000 7f0b9c670640 1 -- 172.21.15.73:0/1246962039 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b941f48c0 con 0x7f0b940d0490 2024-03-29T04:08:57.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.337+0000 7f0b8affd640 1 -- 172.21.15.73:0/1246962039 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b84034040 con 0x7f0b940d0490 2024-03-29T04:08:57.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.337+0000 7f0b9c670640 1 -- 172.21.15.73:0/1246962039 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b941f4e80 con 0x7f0b940d0490 2024-03-29T04:08:57.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.338+0000 7f0b9c670640 1 -- 172.21.15.73:0/1246962039 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b94068640 con 0x7f0b940d0490 2024-03-29T04:08:57.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.338+0000 7f0b8affd640 1 -- 172.21.15.73:0/1246962039 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f0b8404b070 con 0x7f0b940d0490 2024-03-29T04:08:57.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.339+0000 7f0b8affd640 1 --2- 172.21.15.73:0/1246962039 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f0b7806c530 0x7f0b7806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:57.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.339+0000 7f0b8affd640 1 -- 172.21.15.73:0/1246962039 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f0b840ad490 con 0x7f0b940d0490 2024-03-29T04:08:57.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.339+0000 7f0b9a40c640 1 --2- 172.21.15.73:0/1246962039 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f0b7806c530 0x7f0b7806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:57.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.339+0000 7f0b9a40c640 1 --2- 172.21.15.73:0/1246962039 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f0b7806c530 0x7f0b7806e9f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0b90000f60 tx=0x7f0b90007c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:57.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.343+0000 7f0b8affd640 1 -- 172.21.15.73:0/1246962039 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f0b941f89f0 con 0x7f0b940d0490 2024-03-29T04:08:57.496 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.517+0000 7f0b9c670640 1 -- 172.21.15.73:0/1246962039 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f0b940d0030 con 0x7f0b940d0490 2024-03-29T04:08:57.693 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.713+0000 7f0b8affd640 1 -- 172.21.15.73:0/1246962039 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) ==== 138+0+0 (secure 0 0 0) 0x7f0b8407be00 con 0x7f0b940d0490 2024-03-29T04:08:57.693 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' created 2024-03-29T04:08:57.696 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.716+0000 7f0b9c670640 1 -- 172.21.15.73:0/1246962039 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f0b7806c530 msgr2=0x7f0b7806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:57.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.716+0000 7f0b9c670640 1 --2- 172.21.15.73:0/1246962039 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f0b7806c530 0x7f0b7806e9f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0b90000f60 tx=0x7f0b90007c00 comp rx=0 tx=0).stop 2024-03-29T04:08:57.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.716+0000 7f0b9c670640 1 -- 172.21.15.73:0/1246962039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b940d0490 msgr2=0x7f0b941f84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:57.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.716+0000 7f0b9c670640 1 --2- 172.21.15.73:0/1246962039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b940d0490 0x7f0b941f84b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0b8402b9e0 tx=0x7f0b84004730 comp rx=0 tx=0).stop 2024-03-29T04:08:57.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.716+0000 7f0b9c670640 1 -- 172.21.15.73:0/1246962039 shutdown_connections 2024-03-29T04:08:57.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.716+0000 7f0b9c670640 1 --2- 172.21.15.73:0/1246962039 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f0b7806c530 0x7f0b7806e9f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:57.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.716+0000 7f0b9c670640 1 --2- 172.21.15.73:0/1246962039 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b9415b350 0x7f0b9406d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:57.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.716+0000 7f0b9c670640 1 --2- 172.21.15.73:0/1246962039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b940d0490 0x7f0b941f84b0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:57.697 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.716+0000 7f0b9c670640 1 --2- 172.21.15.73:0/1246962039 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0b940b4cf0 0x7f0b9414fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:57.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.716+0000 7f0b9c670640 1 -- 172.21.15.73:0/1246962039 >> 172.21.15.73:0/1246962039 conn(0x7f0b9406b6f0 msgr2=0x7f0b940b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:57.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.716+0000 7f0b9c670640 1 -- 172.21.15.73:0/1246962039 shutdown_connections 2024-03-29T04:08:57.698 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.716+0000 7f0b9c670640 1 -- 172.21.15.73:0/1246962039 wait complete. 2024-03-29T04:08:57.709 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-29T04:08:57.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.837+0000 7f09fba70640 1 Processor -- start 2024-03-29T04:08:57.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.837+0000 7f09fba70640 1 -- start start 2024-03-29T04:08:57.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.838+0000 7f09fba70640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f09f415e8b0 0x7f09f40b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:57.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.838+0000 7f09fba70640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09f40b6020 0x7f09f40b2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:57.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.838+0000 7f09fba70640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f09f406b510 0x7f09f406b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:57.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.838+0000 7f09fba70640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f09f40b67e0 con 0x7f09f415e8b0 2024-03-29T04:08:57.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.838+0000 7f09fba70640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f09f40b6500 con 0x7f09f406b510 2024-03-29T04:08:57.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.838+0000 7f09fba70640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f09f40b4470 con 0x7f09f40b6020 2024-03-29T04:08:57.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.838+0000 7f09f980c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f09f415e8b0 0x7f09f40b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:57.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.838+0000 7f09f980c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f09f415e8b0 0x7f09f40b2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47000/0 (socket says 172.21.15.73:47000) 2024-03-29T04:08:57.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.838+0000 7f09f980c640 1 -- 172.21.15.73:0/2904392373 learned_addr learned my addr 172.21.15.73:0/2904392373 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:57.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.838+0000 7f09fa00d640 1 --2- 172.21.15.73:0/2904392373 >> v2:172.21.15.142:3300/0 conn(0x7f09f406b510 0x7f09f406b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:57.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.838+0000 7f09f900b640 1 --2- 172.21.15.73:0/2904392373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09f40b6020 0x7f09f40b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:57.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.839+0000 7f09f980c640 1 -- 172.21.15.73:0/2904392373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09f40b6020 msgr2=0x7f09f40b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:57.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.839+0000 7f09f980c640 1 --2- 172.21.15.73:0/2904392373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09f40b6020 0x7f09f40b2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:57.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.839+0000 7f09f980c640 1 -- 172.21.15.73:0/2904392373 >> v2:172.21.15.142:3300/0 conn(0x7f09f406b510 msgr2=0x7f09f406b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:57.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.839+0000 7f09f980c640 1 --2- 172.21.15.73:0/2904392373 >> v2:172.21.15.142:3300/0 conn(0x7f09f406b510 0x7f09f406b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:57.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.839+0000 7f09f980c640 1 -- 172.21.15.73:0/2904392373 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09f40b4750 con 0x7f09f415e8b0 2024-03-29T04:08:57.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.839+0000 7f09f900b640 1 --2- 172.21.15.73:0/2904392373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09f40b6020 0x7f09f40b2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:08:57.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.839+0000 7f09f980c640 1 --2- 172.21.15.73:0/2904392373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09f415e8b0 0x7f09f40b2a40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f09f409b080 tx=0x7f09f002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b46379630bf272b server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:57.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.839+0000 7f09f880a640 1 -- 172.21.15.73:0/2904392373 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f002c9e0 con 0x7f09f415e8b0 2024-03-29T04:08:57.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.840+0000 7f09f880a640 1 -- 172.21.15.73:0/2904392373 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09f002cb80 con 0x7f09f415e8b0 2024-03-29T04:08:57.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.840+0000 7f09f880a640 1 -- 172.21.15.73:0/2904392373 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f00343f0 con 0x7f09f415e8b0 2024-03-29T04:08:57.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.840+0000 7f09fba70640 1 -- 172.21.15.73:0/2904392373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09f415e8b0 msgr2=0x7f09f40b2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:57.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.840+0000 7f09fba70640 1 --2- 172.21.15.73:0/2904392373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09f415e8b0 0x7f09f40b2a40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f09f409b080 tx=0x7f09f002be40 comp rx=0 tx=0).stop 2024-03-29T04:08:57.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.840+0000 7f09fba70640 1 -- 172.21.15.73:0/2904392373 shutdown_connections 2024-03-29T04:08:57.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.840+0000 7f09fba70640 1 --2- 172.21.15.73:0/2904392373 >> v2:172.21.15.142:3300/0 conn(0x7f09f406b510 0x7f09f406b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:57.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.840+0000 7f09fba70640 1 --2- 172.21.15.73:0/2904392373 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09f40b6020 0x7f09f40b2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:57.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.840+0000 7f09fba70640 1 --2- 172.21.15.73:0/2904392373 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09f415e8b0 0x7f09f40b2a40 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:57.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.840+0000 7f09fba70640 1 -- 172.21.15.73:0/2904392373 >> 172.21.15.73:0/2904392373 conn(0x7f09f4072e40 msgr2=0x7f09f40b3040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:57.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.840+0000 7f09fba70640 1 -- 172.21.15.73:0/2904392373 shutdown_connections 2024-03-29T04:08:57.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.840+0000 7f09fba70640 1 -- 172.21.15.73:0/2904392373 wait complete. 2024-03-29T04:08:57.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.841+0000 7f09fba70640 1 Processor -- start 2024-03-29T04:08:57.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.841+0000 7f09fba70640 1 -- start start 2024-03-29T04:08:57.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.842+0000 7f09fba70640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09f406b510 0x7f09f41613a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:57.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.842+0000 7f09fba70640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09f40b6020 0x7f09f413f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:57.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.842+0000 7f09fba70640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09f415e8b0 0x7f09f4141fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:57.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.842+0000 7f09fba70640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f09f40b2680 con 0x7f09f40b6020 2024-03-29T04:08:57.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.842+0000 7f09fba70640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f09f40b4b30 con 0x7f09f415e8b0 2024-03-29T04:08:57.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.842+0000 7f09fba70640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f09f4160950 con 0x7f09f406b510 2024-03-29T04:08:57.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.842+0000 7f09f900b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09f40b6020 0x7f09f413f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:57.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.842+0000 7f09f900b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09f40b6020 0x7f09f413f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47016/0 (socket says 172.21.15.73:47016) 2024-03-29T04:08:57.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.842+0000 7f09f900b640 1 -- 172.21.15.73:0/484061945 learned_addr learned my addr 172.21.15.73:0/484061945 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:57.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.842+0000 7f09f980c640 1 --2- 172.21.15.73:0/484061945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09f406b510 0x7f09f41613a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:57.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.842+0000 7f09fa00d640 1 --2- 172.21.15.73:0/484061945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09f415e8b0 0x7f09f4141fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:57.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.842+0000 7f09f900b640 1 -- 172.21.15.73:0/484061945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09f406b510 msgr2=0x7f09f41613a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:57.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.842+0000 7f09f900b640 1 --2- 172.21.15.73:0/484061945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09f406b510 0x7f09f41613a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:57.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.842+0000 7f09f900b640 1 -- 172.21.15.73:0/484061945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09f415e8b0 msgr2=0x7f09f4141fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:57.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.842+0000 7f09f900b640 1 --2- 172.21.15.73:0/484061945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09f415e8b0 0x7f09f4141fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:57.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.842+0000 7f09f900b640 1 -- 172.21.15.73:0/484061945 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09f41618e0 con 0x7f09f40b6020 2024-03-29T04:08:57.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.842+0000 7f09f980c640 1 --2- 172.21.15.73:0/484061945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09f406b510 0x7f09f41613a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:08:57.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.843+0000 7f09f900b640 1 --2- 172.21.15.73:0/484061945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09f40b6020 0x7f09f413f6b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f09e400e7e0 tx=0x7f09e400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:57.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.843+0000 7f09ea7fc640 1 -- 172.21.15.73:0/484061945 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e400f040 con 0x7f09f40b6020 2024-03-29T04:08:57.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.843+0000 7f09ea7fc640 1 -- 172.21.15.73:0/484061945 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09e4004030 con 0x7f09f40b6020 2024-03-29T04:08:57.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.843+0000 7f09fba70640 1 -- 172.21.15.73:0/484061945 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09f413fbf0 con 0x7f09f40b6020 2024-03-29T04:08:57.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.843+0000 7f09ea7fc640 1 -- 172.21.15.73:0/484061945 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09e4004400 con 0x7f09f40b6020 2024-03-29T04:08:57.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.843+0000 7f09fba70640 1 -- 172.21.15.73:0/484061945 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09f4158420 con 0x7f09f40b6020 2024-03-29T04:08:57.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.844+0000 7f09fba70640 1 -- 172.21.15.73:0/484061945 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09f409f6a0 con 0x7f09f40b6020 2024-03-29T04:08:57.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.844+0000 7f09ea7fc640 1 -- 172.21.15.73:0/484061945 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f09e400c6d0 con 0x7f09f40b6020 2024-03-29T04:08:57.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.845+0000 7f09ea7fc640 1 --2- 172.21.15.73:0/484061945 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f09d806c560 0x7f09d806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:57.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.845+0000 7f09ea7fc640 1 -- 172.21.15.73:0/484061945 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5227+0+0 (secure 0 0 0) 0x7f09e408b2e0 con 0x7f09f40b6020 2024-03-29T04:08:57.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.845+0000 7f09f980c640 1 --2- 172.21.15.73:0/484061945 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f09d806c560 0x7f09d806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:57.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.845+0000 7f09f980c640 1 --2- 172.21.15.73:0/484061945 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f09d806c560 0x7f09d806ea20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f09f0035000 tx=0x7f09f0030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:57.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:57.849+0000 7f09ea7fc640 1 -- 172.21.15.73:0/484061945 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f09e4017020 con 0x7f09f40b6020 2024-03-29T04:08:58.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.023+0000 7f09fba70640 1 -- 172.21.15.73:0/484061945 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f09f404f9d0 con 0x7f09f40b6020 2024-03-29T04:08:58.700 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.720+0000 7f09ea7fc640 1 -- 172.21.15.73:0/484061945 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) ==== 170+0+0 (secure 0 0 0) 0x7f09e4059ae0 con 0x7f09f40b6020 2024-03-29T04:08:58.700 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' created 2024-03-29T04:08:58.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.723+0000 7f09fba70640 1 -- 172.21.15.73:0/484061945 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f09d806c560 msgr2=0x7f09d806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:58.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.723+0000 7f09fba70640 1 --2- 172.21.15.73:0/484061945 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f09d806c560 0x7f09d806ea20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f09f0035000 tx=0x7f09f0030000 comp rx=0 tx=0).stop 2024-03-29T04:08:58.703 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.723+0000 7f09fba70640 1 -- 172.21.15.73:0/484061945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09f40b6020 msgr2=0x7f09f413f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:58.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.723+0000 7f09fba70640 1 --2- 172.21.15.73:0/484061945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09f40b6020 0x7f09f413f6b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f09e400e7e0 tx=0x7f09e400eca0 comp rx=0 tx=0).stop 2024-03-29T04:08:58.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.724+0000 7f09fba70640 1 -- 172.21.15.73:0/484061945 shutdown_connections 2024-03-29T04:08:58.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.724+0000 7f09fba70640 1 --2- 172.21.15.73:0/484061945 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f09d806c560 0x7f09d806ea20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:58.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.724+0000 7f09fba70640 1 --2- 172.21.15.73:0/484061945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f09f415e8b0 0x7f09f4141fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:58.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.724+0000 7f09fba70640 1 --2- 172.21.15.73:0/484061945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09f40b6020 0x7f09f413f6b0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:58.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.724+0000 7f09fba70640 1 --2- 172.21.15.73:0/484061945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f09f406b510 0x7f09f41613a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:58.704 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.724+0000 7f09fba70640 1 -- 172.21.15.73:0/484061945 >> 172.21.15.73:0/484061945 conn(0x7f09f4072e40 msgr2=0x7f09f406fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:58.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.727+0000 7f09fba70640 1 -- 172.21.15.73:0/484061945 shutdown_connections 2024-03-29T04:08:58.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.727+0000 7f09fba70640 1 -- 172.21.15.73:0/484061945 wait complete. 2024-03-29T04:08:58.728 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-29T04:08:58.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.854+0000 7f49ec132640 1 Processor -- start 2024-03-29T04:08:58.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.854+0000 7f49ec132640 1 -- start start 2024-03-29T04:08:58.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.854+0000 7f49ec132640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f49e415b4f0 0x7f49e40c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:58.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.854+0000 7f49ec132640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49e415bd30 con 0x7f49e415b8d0 2024-03-29T04:08:58.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.854+0000 7f49ec132640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49e415bfa0 con 0x7f49e40b2100 2024-03-29T04:08:58.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.854+0000 7f49ec132640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f49e415c280 con 0x7f49e415b4f0 2024-03-29T04:08:58.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.855+0000 7f49e96cd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f49e415b8d0 0x7f49e40ca950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57376/0 (socket says 172.21.15.73:57376) 2024-03-29T04:08:58.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.855+0000 7f49e96cd640 1 -- 172.21.15.73:0/2212569235 learned_addr learned my addr 172.21.15.73:0/2212569235 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:58.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.855+0000 7f49e9ece640 1 --2- 172.21.15.73:0/2212569235 >> v2:172.21.15.142:3300/0 conn(0x7f49e415b4f0 0x7f49e40c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:58.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.855+0000 7f49e8ecc640 1 -- 172.21.15.73:0/2212569235 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3213670367 0 0) 0x7f49e415bd30 con 0x7f49e415b8d0 2024-03-29T04:08:58.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.855+0000 7f49e8ecc640 1 -- 172.21.15.73:0/2212569235 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49d0003520 con 0x7f49e415b8d0 2024-03-29T04:08:58.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.855+0000 7f49e8ecc640 1 -- 172.21.15.73:0/2212569235 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3298116296 0 0) 0x7f49e415bfa0 con 0x7f49e40b2100 2024-03-29T04:08:58.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.855+0000 7f49e8ecc640 1 -- 172.21.15.73:0/2212569235 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49e415bd30 con 0x7f49e40b2100 2024-03-29T04:08:58.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.855+0000 7f49e9ece640 1 -- 172.21.15.73:0/2212569235 >> v1:172.21.15.142:6789/0 conn(0x7f49e40b2100 legacy=0x7f49e40ce170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:58.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.855+0000 7f49e9ece640 1 -- 172.21.15.73:0/2212569235 >> v1:172.21.15.73:6789/0 conn(0x7f49e415b8d0 legacy=0x7f49e40ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:58.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.855+0000 7f49e8ecc640 1 -- 172.21.15.73:0/2212569235 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1085007584 0 0) 0x7f49d0003520 con 0x7f49e415b8d0 2024-03-29T04:08:58.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.855+0000 7f49e9ece640 1 -- 172.21.15.73:0/2212569235 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e415c560 con 0x7f49e415b4f0 2024-03-29T04:08:58.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.856+0000 7f49e9ece640 1 --2- 172.21.15.73:0/2212569235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49e415b4f0 0x7f49e40c6c50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f49dc0097a0 tx=0x7f49dc02b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d2c0a4e780392f4 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:58.836 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.856+0000 7f49e8ecc640 1 -- 172.21.15.73:0/2212569235 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49dc037070 con 0x7f49e415b4f0 2024-03-29T04:08:58.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.856+0000 7f49e8ecc640 1 -- 172.21.15.73:0/2212569235 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49dc030510 con 0x7f49e415b4f0 2024-03-29T04:08:58.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.856+0000 7f49e8ecc640 1 -- 172.21.15.73:0/2212569235 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d4001670 con 0x7f49e415b4f0 2024-03-29T04:08:58.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.856+0000 7f49ec132640 1 -- 172.21.15.73:0/2212569235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49e415b4f0 msgr2=0x7f49e40c6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:58.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.856+0000 7f49ec132640 1 --2- 172.21.15.73:0/2212569235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49e415b4f0 0x7f49e40c6c50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f49dc0097a0 tx=0x7f49dc02b790 comp rx=0 tx=0).stop 2024-03-29T04:08:58.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.857+0000 7f49ec132640 1 -- 172.21.15.73:0/2212569235 shutdown_connections 2024-03-29T04:08:58.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.857+0000 7f49ec132640 1 --2- 172.21.15.73:0/2212569235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49e415b4f0 0x7f49e40c6c50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:58.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.857+0000 7f49ec132640 1 -- 172.21.15.73:0/2212569235 >> 172.21.15.73:0/2212569235 conn(0x7f49e40d0450 msgr2=0x7f49e40d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:58.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.857+0000 7f49ec132640 1 -- 172.21.15.73:0/2212569235 shutdown_connections 2024-03-29T04:08:58.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.857+0000 7f49ec132640 1 -- 172.21.15.73:0/2212569235 wait complete. 2024-03-29T04:08:58.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.858+0000 7f49ec132640 1 Processor -- start 2024-03-29T04:08:58.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.858+0000 7f49ec132640 1 -- start start 2024-03-29T04:08:58.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.858+0000 7f49ec132640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49e40b2100 0x7f49e415a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:58.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.858+0000 7f49ec132640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49e415b4f0 0x7f49e4158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:58.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.858+0000 7f49ec132640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49e415b8d0 0x7f49e41492d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:58.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.858+0000 7f49ec132640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f49e40b4d50 con 0x7f49e40b2100 2024-03-29T04:08:58.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.858+0000 7f49ec132640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f49e40b4bd0 con 0x7f49e415b8d0 2024-03-29T04:08:58.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.858+0000 7f49ec132640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f49e40ce880 con 0x7f49e415b4f0 2024-03-29T04:08:58.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.859+0000 7f49e9ece640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49e40b2100 0x7f49e415a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:58.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.859+0000 7f49e9ece640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49e40b2100 0x7f49e415a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47030/0 (socket says 172.21.15.73:47030) 2024-03-29T04:08:58.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.859+0000 7f49e9ece640 1 -- 172.21.15.73:0/1259357990 learned_addr learned my addr 172.21.15.73:0/1259357990 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:58.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.859+0000 7f49e96cd640 1 --2- 172.21.15.73:0/1259357990 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49e415b4f0 0x7f49e4158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:58.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.859+0000 7f49ea6cf640 1 --2- 172.21.15.73:0/1259357990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49e415b8d0 0x7f49e41492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:58.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.859+0000 7f49e9ece640 1 -- 172.21.15.73:0/1259357990 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49e415b4f0 msgr2=0x7f49e4158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:58.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.859+0000 7f49e9ece640 1 --2- 172.21.15.73:0/1259357990 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49e415b4f0 0x7f49e4158fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:58.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.859+0000 7f49e9ece640 1 -- 172.21.15.73:0/1259357990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49e415b8d0 msgr2=0x7f49e41492d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:58.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.859+0000 7f49e9ece640 1 --2- 172.21.15.73:0/1259357990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49e415b8d0 0x7f49e41492d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:58.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.859+0000 7f49e9ece640 1 -- 172.21.15.73:0/1259357990 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e4072fa0 con 0x7f49e40b2100 2024-03-29T04:08:58.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.859+0000 7f49e9ece640 1 --2- 172.21.15.73:0/1259357990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49e40b2100 0x7f49e415a640 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f49dc02b7d0 tx=0x7f49dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:58.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.859+0000 7f49da7fc640 1 -- 172.21.15.73:0/1259357990 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49dc041020 con 0x7f49e40b2100 2024-03-29T04:08:58.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.859+0000 7f49da7fc640 1 -- 172.21.15.73:0/1259357990 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49dc03c870 con 0x7f49e40b2100 2024-03-29T04:08:58.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.859+0000 7f49ec132640 1 -- 172.21.15.73:0/1259357990 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49e4159ae0 con 0x7f49e40b2100 2024-03-29T04:08:58.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.859+0000 7f49da7fc640 1 -- 172.21.15.73:0/1259357990 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49dc037040 con 0x7f49e40b2100 2024-03-29T04:08:58.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.859+0000 7f49ec132640 1 -- 172.21.15.73:0/1259357990 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49e415a0a0 con 0x7f49e40b2100 2024-03-29T04:08:58.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.860+0000 7f49ec132640 1 -- 172.21.15.73:0/1259357990 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49e409e520 con 0x7f49e40b2100 2024-03-29T04:08:58.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.861+0000 7f49da7fc640 1 -- 172.21.15.73:0/1259357990 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f49dc044020 con 0x7f49e40b2100 2024-03-29T04:08:58.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.861+0000 7f49da7fc640 1 --2- 172.21.15.73:0/1259357990 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f49c806c530 0x7f49c806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:58.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.861+0000 7f49da7fc640 1 -- 172.21.15.73:0/1259357990 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5609+0+0 (secure 0 0 0) 0x7f49dc0acf70 con 0x7f49e40b2100 2024-03-29T04:08:58.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.861+0000 7f49e96cd640 1 --2- 172.21.15.73:0/1259357990 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f49c806c530 0x7f49c806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:58.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.862+0000 7f49e96cd640 1 --2- 172.21.15.73:0/1259357990 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f49c806c530 0x7f49c806e9f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f49e41f3ac0 tx=0x7f49d4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:58.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:58.866+0000 7f49da7fc640 1 -- 172.21.15.73:0/1259357990 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f49dc04b030 con 0x7f49e40b2100 2024-03-29T04:08:59.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.077+0000 7f49ec132640 1 -- 172.21.15.73:0/1259357990 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f49e404f9d0 con 0x7f49e40b2100 2024-03-29T04:08:59.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.733+0000 7f49da7fc640 1 -- 172.21.15.73:0/1259357990 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) ==== 172+0+0 (secure 0 0 0) 0x7f49dc07b680 con 0x7f49e40b2100 2024-03-29T04:08:59.713 INFO:teuthology.orchestra.run.smithi073.stderr:new fs with metadata pool 4 and data pool 5 2024-03-29T04:08:59.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.740+0000 7f49ec132640 1 -- 172.21.15.73:0/1259357990 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f49c806c530 msgr2=0x7f49c806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:59.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.740+0000 7f49ec132640 1 --2- 172.21.15.73:0/1259357990 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f49c806c530 0x7f49c806e9f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f49e41f3ac0 tx=0x7f49d4009040 comp rx=0 tx=0).stop 2024-03-29T04:08:59.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.740+0000 7f49ec132640 1 -- 172.21.15.73:0/1259357990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49e40b2100 msgr2=0x7f49e415a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:59.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.740+0000 7f49ec132640 1 --2- 172.21.15.73:0/1259357990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49e40b2100 0x7f49e415a640 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f49dc02b7d0 tx=0x7f49dc0046c0 comp rx=0 tx=0).stop 2024-03-29T04:08:59.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.741+0000 7f49ec132640 1 -- 172.21.15.73:0/1259357990 shutdown_connections 2024-03-29T04:08:59.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.741+0000 7f49ec132640 1 --2- 172.21.15.73:0/1259357990 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f49c806c530 0x7f49c806e9f0 secure :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f49e41f3ac0 tx=0x7f49d4009040 comp rx=0 tx=0).stop 2024-03-29T04:08:59.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.741+0000 7f49ec132640 1 --2- 172.21.15.73:0/1259357990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49e415b8d0 0x7f49e41492d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:59.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.741+0000 7f49ec132640 1 --2- 172.21.15.73:0/1259357990 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f49e415b4f0 0x7f49e4158fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:59.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.741+0000 7f49ec132640 1 --2- 172.21.15.73:0/1259357990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f49e40b2100 0x7f49e415a640 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:59.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.741+0000 7f49ec132640 1 -- 172.21.15.73:0/1259357990 >> 172.21.15.73:0/1259357990 conn(0x7f49e40d0450 msgr2=0x7f49e40cb980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:59.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.744+0000 7f49ec132640 1 -- 172.21.15.73:0/1259357990 shutdown_connections 2024-03-29T04:08:59.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.746+0000 7f49ec132640 1 -- 172.21.15.73:0/1259357990 wait complete. 2024-03-29T04:08:59.744 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-29T04:08:59.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.867+0000 7ff16498d640 1 Processor -- start 2024-03-29T04:08:59.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.867+0000 7ff16498d640 1 -- start start 2024-03-29T04:08:59.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.867+0000 7ff16498d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff16015b370 0x7ff1600b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:59.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.867+0000 7ff16498d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff160073290 0x7ff16015f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:59.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.867+0000 7ff16498d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff160071ae0 con 0x7ff16006f3f0 2024-03-29T04:08:59.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.867+0000 7ff16498d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7ff160071dc0 con 0x7ff160073290 2024-03-29T04:08:59.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.867+0000 7ff16498d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff1600720a0 con 0x7ff16015b370 2024-03-29T04:08:59.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.868+0000 7ff15e59c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff16015b370 0x7ff1600b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:59.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.868+0000 7ff15ed9d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff160073290 0x7ff16015f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:59.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.868+0000 7ff155d9b640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7ff16006f3f0 0x7ff160072b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.73:33510/0 (socket says 172.21.15.73:33510) 2024-03-29T04:08:59.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.868+0000 7ff155d9b640 1 -- 172.21.15.73:0/3886813258 learned_addr learned my addr 172.21.15.73:0/3886813258 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:08:59.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.868+0000 7ff15ed9d640 1 -- 172.21.15.73:0/3886813258 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff16015b370 msgr2=0x7ff1600b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:08:59.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.868+0000 7ff15ed9d640 1 --2- 172.21.15.73:0/3886813258 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff16015b370 0x7ff1600b32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:59.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.868+0000 7ff15ed9d640 1 -- 172.21.15.73:0/3886813258 >> v1:172.21.15.142:6789/0 conn(0x7ff16006f3f0 legacy=0x7ff160072b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:59.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.868+0000 7ff15ed9d640 1 -- 172.21.15.73:0/3886813258 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff160072380 con 0x7ff160073290 2024-03-29T04:08:59.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.868+0000 7ff15e59c640 1 --2- 172.21.15.73:0/3886813258 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff16015b370 0x7ff1600b32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:08:59.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.869+0000 7ff15ed9d640 1 --2- 172.21.15.73:0/3886813258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff160073290 0x7ff16015f0a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff158009d90 tx=0x7ff15802bce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9648859c8d581a6f server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:59.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.869+0000 7ff15dd9b640 1 -- 172.21.15.73:0/3886813258 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff158039070 con 0x7ff160073290 2024-03-29T04:08:59.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.869+0000 7ff15dd9b640 1 -- 172.21.15.73:0/3886813258 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff15802ca10 con 0x7ff160073290 2024-03-29T04:08:59.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.869+0000 7ff15dd9b640 1 -- 172.21.15.73:0/3886813258 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff15802cde0 con 0x7ff160073290 2024-03-29T04:08:59.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.870+0000 7ff16498d640 1 -- 172.21.15.73:0/3886813258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff160073290 msgr2=0x7ff16015f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:59.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.870+0000 7ff16498d640 1 --2- 172.21.15.73:0/3886813258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff160073290 0x7ff16015f0a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff158009d90 tx=0x7ff15802bce0 comp rx=0 tx=0).stop 2024-03-29T04:08:59.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.870+0000 7ff16498d640 1 -- 172.21.15.73:0/3886813258 shutdown_connections 2024-03-29T04:08:59.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.870+0000 7ff16498d640 1 --2- 172.21.15.73:0/3886813258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff160073290 0x7ff16015f0a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:59.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.870+0000 7ff16498d640 1 --2- 172.21.15.73:0/3886813258 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff16015b370 0x7ff1600b32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:59.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.870+0000 7ff16498d640 1 -- 172.21.15.73:0/3886813258 >> 172.21.15.73:0/3886813258 conn(0x7ff16006b510 msgr2=0x7ff16006b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:08:59.851 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.870+0000 7ff16498d640 1 -- 172.21.15.73:0/3886813258 shutdown_connections 2024-03-29T04:08:59.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.870+0000 7ff16498d640 1 -- 172.21.15.73:0/3886813258 wait complete. 2024-03-29T04:08:59.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.872+0000 7ff16498d640 1 Processor -- start 2024-03-29T04:08:59.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.872+0000 7ff16498d640 1 -- start start 2024-03-29T04:08:59.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.872+0000 7ff16498d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff16006f3f0 0x7ff16015cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:59.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.872+0000 7ff16498d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff160073290 0x7ff16015dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:59.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.872+0000 7ff16498d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff16015b370 0x7ff1600ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:59.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.872+0000 7ff16498d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff1600b3980 con 0x7ff160073290 2024-03-29T04:08:59.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.872+0000 7ff16498d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff1600b3800 con 0x7ff16006f3f0 2024-03-29T04:08:59.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.872+0000 7ff16498d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff16015b750 con 0x7ff16015b370 2024-03-29T04:08:59.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.872+0000 7ff155d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff160073290 0x7ff16015dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:59.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.872+0000 7ff155d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff160073290 0x7ff16015dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47038/0 (socket says 172.21.15.73:47038) 2024-03-29T04:08:59.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.872+0000 7ff155d9b640 1 -- 172.21.15.73:0/2219062843 learned_addr learned my addr 172.21.15.73:0/2219062843 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:08:59.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.873+0000 7ff15e59c640 1 --2- 172.21.15.73:0/2219062843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff16006f3f0 0x7ff16015cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:59.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.873+0000 7ff15ed9d640 1 --2- 172.21.15.73:0/2219062843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff16015b370 0x7ff1600ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:59.854 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.873+0000 7ff155d9b640 1 -- 172.21.15.73:0/2219062843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff16015b370 msgr2=0x7ff1600ceeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:59.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.873+0000 7ff155d9b640 1 --2- 172.21.15.73:0/2219062843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff16015b370 0x7ff1600ceeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:59.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.873+0000 7ff155d9b640 1 -- 172.21.15.73:0/2219062843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff16006f3f0 msgr2=0x7ff16015cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:08:59.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.873+0000 7ff155d9b640 1 --2- 172.21.15.73:0/2219062843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff16006f3f0 0x7ff16015cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:08:59.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.873+0000 7ff155d9b640 1 -- 172.21.15.73:0/2219062843 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff16015bff0 con 0x7ff160073290 2024-03-29T04:08:59.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.873+0000 7ff15e59c640 1 --2- 172.21.15.73:0/2219062843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff16006f3f0 0x7ff16015cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:08:59.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.873+0000 7ff155d9b640 1 --2- 172.21.15.73:0/2219062843 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff160073290 0x7ff16015dc10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff14800c780 tx=0x7ff14800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:59.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.873+0000 7ff1577fe640 1 -- 172.21.15.73:0/2219062843 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff148018070 con 0x7ff160073290 2024-03-29T04:08:59.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.873+0000 7ff1577fe640 1 -- 172.21.15.73:0/2219062843 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1480072d0 con 0x7ff160073290 2024-03-29T04:08:59.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.873+0000 7ff1577fe640 1 -- 172.21.15.73:0/2219062843 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1480047e0 con 0x7ff160073290 2024-03-29T04:08:59.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.873+0000 7ff16498d640 1 -- 172.21.15.73:0/2219062843 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff16015c2d0 con 0x7ff160073290 2024-03-29T04:08:59.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.873+0000 7ff16498d640 1 -- 172.21.15.73:0/2219062843 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff16015a720 con 0x7ff160073290 2024-03-29T04:08:59.855 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.874+0000 7ff16498d640 1 -- 172.21.15.73:0/2219062843 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff160068640 con 0x7ff160073290 2024-03-29T04:08:59.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.875+0000 7ff1577fe640 1 -- 172.21.15.73:0/2219062843 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff14801b070 con 0x7ff160073290 2024-03-29T04:08:59.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.875+0000 7ff1577fe640 1 --2- 172.21.15.73:0/2219062843 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff14006c560 0x7ff14006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:08:59.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.875+0000 7ff15e59c640 1 --2- 172.21.15.73:0/2219062843 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff14006c560 0x7ff14006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:08:59.856 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.875+0000 7ff1577fe640 1 -- 172.21.15.73:0/2219062843 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7ff14808aa00 con 0x7ff160073290 2024-03-29T04:08:59.857 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.876+0000 7ff15e59c640 1 --2- 172.21.15.73:0/2219062843 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff14006c560 0x7ff14006ea20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff16006f260 tx=0x7ff150008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:08:59.859 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:08:59.880+0000 7ff1577fe640 1 -- 172.21.15.73:0/2219062843 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7ff148058a90 con 0x7ff160073290 2024-03-29T04:09:00.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.055+0000 7ff16498d640 1 -- 172.21.15.73:0/2219062843 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff1600d0000 con 0x7ff160073290 2024-03-29T04:09:00.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.056+0000 7ff1577fe640 1 -- 172.21.15.73:0/2219062843 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16682 (secure 0 0 0) 0x7ff14805cd90 con 0x7ff160073290 2024-03-29T04:09:00.035 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:09:00.036 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":31,"fsid":"6bff1617-b138-4517-acca-3ecaae3f2bb3","created":"2024-03-29T04:07:47.346864+0000","modified":"2024-03-29T04:08:59.078850+0000","last_up_change":"2024-03-29T04:07:58.507139+0000","last_in_change":"2024-03-29T04:07:49.637816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-29T04:07:59.537301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-29T04:08:57.521498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-29T04:08:58.027631+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"925d7de1-14ab-48c0-aebd-7bded108f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6820","nonce":2387335359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6824","nonce":2387335359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6831","nonce":2387335359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6828","nonce":2387335359}]},"public_addr":"172.21.15.73:6820/2387335359","cluster_addr":"172.21.15.73:6824/2387335359","heartbeat_back_addr":"172.21.15.73:6831/2387335359","heartbeat_front_addr":"172.21.15.73:6828/2387335359","state":["exists","up"]},{"osd":1,"uuid":"6b182102-882a-4e0c-99db-0afae5cfb38b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6801","nonce":2431315515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6803","nonce":2431315515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6807","nonce":2431315515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6805","nonce":2431315515}]},"public_addr":"172.21.15.73:6801/2431315515","cluster_addr":"172.21.15.73:6803/2431315515","heartbeat_back_addr":"172.21.15.73:6807/2431315515","heartbeat_front_addr":"172.21.15.73:6805/2431315515","state":["exists","up"]},{"osd":2,"uuid":"8040902e-b0b8-4a21-bf64-ce1c222115ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6809","nonce":407236597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6811","nonce":407236597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6815","nonce":407236597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6813","nonce":407236597}]},"public_addr":"172.21.15.73:6809/407236597","cluster_addr":"172.21.15.73:6811/407236597","heartbeat_back_addr":"172.21.15.73:6815/407236597","heartbeat_front_addr":"172.21.15.73:6813/407236597","state":["exists","up"]},{"osd":3,"uuid":"1bab19ee-3775-4ce1-a4ce-cf7cda3bbbf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6817","nonce":4291100709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6821","nonce":4291100709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6829","nonce":4291100709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6825","nonce":4291100709}]},"public_addr":"172.21.15.73:6817/4291100709","cluster_addr":"172.21.15.73:6821/4291100709","heartbeat_back_addr":"172.21.15.73:6829/4291100709","heartbeat_front_addr":"172.21.15.73:6825/4291100709","state":["exists","up"]},{"osd":4,"uuid":"b0c74337-8fe4-47dc-b3da-2d07591b1f6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6817","nonce":3703256194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6819","nonce":3703256194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6823","nonce":3703256194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6821","nonce":3703256194}]},"public_addr":"172.21.15.142:6817/3703256194","cluster_addr":"172.21.15.142:6819/3703256194","heartbeat_back_addr":"172.21.15.142:6823/3703256194","heartbeat_front_addr":"172.21.15.142:6821/3703256194","state":["exists","up"]},{"osd":5,"uuid":"9ce36410-a29a-42c6-99f4-f95d4afdd7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6825","nonce":4271575803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6827","nonce":4271575803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6831","nonce":4271575803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6829","nonce":4271575803}]},"public_addr":"172.21.15.142:6825/4271575803","cluster_addr":"172.21.15.142:6827/4271575803","heartbeat_back_addr":"172.21.15.142:6831/4271575803","heartbeat_front_addr":"172.21.15.142:6829/4271575803","state":["exists","up"]},{"osd":6,"uuid":"aec4264a-64ac-428e-a860-d2920a304019","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6801","nonce":1772722570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6803","nonce":1772722570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6807","nonce":1772722570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6805","nonce":1772722570}]},"public_addr":"172.21.15.142:6801/1772722570","cluster_addr":"172.21.15.142:6803/1772722570","heartbeat_back_addr":"172.21.15.142:6807/1772722570","heartbeat_front_addr":"172.21.15.142:6805/1772722570","state":["exists","up"]},{"osd":7,"uuid":"fe599052-8e5a-4c7a-91e7-52d1bae24a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6809","nonce":3910589675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6811","nonce":3910589675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6815","nonce":3910589675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6813","nonce":3910589675}]},"public_addr":"172.21.15.142:6809/3910589675","cluster_addr":"172.21.15.142:6811/3910589675","heartbeat_back_addr":"172.21.15.142:6815/3910589675","heartbeat_front_addr":"172.21.15.142:6813/3910589675","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.835096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.587210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.786547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.778004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.843740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.791160+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.837992+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.718722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:09:00.037 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.058+0000 7ff16498d640 1 -- 172.21.15.73:0/2219062843 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff14006c560 msgr2=0x7ff14006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:00.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.058+0000 7ff16498d640 1 --2- 172.21.15.73:0/2219062843 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff14006c560 0x7ff14006ea20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff16006f260 tx=0x7ff150008040 comp rx=0 tx=0).stop 2024-03-29T04:09:00.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.058+0000 7ff16498d640 1 -- 172.21.15.73:0/2219062843 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff160073290 msgr2=0x7ff16015dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:00.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.058+0000 7ff16498d640 1 --2- 172.21.15.73:0/2219062843 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff160073290 0x7ff16015dc10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff14800c780 tx=0x7ff14800cc40 comp rx=0 tx=0).stop 2024-03-29T04:09:00.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.058+0000 7ff16498d640 1 -- 172.21.15.73:0/2219062843 shutdown_connections 2024-03-29T04:09:00.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.058+0000 7ff16498d640 1 --2- 172.21.15.73:0/2219062843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff16015b370 0x7ff1600ceeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:00.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.058+0000 7ff16498d640 1 --2- 172.21.15.73:0/2219062843 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff160073290 0x7ff16015dc10 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:00.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.058+0000 7ff16498d640 1 --2- 172.21.15.73:0/2219062843 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff14006c560 0x7ff14006ea20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:00.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.058+0000 7ff16498d640 1 --2- 172.21.15.73:0/2219062843 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff16006f3f0 0x7ff16015cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:00.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.058+0000 7ff16498d640 1 -- 172.21.15.73:0/2219062843 >> 172.21.15.73:0/2219062843 conn(0x7ff16006b510 msgr2=0x7ff1600b12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:00.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.058+0000 7ff16498d640 1 -- 172.21.15.73:0/2219062843 shutdown_connections 2024-03-29T04:09:00.038 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.058+0000 7ff16498d640 1 -- 172.21.15.73:0/2219062843 wait complete. 2024-03-29T04:09:00.049 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-29T04:09:00.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.170+0000 7fe421359640 1 Processor -- start 2024-03-29T04:09:00.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.170+0000 7fe421359640 1 -- start start 2024-03-29T04:09:00.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.170+0000 7fe421359640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe41c15e930 0x7fe41c0cf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:00.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.170+0000 7fe421359640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe41c0cf670 0x7fe41c0d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:00.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.170+0000 7fe421359640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe41c0cfb30 con 0x7fe41c0b3c50 2024-03-29T04:09:00.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.170+0000 7fe421359640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fe41c06c780 con 0x7fe41c15e930 2024-03-29T04:09:00.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.170+0000 7fe421359640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe41c0cfe10 con 0x7fe41c0cf670 2024-03-29T04:09:00.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.171+0000 7fe41affd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe41c15e930 0x7fe41c0cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:00.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.171+0000 7fe41b7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe41c0b3c50 0x7fe41c0d0c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57390/0 (socket says 172.21.15.73:57390) 2024-03-29T04:09:00.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.171+0000 7fe41b7fe640 1 -- 172.21.15.73:0/3222780474 learned_addr learned my addr 172.21.15.73:0/3222780474 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:09:00.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.171+0000 7fe41a7fc640 1 --2- 172.21.15.73:0/3222780474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe41c0cf670 0x7fe41c0d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:00.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.171+0000 7fe41affd640 1 -- 172.21.15.73:0/3222780474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe41c0cf670 msgr2=0x7fe41c0d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:00.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.171+0000 7fe419ffb640 1 -- 172.21.15.73:0/3222780474 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1123636155 0 0) 0x7fe41c0cfb30 con 0x7fe41c0b3c50 2024-03-29T04:09:00.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.171+0000 7fe41affd640 1 --2- 172.21.15.73:0/3222780474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe41c0cf670 0x7fe41c0d2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:00.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.171+0000 7fe41affd640 1 -- 172.21.15.73:0/3222780474 >> v1:172.21.15.73:6789/0 conn(0x7fe41c0b3c50 legacy=0x7fe41c0d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:00.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.171+0000 7fe41affd640 1 -- 172.21.15.73:0/3222780474 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe41c0d00f0 con 0x7fe41c15e930 2024-03-29T04:09:00.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.171+0000 7fe41a7fc640 1 --2- 172.21.15.73:0/3222780474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe41c0cf670 0x7fe41c0d2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:09:00.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.172+0000 7fe41affd640 1 --2- 172.21.15.73:0/3222780474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe41c15e930 0x7fe41c0cf130 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe4100097a0 tx=0x7fe41002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48a4dec4dda8850f server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:00.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.172+0000 7fe419ffb640 1 -- 172.21.15.73:0/3222780474 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4100315a0 con 0x7fe41c15e930 2024-03-29T04:09:00.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.172+0000 7fe419ffb640 1 -- 172.21.15.73:0/3222780474 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe410037070 con 0x7fe41c15e930 2024-03-29T04:09:00.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.172+0000 7fe419ffb640 1 -- 172.21.15.73:0/3222780474 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe410031960 con 0x7fe41c15e930 2024-03-29T04:09:00.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.172+0000 7fe421359640 1 -- 172.21.15.73:0/3222780474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe41c15e930 msgr2=0x7fe41c0cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:00.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.172+0000 7fe421359640 1 --2- 172.21.15.73:0/3222780474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe41c15e930 0x7fe41c0cf130 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe4100097a0 tx=0x7fe41002b840 comp rx=0 tx=0).stop 2024-03-29T04:09:00.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.172+0000 7fe421359640 1 -- 172.21.15.73:0/3222780474 shutdown_connections 2024-03-29T04:09:00.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.172+0000 7fe421359640 1 --2- 172.21.15.73:0/3222780474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe41c0cf670 0x7fe41c0d2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:00.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.172+0000 7fe421359640 1 --2- 172.21.15.73:0/3222780474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe41c15e930 0x7fe41c0cf130 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:00.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.172+0000 7fe421359640 1 -- 172.21.15.73:0/3222780474 >> 172.21.15.73:0/3222780474 conn(0x7fe41c08bfc0 msgr2=0x7fe41c0d4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:00.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.172+0000 7fe421359640 1 -- 172.21.15.73:0/3222780474 shutdown_connections 2024-03-29T04:09:00.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.172+0000 7fe421359640 1 -- 172.21.15.73:0/3222780474 wait complete. 2024-03-29T04:09:00.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.174+0000 7fe421359640 1 Processor -- start 2024-03-29T04:09:00.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.174+0000 7fe421359640 1 -- start start 2024-03-29T04:09:00.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.174+0000 7fe421359640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe41c0b3c50 0x7fe41c157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:00.156 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.174+0000 7fe421359640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe41c0cf670 0x7fe41c0ca210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:00.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.174+0000 7fe421359640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe41c15e930 0x7fe41c0b2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:00.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.174+0000 7fe421359640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe41c15ee90 con 0x7fe41c15e930 2024-03-29T04:09:00.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.174+0000 7fe421359640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe41c15ed10 con 0x7fe41c0b3c50 2024-03-29T04:09:00.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.174+0000 7fe421359640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe41c06dc20 con 0x7fe41c0cf670 2024-03-29T04:09:00.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.174+0000 7fe41b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe41c15e930 0x7fe41c0b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:00.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.174+0000 7fe41b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe41c15e930 0x7fe41c0b2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47066/0 (socket says 172.21.15.73:47066) 2024-03-29T04:09:00.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.175+0000 7fe41b7fe640 1 -- 172.21.15.73:0/1808519234 learned_addr learned my addr 172.21.15.73:0/1808519234 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:00.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.175+0000 7fe41a7fc640 1 --2- 172.21.15.73:0/1808519234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe41c0cf670 0x7fe41c0ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:00.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.175+0000 7fe41affd640 1 --2- 172.21.15.73:0/1808519234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe41c0b3c50 0x7fe41c157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:00.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.175+0000 7fe41b7fe640 1 -- 172.21.15.73:0/1808519234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe41c0cf670 msgr2=0x7fe41c0ca210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:00.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.175+0000 7fe41b7fe640 1 --2- 172.21.15.73:0/1808519234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe41c0cf670 0x7fe41c0ca210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:00.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.175+0000 7fe41b7fe640 1 -- 172.21.15.73:0/1808519234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe41c0b3c50 msgr2=0x7fe41c157f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:00.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.175+0000 7fe41b7fe640 1 --2- 172.21.15.73:0/1808519234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe41c0b3c50 0x7fe41c157f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:00.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.175+0000 7fe41b7fe640 1 -- 172.21.15.73:0/1808519234 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe41c158470 con 0x7fe41c15e930 2024-03-29T04:09:00.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.175+0000 7fe41affd640 1 --2- 172.21.15.73:0/1808519234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe41c0b3c50 0x7fe41c157f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:09:00.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.175+0000 7fe41a7fc640 1 --2- 172.21.15.73:0/1808519234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe41c0cf670 0x7fe41c0ca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:09:00.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.175+0000 7fe41b7fe640 1 --2- 172.21.15.73:0/1808519234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe41c15e930 0x7fe41c0b2160 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe41400c770 tx=0x7fe41400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:00.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.175+0000 7fe4037fe640 1 -- 172.21.15.73:0/1808519234 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe414018070 con 0x7fe41c15e930 2024-03-29T04:09:00.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.175+0000 7fe4037fe640 1 -- 172.21.15.73:0/1808519234 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe41400a640 con 0x7fe41c15e930 2024-03-29T04:09:00.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.175+0000 7fe421359640 1 -- 172.21.15.73:0/1808519234 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe41c0cc2e0 con 0x7fe41c15e930 2024-03-29T04:09:00.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.175+0000 7fe4037fe640 1 -- 172.21.15.73:0/1808519234 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41400aa30 con 0x7fe41c15e930 2024-03-29T04:09:00.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.175+0000 7fe421359640 1 -- 172.21.15.73:0/1808519234 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe41c158a90 con 0x7fe41c15e930 2024-03-29T04:09:00.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.176+0000 7fe421359640 1 -- 172.21.15.73:0/1808519234 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe41c0cc4b0 con 0x7fe41c15e930 2024-03-29T04:09:00.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.176+0000 7fe4037fe640 1 -- 172.21.15.73:0/1808519234 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fe41401b070 con 0x7fe41c15e930 2024-03-29T04:09:00.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.177+0000 7fe4037fe640 1 --2- 172.21.15.73:0/1808519234 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fe40806c560 0x7fe40806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:00.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.177+0000 7fe4037fe640 1 -- 172.21.15.73:0/1808519234 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fe41408abf0 con 0x7fe41c15e930 2024-03-29T04:09:00.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.177+0000 7fe41affd640 1 --2- 172.21.15.73:0/1808519234 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fe40806c560 0x7fe40806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:00.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.177+0000 7fe41affd640 1 --2- 172.21.15.73:0/1808519234 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fe40806c560 0x7fe40806ea20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe410036000 tx=0x7fe410008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:00.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.181+0000 7fe4037fe640 1 -- 172.21.15.73:0/1808519234 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fe4140592a0 con 0x7fe41c15e930 2024-03-29T04:09:00.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.357+0000 7fe421359640 1 -- 172.21.15.73:0/1808519234 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe41c0ba480 con 0x7fe41c15e930 2024-03-29T04:09:00.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.358+0000 7fe4037fe640 1 -- 172.21.15.73:0/1808519234 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16682 (secure 0 0 0) 0x7fe41c0ba480 con 0x7fe41c15e930 2024-03-29T04:09:00.338 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:09:00.338 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":31,"fsid":"6bff1617-b138-4517-acca-3ecaae3f2bb3","created":"2024-03-29T04:07:47.346864+0000","modified":"2024-03-29T04:08:59.078850+0000","last_up_change":"2024-03-29T04:07:58.507139+0000","last_in_change":"2024-03-29T04:07:49.637816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-29T04:07:59.537301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-29T04:08:57.521498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-29T04:08:58.027631+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"925d7de1-14ab-48c0-aebd-7bded108f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6820","nonce":2387335359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6824","nonce":2387335359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6831","nonce":2387335359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6828","nonce":2387335359}]},"public_addr":"172.21.15.73:6820/2387335359","cluster_addr":"172.21.15.73:6824/2387335359","heartbeat_back_addr":"172.21.15.73:6831/2387335359","heartbeat_front_addr":"172.21.15.73:6828/2387335359","state":["exists","up"]},{"osd":1,"uuid":"6b182102-882a-4e0c-99db-0afae5cfb38b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6801","nonce":2431315515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6803","nonce":2431315515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6807","nonce":2431315515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6805","nonce":2431315515}]},"public_addr":"172.21.15.73:6801/2431315515","cluster_addr":"172.21.15.73:6803/2431315515","heartbeat_back_addr":"172.21.15.73:6807/2431315515","heartbeat_front_addr":"172.21.15.73:6805/2431315515","state":["exists","up"]},{"osd":2,"uuid":"8040902e-b0b8-4a21-bf64-ce1c222115ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6809","nonce":407236597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6811","nonce":407236597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6815","nonce":407236597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6813","nonce":407236597}]},"public_addr":"172.21.15.73:6809/407236597","cluster_addr":"172.21.15.73:6811/407236597","heartbeat_back_addr":"172.21.15.73:6815/407236597","heartbeat_front_addr":"172.21.15.73:6813/407236597","state":["exists","up"]},{"osd":3,"uuid":"1bab19ee-3775-4ce1-a4ce-cf7cda3bbbf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6817","nonce":4291100709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6821","nonce":4291100709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6829","nonce":4291100709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6825","nonce":4291100709}]},"public_addr":"172.21.15.73:6817/4291100709","cluster_addr":"172.21.15.73:6821/4291100709","heartbeat_back_addr":"172.21.15.73:6829/4291100709","heartbeat_front_addr":"172.21.15.73:6825/4291100709","state":["exists","up"]},{"osd":4,"uuid":"b0c74337-8fe4-47dc-b3da-2d07591b1f6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6817","nonce":3703256194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6819","nonce":3703256194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6823","nonce":3703256194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6821","nonce":3703256194}]},"public_addr":"172.21.15.142:6817/3703256194","cluster_addr":"172.21.15.142:6819/3703256194","heartbeat_back_addr":"172.21.15.142:6823/3703256194","heartbeat_front_addr":"172.21.15.142:6821/3703256194","state":["exists","up"]},{"osd":5,"uuid":"9ce36410-a29a-42c6-99f4-f95d4afdd7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6825","nonce":4271575803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6827","nonce":4271575803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6831","nonce":4271575803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6829","nonce":4271575803}]},"public_addr":"172.21.15.142:6825/4271575803","cluster_addr":"172.21.15.142:6827/4271575803","heartbeat_back_addr":"172.21.15.142:6831/4271575803","heartbeat_front_addr":"172.21.15.142:6829/4271575803","state":["exists","up"]},{"osd":6,"uuid":"aec4264a-64ac-428e-a860-d2920a304019","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6801","nonce":1772722570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6803","nonce":1772722570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6807","nonce":1772722570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6805","nonce":1772722570}]},"public_addr":"172.21.15.142:6801/1772722570","cluster_addr":"172.21.15.142:6803/1772722570","heartbeat_back_addr":"172.21.15.142:6807/1772722570","heartbeat_front_addr":"172.21.15.142:6805/1772722570","state":["exists","up"]},{"osd":7,"uuid":"fe599052-8e5a-4c7a-91e7-52d1bae24a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6809","nonce":3910589675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6811","nonce":3910589675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6815","nonce":3910589675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6813","nonce":3910589675}]},"public_addr":"172.21.15.142:6809/3910589675","cluster_addr":"172.21.15.142:6811/3910589675","heartbeat_back_addr":"172.21.15.142:6815/3910589675","heartbeat_front_addr":"172.21.15.142:6813/3910589675","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.835096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.587210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.786547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.778004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.843740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.791160+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.837992+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.718722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:09:00.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.360+0000 7fe421359640 1 -- 172.21.15.73:0/1808519234 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fe40806c560 msgr2=0x7fe40806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:00.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.360+0000 7fe421359640 1 --2- 172.21.15.73:0/1808519234 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fe40806c560 0x7fe40806ea20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe410036000 tx=0x7fe410008030 comp rx=0 tx=0).stop 2024-03-29T04:09:00.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.360+0000 7fe421359640 1 -- 172.21.15.73:0/1808519234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe41c15e930 msgr2=0x7fe41c0b2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:00.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.360+0000 7fe421359640 1 --2- 172.21.15.73:0/1808519234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe41c15e930 0x7fe41c0b2160 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe41400c770 tx=0x7fe41400cc30 comp rx=0 tx=0).stop 2024-03-29T04:09:00.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.360+0000 7fe421359640 1 -- 172.21.15.73:0/1808519234 shutdown_connections 2024-03-29T04:09:00.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.360+0000 7fe421359640 1 --2- 172.21.15.73:0/1808519234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe41c15e930 0x7fe41c0b2160 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:00.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.360+0000 7fe421359640 1 --2- 172.21.15.73:0/1808519234 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe41c0cf670 0x7fe41c0ca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:00.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.360+0000 7fe421359640 1 --2- 172.21.15.73:0/1808519234 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fe40806c560 0x7fe40806ea20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:00.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.360+0000 7fe421359640 1 --2- 172.21.15.73:0/1808519234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe41c0b3c50 0x7fe41c157f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:00.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.360+0000 7fe421359640 1 -- 172.21.15.73:0/1808519234 >> 172.21.15.73:0/1808519234 conn(0x7fe41c08bfc0 msgr2=0x7fe41c0d2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:00.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.360+0000 7fe421359640 1 -- 172.21.15.73:0/1808519234 shutdown_connections 2024-03-29T04:09:00.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.360+0000 7fe421359640 1 -- 172.21.15.73:0/1808519234 wait complete. 2024-03-29T04:09:00.351 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-29T04:09:00.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.474+0000 7f4568a63640 1 Processor -- start 2024-03-29T04:09:00.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.474+0000 7f4568a63640 1 -- start start 2024-03-29T04:09:00.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.475+0000 7f4568a63640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f456415c760 0x7f456406f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:00.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.475+0000 7f4568a63640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f456406c520 0x7f456406c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:00.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.475+0000 7f4568a63640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f456406ce70 con 0x7f4564072dc0 2024-03-29T04:09:00.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.475+0000 7f4568a63640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f45640b6050 con 0x7f456415c760 2024-03-29T04:09:00.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.475+0000 7f4568a63640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f45640d01e0 con 0x7f456406c520 2024-03-29T04:09:00.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.475+0000 7f456259c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f456415c760 0x7f456406f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:00.455 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.475+0000 7f456259c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f456415c760 0x7f456406f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47072/0 (socket says 172.21.15.73:47072) 2024-03-29T04:09:00.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.475+0000 7f456259c640 1 -- 172.21.15.73:0/1321863883 learned_addr learned my addr 172.21.15.73:0/1321863883 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:00.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.475+0000 7f4562d9d640 1 --2- 172.21.15.73:0/1321863883 >> v2:172.21.15.142:3300/0 conn(0x7f456406c520 0x7f456406c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:00.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.475+0000 7f456259c640 1 -- 172.21.15.73:0/1321863883 >> v2:172.21.15.142:3300/0 conn(0x7f456406c520 msgr2=0x7f456406c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:00.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.475+0000 7f456259c640 1 --2- 172.21.15.73:0/1321863883 >> v2:172.21.15.142:3300/0 conn(0x7f456406c520 0x7f456406c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:00.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.475+0000 7f456259c640 1 -- 172.21.15.73:0/1321863883 >> v1:172.21.15.142:6789/0 conn(0x7f4564072dc0 legacy=0x7f45640cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:00.456 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.475+0000 7f456259c640 1 -- 172.21.15.73:0/1321863883 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45640d04c0 con 0x7f456415c760 2024-03-29T04:09:00.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.476+0000 7f456259c640 1 --2- 172.21.15.73:0/1321863883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f456415c760 0x7f456406f9a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4564075630 tx=0x7f455402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a1876f48ff3e9c8 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:00.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.476+0000 7f456159a640 1 -- 172.21.15.73:0/1321863883 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455402cb20 con 0x7f456415c760 2024-03-29T04:09:00.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.476+0000 7f456159a640 1 -- 172.21.15.73:0/1321863883 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f455402ccc0 con 0x7f456415c760 2024-03-29T04:09:00.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.476+0000 7f456159a640 1 -- 172.21.15.73:0/1321863883 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4554034610 con 0x7f456415c760 2024-03-29T04:09:00.457 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.477+0000 7f4568a63640 1 -- 172.21.15.73:0/1321863883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f456415c760 msgr2=0x7f456406f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:00.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.477+0000 7f4568a63640 1 --2- 172.21.15.73:0/1321863883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f456415c760 0x7f456406f9a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4564075630 tx=0x7f455402bf80 comp rx=0 tx=0).stop 2024-03-29T04:09:00.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.477+0000 7f4568a63640 1 -- 172.21.15.73:0/1321863883 shutdown_connections 2024-03-29T04:09:00.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.477+0000 7f4568a63640 1 --2- 172.21.15.73:0/1321863883 >> v2:172.21.15.142:3300/0 conn(0x7f456406c520 0x7f456406c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:00.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.477+0000 7f4568a63640 1 --2- 172.21.15.73:0/1321863883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f456415c760 0x7f456406f9a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:00.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.477+0000 7f4568a63640 1 -- 172.21.15.73:0/1321863883 >> 172.21.15.73:0/1321863883 conn(0x7f4564072090 msgr2=0x7f45640724a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:00.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.477+0000 7f4568a63640 1 -- 172.21.15.73:0/1321863883 shutdown_connections 2024-03-29T04:09:00.458 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.477+0000 7f4568a63640 1 -- 172.21.15.73:0/1321863883 wait complete. 2024-03-29T04:09:00.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.478+0000 7f4568a63640 1 Processor -- start 2024-03-29T04:09:00.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.478+0000 7f4568a63640 1 -- start start 2024-03-29T04:09:00.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.479+0000 7f4568a63640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f456406c520 0x7f45641f2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:00.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.479+0000 7f4568a63640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4564072dc0 0x7f456415e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:00.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.479+0000 7f4568a63640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f456415c760 0x7f456414dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:00.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.479+0000 7f4568a63640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f456406fee0 con 0x7f456415c760 2024-03-29T04:09:00.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.479+0000 7f4568a63640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f456406f480 con 0x7f456406c520 2024-03-29T04:09:00.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.479+0000 7f4568a63640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f45640d07a0 con 0x7f4564072dc0 2024-03-29T04:09:00.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.479+0000 7f4562d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f456415c760 0x7f456414dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:00.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.479+0000 7f4562d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f456415c760 0x7f456414dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47084/0 (socket says 172.21.15.73:47084) 2024-03-29T04:09:00.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.479+0000 7f4562d9d640 1 -- 172.21.15.73:0/4261100314 learned_addr learned my addr 172.21.15.73:0/4261100314 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:00.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.479+0000 7f4561d9b640 1 --2- 172.21.15.73:0/4261100314 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4564072dc0 0x7f456415e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:00.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.479+0000 7f4562d9d640 1 -- 172.21.15.73:0/4261100314 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4564072dc0 msgr2=0x7f456415e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:00.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.479+0000 7f4562d9d640 1 --2- 172.21.15.73:0/4261100314 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4564072dc0 0x7f456415e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:00.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.479+0000 7f4562d9d640 1 -- 172.21.15.73:0/4261100314 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f456406c520 msgr2=0x7f45641f2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:00.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.479+0000 7f456259c640 1 --2- 172.21.15.73:0/4261100314 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f456406c520 0x7f45641f2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:00.461 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.479+0000 7f4562d9d640 1 --2- 172.21.15.73:0/4261100314 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f456406c520 0x7f45641f2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:00.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.479+0000 7f4562d9d640 1 -- 172.21.15.73:0/4261100314 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f456414c520 con 0x7f456415c760 2024-03-29T04:09:00.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.479+0000 7f4562d9d640 1 --2- 172.21.15.73:0/4261100314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f456415c760 0x7f456414dfb0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f455c00d5d0 tx=0x7f455c00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:00.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.480+0000 7f4552ffd640 1 -- 172.21.15.73:0/4261100314 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455c0125f0 con 0x7f456415c760 2024-03-29T04:09:00.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.480+0000 7f4552ffd640 1 -- 172.21.15.73:0/4261100314 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f455c019070 con 0x7f456415c760 2024-03-29T04:09:00.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.480+0000 7f4568a63640 1 -- 172.21.15.73:0/4261100314 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f456414c800 con 0x7f456415c760 2024-03-29T04:09:00.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.480+0000 7f4552ffd640 1 -- 172.21.15.73:0/4261100314 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455c0129f0 con 0x7f456415c760 2024-03-29T04:09:00.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.480+0000 7f4568a63640 1 -- 172.21.15.73:0/4261100314 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f456414cdc0 con 0x7f456415c760 2024-03-29T04:09:00.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.481+0000 7f4568a63640 1 -- 172.21.15.73:0/4261100314 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f456404f9d0 con 0x7f456415c760 2024-03-29T04:09:00.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.481+0000 7f4552ffd640 1 -- 172.21.15.73:0/4261100314 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f455c012b90 con 0x7f456415c760 2024-03-29T04:09:00.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.481+0000 7f4552ffd640 1 --2- 172.21.15.73:0/4261100314 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f454406c530 0x7f454406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:00.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.481+0000 7f4552ffd640 1 -- 172.21.15.73:0/4261100314 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f455c08ba80 con 0x7f456415c760 2024-03-29T04:09:00.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.481+0000 7f456259c640 1 --2- 172.21.15.73:0/4261100314 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f454406c530 0x7f454406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:00.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.482+0000 7f456259c640 1 --2- 172.21.15.73:0/4261100314 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f454406c530 0x7f454406e9f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4554035000 tx=0x7f4554030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:00.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.486+0000 7f4552ffd640 1 -- 172.21.15.73:0/4261100314 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f455c05a0b0 con 0x7f456415c760 2024-03-29T04:09:00.678 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.699+0000 7f4568a63640 1 -- 172.21.15.73:0/4261100314 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f456406faf0 con 0x7f456415c760 2024-03-29T04:09:00.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.739+0000 7f4552ffd640 1 -- 172.21.15.73:0/4261100314 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v12) ==== 118+0+0 (secure 0 0 0) 0x7f455c0599b0 con 0x7f456415c760 2024-03-29T04:09:00.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.742+0000 7f4568a63640 1 -- 172.21.15.73:0/4261100314 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f454406c530 msgr2=0x7f454406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:00.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.742+0000 7f4568a63640 1 --2- 172.21.15.73:0/4261100314 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f454406c530 0x7f454406e9f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4554035000 tx=0x7f4554030000 comp rx=0 tx=0).stop 2024-03-29T04:09:00.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.742+0000 7f4568a63640 1 -- 172.21.15.73:0/4261100314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f456415c760 msgr2=0x7f456414dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:00.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.742+0000 7f4568a63640 1 --2- 172.21.15.73:0/4261100314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f456415c760 0x7f456414dfb0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f455c00d5d0 tx=0x7f455c00da90 comp rx=0 tx=0).stop 2024-03-29T04:09:00.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.742+0000 7f4568a63640 1 -- 172.21.15.73:0/4261100314 shutdown_connections 2024-03-29T04:09:00.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.742+0000 7f4568a63640 1 --2- 172.21.15.73:0/4261100314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f456415c760 0x7f456414dfb0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:00.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.742+0000 7f4568a63640 1 --2- 172.21.15.73:0/4261100314 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4564072dc0 0x7f456415e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:00.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.742+0000 7f4568a63640 1 --2- 172.21.15.73:0/4261100314 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f454406c530 0x7f454406e9f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:00.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.742+0000 7f4568a63640 1 --2- 172.21.15.73:0/4261100314 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f456406c520 0x7f45641f2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:00.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.742+0000 7f4568a63640 1 -- 172.21.15.73:0/4261100314 >> 172.21.15.73:0/4261100314 conn(0x7f4564072090 msgr2=0x7f456406e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:00.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.742+0000 7f4568a63640 1 -- 172.21.15.73:0/4261100314 shutdown_connections 2024-03-29T04:09:00.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.742+0000 7f4568a63640 1 -- 172.21.15.73:0/4261100314 wait complete. 2024-03-29T04:09:00.734 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-29T04:09:00.734 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-29T04:09:00.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.858+0000 7f25a870e640 1 Processor -- start 2024-03-29T04:09:00.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.858+0000 7f25a870e640 1 -- start start 2024-03-29T04:09:00.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.859+0000 7f25a870e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f25a015e920 0x7f25a00d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:00.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.859+0000 7f25a870e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25a00d16a0 0x7f25a00d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:00.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.859+0000 7f25a870e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25a00d3780 con 0x7f25a00cfde0 2024-03-29T04:09:00.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.859+0000 7f25a870e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f25a015ed00 con 0x7f25a015e920 2024-03-29T04:09:00.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.859+0000 7f25a870e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f25a00d21e0 con 0x7f25a00d16a0 2024-03-29T04:09:00.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.859+0000 7f25a5ca9640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f25a00cfde0 0x7f25a00d0f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57392/0 (socket says 172.21.15.73:57392) 2024-03-29T04:09:00.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.859+0000 7f25a5ca9640 1 -- 172.21.15.73:0/670213681 learned_addr learned my addr 172.21.15.73:0/670213681 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:09:00.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.859+0000 7f25a6cab640 1 --2- 172.21.15.73:0/670213681 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25a00d16a0 0x7f25a00d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:00.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.859+0000 7f25a64aa640 1 --2- 172.21.15.73:0/670213681 >> v2:172.21.15.142:3300/0 conn(0x7f25a015e920 0x7f25a00d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:00.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.859+0000 7f25a54a8640 1 -- 172.21.15.73:0/670213681 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 651335504 0 0) 0x7f2590001110 con 0x7f25a00cfde0 2024-03-29T04:09:00.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.859+0000 7f25a54a8640 1 -- 172.21.15.73:0/670213681 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f258c003520 con 0x7f25a00cfde0 2024-03-29T04:09:00.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.859+0000 7f25a54a8640 1 -- 172.21.15.73:0/670213681 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2991226130 0 0) 0x7f258c003520 con 0x7f25a00cfde0 2024-03-29T04:09:00.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.859+0000 7f25a54a8640 1 -- 172.21.15.73:0/670213681 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25a00d16a0 msgr2=0x7f25a00d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:00.842 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.859+0000 7f25a54a8640 1 --2- 172.21.15.73:0/670213681 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25a00d16a0 0x7f25a00d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:00.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.859+0000 7f25a54a8640 1 -- 172.21.15.73:0/670213681 >> v2:172.21.15.142:3300/0 conn(0x7f25a015e920 msgr2=0x7f25a00d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:00.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.859+0000 7f25a54a8640 1 --2- 172.21.15.73:0/670213681 >> v2:172.21.15.142:3300/0 conn(0x7f25a015e920 0x7f25a00d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:00.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.859+0000 7f25a54a8640 1 -- 172.21.15.73:0/670213681 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a00d2480 con 0x7f25a00cfde0 2024-03-29T04:09:00.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.859+0000 7f25a54a8640 1 -- 172.21.15.73:0/670213681 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1290421750 0 0) 0x7f2590001840 con 0x7f25a00cfde0 2024-03-29T04:09:00.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.859+0000 7f25a64aa640 1 --2- 172.21.15.73:0/670213681 >> v2:172.21.15.142:3300/0 conn(0x7f25a015e920 0x7f25a00d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:09:00.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.859+0000 7f25a6cab640 1 --2- 172.21.15.73:0/670213681 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25a00d16a0 0x7f25a00d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:09:00.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.859+0000 7f25a54a8640 1 -- 172.21.15.73:0/670213681 >> v1:172.21.15.73:6789/0 conn(0x7f25a00cfde0 legacy=0x7f25a00d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:00.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.860+0000 7f25a54a8640 1 --2- 172.21.15.73:0/670213681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f258c0039b0 0x7f258c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:00.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.860+0000 7f25a54a8640 1 --2- 172.21.15.73:0/670213681 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25a00d16a0 0x7f258c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:00.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.860+0000 7f25a54a8640 1 --2- 172.21.15.73:0/670213681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f258c004d40 0x7f258c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:00.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.860+0000 7f25a54a8640 1 -- 172.21.15.73:0/670213681 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f25a015ed00 con 0x7f258c0039b0 2024-03-29T04:09:00.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.860+0000 7f25a54a8640 1 -- 172.21.15.73:0/670213681 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f25a00d21e0 con 0x7f258c004d40 2024-03-29T04:09:00.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.860+0000 7f25a54a8640 1 -- 172.21.15.73:0/670213681 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f258c00b9c0 con 0x7f25a00d16a0 2024-03-29T04:09:00.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.860+0000 7f25a64aa640 1 --2- 172.21.15.73:0/670213681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f258c0039b0 0x7f258c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:00.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.860+0000 7f25a6cab640 1 --2- 172.21.15.73:0/670213681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f258c004d40 0x7f258c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:00.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.860+0000 7f25a5ca9640 1 --2- 172.21.15.73:0/670213681 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25a00d16a0 0x7f258c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:00.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.860+0000 7f25a64aa640 1 -- 172.21.15.73:0/670213681 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25a00d16a0 msgr2=0x7f258c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:00.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.860+0000 7f25a64aa640 1 --2- 172.21.15.73:0/670213681 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25a00d16a0 0x7f258c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:00.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.860+0000 7f25a64aa640 1 -- 172.21.15.73:0/670213681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f258c004d40 msgr2=0x7f258c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:00.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.860+0000 7f25a64aa640 1 --2- 172.21.15.73:0/670213681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f258c004d40 0x7f258c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:00.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.860+0000 7f25a64aa640 1 -- 172.21.15.73:0/670213681 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f258c003520 con 0x7f258c0039b0 2024-03-29T04:09:00.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.861+0000 7f25a64aa640 1 --2- 172.21.15.73:0/670213681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f258c0039b0 0x7f258c003dd0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f259c009c90 tx=0x7f258c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a06ff30da9bedc29 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:00.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.861+0000 7f25a54a8640 1 -- 172.21.15.73:0/670213681 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259c039070 con 0x7f258c0039b0 2024-03-29T04:09:00.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.861+0000 7f25a54a8640 1 -- 172.21.15.73:0/670213681 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f259c02c980 con 0x7f258c0039b0 2024-03-29T04:09:00.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.861+0000 7f25a54a8640 1 -- 172.21.15.73:0/670213681 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259c009860 con 0x7f258c0039b0 2024-03-29T04:09:00.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.861+0000 7f25a870e640 1 -- 172.21.15.73:0/670213681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f258c0039b0 msgr2=0x7f258c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:00.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.861+0000 7f25a870e640 1 --2- 172.21.15.73:0/670213681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f258c0039b0 0x7f258c003dd0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f259c009c90 tx=0x7f258c005830 comp rx=0 tx=0).stop 2024-03-29T04:09:00.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.861+0000 7f25a6cab640 1 -- 172.21.15.73:0/670213681 reap_dead start 2024-03-29T04:09:00.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.861+0000 7f25a870e640 1 -- 172.21.15.73:0/670213681 shutdown_connections 2024-03-29T04:09:00.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.861+0000 7f25a870e640 1 -- 172.21.15.73:0/670213681 >> 172.21.15.73:0/670213681 conn(0x7f25a008bfc0 msgr2=0x7f25a00d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:00.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.861+0000 7f25a870e640 1 -- 172.21.15.73:0/670213681 shutdown_connections 2024-03-29T04:09:00.845 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.861+0000 7f25a870e640 1 -- 172.21.15.73:0/670213681 wait complete. 2024-03-29T04:09:00.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.863+0000 7f25a870e640 1 Processor -- start 2024-03-29T04:09:00.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.863+0000 7f25a870e640 1 -- start start 2024-03-29T04:09:00.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.863+0000 7f25a870e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f258c0039b0 0x7f25a01f8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.863+0000 7f25a870e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25a014aef0 0x7f25a0160580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.863+0000 7f25a870e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25a00ccd80 0x7f25a00c9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.863+0000 7f25a870e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f25a00d2d20 con 0x7f258c0039b0 2024-03-29T04:09:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.863+0000 7f25a870e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f25a00d2a40 con 0x7f25a014aef0 2024-03-29T04:09:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.863+0000 7f25a870e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f25a00d4ef0 con 0x7f25a00ccd80 2024-03-29T04:09:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.863+0000 7f25a64aa640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f258c0039b0 0x7f25a01f8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.863+0000 7f25a64aa640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f258c0039b0 0x7f25a01f8e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47106/0 (socket says 172.21.15.73:47106) 2024-03-29T04:09:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.863+0000 7f25a64aa640 1 -- 172.21.15.73:0/1703061295 learned_addr learned my addr 172.21.15.73:0/1703061295 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.864+0000 7f25a64aa640 1 -- 172.21.15.73:0/1703061295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25a00ccd80 msgr2=0x7f25a00c9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.864+0000 7f25a64aa640 1 --2- 172.21.15.73:0/1703061295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25a00ccd80 0x7f25a00c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.864+0000 7f25a64aa640 1 -- 172.21.15.73:0/1703061295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25a014aef0 msgr2=0x7f25a0160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.864+0000 7f25a64aa640 1 --2- 172.21.15.73:0/1703061295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25a014aef0 0x7f25a0160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.864+0000 7f25a64aa640 1 -- 172.21.15.73:0/1703061295 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a015a270 con 0x7f258c0039b0 2024-03-29T04:09:00.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.864+0000 7f25a64aa640 1 --2- 172.21.15.73:0/1703061295 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f258c0039b0 0x7f25a01f8e90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f259c009db0 tx=0x7f259c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:00.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.864+0000 7f2596ffd640 1 -- 172.21.15.73:0/1703061295 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259c039050 con 0x7f258c0039b0 2024-03-29T04:09:00.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.864+0000 7f2596ffd640 1 -- 172.21.15.73:0/1703061295 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f259c045070 con 0x7f258c0039b0 2024-03-29T04:09:00.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.864+0000 7f25a870e640 1 -- 172.21.15.73:0/1703061295 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25a014b3d0 con 0x7f258c0039b0 2024-03-29T04:09:00.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.864+0000 7f2596ffd640 1 -- 172.21.15.73:0/1703061295 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259c009860 con 0x7f258c0039b0 2024-03-29T04:09:00.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.864+0000 7f25a870e640 1 -- 172.21.15.73:0/1703061295 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25a014b990 con 0x7f258c0039b0 2024-03-29T04:09:00.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.865+0000 7f25a870e640 1 -- 172.21.15.73:0/1703061295 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25a00a2560 con 0x7f258c0039b0 2024-03-29T04:09:00.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.865+0000 7f2596ffd640 1 -- 172.21.15.73:0/1703061295 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f259c040450 con 0x7f258c0039b0 2024-03-29T04:09:00.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.866+0000 7f2596ffd640 1 --2- 172.21.15.73:0/1703061295 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f258406c560 0x7f258406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:00.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.866+0000 7f2596ffd640 1 -- 172.21.15.73:0/1703061295 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f259c0ad260 con 0x7f258c0039b0 2024-03-29T04:09:00.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.866+0000 7f25a5ca9640 1 --2- 172.21.15.73:0/1703061295 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f258406c560 0x7f258406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:00.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.866+0000 7f25a5ca9640 1 --2- 172.21.15.73:0/1703061295 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f258406c560 0x7f258406ea20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2590000f60 tx=0x7f2590000ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:00.850 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:00.870+0000 7f2596ffd640 1 -- 172.21.15.73:0/1703061295 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f259c04e020 con 0x7f258c0039b0 2024-03-29T04:09:01.073 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.094+0000 7f25a870e640 1 -- 172.21.15.73:0/1703061295 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f25a004f9d0 con 0x7f258c0039b0 2024-03-29T04:09:01.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.742+0000 7f2596ffd640 1 -- 172.21.15.73:0/1703061295 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v13) ==== 122+0+0 (secure 0 0 0) 0x7f25a015a270 con 0x7f258c0039b0 2024-03-29T04:09:01.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.746+0000 7f25a870e640 1 -- 172.21.15.73:0/1703061295 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f258406c560 msgr2=0x7f258406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:01.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.746+0000 7f25a870e640 1 --2- 172.21.15.73:0/1703061295 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f258406c560 0x7f258406ea20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2590000f60 tx=0x7f2590000ed0 comp rx=0 tx=0).stop 2024-03-29T04:09:01.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.746+0000 7f25a870e640 1 -- 172.21.15.73:0/1703061295 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f258c0039b0 msgr2=0x7f25a01f8e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:01.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.746+0000 7f25a870e640 1 --2- 172.21.15.73:0/1703061295 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f258c0039b0 0x7f25a01f8e90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f259c009db0 tx=0x7f259c004730 comp rx=0 tx=0).stop 2024-03-29T04:09:01.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.746+0000 7f25a870e640 1 -- 172.21.15.73:0/1703061295 shutdown_connections 2024-03-29T04:09:01.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.746+0000 7f25a870e640 1 --2- 172.21.15.73:0/1703061295 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f25a00ccd80 0x7f25a00c9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:01.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.746+0000 7f25a870e640 1 --2- 172.21.15.73:0/1703061295 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f258406c560 0x7f258406ea20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:01.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.746+0000 7f25a870e640 1 --2- 172.21.15.73:0/1703061295 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25a014aef0 0x7f25a0160580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:01.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.746+0000 7f25a870e640 1 --2- 172.21.15.73:0/1703061295 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f258c0039b0 0x7f25a01f8e90 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:01.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.746+0000 7f25a870e640 1 -- 172.21.15.73:0/1703061295 >> 172.21.15.73:0/1703061295 conn(0x7f25a008bfc0 msgr2=0x7f25a00b2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:01.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.746+0000 7f25a870e640 1 -- 172.21.15.73:0/1703061295 shutdown_connections 2024-03-29T04:09:01.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.746+0000 7f25a870e640 1 -- 172.21.15.73:0/1703061295 wait complete. 2024-03-29T04:09:01.736 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-29T04:09:01.736 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-29T04:09:01.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.894+0000 7fb96ee9a640 1 Processor -- start 2024-03-29T04:09:01.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.894+0000 7fb96ee9a640 1 -- start start 2024-03-29T04:09:01.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.895+0000 7fb96ee9a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9680b3c50 0x7fb9680d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:01.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.895+0000 7fb96ee9a640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9680cfb30 con 0x7fb96815e930 2024-03-29T04:09:01.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.895+0000 7fb96ee9a640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9680cfe10 con 0x7fb9680d3140 2024-03-29T04:09:01.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.895+0000 7fb96ee9a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fb96806c780 con 0x7fb9680b3c50 2024-03-29T04:09:01.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.895+0000 7fb96cc36640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb96815e930 0x7fb9680cf130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57400/0 (socket says 172.21.15.73:57400) 2024-03-29T04:09:01.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.895+0000 7fb96cc36640 1 -- 172.21.15.73:0/2735766977 learned_addr learned my addr 172.21.15.73:0/2735766977 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:09:01.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.895+0000 7fb95ffff640 1 --2- 172.21.15.73:0/2735766977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9680b3c50 0x7fb9680d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:01.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.896+0000 7fb95f7fe640 1 -- 172.21.15.73:0/2735766977 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3641281630 0 0) 0x7fb9680cfb30 con 0x7fb96815e930 2024-03-29T04:09:01.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.896+0000 7fb95f7fe640 1 -- 172.21.15.73:0/2735766977 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb950003520 con 0x7fb96815e930 2024-03-29T04:09:01.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.896+0000 7fb95f7fe640 1 -- 172.21.15.73:0/2735766977 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1579959563 0 0) 0x7fb9680cfe10 con 0x7fb9680d3140 2024-03-29T04:09:01.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.896+0000 7fb95f7fe640 1 -- 172.21.15.73:0/2735766977 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9680cfb30 con 0x7fb9680d3140 2024-03-29T04:09:01.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.896+0000 7fb95f7fe640 1 -- 172.21.15.73:0/2735766977 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2529766238 0 0) 0x7fb950003520 con 0x7fb96815e930 2024-03-29T04:09:01.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.896+0000 7fb95ffff640 1 -- 172.21.15.73:0/2735766977 >> v1:172.21.15.142:6789/0 conn(0x7fb9680d3140 legacy=0x7fb96806cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:01.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.896+0000 7fb95ffff640 1 -- 172.21.15.73:0/2735766977 >> v1:172.21.15.73:6789/0 conn(0x7fb96815e930 legacy=0x7fb9680cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:01.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.896+0000 7fb95ffff640 1 -- 172.21.15.73:0/2735766977 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9680d00f0 con 0x7fb9680b3c50 2024-03-29T04:09:01.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.897+0000 7fb95ffff640 1 --2- 172.21.15.73:0/2735766977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9680b3c50 0x7fb9680d2c00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb9580097d0 tx=0x7fb95802b770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9983812cab55e2e server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:01.877 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.897+0000 7fb95f7fe640 1 -- 172.21.15.73:0/2735766977 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb958037070 con 0x7fb9680b3c50 2024-03-29T04:09:01.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.897+0000 7fb95f7fe640 1 -- 172.21.15.73:0/2735766977 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb958030510 con 0x7fb9680b3c50 2024-03-29T04:09:01.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.897+0000 7fb95f7fe640 1 -- 172.21.15.73:0/2735766977 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb964001670 con 0x7fb9680b3c50 2024-03-29T04:09:01.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.898+0000 7fb96ee9a640 1 -- 172.21.15.73:0/2735766977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9680b3c50 msgr2=0x7fb9680d2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:01.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.898+0000 7fb96ee9a640 1 --2- 172.21.15.73:0/2735766977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9680b3c50 0x7fb9680d2c00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb9580097d0 tx=0x7fb95802b770 comp rx=0 tx=0).stop 2024-03-29T04:09:01.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.898+0000 7fb96ee9a640 1 -- 172.21.15.73:0/2735766977 shutdown_connections 2024-03-29T04:09:01.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.898+0000 7fb96ee9a640 1 --2- 172.21.15.73:0/2735766977 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9680b3c50 0x7fb9680d2c00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:01.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.898+0000 7fb96ee9a640 1 -- 172.21.15.73:0/2735766977 >> 172.21.15.73:0/2735766977 conn(0x7fb96808bfc0 msgr2=0x7fb9680d4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:01.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.898+0000 7fb96ee9a640 1 -- 172.21.15.73:0/2735766977 shutdown_connections 2024-03-29T04:09:01.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.898+0000 7fb96ee9a640 1 -- 172.21.15.73:0/2735766977 wait complete. 2024-03-29T04:09:01.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.899+0000 7fb96ee9a640 1 Processor -- start 2024-03-29T04:09:01.879 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.899+0000 7fb96ee9a640 1 -- start start 2024-03-29T04:09:01.881 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.901+0000 7fb96ee9a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9680b3c50 0x7fb968160560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:01.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.901+0000 7fb96ee9a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9680d3140 0x7fb968157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:01.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.901+0000 7fb96ee9a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb96815e930 0x7fb968144870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:01.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.901+0000 7fb96ee9a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb96815ed10 con 0x7fb96815e930 2024-03-29T04:09:01.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.901+0000 7fb96ee9a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb9680cf840 con 0x7fb9680b3c50 2024-03-29T04:09:01.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.901+0000 7fb96ee9a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fb96815ee90 con 0x7fb9680d3140 2024-03-29T04:09:01.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.901+0000 7fb96d437640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb96815e930 0x7fb968144870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:01.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.901+0000 7fb96d437640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb96815e930 0x7fb968144870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47118/0 (socket says 172.21.15.73:47118) 2024-03-29T04:09:01.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.901+0000 7fb96d437640 1 -- 172.21.15.73:0/4169188715 learned_addr learned my addr 172.21.15.73:0/4169188715 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:01.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.901+0000 7fb95ffff640 1 --2- 172.21.15.73:0/4169188715 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9680d3140 0x7fb968157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:01.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.901+0000 7fb96cc36640 1 --2- 172.21.15.73:0/4169188715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9680b3c50 0x7fb968160560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:01.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.901+0000 7fb96d437640 1 -- 172.21.15.73:0/4169188715 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9680d3140 msgr2=0x7fb968157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:01.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.901+0000 7fb96d437640 1 --2- 172.21.15.73:0/4169188715 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9680d3140 0x7fb968157900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:01.882 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.901+0000 7fb96d437640 1 -- 172.21.15.73:0/4169188715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9680b3c50 msgr2=0x7fb968160560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:01.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.901+0000 7fb96d437640 1 --2- 172.21.15.73:0/4169188715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9680b3c50 0x7fb968160560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:01.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.901+0000 7fb96d437640 1 -- 172.21.15.73:0/4169188715 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb96815a880 con 0x7fb96815e930 2024-03-29T04:09:01.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.901+0000 7fb96cc36640 1 --2- 172.21.15.73:0/4169188715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9680b3c50 0x7fb968160560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:09:01.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.901+0000 7fb96d437640 1 --2- 172.21.15.73:0/4169188715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb96815e930 0x7fb968144870 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb96000c790 tx=0x7fb96000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:01.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.902+0000 7fb95d7fa640 1 -- 172.21.15.73:0/4169188715 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb960003b70 con 0x7fb96815e930 2024-03-29T04:09:01.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.902+0000 7fb95d7fa640 1 -- 172.21.15.73:0/4169188715 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb960003d10 con 0x7fb96815e930 2024-03-29T04:09:01.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.902+0000 7fb96ee9a640 1 -- 172.21.15.73:0/4169188715 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb96815ab60 con 0x7fb96815e930 2024-03-29T04:09:01.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.902+0000 7fb95d7fa640 1 -- 172.21.15.73:0/4169188715 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb96000aa50 con 0x7fb96815e930 2024-03-29T04:09:01.883 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.902+0000 7fb96ee9a640 1 -- 172.21.15.73:0/4169188715 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb968160aa0 con 0x7fb96815e930 2024-03-29T04:09:01.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.903+0000 7fb96ee9a640 1 -- 172.21.15.73:0/4169188715 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb968068640 con 0x7fb96815e930 2024-03-29T04:09:01.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.903+0000 7fb95d7fa640 1 -- 172.21.15.73:0/4169188715 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fb96000abf0 con 0x7fb96815e930 2024-03-29T04:09:01.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.903+0000 7fb95d7fa640 1 --2- 172.21.15.73:0/4169188715 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fb95406c530 0x7fb95406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:01.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.904+0000 7fb95d7fa640 1 -- 172.21.15.73:0/4169188715 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fb96008b5f0 con 0x7fb96815e930 2024-03-29T04:09:01.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.904+0000 7fb96cc36640 1 --2- 172.21.15.73:0/4169188715 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fb95406c530 0x7fb95406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:01.884 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.904+0000 7fb96cc36640 1 --2- 172.21.15.73:0/4169188715 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fb95406c530 0x7fb95406e9f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb9640017e0 tx=0x7fb964009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:01.887 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:01.908+0000 7fb95d7fa640 1 -- 172.21.15.73:0/4169188715 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fb960059c10 con 0x7fb96815e930 2024-03-29T04:09:02.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.157+0000 7fb96ee9a640 1 -- 172.21.15.73:0/4169188715 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb9680b2d40 con 0x7fb96815e930 2024-03-29T04:09:02.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.158+0000 7fb95d7fa640 1 -- 172.21.15.73:0/4169188715 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5181 (secure 0 0 0) 0x7fb960059510 con 0x7fb96815e930 2024-03-29T04:09:02.138 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:09:02.138 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4739,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1125143848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1125143848},{"type":"v1","addr":"172.21.15.73:6837","nonce":1125143848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4742,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2988261972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2988261972},{"type":"v1","addr":"172.21.15.142:6835","nonce":2988261972}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5029,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/510984531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":510984531},{"type":"v1","addr":"172.21.15.142:6834","nonce":510984531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-29T04:08:59.079178+0000","modified":"2024-03-29T04:09:01.095589+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5055},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5055":{"gid":5055,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6836/936189393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":936189393},{"type":"v1","addr":"172.21.15.73:6836","nonce":936189393}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5055,"qdb_cluster":[5055]},"id":2}]} 2024-03-29T04:09:02.138 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 13 2024-03-29T04:09:02.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.160+0000 7fb96ee9a640 1 -- 172.21.15.73:0/4169188715 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fb95406c530 msgr2=0x7fb95406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:02.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.160+0000 7fb96ee9a640 1 --2- 172.21.15.73:0/4169188715 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fb95406c530 0x7fb95406e9f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb9640017e0 tx=0x7fb964009040 comp rx=0 tx=0).stop 2024-03-29T04:09:02.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.160+0000 7fb96ee9a640 1 -- 172.21.15.73:0/4169188715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb96815e930 msgr2=0x7fb968144870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:02.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.160+0000 7fb96ee9a640 1 --2- 172.21.15.73:0/4169188715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb96815e930 0x7fb968144870 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb96000c790 tx=0x7fb96000cc50 comp rx=0 tx=0).stop 2024-03-29T04:09:02.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.160+0000 7fb96ee9a640 1 -- 172.21.15.73:0/4169188715 shutdown_connections 2024-03-29T04:09:02.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.160+0000 7fb96ee9a640 1 --2- 172.21.15.73:0/4169188715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb96815e930 0x7fb968144870 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:02.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.160+0000 7fb96ee9a640 1 --2- 172.21.15.73:0/4169188715 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9680d3140 0x7fb968157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:02.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.160+0000 7fb96ee9a640 1 --2- 172.21.15.73:0/4169188715 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fb95406c530 0x7fb95406e9f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:02.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.160+0000 7fb96ee9a640 1 --2- 172.21.15.73:0/4169188715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9680b3c50 0x7fb968160560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:02.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.160+0000 7fb96ee9a640 1 -- 172.21.15.73:0/4169188715 >> 172.21.15.73:0/4169188715 conn(0x7fb96808bfc0 msgr2=0x7fb9680b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:02.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.160+0000 7fb96ee9a640 1 -- 172.21.15.73:0/4169188715 shutdown_connections 2024-03-29T04:09:02.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.160+0000 7fb96ee9a640 1 -- 172.21.15.73:0/4169188715 wait complete. 2024-03-29T04:09:02.151 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-29T04:09:02.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.309+0000 7fe621ba8640 1 Processor -- start 2024-03-29T04:09:02.294 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.309+0000 7fe621ba8640 1 -- start start 2024-03-29T04:09:02.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.310+0000 7fe621ba8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe61c15e930 0x7fe61c0cf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:02.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.310+0000 7fe621ba8640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe61c0d3310 0x7fe61c06cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:02.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.310+0000 7fe621ba8640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe61c0cfb30 con 0x7fe61c0cf670 2024-03-29T04:09:02.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.310+0000 7fe621ba8640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fe61c06c780 con 0x7fe61c0d3310 2024-03-29T04:09:02.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.310+0000 7fe621ba8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe61c0cfe10 con 0x7fe61c15e930 2024-03-29T04:09:02.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.310+0000 7fe61b7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe61c15e930 0x7fe61c0cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:02.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.310+0000 7fe61bfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe61c0d3310 0x7fe61c06cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:02.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.310+0000 7fe61b7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe61c15e930 0x7fe61c0cf130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:41644/0 (socket says 172.21.15.73:41644) 2024-03-29T04:09:02.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.310+0000 7fe61b7fe640 1 -- 172.21.15.73:0/3600856839 learned_addr learned my addr 172.21.15.73:0/3600856839 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:02.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.310+0000 7fe612ffd640 1 --1- 172.21.15.73:0/3600856839 >> v1:172.21.15.142:6789/0 conn(0x7fe61c0cf670 0x7fe61c0d2c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.73:33522/0 (socket says 172.21.15.73:33522) 2024-03-29T04:09:02.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.311+0000 7fe61b7fe640 1 -- 172.21.15.73:0/3600856839 >> v2:172.21.15.142:3300/0 conn(0x7fe61c0d3310 msgr2=0x7fe61c06cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:02.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.311+0000 7fe61b7fe640 1 --2- 172.21.15.73:0/3600856839 >> v2:172.21.15.142:3300/0 conn(0x7fe61c0d3310 0x7fe61c06cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:02.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.311+0000 7fe61affd640 1 -- 172.21.15.73:0/3600856839 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3974399828 0 0) 0x7fe61c0cfb30 con 0x7fe61c0cf670 2024-03-29T04:09:02.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.311+0000 7fe61b7fe640 1 -- 172.21.15.73:0/3600856839 >> v1:172.21.15.142:6789/0 conn(0x7fe61c0cf670 legacy=0x7fe61c0d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:02.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.311+0000 7fe61b7fe640 1 -- 172.21.15.73:0/3600856839 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe61c0d00f0 con 0x7fe61c15e930 2024-03-29T04:09:02.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.311+0000 7fe61bfff640 1 --2- 172.21.15.73:0/3600856839 >> v2:172.21.15.142:3300/0 conn(0x7fe61c0d3310 0x7fe61c06cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:09:02.297 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.312+0000 7fe61b7fe640 1 --2- 172.21.15.73:0/3600856839 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe61c15e930 0x7fe61c0cf130 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe60c009870 tx=0x7fe60c02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35f2d8595ce91102 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:02.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.312+0000 7fe61affd640 1 -- 172.21.15.73:0/3600856839 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60c035020 con 0x7fe61c15e930 2024-03-29T04:09:02.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.312+0000 7fe61affd640 1 -- 172.21.15.73:0/3600856839 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe60c031640 con 0x7fe61c15e930 2024-03-29T04:09:02.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.312+0000 7fe61affd640 1 -- 172.21.15.73:0/3600856839 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60c02d040 con 0x7fe61c15e930 2024-03-29T04:09:02.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.312+0000 7fe621ba8640 1 -- 172.21.15.73:0/3600856839 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe61c15e930 msgr2=0x7fe61c0cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:02.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.312+0000 7fe621ba8640 1 --2- 172.21.15.73:0/3600856839 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe61c15e930 0x7fe61c0cf130 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe60c009870 tx=0x7fe60c02b8f0 comp rx=0 tx=0).stop 2024-03-29T04:09:02.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.312+0000 7fe621ba8640 1 -- 172.21.15.73:0/3600856839 shutdown_connections 2024-03-29T04:09:02.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.312+0000 7fe621ba8640 1 --2- 172.21.15.73:0/3600856839 >> v2:172.21.15.142:3300/0 conn(0x7fe61c0d3310 0x7fe61c06cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:02.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.312+0000 7fe621ba8640 1 --2- 172.21.15.73:0/3600856839 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe61c15e930 0x7fe61c0cf130 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:02.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.313+0000 7fe621ba8640 1 -- 172.21.15.73:0/3600856839 >> 172.21.15.73:0/3600856839 conn(0x7fe61c08bfc0 msgr2=0x7fe61c0d4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:02.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.313+0000 7fe621ba8640 1 -- 172.21.15.73:0/3600856839 shutdown_connections 2024-03-29T04:09:02.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.313+0000 7fe621ba8640 1 -- 172.21.15.73:0/3600856839 wait complete. 2024-03-29T04:09:02.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.314+0000 7fe621ba8640 1 Processor -- start 2024-03-29T04:09:02.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.315+0000 7fe621ba8640 1 -- start start 2024-03-29T04:09:02.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.316+0000 7fe621ba8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe61c0cf670 0x7fe61c1557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:02.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.316+0000 7fe621ba8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe61c0d3310 0x7fe61c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:02.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.316+0000 7fe621ba8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe61c15e930 0x7fe61c0ca070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:02.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.316+0000 7fe621ba8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe61c15ee90 con 0x7fe61c0cf670 2024-03-29T04:09:02.306 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.316+0000 7fe621ba8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe61c15ed10 con 0x7fe61c0d3310 2024-03-29T04:09:02.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.316+0000 7fe621ba8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fe61c0b3c50 con 0x7fe61c15e930 2024-03-29T04:09:02.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.316+0000 7fe61b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe61c0cf670 0x7fe61c1557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:02.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.316+0000 7fe61b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe61c0cf670 0x7fe61c1557e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47132/0 (socket says 172.21.15.73:47132) 2024-03-29T04:09:02.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.316+0000 7fe61b7fe640 1 -- 172.21.15.73:0/2026193824 learned_addr learned my addr 172.21.15.73:0/2026193824 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:02.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.316+0000 7fe61bfff640 1 --2- 172.21.15.73:0/2026193824 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe61c15e930 0x7fe61c0ca070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:02.307 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.316+0000 7fe612ffd640 1 --2- 172.21.15.73:0/2026193824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe61c0d3310 0x7fe61c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:02.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.316+0000 7fe61b7fe640 1 -- 172.21.15.73:0/2026193824 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe61c15e930 msgr2=0x7fe61c0ca070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:02.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.316+0000 7fe61b7fe640 1 --2- 172.21.15.73:0/2026193824 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe61c15e930 0x7fe61c0ca070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:02.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.316+0000 7fe61b7fe640 1 -- 172.21.15.73:0/2026193824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe61c0d3310 msgr2=0x7fe61c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:02.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.316+0000 7fe61b7fe640 1 --2- 172.21.15.73:0/2026193824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe61c0d3310 0x7fe61c0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:02.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.316+0000 7fe61b7fe640 1 -- 172.21.15.73:0/2026193824 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe61c0cbe90 con 0x7fe61c0cf670 2024-03-29T04:09:02.308 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.316+0000 7fe612ffd640 1 --2- 172.21.15.73:0/2026193824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe61c0d3310 0x7fe61c0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:09:02.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.316+0000 7fe61b7fe640 1 --2- 172.21.15.73:0/2026193824 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe61c0cf670 0x7fe61c1557e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe60c034040 tx=0x7fe60c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:02.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.316+0000 7fe618ff9640 1 -- 172.21.15.73:0/2026193824 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60c040070 con 0x7fe61c0cf670 2024-03-29T04:09:02.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.317+0000 7fe618ff9640 1 -- 172.21.15.73:0/2026193824 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe60c0399f0 con 0x7fe61c0cf670 2024-03-29T04:09:02.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.317+0000 7fe618ff9640 1 -- 172.21.15.73:0/2026193824 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60c035040 con 0x7fe61c0cf670 2024-03-29T04:09:02.309 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.317+0000 7fe621ba8640 1 -- 172.21.15.73:0/2026193824 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe61c0cc170 con 0x7fe61c0cf670 2024-03-29T04:09:02.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.317+0000 7fe621ba8640 1 -- 172.21.15.73:0/2026193824 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe61c0cc730 con 0x7fe61c0cf670 2024-03-29T04:09:02.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.318+0000 7fe621ba8640 1 -- 172.21.15.73:0/2026193824 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe61c068640 con 0x7fe61c0cf670 2024-03-29T04:09:02.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.318+0000 7fe618ff9640 1 -- 172.21.15.73:0/2026193824 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fe60c038020 con 0x7fe61c0cf670 2024-03-29T04:09:02.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.318+0000 7fe618ff9640 1 --2- 172.21.15.73:0/2026193824 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fe5fc06c560 0x7fe5fc06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:02.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.318+0000 7fe618ff9640 1 -- 172.21.15.73:0/2026193824 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fe60c0ace40 con 0x7fe61c0cf670 2024-03-29T04:09:02.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.318+0000 7fe612ffd640 1 --2- 172.21.15.73:0/2026193824 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fe5fc06c560 0x7fe5fc06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:02.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.319+0000 7fe612ffd640 1 --2- 172.21.15.73:0/2026193824 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fe5fc06c560 0x7fe5fc06ea20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe61c156000 tx=0x7fe604007c10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:02.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.323+0000 7fe618ff9640 1 -- 172.21.15.73:0/2026193824 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fe60c07b4f0 con 0x7fe61c0cf670 2024-03-29T04:09:02.486 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.506+0000 7fe621ba8640 1 -- 172.21.15.73:0/2026193824 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe61c0cb1b0 con 0x7fe61c0cf670 2024-03-29T04:09:02.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.507+0000 7fe618ff9640 1 -- 172.21.15.73:0/2026193824 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16669 (secure 0 0 0) 0x7fe60c07adf0 con 0x7fe61c0cf670 2024-03-29T04:09:02.487 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:09:02.488 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":32,"fsid":"6bff1617-b138-4517-acca-3ecaae3f2bb3","created":"2024-03-29T04:07:47.346864+0000","modified":"2024-03-29T04:09:00.732697+0000","last_up_change":"2024-03-29T04:07:58.507139+0000","last_in_change":"2024-03-29T04:07:49.637816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-29T04:07:59.537301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-29T04:08:57.521498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-29T04:08:58.027631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"925d7de1-14ab-48c0-aebd-7bded108f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6820","nonce":2387335359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6824","nonce":2387335359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6831","nonce":2387335359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6828","nonce":2387335359}]},"public_addr":"172.21.15.73:6820/2387335359","cluster_addr":"172.21.15.73:6824/2387335359","heartbeat_back_addr":"172.21.15.73:6831/2387335359","heartbeat_front_addr":"172.21.15.73:6828/2387335359","state":["exists","up"]},{"osd":1,"uuid":"6b182102-882a-4e0c-99db-0afae5cfb38b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6801","nonce":2431315515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6803","nonce":2431315515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6807","nonce":2431315515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6805","nonce":2431315515}]},"public_addr":"172.21.15.73:6801/2431315515","cluster_addr":"172.21.15.73:6803/2431315515","heartbeat_back_addr":"172.21.15.73:6807/2431315515","heartbeat_front_addr":"172.21.15.73:6805/2431315515","state":["exists","up"]},{"osd":2,"uuid":"8040902e-b0b8-4a21-bf64-ce1c222115ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6809","nonce":407236597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6811","nonce":407236597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6815","nonce":407236597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6813","nonce":407236597}]},"public_addr":"172.21.15.73:6809/407236597","cluster_addr":"172.21.15.73:6811/407236597","heartbeat_back_addr":"172.21.15.73:6815/407236597","heartbeat_front_addr":"172.21.15.73:6813/407236597","state":["exists","up"]},{"osd":3,"uuid":"1bab19ee-3775-4ce1-a4ce-cf7cda3bbbf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6817","nonce":4291100709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6821","nonce":4291100709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6829","nonce":4291100709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6825","nonce":4291100709}]},"public_addr":"172.21.15.73:6817/4291100709","cluster_addr":"172.21.15.73:6821/4291100709","heartbeat_back_addr":"172.21.15.73:6829/4291100709","heartbeat_front_addr":"172.21.15.73:6825/4291100709","state":["exists","up"]},{"osd":4,"uuid":"b0c74337-8fe4-47dc-b3da-2d07591b1f6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6817","nonce":3703256194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6819","nonce":3703256194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6823","nonce":3703256194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6821","nonce":3703256194}]},"public_addr":"172.21.15.142:6817/3703256194","cluster_addr":"172.21.15.142:6819/3703256194","heartbeat_back_addr":"172.21.15.142:6823/3703256194","heartbeat_front_addr":"172.21.15.142:6821/3703256194","state":["exists","up"]},{"osd":5,"uuid":"9ce36410-a29a-42c6-99f4-f95d4afdd7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6825","nonce":4271575803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6827","nonce":4271575803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6831","nonce":4271575803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6829","nonce":4271575803}]},"public_addr":"172.21.15.142:6825/4271575803","cluster_addr":"172.21.15.142:6827/4271575803","heartbeat_back_addr":"172.21.15.142:6831/4271575803","heartbeat_front_addr":"172.21.15.142:6829/4271575803","state":["exists","up"]},{"osd":6,"uuid":"aec4264a-64ac-428e-a860-d2920a304019","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6801","nonce":1772722570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6803","nonce":1772722570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6807","nonce":1772722570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6805","nonce":1772722570}]},"public_addr":"172.21.15.142:6801/1772722570","cluster_addr":"172.21.15.142:6803/1772722570","heartbeat_back_addr":"172.21.15.142:6807/1772722570","heartbeat_front_addr":"172.21.15.142:6805/1772722570","state":["exists","up"]},{"osd":7,"uuid":"fe599052-8e5a-4c7a-91e7-52d1bae24a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6809","nonce":3910589675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6811","nonce":3910589675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6815","nonce":3910589675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6813","nonce":3910589675}]},"public_addr":"172.21.15.142:6809/3910589675","cluster_addr":"172.21.15.142:6811/3910589675","heartbeat_back_addr":"172.21.15.142:6815/3910589675","heartbeat_front_addr":"172.21.15.142:6813/3910589675","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.835096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.587210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.786547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.778004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.843740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.791160+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.837992+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.718722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:09:02.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.509+0000 7fe621ba8640 1 -- 172.21.15.73:0/2026193824 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fe5fc06c560 msgr2=0x7fe5fc06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:02.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.509+0000 7fe621ba8640 1 --2- 172.21.15.73:0/2026193824 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fe5fc06c560 0x7fe5fc06ea20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe61c156000 tx=0x7fe604007c10 comp rx=0 tx=0).stop 2024-03-29T04:09:02.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.509+0000 7fe621ba8640 1 -- 172.21.15.73:0/2026193824 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe61c0cf670 msgr2=0x7fe61c1557e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:02.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.509+0000 7fe621ba8640 1 --2- 172.21.15.73:0/2026193824 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe61c0cf670 0x7fe61c1557e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe60c034040 tx=0x7fe60c0046c0 comp rx=0 tx=0).stop 2024-03-29T04:09:02.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.509+0000 7fe621ba8640 1 -- 172.21.15.73:0/2026193824 shutdown_connections 2024-03-29T04:09:02.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.509+0000 7fe621ba8640 1 --2- 172.21.15.73:0/2026193824 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fe61c15e930 0x7fe61c0ca070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:02.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.509+0000 7fe621ba8640 1 --2- 172.21.15.73:0/2026193824 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fe5fc06c560 0x7fe5fc06ea20 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:02.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.509+0000 7fe621ba8640 1 --2- 172.21.15.73:0/2026193824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe61c0d3310 0x7fe61c0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:02.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.509+0000 7fe621ba8640 1 --2- 172.21.15.73:0/2026193824 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe61c0cf670 0x7fe61c1557e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:02.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.509+0000 7fe621ba8640 1 -- 172.21.15.73:0/2026193824 >> 172.21.15.73:0/2026193824 conn(0x7fe61c08bfc0 msgr2=0x7fe61c0d37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:02.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.509+0000 7fe621ba8640 1 -- 172.21.15.73:0/2026193824 shutdown_connections 2024-03-29T04:09:02.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.509+0000 7fe621ba8640 1 -- 172.21.15.73:0/2026193824 wait complete. 2024-03-29T04:09:02.500 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-29T04:09:02.500 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-29T04:09:02.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.625+0000 7f9b20849640 1 Processor -- start 2024-03-29T04:09:02.605 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.625+0000 7f9b20849640 1 -- start start 2024-03-29T04:09:02.606 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.626+0000 7f9b20849640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b1c15e930 0x7f9b1c0cf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:02.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.626+0000 7f9b20849640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9b1c0cf670 0x7f9b1c0d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:02.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.626+0000 7f9b20849640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b1c0cfb30 con 0x7f9b1c0b3c50 2024-03-29T04:09:02.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.626+0000 7f9b20849640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f9b1c06c780 con 0x7f9b1c0cf670 2024-03-29T04:09:02.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.626+0000 7f9b20849640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9b1c0cfe10 con 0x7f9b1c15e930 2024-03-29T04:09:02.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.626+0000 7f9b1a59c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b1c15e930 0x7f9b1c0cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:02.607 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.626+0000 7f9b19d9b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9b1c0cf670 0x7f9b1c0d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:02.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.626+0000 7f9b1a59c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b1c15e930 0x7f9b1c0cf130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:41654/0 (socket says 172.21.15.73:41654) 2024-03-29T04:09:02.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.626+0000 7f9b1a59c640 1 -- 172.21.15.73:0/4011130457 learned_addr learned my addr 172.21.15.73:0/4011130457 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:02.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.626+0000 7f9b1ad9d640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f9b1c0b3c50 0x7f9b1c0d0c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.73:33536/0 (socket says 172.21.15.73:33536) 2024-03-29T04:09:02.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.627+0000 7f9b1a59c640 1 -- 172.21.15.73:0/4011130457 >> v2:172.21.15.142:3300/0 conn(0x7f9b1c0cf670 msgr2=0x7f9b1c0d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:02.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.627+0000 7f9b1a59c640 1 --2- 172.21.15.73:0/4011130457 >> v2:172.21.15.142:3300/0 conn(0x7f9b1c0cf670 0x7f9b1c0d2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:02.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.627+0000 7f9b1a59c640 1 -- 172.21.15.73:0/4011130457 >> v1:172.21.15.142:6789/0 conn(0x7f9b1c0b3c50 legacy=0x7f9b1c0d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:02.608 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.627+0000 7f9b1a59c640 1 -- 172.21.15.73:0/4011130457 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b1c0d00f0 con 0x7f9b1c15e930 2024-03-29T04:09:02.609 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.627+0000 7f9b19d9b640 1 --2- 172.21.15.73:0/4011130457 >> v2:172.21.15.142:3300/0 conn(0x7f9b1c0cf670 0x7f9b1c0d2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:09:02.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.627+0000 7f9b1a59c640 1 --2- 172.21.15.73:0/4011130457 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b1c15e930 0x7f9b1c0cf130 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9b14009870 tx=0x7f9b1402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=762b5505d50a6731 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:02.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.628+0000 7f9b1959a640 1 -- 172.21.15.73:0/4011130457 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b14035020 con 0x7f9b1c15e930 2024-03-29T04:09:02.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.628+0000 7f9b1959a640 1 -- 172.21.15.73:0/4011130457 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b14031640 con 0x7f9b1c15e930 2024-03-29T04:09:02.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.628+0000 7f9b1959a640 1 -- 172.21.15.73:0/4011130457 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1402d040 con 0x7f9b1c15e930 2024-03-29T04:09:02.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.628+0000 7f9b20849640 1 -- 172.21.15.73:0/4011130457 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b1c15e930 msgr2=0x7f9b1c0cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:02.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.628+0000 7f9b20849640 1 --2- 172.21.15.73:0/4011130457 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b1c15e930 0x7f9b1c0cf130 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9b14009870 tx=0x7f9b1402b8f0 comp rx=0 tx=0).stop 2024-03-29T04:09:02.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.628+0000 7f9b20849640 1 -- 172.21.15.73:0/4011130457 shutdown_connections 2024-03-29T04:09:02.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.628+0000 7f9b20849640 1 --2- 172.21.15.73:0/4011130457 >> v2:172.21.15.142:3300/0 conn(0x7f9b1c0cf670 0x7f9b1c0d2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:02.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.628+0000 7f9b20849640 1 --2- 172.21.15.73:0/4011130457 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b1c15e930 0x7f9b1c0cf130 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:02.613 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.628+0000 7f9b20849640 1 -- 172.21.15.73:0/4011130457 >> 172.21.15.73:0/4011130457 conn(0x7f9b1c08bfc0 msgr2=0x7f9b1c0d4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.628+0000 7f9b20849640 1 -- 172.21.15.73:0/4011130457 shutdown_connections 2024-03-29T04:09:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.628+0000 7f9b20849640 1 -- 172.21.15.73:0/4011130457 wait complete. 2024-03-29T04:09:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.630+0000 7f9b20849640 1 Processor -- start 2024-03-29T04:09:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.630+0000 7f9b20849640 1 -- start start 2024-03-29T04:09:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.630+0000 7f9b20849640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b1c0b3c50 0x7f9b1c1f85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.630+0000 7f9b20849640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b1c0cf670 0x7f9b1c157e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.630+0000 7f9b20849640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b1c15e930 0x7f9b1c0cd690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.630+0000 7f9b20849640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9b1c15ee90 con 0x7f9b1c0cf670 2024-03-29T04:09:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.630+0000 7f9b20849640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9b1c15ed10 con 0x7f9b1c0b3c50 2024-03-29T04:09:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.630+0000 7f9b20849640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9b1c06dc20 con 0x7f9b1c15e930 2024-03-29T04:09:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.631+0000 7f9b19d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b1c0cf670 0x7f9b1c157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.631+0000 7f9b19d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b1c0cf670 0x7f9b1c157e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47138/0 (socket says 172.21.15.73:47138) 2024-03-29T04:09:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.631+0000 7f9b19d9b640 1 -- 172.21.15.73:0/740093474 learned_addr learned my addr 172.21.15.73:0/740093474 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:02.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.631+0000 7f9b1a59c640 1 --2- 172.21.15.73:0/740093474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b1c0b3c50 0x7f9b1c1f85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:02.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.631+0000 7f9b1ad9d640 1 --2- 172.21.15.73:0/740093474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b1c15e930 0x7f9b1c0cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:02.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.631+0000 7f9b19d9b640 1 -- 172.21.15.73:0/740093474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b1c15e930 msgr2=0x7f9b1c0cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:02.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.631+0000 7f9b19d9b640 1 --2- 172.21.15.73:0/740093474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b1c15e930 0x7f9b1c0cd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:02.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.631+0000 7f9b19d9b640 1 -- 172.21.15.73:0/740093474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b1c0b3c50 msgr2=0x7f9b1c1f85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:02.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.631+0000 7f9b19d9b640 1 --2- 172.21.15.73:0/740093474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b1c0b3c50 0x7f9b1c1f85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:02.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.631+0000 7f9b19d9b640 1 -- 172.21.15.73:0/740093474 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b1c1583c0 con 0x7f9b1c0cf670 2024-03-29T04:09:02.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.631+0000 7f9b19d9b640 1 --2- 172.21.15.73:0/740093474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b1c0cf670 0x7f9b1c157e80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9b0400ebe0 tx=0x7f9b0400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:02.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.631+0000 7f9b12ffd640 1 -- 172.21.15.73:0/740093474 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b04017070 con 0x7f9b1c0cf670 2024-03-29T04:09:02.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.631+0000 7f9b20849640 1 -- 172.21.15.73:0/740093474 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b1c0cdbd0 con 0x7f9b1c0cf670 2024-03-29T04:09:02.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.631+0000 7f9b12ffd640 1 -- 172.21.15.73:0/740093474 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b0400cc30 con 0x7f9b1c0cf670 2024-03-29T04:09:02.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.631+0000 7f9b12ffd640 1 -- 172.21.15.73:0/740093474 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b04013470 con 0x7f9b1c0cf670 2024-03-29T04:09:02.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.631+0000 7f9b20849640 1 -- 172.21.15.73:0/740093474 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b1c1589e0 con 0x7f9b1c0cf670 2024-03-29T04:09:02.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.632+0000 7f9b20849640 1 -- 172.21.15.73:0/740093474 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b1c068640 con 0x7f9b1c0cf670 2024-03-29T04:09:02.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.633+0000 7f9b12ffd640 1 -- 172.21.15.73:0/740093474 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f9b0401a070 con 0x7f9b1c0cf670 2024-03-29T04:09:02.615 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.633+0000 7f9b12ffd640 1 --2- 172.21.15.73:0/740093474 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9afc06c530 0x7f9afc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:02.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.633+0000 7f9b12ffd640 1 -- 172.21.15.73:0/740093474 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f9b0408b5e0 con 0x7f9b1c0cf670 2024-03-29T04:09:02.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.633+0000 7f9b1a59c640 1 --2- 172.21.15.73:0/740093474 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9afc06c530 0x7f9afc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:02.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.633+0000 7f9b1a59c640 1 --2- 172.21.15.73:0/740093474 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9afc06c530 0x7f9afc06e9f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9b14036000 tx=0x7f9b1403c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:02.617 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.637+0000 7f9b12ffd640 1 -- 172.21.15.73:0/740093474 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f9b040595c0 con 0x7f9b1c0cf670 2024-03-29T04:09:02.792 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.812+0000 7f9b20849640 1 -- 172.21.15.73:0/740093474 --> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9b1c0d1680 con 0x7f9afc06c530 2024-03-29T04:09:02.798 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.818+0000 7f9b12ffd640 1 -- 172.21.15.73:0/740093474 <== mgr.4104 v2:172.21.15.73:6832/1640471941 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239854 (secure 0 0 0) 0x7f9b14082900 con 0x7f9afc06c530 2024-03-29T04:09:02.800 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:09:02.802 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-29T04:09:02.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.821+0000 7f9b20849640 1 -- 172.21.15.73:0/740093474 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9afc06c530 msgr2=0x7f9afc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:02.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.821+0000 7f9b20849640 1 --2- 172.21.15.73:0/740093474 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9afc06c530 0x7f9afc06e9f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9b14036000 tx=0x7f9b1403c040 comp rx=0 tx=0).stop 2024-03-29T04:09:02.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.821+0000 7f9b20849640 1 -- 172.21.15.73:0/740093474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b1c0cf670 msgr2=0x7f9b1c157e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:02.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.821+0000 7f9b20849640 1 --2- 172.21.15.73:0/740093474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b1c0cf670 0x7f9b1c157e80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9b0400ebe0 tx=0x7f9b0400c520 comp rx=0 tx=0).stop 2024-03-29T04:09:02.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.821+0000 7f9b20849640 1 -- 172.21.15.73:0/740093474 shutdown_connections 2024-03-29T04:09:02.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.821+0000 7f9b20849640 1 --2- 172.21.15.73:0/740093474 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b1c15e930 0x7f9b1c0cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:02.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.821+0000 7f9b20849640 1 --2- 172.21.15.73:0/740093474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b1c0cf670 0x7f9b1c157e80 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:02.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.821+0000 7f9b20849640 1 --2- 172.21.15.73:0/740093474 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9afc06c530 0x7f9afc06e9f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:02.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.821+0000 7f9b20849640 1 --2- 172.21.15.73:0/740093474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b1c0b3c50 0x7f9b1c1f85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:02.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.821+0000 7f9b20849640 1 -- 172.21.15.73:0/740093474 >> 172.21.15.73:0/740093474 conn(0x7f9b1c08bfc0 msgr2=0x7f9b1c0d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:02.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.821+0000 7f9b20849640 1 -- 172.21.15.73:0/740093474 shutdown_connections 2024-03-29T04:09:02.805 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.821+0000 7f9b20849640 1 -- 172.21.15.73:0/740093474 wait complete. 2024-03-29T04:09:02.812 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-03-29T04:09:01.531915+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219832,"kb_used_data":3652,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754888,"statfs":{"total":773094113280,"available":772869005312,"internally_reserved":0,"allocated":3739648,"data_stored":2123381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000806"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.719918+0000","last_change":"2024-03-29T04:08:57.719918+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.719918+0000","last_undegraded":"2024-03-29T04:08:57.719918+0000","last_fullsized":"2024-03-29T04:08:57.719918+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.825613+0000","last_change":"2024-03-29T04:08:57.825613+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.825613+0000","last_undegraded":"2024-03-29T04:08:57.825613+0000","last_fullsized":"2024-03-29T04:08:57.825613+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.716380+0000","last_change":"2024-03-29T04:08:57.716380+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.716380+0000","last_undegraded":"2024-03-29T04:08:57.716380+0000","last_fullsized":"2024-03-29T04:08:57.716380+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.719295+0000","last_change":"2024-03-29T04:08:57.719295+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.719295+0000","last_undegraded":"2024-03-29T04:08:57.719295+0000","last_fullsized":"2024-03-29T04:08:57.719295+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.717547+0000","last_change":"2024-03-29T04:08:57.717547+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.717547+0000","last_undegraded":"2024-03-29T04:08:57.717547+0000","last_fullsized":"2024-03-29T04:08:57.717547+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.716711+0000","last_change":"2024-03-29T04:08:57.716711+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.716711+0000","last_undegraded":"2024-03-29T04:08:57.716711+0000","last_fullsized":"2024-03-29T04:08:57.716711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.717079+0000","last_change":"2024-03-29T04:08:57.717079+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.717079+0000","last_undegraded":"2024-03-29T04:08:57.717079+0000","last_fullsized":"2024-03-29T04:08:57.717079+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.716813+0000","last_change":"2024-03-29T04:08:57.716813+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.716813+0000","last_undegraded":"2024-03-29T04:08:57.716813+0000","last_fullsized":"2024-03-29T04:08:57.716813+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.716285+0000","last_change":"2024-03-29T04:08:57.716285+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.716285+0000","last_undegraded":"2024-03-29T04:08:57.716285+0000","last_fullsized":"2024-03-29T04:08:57.716285+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.825205+0000","last_change":"2024-03-29T04:08:57.825205+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.825205+0000","last_undegraded":"2024-03-29T04:08:57.825205+0000","last_fullsized":"2024-03-29T04:08:57.825205+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.720451+0000","last_change":"2024-03-29T04:08:57.720451+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.720451+0000","last_undegraded":"2024-03-29T04:08:57.720451+0000","last_fullsized":"2024-03-29T04:08:57.720451+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.716382+0000","last_change":"2024-03-29T04:08:57.716382+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.716382+0000","last_undegraded":"2024-03-29T04:08:57.716382+0000","last_fullsized":"2024-03-29T04:08:57.716382+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.716729+0000","last_change":"2024-03-29T04:08:57.716729+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.716729+0000","last_undegraded":"2024-03-29T04:08:57.716729+0000","last_fullsized":"2024-03-29T04:08:57.716729+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.719925+0000","last_change":"2024-03-29T04:08:57.719925+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.719925+0000","last_undegraded":"2024-03-29T04:08:57.719925+0000","last_fullsized":"2024-03-29T04:08:57.719925+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.716601+0000","last_change":"2024-03-29T04:08:57.716601+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.716601+0000","last_undegraded":"2024-03-29T04:08:57.716601+0000","last_fullsized":"2024-03-29T04:08:57.716601+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.717034+0000","last_change":"2024-03-29T04:08:57.717034+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.717034+0000","last_undegraded":"2024-03-29T04:08:57.717034+0000","last_fullsized":"2024-03-29T04:08:57.717034+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.720010+0000","last_change":"2024-03-29T04:08:57.720010+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.720010+0000","last_undegraded":"2024-03-29T04:08:57.720010+0000","last_fullsized":"2024-03-29T04:08:57.720010+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.716729+0000","last_change":"2024-03-29T04:08:57.716729+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.716729+0000","last_undegraded":"2024-03-29T04:08:57.716729+0000","last_fullsized":"2024-03-29T04:08:57.716729+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.717112+0000","last_change":"2024-03-29T04:08:57.717112+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.717112+0000","last_undegraded":"2024-03-29T04:08:57.717112+0000","last_fullsized":"2024-03-29T04:08:57.717112+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.717521+0000","last_change":"2024-03-29T04:08:57.717521+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.717521+0000","last_undegraded":"2024-03-29T04:08:57.717521+0000","last_fullsized":"2024-03-29T04:08:57.717521+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.825128+0000","last_change":"2024-03-29T04:08:57.825128+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.825128+0000","last_undegraded":"2024-03-29T04:08:57.825128+0000","last_fullsized":"2024-03-29T04:08:57.825128+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.719939+0000","last_change":"2024-03-29T04:08:57.719939+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.719939+0000","last_undegraded":"2024-03-29T04:08:57.719939+0000","last_fullsized":"2024-03-29T04:08:57.719939+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.718145+0000","last_change":"2024-03-29T04:08:57.718145+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.718145+0000","last_undegraded":"2024-03-29T04:08:57.718145+0000","last_fullsized":"2024-03-29T04:08:57.718145+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.720410+0000","last_change":"2024-03-29T04:08:57.720410+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.720410+0000","last_undegraded":"2024-03-29T04:08:57.720410+0000","last_fullsized":"2024-03-29T04:08:57.720410+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.719548+0000","last_change":"2024-03-29T04:08:57.719548+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.719548+0000","last_undegraded":"2024-03-29T04:08:57.719548+0000","last_fullsized":"2024-03-29T04:08:57.719548+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.824634+0000","last_change":"2024-03-29T04:08:57.824634+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.824634+0000","last_undegraded":"2024-03-29T04:08:57.824634+0000","last_fullsized":"2024-03-29T04:08:57.824634+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.718652+0000","last_change":"2024-03-29T04:08:57.718652+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.718652+0000","last_undegraded":"2024-03-29T04:08:57.718652+0000","last_fullsized":"2024-03-29T04:08:57.718652+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.824633+0000","last_change":"2024-03-29T04:08:57.824633+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.824633+0000","last_undegraded":"2024-03-29T04:08:57.824633+0000","last_fullsized":"2024-03-29T04:08:57.824633+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.718642+0000","last_change":"2024-03-29T04:08:57.718642+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.718642+0000","last_undegraded":"2024-03-29T04:08:57.718642+0000","last_fullsized":"2024-03-29T04:08:57.718642+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.716640+0000","last_change":"2024-03-29T04:08:57.716640+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.716640+0000","last_undegraded":"2024-03-29T04:08:57.716640+0000","last_fullsized":"2024-03-29T04:08:57.716640+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.716318+0000","last_change":"2024-03-29T04:08:57.716318+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.716318+0000","last_undegraded":"2024-03-29T04:08:57.716318+0000","last_fullsized":"2024-03-29T04:08:57.716318+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.719939+0000","last_change":"2024-03-29T04:08:57.719939+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.719939+0000","last_undegraded":"2024-03-29T04:08:57.719939+0000","last_fullsized":"2024-03-29T04:08:57.719939+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":184,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T04:08:57.718690+0000","last_change":"2024-03-29T04:08:01.885311+0000","last_active":"2024-03-29T04:08:57.718690+0000","last_peered":"2024-03-29T04:08:57.718690+0000","last_clean":"2024-03-29T04:08:57.718690+0000","last_became_active":"2024-03-29T04:08:01.884340+0000","last_became_peered":"2024-03-29T04:08:01.884340+0000","last_unstale":"2024-03-29T04:08:57.718690+0000","last_undegraded":"2024-03-29T04:08:57.718690+0000","last_fullsized":"2024-03-29T04:08:57.718690+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:00.511520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:00.511520+0000","last_clean_scrub_stamp":"2024-03-29T04:08:00.511520+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:40:25.245419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":905216,"data_stored":704563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":120012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":120012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":311296,"data_stored":114195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":120012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":120012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":120012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":704563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-29T04:09:02.816 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-29T04:09:02.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.976+0000 7fb9dd0c8640 1 Processor -- start 2024-03-29T04:09:02.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.976+0000 7fb9dd0c8640 1 -- start start 2024-03-29T04:09:02.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.976+0000 7fb9dd0c8640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb9d815e930 0x7fb9d80cf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:02.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.976+0000 7fb9dd0c8640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9d80cfb30 con 0x7fb9d80d3310 2024-03-29T04:09:02.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.976+0000 7fb9dd0c8640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9d80cfe10 con 0x7fb9d80cf670 2024-03-29T04:09:02.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.976+0000 7fb9dd0c8640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fb9d806c780 con 0x7fb9d815e930 2024-03-29T04:09:02.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.977+0000 7fb9d6d9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb9d815e930 0x7fb9d80cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:02.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.977+0000 7fb9d6d9d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb9d815e930 0x7fb9d80cf130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47146/0 (socket says 172.21.15.73:47146) 2024-03-29T04:09:02.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.977+0000 7fb9d6d9d640 1 -- 172.21.15.73:0/700723976 learned_addr learned my addr 172.21.15.73:0/700723976 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:02.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.977+0000 7fb9d759e640 1 --1- 172.21.15.73:0/700723976 >> v1:172.21.15.73:6789/0 conn(0x7fb9d80d3310 0x7fb9d806cc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57402/0 (socket says 172.21.15.73:57402) 2024-03-29T04:09:02.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.977+0000 7fb9d6d9d640 1 -- 172.21.15.73:0/700723976 >> v1:172.21.15.142:6789/0 conn(0x7fb9d80cf670 legacy=0x7fb9d80d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:02.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.977+0000 7fb9d6d9d640 1 -- 172.21.15.73:0/700723976 >> v1:172.21.15.73:6789/0 conn(0x7fb9d80d3310 legacy=0x7fb9d806cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:02.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.977+0000 7fb9d6d9d640 1 -- 172.21.15.73:0/700723976 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9d80d00f0 con 0x7fb9d815e930 2024-03-29T04:09:02.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.977+0000 7fb9d5d9b640 1 -- 172.21.15.73:0/700723976 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1615099049 0 0) 0x7fb9d80cfb30 con 0x7fb9d80d3310 2024-03-29T04:09:02.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.978+0000 7fb9d6d9d640 1 --2- 172.21.15.73:0/700723976 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9d815e930 0x7fb9d80cf130 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8009870 tx=0x7fb9c802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea191c4d04c15785 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:02.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.978+0000 7fb9d5d9b640 1 -- 172.21.15.73:0/700723976 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c8034070 con 0x7fb9d815e930 2024-03-29T04:09:02.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.978+0000 7fb9d5d9b640 1 -- 172.21.15.73:0/700723976 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9c8030860 con 0x7fb9d815e930 2024-03-29T04:09:02.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.978+0000 7fb9d5d9b640 1 -- 172.21.15.73:0/700723976 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c8030c30 con 0x7fb9d815e930 2024-03-29T04:09:02.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.978+0000 7fb9dd0c8640 1 -- 172.21.15.73:0/700723976 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9d815e930 msgr2=0x7fb9d80cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:02.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.978+0000 7fb9dd0c8640 1 --2- 172.21.15.73:0/700723976 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9d815e930 0x7fb9d80cf130 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8009870 tx=0x7fb9c802b9a0 comp rx=0 tx=0).stop 2024-03-29T04:09:02.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.978+0000 7fb9dd0c8640 1 -- 172.21.15.73:0/700723976 shutdown_connections 2024-03-29T04:09:02.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.978+0000 7fb9dd0c8640 1 --2- 172.21.15.73:0/700723976 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9d815e930 0x7fb9d80cf130 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:02.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.978+0000 7fb9dd0c8640 1 -- 172.21.15.73:0/700723976 >> 172.21.15.73:0/700723976 conn(0x7fb9d808bfc0 msgr2=0x7fb9d80d4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:02.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.978+0000 7fb9dd0c8640 1 -- 172.21.15.73:0/700723976 shutdown_connections 2024-03-29T04:09:02.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.978+0000 7fb9dd0c8640 1 -- 172.21.15.73:0/700723976 wait complete. 2024-03-29T04:09:02.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.980+0000 7fb9dd0c8640 1 Processor -- start 2024-03-29T04:09:02.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.980+0000 7fb9dd0c8640 1 -- start start 2024-03-29T04:09:02.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.981+0000 7fb9dd0c8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9d80cf670 0x7fb9d80ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:02.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.981+0000 7fb9dd0c8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9d80d3310 0x7fb9d80cd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:02.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.981+0000 7fb9dd0c8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9d815e930 0x7fb9d80cd850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:02.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.981+0000 7fb9dd0c8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d815ee90 con 0x7fb9d80d3310 2024-03-29T04:09:02.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.981+0000 7fb9dd0c8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d815ed10 con 0x7fb9d815e930 2024-03-29T04:09:02.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.981+0000 7fb9dd0c8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fb9d80b3c50 con 0x7fb9d80cf670 2024-03-29T04:09:02.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.981+0000 7fb9d659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9d80d3310 0x7fb9d80cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:02.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.981+0000 7fb9d659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9d80d3310 0x7fb9d80cd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47160/0 (socket says 172.21.15.73:47160) 2024-03-29T04:09:02.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.981+0000 7fb9d659c640 1 -- 172.21.15.73:0/2981671030 learned_addr learned my addr 172.21.15.73:0/2981671030 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:02.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.981+0000 7fb9d6d9d640 1 --2- 172.21.15.73:0/2981671030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9d80cf670 0x7fb9d80ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:02.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.981+0000 7fb9d759e640 1 --2- 172.21.15.73:0/2981671030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9d815e930 0x7fb9d80cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:02.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.981+0000 7fb9d659c640 1 -- 172.21.15.73:0/2981671030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9d80cf670 msgr2=0x7fb9d80ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:02.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.981+0000 7fb9d659c640 1 --2- 172.21.15.73:0/2981671030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9d80cf670 0x7fb9d80ca0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:02.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.981+0000 7fb9d659c640 1 -- 172.21.15.73:0/2981671030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9d815e930 msgr2=0x7fb9d80cd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:02.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.981+0000 7fb9d659c640 1 --2- 172.21.15.73:0/2981671030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9d815e930 0x7fb9d80cd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:02.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.981+0000 7fb9d659c640 1 -- 172.21.15.73:0/2981671030 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9d80ce080 con 0x7fb9d80d3310 2024-03-29T04:09:02.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.981+0000 7fb9d759e640 1 --2- 172.21.15.73:0/2981671030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9d815e930 0x7fb9d80cd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:09:02.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.981+0000 7fb9d659c640 1 --2- 172.21.15.73:0/2981671030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9d80d3310 0x7fb9d80cd310 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc00c450 tx=0x7fb9cc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:02.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.981+0000 7fb9bf7fe640 1 -- 172.21.15.73:0/2981671030 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc0052d0 con 0x7fb9d80d3310 2024-03-29T04:09:02.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.981+0000 7fb9bf7fe640 1 -- 172.21.15.73:0/2981671030 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9cc005470 con 0x7fb9d80d3310 2024-03-29T04:09:02.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.981+0000 7fb9dd0c8640 1 -- 172.21.15.73:0/2981671030 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9d80ce360 con 0x7fb9d80d3310 2024-03-29T04:09:02.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.981+0000 7fb9bf7fe640 1 -- 172.21.15.73:0/2981671030 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc012870 con 0x7fb9d80d3310 2024-03-29T04:09:02.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.981+0000 7fb9dd0c8640 1 -- 172.21.15.73:0/2981671030 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9d80cdd90 con 0x7fb9d80d3310 2024-03-29T04:09:02.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.983+0000 7fb9dd0c8640 1 -- 172.21.15.73:0/2981671030 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9d8068640 con 0x7fb9d80d3310 2024-03-29T04:09:02.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.983+0000 7fb9bf7fe640 1 -- 172.21.15.73:0/2981671030 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fb9cc012a10 con 0x7fb9d80d3310 2024-03-29T04:09:02.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.983+0000 7fb9bf7fe640 1 --2- 172.21.15.73:0/2981671030 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fb9c406c530 0x7fb9c406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:02.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.984+0000 7fb9bf7fe640 1 -- 172.21.15.73:0/2981671030 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fb9cc08b280 con 0x7fb9d80d3310 2024-03-29T04:09:02.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.984+0000 7fb9d6d9d640 1 --2- 172.21.15.73:0/2981671030 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fb9c406c530 0x7fb9c406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:02.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.984+0000 7fb9d6d9d640 1 --2- 172.21.15.73:0/2981671030 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fb9c406c530 0x7fb9c406e9f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8036000 tx=0x7fb9c803b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:02.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:02.992+0000 7fb9bf7fe640 1 -- 172.21.15.73:0/2981671030 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fb9cc059930 con 0x7fb9d80d3310 2024-03-29T04:09:03.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.169+0000 7fb9dd0c8640 1 -- 172.21.15.73:0/2981671030 --> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb9d81541b0 con 0x7fb9c406c530 2024-03-29T04:09:03.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.175+0000 7fb9bf7fe640 1 -- 172.21.15.73:0/2981671030 <== mgr.4104 v2:172.21.15.73:6832/1640471941 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239854 (secure 0 0 0) 0x7fb9d81541b0 con 0x7fb9c406c530 2024-03-29T04:09:03.157 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:09:03.158 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-29T04:09:03.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.178+0000 7fb9dd0c8640 1 -- 172.21.15.73:0/2981671030 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fb9c406c530 msgr2=0x7fb9c406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:03.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.178+0000 7fb9dd0c8640 1 --2- 172.21.15.73:0/2981671030 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fb9c406c530 0x7fb9c406e9f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8036000 tx=0x7fb9c803b040 comp rx=0 tx=0).stop 2024-03-29T04:09:03.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.178+0000 7fb9dd0c8640 1 -- 172.21.15.73:0/2981671030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9d80d3310 msgr2=0x7fb9d80cd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:03.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.178+0000 7fb9dd0c8640 1 --2- 172.21.15.73:0/2981671030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9d80d3310 0x7fb9d80cd310 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc00c450 tx=0x7fb9cc00c910 comp rx=0 tx=0).stop 2024-03-29T04:09:03.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.178+0000 7fb9dd0c8640 1 -- 172.21.15.73:0/2981671030 shutdown_connections 2024-03-29T04:09:03.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.178+0000 7fb9dd0c8640 1 --2- 172.21.15.73:0/2981671030 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fb9c406c530 0x7fb9c406e9f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:03.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.178+0000 7fb9dd0c8640 1 --2- 172.21.15.73:0/2981671030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9d815e930 0x7fb9d80cd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:03.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.178+0000 7fb9dd0c8640 1 --2- 172.21.15.73:0/2981671030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb9d80d3310 0x7fb9d80cd310 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:03.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.178+0000 7fb9dd0c8640 1 --2- 172.21.15.73:0/2981671030 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fb9d80cf670 0x7fb9d80ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:03.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.178+0000 7fb9dd0c8640 1 -- 172.21.15.73:0/2981671030 >> 172.21.15.73:0/2981671030 conn(0x7fb9d808bfc0 msgr2=0x7fb9d806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:03.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.178+0000 7fb9dd0c8640 1 -- 172.21.15.73:0/2981671030 shutdown_connections 2024-03-29T04:09:03.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.178+0000 7fb9dd0c8640 1 -- 172.21.15.73:0/2981671030 wait complete. 2024-03-29T04:09:03.168 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-03-29T04:09:01.531915+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219832,"kb_used_data":3652,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754888,"statfs":{"total":773094113280,"available":772869005312,"internally_reserved":0,"allocated":3739648,"data_stored":2123381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000806"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.719918+0000","last_change":"2024-03-29T04:08:57.719918+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.719918+0000","last_undegraded":"2024-03-29T04:08:57.719918+0000","last_fullsized":"2024-03-29T04:08:57.719918+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.825613+0000","last_change":"2024-03-29T04:08:57.825613+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.825613+0000","last_undegraded":"2024-03-29T04:08:57.825613+0000","last_fullsized":"2024-03-29T04:08:57.825613+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.716380+0000","last_change":"2024-03-29T04:08:57.716380+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.716380+0000","last_undegraded":"2024-03-29T04:08:57.716380+0000","last_fullsized":"2024-03-29T04:08:57.716380+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.719295+0000","last_change":"2024-03-29T04:08:57.719295+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.719295+0000","last_undegraded":"2024-03-29T04:08:57.719295+0000","last_fullsized":"2024-03-29T04:08:57.719295+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.717547+0000","last_change":"2024-03-29T04:08:57.717547+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.717547+0000","last_undegraded":"2024-03-29T04:08:57.717547+0000","last_fullsized":"2024-03-29T04:08:57.717547+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.716711+0000","last_change":"2024-03-29T04:08:57.716711+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.716711+0000","last_undegraded":"2024-03-29T04:08:57.716711+0000","last_fullsized":"2024-03-29T04:08:57.716711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.717079+0000","last_change":"2024-03-29T04:08:57.717079+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.717079+0000","last_undegraded":"2024-03-29T04:08:57.717079+0000","last_fullsized":"2024-03-29T04:08:57.717079+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.716813+0000","last_change":"2024-03-29T04:08:57.716813+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.716813+0000","last_undegraded":"2024-03-29T04:08:57.716813+0000","last_fullsized":"2024-03-29T04:08:57.716813+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.716285+0000","last_change":"2024-03-29T04:08:57.716285+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.716285+0000","last_undegraded":"2024-03-29T04:08:57.716285+0000","last_fullsized":"2024-03-29T04:08:57.716285+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.825205+0000","last_change":"2024-03-29T04:08:57.825205+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.825205+0000","last_undegraded":"2024-03-29T04:08:57.825205+0000","last_fullsized":"2024-03-29T04:08:57.825205+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.720451+0000","last_change":"2024-03-29T04:08:57.720451+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.720451+0000","last_undegraded":"2024-03-29T04:08:57.720451+0000","last_fullsized":"2024-03-29T04:08:57.720451+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.716382+0000","last_change":"2024-03-29T04:08:57.716382+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.716382+0000","last_undegraded":"2024-03-29T04:08:57.716382+0000","last_fullsized":"2024-03-29T04:08:57.716382+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.716729+0000","last_change":"2024-03-29T04:08:57.716729+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.716729+0000","last_undegraded":"2024-03-29T04:08:57.716729+0000","last_fullsized":"2024-03-29T04:08:57.716729+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.719925+0000","last_change":"2024-03-29T04:08:57.719925+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.719925+0000","last_undegraded":"2024-03-29T04:08:57.719925+0000","last_fullsized":"2024-03-29T04:08:57.719925+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.716601+0000","last_change":"2024-03-29T04:08:57.716601+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.716601+0000","last_undegraded":"2024-03-29T04:08:57.716601+0000","last_fullsized":"2024-03-29T04:08:57.716601+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.717034+0000","last_change":"2024-03-29T04:08:57.717034+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.717034+0000","last_undegraded":"2024-03-29T04:08:57.717034+0000","last_fullsized":"2024-03-29T04:08:57.717034+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.720010+0000","last_change":"2024-03-29T04:08:57.720010+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.720010+0000","last_undegraded":"2024-03-29T04:08:57.720010+0000","last_fullsized":"2024-03-29T04:08:57.720010+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.716729+0000","last_change":"2024-03-29T04:08:57.716729+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.716729+0000","last_undegraded":"2024-03-29T04:08:57.716729+0000","last_fullsized":"2024-03-29T04:08:57.716729+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.717112+0000","last_change":"2024-03-29T04:08:57.717112+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.717112+0000","last_undegraded":"2024-03-29T04:08:57.717112+0000","last_fullsized":"2024-03-29T04:08:57.717112+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.717521+0000","last_change":"2024-03-29T04:08:57.717521+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.717521+0000","last_undegraded":"2024-03-29T04:08:57.717521+0000","last_fullsized":"2024-03-29T04:08:57.717521+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.825128+0000","last_change":"2024-03-29T04:08:57.825128+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.825128+0000","last_undegraded":"2024-03-29T04:08:57.825128+0000","last_fullsized":"2024-03-29T04:08:57.825128+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.719939+0000","last_change":"2024-03-29T04:08:57.719939+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.719939+0000","last_undegraded":"2024-03-29T04:08:57.719939+0000","last_fullsized":"2024-03-29T04:08:57.719939+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.718145+0000","last_change":"2024-03-29T04:08:57.718145+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.718145+0000","last_undegraded":"2024-03-29T04:08:57.718145+0000","last_fullsized":"2024-03-29T04:08:57.718145+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.720410+0000","last_change":"2024-03-29T04:08:57.720410+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.720410+0000","last_undegraded":"2024-03-29T04:08:57.720410+0000","last_fullsized":"2024-03-29T04:08:57.720410+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.719548+0000","last_change":"2024-03-29T04:08:57.719548+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.719548+0000","last_undegraded":"2024-03-29T04:08:57.719548+0000","last_fullsized":"2024-03-29T04:08:57.719548+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.824634+0000","last_change":"2024-03-29T04:08:57.824634+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.824634+0000","last_undegraded":"2024-03-29T04:08:57.824634+0000","last_fullsized":"2024-03-29T04:08:57.824634+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.718652+0000","last_change":"2024-03-29T04:08:57.718652+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.718652+0000","last_undegraded":"2024-03-29T04:08:57.718652+0000","last_fullsized":"2024-03-29T04:08:57.718652+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.824633+0000","last_change":"2024-03-29T04:08:57.824633+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.824633+0000","last_undegraded":"2024-03-29T04:08:57.824633+0000","last_fullsized":"2024-03-29T04:08:57.824633+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.718642+0000","last_change":"2024-03-29T04:08:57.718642+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.718642+0000","last_undegraded":"2024-03-29T04:08:57.718642+0000","last_fullsized":"2024-03-29T04:08:57.718642+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.716640+0000","last_change":"2024-03-29T04:08:57.716640+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.716640+0000","last_undegraded":"2024-03-29T04:08:57.716640+0000","last_fullsized":"2024-03-29T04:08:57.716640+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.716318+0000","last_change":"2024-03-29T04:08:57.716318+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.716318+0000","last_undegraded":"2024-03-29T04:08:57.716318+0000","last_fullsized":"2024-03-29T04:08:57.716318+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.719939+0000","last_change":"2024-03-29T04:08:57.719939+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.719939+0000","last_undegraded":"2024-03-29T04:08:57.719939+0000","last_fullsized":"2024-03-29T04:08:57.719939+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":184,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T04:08:57.718690+0000","last_change":"2024-03-29T04:08:01.885311+0000","last_active":"2024-03-29T04:08:57.718690+0000","last_peered":"2024-03-29T04:08:57.718690+0000","last_clean":"2024-03-29T04:08:57.718690+0000","last_became_active":"2024-03-29T04:08:01.884340+0000","last_became_peered":"2024-03-29T04:08:01.884340+0000","last_unstale":"2024-03-29T04:08:57.718690+0000","last_undegraded":"2024-03-29T04:08:57.718690+0000","last_fullsized":"2024-03-29T04:08:57.718690+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:00.511520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:00.511520+0000","last_clean_scrub_stamp":"2024-03-29T04:08:00.511520+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:40:25.245419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":905216,"data_stored":704563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":120012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":120012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":311296,"data_stored":114195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":120012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":120012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":120012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":704563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-29T04:09:03.172 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-29T04:09:03.310 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.331+0000 7fedc33a8640 1 Processor -- start 2024-03-29T04:09:03.311 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.331+0000 7fedc33a8640 1 -- start start 2024-03-29T04:09:03.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.332+0000 7fedc33a8640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fedbc15e930 0x7fedbc0cf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:03.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.332+0000 7fedc33a8640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fedbc0cf670 0x7fedbc0d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:03.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.332+0000 7fedc33a8640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedbc0cfb30 con 0x7fedbc0b3c50 2024-03-29T04:09:03.312 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.332+0000 7fedc33a8640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fedbc06c780 con 0x7fedbc15e930 2024-03-29T04:09:03.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.332+0000 7fedc33a8640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fedbc0cfe10 con 0x7fedbc0cf670 2024-03-29T04:09:03.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.332+0000 7fedc1144640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fedbc15e930 0x7fedbc0cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:03.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.332+0000 7fedc1144640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fedbc15e930 0x7fedbc0cf130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47170/0 (socket says 172.21.15.73:47170) 2024-03-29T04:09:03.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.332+0000 7fedc1144640 1 -- 172.21.15.73:0/1847032875 learned_addr learned my addr 172.21.15.73:0/1847032875 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:03.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.332+0000 7fedc0943640 1 --2- 172.21.15.73:0/1847032875 >> v2:172.21.15.142:3300/0 conn(0x7fedbc0cf670 0x7fedbc0d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:03.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.332+0000 7fedc1144640 1 -- 172.21.15.73:0/1847032875 >> v2:172.21.15.142:3300/0 conn(0x7fedbc0cf670 msgr2=0x7fedbc0d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:03.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.332+0000 7fedc1144640 1 --2- 172.21.15.73:0/1847032875 >> v2:172.21.15.142:3300/0 conn(0x7fedbc0cf670 0x7fedbc0d2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:03.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.332+0000 7fedc1144640 1 -- 172.21.15.73:0/1847032875 >> v1:172.21.15.142:6789/0 conn(0x7fedbc0b3c50 legacy=0x7fedbc0d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:03.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.332+0000 7fedc1144640 1 -- 172.21.15.73:0/1847032875 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedbc0d00f0 con 0x7fedbc15e930 2024-03-29T04:09:03.313 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.332+0000 7fedc0943640 1 --2- 172.21.15.73:0/1847032875 >> v2:172.21.15.142:3300/0 conn(0x7fedbc0cf670 0x7fedbc0d2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:09:03.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.333+0000 7fedc1144640 1 --2- 172.21.15.73:0/1847032875 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedbc15e930 0x7fedbc0cf130 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fedbc06c900 tx=0x7fedb802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55b0f880d45336c9 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:03.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.334+0000 7fedb3fff640 1 -- 172.21.15.73:0/1847032875 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb802e070 con 0x7fedbc15e930 2024-03-29T04:09:03.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.334+0000 7fedb3fff640 1 -- 172.21.15.73:0/1847032875 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedb8037070 con 0x7fedbc15e930 2024-03-29T04:09:03.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.334+0000 7fedb3fff640 1 -- 172.21.15.73:0/1847032875 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb8031a00 con 0x7fedbc15e930 2024-03-29T04:09:03.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.334+0000 7fedc33a8640 1 -- 172.21.15.73:0/1847032875 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedbc15e930 msgr2=0x7fedbc0cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:03.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.334+0000 7fedc33a8640 1 --2- 172.21.15.73:0/1847032875 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedbc15e930 0x7fedbc0cf130 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fedbc06c900 tx=0x7fedb802b880 comp rx=0 tx=0).stop 2024-03-29T04:09:03.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.334+0000 7fedc33a8640 1 -- 172.21.15.73:0/1847032875 shutdown_connections 2024-03-29T04:09:03.315 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.334+0000 7fedc33a8640 1 --2- 172.21.15.73:0/1847032875 >> v2:172.21.15.142:3300/0 conn(0x7fedbc0cf670 0x7fedbc0d2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:03.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.334+0000 7fedc33a8640 1 --2- 172.21.15.73:0/1847032875 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedbc15e930 0x7fedbc0cf130 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:03.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.334+0000 7fedc33a8640 1 -- 172.21.15.73:0/1847032875 >> 172.21.15.73:0/1847032875 conn(0x7fedbc08bfc0 msgr2=0x7fedbc0d4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:03.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.334+0000 7fedc33a8640 1 -- 172.21.15.73:0/1847032875 shutdown_connections 2024-03-29T04:09:03.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.334+0000 7fedc33a8640 1 -- 172.21.15.73:0/1847032875 wait complete. 2024-03-29T04:09:03.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.335+0000 7fedc33a8640 1 Processor -- start 2024-03-29T04:09:03.316 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.335+0000 7fedc33a8640 1 -- start start 2024-03-29T04:09:03.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.336+0000 7fedc33a8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedbc0b3c50 0x7fedbc14a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:03.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.336+0000 7fedc33a8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedbc0cf670 0x7fedbc156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:03.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.336+0000 7fedc33a8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedbc15e930 0x7fedbc157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:03.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.336+0000 7fedc33a8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fedbc15ee90 con 0x7fedbc0b3c50 2024-03-29T04:09:03.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.336+0000 7fedc33a8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fedbc15ed10 con 0x7fedbc0cf670 2024-03-29T04:09:03.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.336+0000 7fedc33a8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fedbc06dc20 con 0x7fedbc15e930 2024-03-29T04:09:03.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.336+0000 7fedc1144640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedbc0b3c50 0x7fedbc14a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:03.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.336+0000 7fedc1144640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedbc0b3c50 0x7fedbc14a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47182/0 (socket says 172.21.15.73:47182) 2024-03-29T04:09:03.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.336+0000 7fedc1144640 1 -- 172.21.15.73:0/231891499 learned_addr learned my addr 172.21.15.73:0/231891499 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:03.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.336+0000 7fedc1945640 1 --2- 172.21.15.73:0/231891499 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedbc15e930 0x7fedbc157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:03.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.336+0000 7fedc1144640 1 -- 172.21.15.73:0/231891499 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedbc15e930 msgr2=0x7fedbc157ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:03.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.336+0000 7fedc0943640 1 --2- 172.21.15.73:0/231891499 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedbc0cf670 0x7fedbc156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:03.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.337+0000 7fedc1144640 1 --2- 172.21.15.73:0/231891499 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedbc15e930 0x7fedbc157ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:03.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.337+0000 7fedc1144640 1 -- 172.21.15.73:0/231891499 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedbc0cf670 msgr2=0x7fedbc156620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:03.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.337+0000 7fedc1144640 1 --2- 172.21.15.73:0/231891499 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedbc0cf670 0x7fedbc156620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:03.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.337+0000 7fedc1144640 1 -- 172.21.15.73:0/231891499 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedbc14ae30 con 0x7fedbc0b3c50 2024-03-29T04:09:03.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.337+0000 7fedc1945640 1 --2- 172.21.15.73:0/231891499 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedbc15e930 0x7fedbc157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:09:03.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.337+0000 7fedc1144640 1 --2- 172.21.15.73:0/231891499 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedbc0b3c50 0x7fedbc14a8f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fedb8000c00 tx=0x7fedb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:03.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.337+0000 7fedb1ffb640 1 -- 172.21.15.73:0/231891499 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb8032880 con 0x7fedbc0b3c50 2024-03-29T04:09:03.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.337+0000 7fedb1ffb640 1 -- 172.21.15.73:0/231891499 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedb8032a20 con 0x7fedbc0b3c50 2024-03-29T04:09:03.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.337+0000 7fedc33a8640 1 -- 172.21.15.73:0/231891499 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedbc157000 con 0x7fedbc0b3c50 2024-03-29T04:09:03.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.337+0000 7fedb1ffb640 1 -- 172.21.15.73:0/231891499 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb8032e10 con 0x7fedbc0b3c50 2024-03-29T04:09:03.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.337+0000 7fedc33a8640 1 -- 172.21.15.73:0/231891499 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedbc15fdc0 con 0x7fedbc0b3c50 2024-03-29T04:09:03.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.338+0000 7fedc33a8640 1 -- 172.21.15.73:0/231891499 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedbc068640 con 0x7fedbc0b3c50 2024-03-29T04:09:03.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.339+0000 7fedb1ffb640 1 -- 172.21.15.73:0/231891499 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fedb804c060 con 0x7fedbc0b3c50 2024-03-29T04:09:03.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.339+0000 7fedb1ffb640 1 --2- 172.21.15.73:0/231891499 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7feda006c560 0x7feda006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:03.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.340+0000 7fedb1ffb640 1 -- 172.21.15.73:0/231891499 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fedb80acf10 con 0x7fedbc0b3c50 2024-03-29T04:09:03.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.340+0000 7fedc0943640 1 --2- 172.21.15.73:0/231891499 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7feda006c560 0x7feda006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:03.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.340+0000 7fedc0943640 1 --2- 172.21.15.73:0/231891499 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7feda006c560 0x7feda006ea20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fedac008850 tx=0x7fedac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:03.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.344+0000 7fedb1ffb640 1 -- 172.21.15.73:0/231891499 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fedb8040070 con 0x7fedbc0b3c50 2024-03-29T04:09:03.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.522+0000 7fedc33a8640 1 -- 172.21.15.73:0/231891499 --> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fedbc0b3210 con 0x7feda006c560 2024-03-29T04:09:03.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.528+0000 7fedb1ffb640 1 -- 172.21.15.73:0/231891499 <== mgr.4104 v2:172.21.15.73:6832/1640471941 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239854 (secure 0 0 0) 0x7fedbc0b3210 con 0x7feda006c560 2024-03-29T04:09:03.510 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:09:03.511 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-29T04:09:03.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.531+0000 7fedc33a8640 1 -- 172.21.15.73:0/231891499 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7feda006c560 msgr2=0x7feda006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:03.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.531+0000 7fedc33a8640 1 --2- 172.21.15.73:0/231891499 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7feda006c560 0x7feda006ea20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fedac008850 tx=0x7fedac008040 comp rx=0 tx=0).stop 2024-03-29T04:09:03.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.531+0000 7fedc33a8640 1 -- 172.21.15.73:0/231891499 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedbc0b3c50 msgr2=0x7fedbc14a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:03.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.531+0000 7fedc33a8640 1 --2- 172.21.15.73:0/231891499 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedbc0b3c50 0x7fedbc14a8f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fedb8000c00 tx=0x7fedb80046c0 comp rx=0 tx=0).stop 2024-03-29T04:09:03.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.531+0000 7fedc33a8640 1 -- 172.21.15.73:0/231891499 shutdown_connections 2024-03-29T04:09:03.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.531+0000 7fedc33a8640 1 --2- 172.21.15.73:0/231891499 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fedbc15e930 0x7fedbc157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:03.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.531+0000 7fedc33a8640 1 --2- 172.21.15.73:0/231891499 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7feda006c560 0x7feda006ea20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:03.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.531+0000 7fedc33a8640 1 --2- 172.21.15.73:0/231891499 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedbc0cf670 0x7fedbc156620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:03.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.531+0000 7fedc33a8640 1 --2- 172.21.15.73:0/231891499 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fedbc0b3c50 0x7fedbc14a8f0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:03.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.531+0000 7fedc33a8640 1 -- 172.21.15.73:0/231891499 >> 172.21.15.73:0/231891499 conn(0x7fedbc08bfc0 msgr2=0x7fedbc0b18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:03.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.531+0000 7fedc33a8640 1 -- 172.21.15.73:0/231891499 shutdown_connections 2024-03-29T04:09:03.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.531+0000 7fedc33a8640 1 -- 172.21.15.73:0/231891499 wait complete. 2024-03-29T04:09:03.522 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-03-29T04:09:01.531915+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219832,"kb_used_data":3652,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754888,"statfs":{"total":773094113280,"available":772869005312,"internally_reserved":0,"allocated":3739648,"data_stored":2123381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000806"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.719918+0000","last_change":"2024-03-29T04:08:57.719918+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.719918+0000","last_undegraded":"2024-03-29T04:08:57.719918+0000","last_fullsized":"2024-03-29T04:08:57.719918+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.825613+0000","last_change":"2024-03-29T04:08:57.825613+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.825613+0000","last_undegraded":"2024-03-29T04:08:57.825613+0000","last_fullsized":"2024-03-29T04:08:57.825613+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.716380+0000","last_change":"2024-03-29T04:08:57.716380+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.716380+0000","last_undegraded":"2024-03-29T04:08:57.716380+0000","last_fullsized":"2024-03-29T04:08:57.716380+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.719295+0000","last_change":"2024-03-29T04:08:57.719295+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.719295+0000","last_undegraded":"2024-03-29T04:08:57.719295+0000","last_fullsized":"2024-03-29T04:08:57.719295+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.717547+0000","last_change":"2024-03-29T04:08:57.717547+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.717547+0000","last_undegraded":"2024-03-29T04:08:57.717547+0000","last_fullsized":"2024-03-29T04:08:57.717547+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.716711+0000","last_change":"2024-03-29T04:08:57.716711+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.716711+0000","last_undegraded":"2024-03-29T04:08:57.716711+0000","last_fullsized":"2024-03-29T04:08:57.716711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.717079+0000","last_change":"2024-03-29T04:08:57.717079+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.717079+0000","last_undegraded":"2024-03-29T04:08:57.717079+0000","last_fullsized":"2024-03-29T04:08:57.717079+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.716813+0000","last_change":"2024-03-29T04:08:57.716813+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.716813+0000","last_undegraded":"2024-03-29T04:08:57.716813+0000","last_fullsized":"2024-03-29T04:08:57.716813+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.716285+0000","last_change":"2024-03-29T04:08:57.716285+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.716285+0000","last_undegraded":"2024-03-29T04:08:57.716285+0000","last_fullsized":"2024-03-29T04:08:57.716285+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.825205+0000","last_change":"2024-03-29T04:08:57.825205+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.825205+0000","last_undegraded":"2024-03-29T04:08:57.825205+0000","last_fullsized":"2024-03-29T04:08:57.825205+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.720451+0000","last_change":"2024-03-29T04:08:57.720451+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.720451+0000","last_undegraded":"2024-03-29T04:08:57.720451+0000","last_fullsized":"2024-03-29T04:08:57.720451+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.716382+0000","last_change":"2024-03-29T04:08:57.716382+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.716382+0000","last_undegraded":"2024-03-29T04:08:57.716382+0000","last_fullsized":"2024-03-29T04:08:57.716382+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.716729+0000","last_change":"2024-03-29T04:08:57.716729+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.716729+0000","last_undegraded":"2024-03-29T04:08:57.716729+0000","last_fullsized":"2024-03-29T04:08:57.716729+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.719925+0000","last_change":"2024-03-29T04:08:57.719925+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.719925+0000","last_undegraded":"2024-03-29T04:08:57.719925+0000","last_fullsized":"2024-03-29T04:08:57.719925+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.716601+0000","last_change":"2024-03-29T04:08:57.716601+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.716601+0000","last_undegraded":"2024-03-29T04:08:57.716601+0000","last_fullsized":"2024-03-29T04:08:57.716601+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.717034+0000","last_change":"2024-03-29T04:08:57.717034+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.717034+0000","last_undegraded":"2024-03-29T04:08:57.717034+0000","last_fullsized":"2024-03-29T04:08:57.717034+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.720010+0000","last_change":"2024-03-29T04:08:57.720010+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.720010+0000","last_undegraded":"2024-03-29T04:08:57.720010+0000","last_fullsized":"2024-03-29T04:08:57.720010+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.716729+0000","last_change":"2024-03-29T04:08:57.716729+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.716729+0000","last_undegraded":"2024-03-29T04:08:57.716729+0000","last_fullsized":"2024-03-29T04:08:57.716729+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.717112+0000","last_change":"2024-03-29T04:08:57.717112+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.717112+0000","last_undegraded":"2024-03-29T04:08:57.717112+0000","last_fullsized":"2024-03-29T04:08:57.717112+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.717521+0000","last_change":"2024-03-29T04:08:57.717521+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.717521+0000","last_undegraded":"2024-03-29T04:08:57.717521+0000","last_fullsized":"2024-03-29T04:08:57.717521+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.825128+0000","last_change":"2024-03-29T04:08:57.825128+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.825128+0000","last_undegraded":"2024-03-29T04:08:57.825128+0000","last_fullsized":"2024-03-29T04:08:57.825128+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.719939+0000","last_change":"2024-03-29T04:08:57.719939+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.719939+0000","last_undegraded":"2024-03-29T04:08:57.719939+0000","last_fullsized":"2024-03-29T04:08:57.719939+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.718145+0000","last_change":"2024-03-29T04:08:57.718145+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.718145+0000","last_undegraded":"2024-03-29T04:08:57.718145+0000","last_fullsized":"2024-03-29T04:08:57.718145+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.720410+0000","last_change":"2024-03-29T04:08:57.720410+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.720410+0000","last_undegraded":"2024-03-29T04:08:57.720410+0000","last_fullsized":"2024-03-29T04:08:57.720410+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.719548+0000","last_change":"2024-03-29T04:08:57.719548+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.719548+0000","last_undegraded":"2024-03-29T04:08:57.719548+0000","last_fullsized":"2024-03-29T04:08:57.719548+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.824634+0000","last_change":"2024-03-29T04:08:57.824634+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.824634+0000","last_undegraded":"2024-03-29T04:08:57.824634+0000","last_fullsized":"2024-03-29T04:08:57.824634+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.718652+0000","last_change":"2024-03-29T04:08:57.718652+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.718652+0000","last_undegraded":"2024-03-29T04:08:57.718652+0000","last_fullsized":"2024-03-29T04:08:57.718652+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.824633+0000","last_change":"2024-03-29T04:08:57.824633+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.824633+0000","last_undegraded":"2024-03-29T04:08:57.824633+0000","last_fullsized":"2024-03-29T04:08:57.824633+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.718642+0000","last_change":"2024-03-29T04:08:57.718642+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.718642+0000","last_undegraded":"2024-03-29T04:08:57.718642+0000","last_fullsized":"2024-03-29T04:08:57.718642+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.716640+0000","last_change":"2024-03-29T04:08:57.716640+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.716640+0000","last_undegraded":"2024-03-29T04:08:57.716640+0000","last_fullsized":"2024-03-29T04:08:57.716640+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.716318+0000","last_change":"2024-03-29T04:08:57.716318+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.716318+0000","last_undegraded":"2024-03-29T04:08:57.716318+0000","last_fullsized":"2024-03-29T04:08:57.716318+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.719939+0000","last_change":"2024-03-29T04:08:57.719939+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.719939+0000","last_undegraded":"2024-03-29T04:08:57.719939+0000","last_fullsized":"2024-03-29T04:08:57.719939+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":184,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T04:08:57.718690+0000","last_change":"2024-03-29T04:08:01.885311+0000","last_active":"2024-03-29T04:08:57.718690+0000","last_peered":"2024-03-29T04:08:57.718690+0000","last_clean":"2024-03-29T04:08:57.718690+0000","last_became_active":"2024-03-29T04:08:01.884340+0000","last_became_peered":"2024-03-29T04:08:01.884340+0000","last_unstale":"2024-03-29T04:08:57.718690+0000","last_undegraded":"2024-03-29T04:08:57.718690+0000","last_fullsized":"2024-03-29T04:08:57.718690+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:00.511520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:00.511520+0000","last_clean_scrub_stamp":"2024-03-29T04:08:00.511520+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:40:25.245419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":905216,"data_stored":704563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":120012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":120012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":311296,"data_stored":114195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":120012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":120012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":120012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":704563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-29T04:09:03.525 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2024-03-29T04:09:03.526 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.526 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2024-03-29T04:09:03.526 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.526 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2024-03-29T04:09:03.526 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.526 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2024-03-29T04:09:03.526 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.526 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2024-03-29T04:09:03.526 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.526 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2024-03-29T04:09:03.526 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.527 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2024-03-29T04:09:03.527 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.527 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2024-03-29T04:09:03.527 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.527 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2024-03-29T04:09:03.527 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.527 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2024-03-29T04:09:03.527 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.527 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2024-03-29T04:09:03.527 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.527 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2024-03-29T04:09:03.527 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.528 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2024-03-29T04:09:03.528 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.528 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2024-03-29T04:09:03.528 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.528 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2024-03-29T04:09:03.528 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.528 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2024-03-29T04:09:03.528 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.528 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2024-03-29T04:09:03.528 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.528 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2024-03-29T04:09:03.528 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.529 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2024-03-29T04:09:03.529 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.529 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2024-03-29T04:09:03.529 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.529 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2024-03-29T04:09:03.529 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.529 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2024-03-29T04:09:03.529 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.529 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2024-03-29T04:09:03.529 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.529 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2024-03-29T04:09:03.529 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.530 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2024-03-29T04:09:03.530 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.530 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2024-03-29T04:09:03.530 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.530 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2024-03-29T04:09:03.530 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.530 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2024-03-29T04:09:03.530 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.530 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2024-03-29T04:09:03.530 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.530 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2024-03-29T04:09:03.530 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.531 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2024-03-29T04:09:03.531 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.531 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2024-03-29T04:09:03.531 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.531 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2024-03-29T04:09:03.531 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.531 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2024-03-29T04:09:03.531 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-03-29T04:08:57.719918+0000', 'last_change': '2024-03-29T04:08:57.719918+0000', 'last_active': '2024-03-29T04:08:57.709012+0000', 'last_peered': '2024-03-29T04:08:57.709012+0000', 'last_clean': '2024-03-29T04:08:57.709012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:57.719918+0000', 'last_undegraded': '2024-03-29T04:08:57.719918+0000', 'last_fullsized': '2024-03-29T04:08:57.719918+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-29T04:09:03.531 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2024-03-29T04:09:03.531 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.531 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2024-03-29T04:09:03.531 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-03-29T04:08:57.825613+0000', 'last_change': '2024-03-29T04:08:57.825613+0000', 'last_active': '2024-03-29T04:08:57.709012+0000', 'last_peered': '2024-03-29T04:08:57.709012+0000', 'last_clean': '2024-03-29T04:08:57.709012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:57.825613+0000', 'last_undegraded': '2024-03-29T04:08:57.825613+0000', 'last_fullsized': '2024-03-29T04:08:57.825613+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-29T04:09:03.532 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2024-03-29T04:09:03.532 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.532 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2024-03-29T04:09:03.532 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-03-29T04:08:57.716380+0000', 'last_change': '2024-03-29T04:08:57.716380+0000', 'last_active': '2024-03-29T04:08:57.709012+0000', 'last_peered': '2024-03-29T04:08:57.709012+0000', 'last_clean': '2024-03-29T04:08:57.709012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:57.716380+0000', 'last_undegraded': '2024-03-29T04:08:57.716380+0000', 'last_fullsized': '2024-03-29T04:08:57.716380+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-29T04:09:03.532 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2024-03-29T04:09:03.532 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.532 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2024-03-29T04:09:03.532 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-03-29T04:08:57.719295+0000', 'last_change': '2024-03-29T04:08:57.719295+0000', 'last_active': '2024-03-29T04:08:57.709012+0000', 'last_peered': '2024-03-29T04:08:57.709012+0000', 'last_clean': '2024-03-29T04:08:57.709012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:57.719295+0000', 'last_undegraded': '2024-03-29T04:08:57.719295+0000', 'last_fullsized': '2024-03-29T04:08:57.719295+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-29T04:09:03.532 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2024-03-29T04:09:03.532 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.532 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2024-03-29T04:09:03.532 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-03-29T04:08:57.717547+0000', 'last_change': '2024-03-29T04:08:57.717547+0000', 'last_active': '2024-03-29T04:08:57.709012+0000', 'last_peered': '2024-03-29T04:08:57.709012+0000', 'last_clean': '2024-03-29T04:08:57.709012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:57.717547+0000', 'last_undegraded': '2024-03-29T04:08:57.717547+0000', 'last_fullsized': '2024-03-29T04:08:57.717547+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-29T04:09:03.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2024-03-29T04:09:03.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2024-03-29T04:09:03.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-03-29T04:08:57.716711+0000', 'last_change': '2024-03-29T04:08:57.716711+0000', 'last_active': '2024-03-29T04:08:57.709012+0000', 'last_peered': '2024-03-29T04:08:57.709012+0000', 'last_clean': '2024-03-29T04:08:57.709012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:57.716711+0000', 'last_undegraded': '2024-03-29T04:08:57.716711+0000', 'last_fullsized': '2024-03-29T04:08:57.716711+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-29T04:09:03.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2024-03-29T04:09:03.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2024-03-29T04:09:03.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-03-29T04:08:57.717079+0000', 'last_change': '2024-03-29T04:08:57.717079+0000', 'last_active': '2024-03-29T04:08:57.709012+0000', 'last_peered': '2024-03-29T04:08:57.709012+0000', 'last_clean': '2024-03-29T04:08:57.709012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:57.717079+0000', 'last_undegraded': '2024-03-29T04:08:57.717079+0000', 'last_fullsized': '2024-03-29T04:08:57.717079+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-29T04:09:03.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2024-03-29T04:09:03.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.533 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2024-03-29T04:09:03.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-03-29T04:08:57.716813+0000', 'last_change': '2024-03-29T04:08:57.716813+0000', 'last_active': '2024-03-29T04:08:57.709012+0000', 'last_peered': '2024-03-29T04:08:57.709012+0000', 'last_clean': '2024-03-29T04:08:57.709012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:57.716813+0000', 'last_undegraded': '2024-03-29T04:08:57.716813+0000', 'last_fullsized': '2024-03-29T04:08:57.716813+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-29T04:09:03.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2024-03-29T04:09:03.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2024-03-29T04:09:03.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-03-29T04:08:57.716285+0000', 'last_change': '2024-03-29T04:08:57.716285+0000', 'last_active': '2024-03-29T04:08:57.709012+0000', 'last_peered': '2024-03-29T04:08:57.709012+0000', 'last_clean': '2024-03-29T04:08:57.709012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:57.716285+0000', 'last_undegraded': '2024-03-29T04:08:57.716285+0000', 'last_fullsized': '2024-03-29T04:08:57.716285+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-29T04:09:03.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2024-03-29T04:09:03.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2024-03-29T04:09:03.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-03-29T04:08:57.825205+0000', 'last_change': '2024-03-29T04:08:57.825205+0000', 'last_active': '2024-03-29T04:08:57.709012+0000', 'last_peered': '2024-03-29T04:08:57.709012+0000', 'last_clean': '2024-03-29T04:08:57.709012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:57.825205+0000', 'last_undegraded': '2024-03-29T04:08:57.825205+0000', 'last_fullsized': '2024-03-29T04:08:57.825205+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-29T04:09:03.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2024-03-29T04:09:03.534 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.534 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2024-03-29T04:09:03.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-03-29T04:08:57.720451+0000', 'last_change': '2024-03-29T04:08:57.720451+0000', 'last_active': '2024-03-29T04:08:57.709012+0000', 'last_peered': '2024-03-29T04:08:57.709012+0000', 'last_clean': '2024-03-29T04:08:57.709012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:57.720451+0000', 'last_undegraded': '2024-03-29T04:08:57.720451+0000', 'last_fullsized': '2024-03-29T04:08:57.720451+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-29T04:09:03.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2024-03-29T04:09:03.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2024-03-29T04:09:03.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-03-29T04:08:57.716382+0000', 'last_change': '2024-03-29T04:08:57.716382+0000', 'last_active': '2024-03-29T04:08:57.709012+0000', 'last_peered': '2024-03-29T04:08:57.709012+0000', 'last_clean': '2024-03-29T04:08:57.709012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:57.716382+0000', 'last_undegraded': '2024-03-29T04:08:57.716382+0000', 'last_fullsized': '2024-03-29T04:08:57.716382+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-29T04:09:03.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2024-03-29T04:09:03.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2024-03-29T04:09:03.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-03-29T04:08:57.716729+0000', 'last_change': '2024-03-29T04:08:57.716729+0000', 'last_active': '2024-03-29T04:08:57.709012+0000', 'last_peered': '2024-03-29T04:08:57.709012+0000', 'last_clean': '2024-03-29T04:08:57.709012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:57.716729+0000', 'last_undegraded': '2024-03-29T04:08:57.716729+0000', 'last_fullsized': '2024-03-29T04:08:57.716729+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-29T04:09:03.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2024-03-29T04:09:03.535 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.535 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2024-03-29T04:09:03.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-03-29T04:08:57.719925+0000', 'last_change': '2024-03-29T04:08:57.719925+0000', 'last_active': '2024-03-29T04:08:57.709012+0000', 'last_peered': '2024-03-29T04:08:57.709012+0000', 'last_clean': '2024-03-29T04:08:57.709012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:57.719925+0000', 'last_undegraded': '2024-03-29T04:08:57.719925+0000', 'last_fullsized': '2024-03-29T04:08:57.719925+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-29T04:09:03.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2024-03-29T04:09:03.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2024-03-29T04:09:03.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-03-29T04:08:57.716601+0000', 'last_change': '2024-03-29T04:08:57.716601+0000', 'last_active': '2024-03-29T04:08:57.709012+0000', 'last_peered': '2024-03-29T04:08:57.709012+0000', 'last_clean': '2024-03-29T04:08:57.709012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:57.716601+0000', 'last_undegraded': '2024-03-29T04:08:57.716601+0000', 'last_fullsized': '2024-03-29T04:08:57.716601+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-29T04:09:03.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2024-03-29T04:09:03.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2024-03-29T04:09:03.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-03-29T04:08:57.717034+0000', 'last_change': '2024-03-29T04:08:57.717034+0000', 'last_active': '2024-03-29T04:08:57.709012+0000', 'last_peered': '2024-03-29T04:08:57.709012+0000', 'last_clean': '2024-03-29T04:08:57.709012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:57.717034+0000', 'last_undegraded': '2024-03-29T04:08:57.717034+0000', 'last_fullsized': '2024-03-29T04:08:57.717034+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-29T04:09:03.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2024-03-29T04:09:03.536 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.536 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2024-03-29T04:09:03.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-03-29T04:08:57.720010+0000', 'last_change': '2024-03-29T04:08:57.720010+0000', 'last_active': '2024-03-29T04:08:57.709012+0000', 'last_peered': '2024-03-29T04:08:57.709012+0000', 'last_clean': '2024-03-29T04:08:57.709012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:57.720010+0000', 'last_undegraded': '2024-03-29T04:08:57.720010+0000', 'last_fullsized': '2024-03-29T04:08:57.720010+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-29T04:09:03.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2024-03-29T04:09:03.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2024-03-29T04:09:03.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-03-29T04:08:57.716729+0000', 'last_change': '2024-03-29T04:08:57.716729+0000', 'last_active': '2024-03-29T04:08:57.709012+0000', 'last_peered': '2024-03-29T04:08:57.709012+0000', 'last_clean': '2024-03-29T04:08:57.709012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:57.716729+0000', 'last_undegraded': '2024-03-29T04:08:57.716729+0000', 'last_fullsized': '2024-03-29T04:08:57.716729+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-29T04:09:03.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2024-03-29T04:09:03.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2024-03-29T04:09:03.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-03-29T04:08:57.717112+0000', 'last_change': '2024-03-29T04:08:57.717112+0000', 'last_active': '2024-03-29T04:08:57.709012+0000', 'last_peered': '2024-03-29T04:08:57.709012+0000', 'last_clean': '2024-03-29T04:08:57.709012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:57.717112+0000', 'last_undegraded': '2024-03-29T04:08:57.717112+0000', 'last_fullsized': '2024-03-29T04:08:57.717112+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-29T04:09:03.537 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2024-03-29T04:09:03.537 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2024-03-29T04:09:03.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-03-29T04:08:57.717521+0000', 'last_change': '2024-03-29T04:08:57.717521+0000', 'last_active': '2024-03-29T04:08:57.709012+0000', 'last_peered': '2024-03-29T04:08:57.709012+0000', 'last_clean': '2024-03-29T04:08:57.709012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:57.717521+0000', 'last_undegraded': '2024-03-29T04:08:57.717521+0000', 'last_fullsized': '2024-03-29T04:08:57.717521+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-29T04:09:03.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2024-03-29T04:09:03.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2024-03-29T04:09:03.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-03-29T04:08:57.825128+0000', 'last_change': '2024-03-29T04:08:57.825128+0000', 'last_active': '2024-03-29T04:08:57.709012+0000', 'last_peered': '2024-03-29T04:08:57.709012+0000', 'last_clean': '2024-03-29T04:08:57.709012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:57.825128+0000', 'last_undegraded': '2024-03-29T04:08:57.825128+0000', 'last_fullsized': '2024-03-29T04:08:57.825128+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-29T04:09:03.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2024-03-29T04:09:03.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2024-03-29T04:09:03.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-03-29T04:08:57.719939+0000', 'last_change': '2024-03-29T04:08:57.719939+0000', 'last_active': '2024-03-29T04:08:57.709012+0000', 'last_peered': '2024-03-29T04:08:57.709012+0000', 'last_clean': '2024-03-29T04:08:57.709012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:57.719939+0000', 'last_undegraded': '2024-03-29T04:08:57.719939+0000', 'last_fullsized': '2024-03-29T04:08:57.719939+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-29T04:09:03.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2024-03-29T04:09:03.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2024-03-29T04:09:03.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-03-29T04:08:57.718145+0000', 'last_change': '2024-03-29T04:08:57.718145+0000', 'last_active': '2024-03-29T04:08:57.709012+0000', 'last_peered': '2024-03-29T04:08:57.709012+0000', 'last_clean': '2024-03-29T04:08:57.709012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:57.718145+0000', 'last_undegraded': '2024-03-29T04:08:57.718145+0000', 'last_fullsized': '2024-03-29T04:08:57.718145+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-29T04:09:03.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2024-03-29T04:09:03.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2024-03-29T04:09:03.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-03-29T04:08:57.720410+0000', 'last_change': '2024-03-29T04:08:57.720410+0000', 'last_active': '2024-03-29T04:08:57.709012+0000', 'last_peered': '2024-03-29T04:08:57.709012+0000', 'last_clean': '2024-03-29T04:08:57.709012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:57.720410+0000', 'last_undegraded': '2024-03-29T04:08:57.720410+0000', 'last_fullsized': '2024-03-29T04:08:57.720410+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-29T04:09:03.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2024-03-29T04:09:03.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2024-03-29T04:09:03.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-03-29T04:08:57.719548+0000', 'last_change': '2024-03-29T04:08:57.719548+0000', 'last_active': '2024-03-29T04:08:57.709012+0000', 'last_peered': '2024-03-29T04:08:57.709012+0000', 'last_clean': '2024-03-29T04:08:57.709012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:57.719548+0000', 'last_undegraded': '2024-03-29T04:08:57.719548+0000', 'last_fullsized': '2024-03-29T04:08:57.719548+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-29T04:09:03.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2024-03-29T04:09:03.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2024-03-29T04:09:03.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-03-29T04:08:57.824634+0000', 'last_change': '2024-03-29T04:08:57.824634+0000', 'last_active': '2024-03-29T04:08:57.709012+0000', 'last_peered': '2024-03-29T04:08:57.709012+0000', 'last_clean': '2024-03-29T04:08:57.709012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:57.824634+0000', 'last_undegraded': '2024-03-29T04:08:57.824634+0000', 'last_fullsized': '2024-03-29T04:08:57.824634+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-29T04:09:03.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2024-03-29T04:09:03.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2024-03-29T04:09:03.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-03-29T04:08:57.718652+0000', 'last_change': '2024-03-29T04:08:57.718652+0000', 'last_active': '2024-03-29T04:08:57.709012+0000', 'last_peered': '2024-03-29T04:08:57.709012+0000', 'last_clean': '2024-03-29T04:08:57.709012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:57.718652+0000', 'last_undegraded': '2024-03-29T04:08:57.718652+0000', 'last_fullsized': '2024-03-29T04:08:57.718652+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-29T04:09:03.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2024-03-29T04:09:03.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2024-03-29T04:09:03.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-03-29T04:08:57.824633+0000', 'last_change': '2024-03-29T04:08:57.824633+0000', 'last_active': '2024-03-29T04:08:57.709012+0000', 'last_peered': '2024-03-29T04:08:57.709012+0000', 'last_clean': '2024-03-29T04:08:57.709012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:57.824633+0000', 'last_undegraded': '2024-03-29T04:08:57.824633+0000', 'last_fullsized': '2024-03-29T04:08:57.824633+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-29T04:09:03.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2024-03-29T04:09:03.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2024-03-29T04:09:03.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-03-29T04:08:57.718642+0000', 'last_change': '2024-03-29T04:08:57.718642+0000', 'last_active': '2024-03-29T04:08:57.709012+0000', 'last_peered': '2024-03-29T04:08:57.709012+0000', 'last_clean': '2024-03-29T04:08:57.709012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:57.718642+0000', 'last_undegraded': '2024-03-29T04:08:57.718642+0000', 'last_fullsized': '2024-03-29T04:08:57.718642+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-29T04:09:03.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2024-03-29T04:09:03.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2024-03-29T04:09:03.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-03-29T04:08:57.716640+0000', 'last_change': '2024-03-29T04:08:57.716640+0000', 'last_active': '2024-03-29T04:08:57.709012+0000', 'last_peered': '2024-03-29T04:08:57.709012+0000', 'last_clean': '2024-03-29T04:08:57.709012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:57.716640+0000', 'last_undegraded': '2024-03-29T04:08:57.716640+0000', 'last_fullsized': '2024-03-29T04:08:57.716640+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-29T04:09:03.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2024-03-29T04:09:03.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2024-03-29T04:09:03.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-03-29T04:08:57.716318+0000', 'last_change': '2024-03-29T04:08:57.716318+0000', 'last_active': '2024-03-29T04:08:57.709012+0000', 'last_peered': '2024-03-29T04:08:57.709012+0000', 'last_clean': '2024-03-29T04:08:57.709012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:57.716318+0000', 'last_undegraded': '2024-03-29T04:08:57.716318+0000', 'last_fullsized': '2024-03-29T04:08:57.716318+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-29T04:09:03.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2024-03-29T04:09:03.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-29T04:08:58.714514+0000', 'last_change': '2024-03-29T04:08:58.714514+0000', 'last_active': '2024-03-29T04:08:58.714514+0000', 'last_peered': '2024-03-29T04:08:58.714514+0000', 'last_clean': '2024-03-29T04:08:58.714514+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:58.714514+0000', 'last_undegraded': '2024-03-29T04:08:58.714514+0000', 'last_fullsized': '2024-03-29T04:08:58.714514+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:58.714514+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-29T04:09:03.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2024-03-29T04:09:03.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-03-29T04:08:57.719939+0000', 'last_change': '2024-03-29T04:08:57.719939+0000', 'last_active': '2024-03-29T04:08:57.709012+0000', 'last_peered': '2024-03-29T04:08:57.709012+0000', 'last_clean': '2024-03-29T04:08:57.709012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-29T04:08:57.719939+0000', 'last_undegraded': '2024-03-29T04:08:57.719939+0000', 'last_fullsized': '2024-03-29T04:08:57.719939+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'last_clean_scrub_stamp': '2024-03-29T04:08:57.709012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-29T04:09:03.542 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-03-29T04:09:03.662 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.683+0000 7ff0c3022640 1 Processor -- start 2024-03-29T04:09:03.663 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.683+0000 7ff0c3022640 1 -- start start 2024-03-29T04:09:03.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.683+0000 7ff0c3022640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff0bc15e930 0x7ff0bc0cf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:03.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.683+0000 7ff0c3022640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0bc0cf670 0x7ff0bc0d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:03.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.683+0000 7ff0c3022640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0bc0cfb30 con 0x7ff0bc0b3c50 2024-03-29T04:09:03.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.683+0000 7ff0c3022640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7ff0bc06c780 con 0x7ff0bc15e930 2024-03-29T04:09:03.665 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.683+0000 7ff0c3022640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff0bc0cfe10 con 0x7ff0bc0cf670 2024-03-29T04:09:03.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.684+0000 7ff0c15bf640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff0bc0b3c50 0x7ff0bc0d0c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57410/0 (socket says 172.21.15.73:57410) 2024-03-29T04:09:03.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.684+0000 7ff0c15bf640 1 -- 172.21.15.73:0/250464355 learned_addr learned my addr 172.21.15.73:0/250464355 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:09:03.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.684+0000 7ff0c0dbe640 1 --2- 172.21.15.73:0/250464355 >> v2:172.21.15.142:3300/0 conn(0x7ff0bc15e930 0x7ff0bc0cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:03.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.684+0000 7ff0bbfff640 1 --2- 172.21.15.73:0/250464355 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0bc0cf670 0x7ff0bc0d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:03.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.684+0000 7ff0bb7fe640 1 -- 172.21.15.73:0/250464355 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1399649830 0 0) 0x7ff0bc0cfb30 con 0x7ff0bc0b3c50 2024-03-29T04:09:03.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.684+0000 7ff0bb7fe640 1 -- 172.21.15.73:0/250464355 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0ac003520 con 0x7ff0bc0b3c50 2024-03-29T04:09:03.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.684+0000 7ff0c0dbe640 1 -- 172.21.15.73:0/250464355 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0bc0cf670 msgr2=0x7ff0bc0d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:03.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.684+0000 7ff0c0dbe640 1 --2- 172.21.15.73:0/250464355 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0bc0cf670 0x7ff0bc0d2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:03.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.684+0000 7ff0c0dbe640 1 -- 172.21.15.73:0/250464355 >> v1:172.21.15.73:6789/0 conn(0x7ff0bc0b3c50 legacy=0x7ff0bc0d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:03.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.684+0000 7ff0c0dbe640 1 -- 172.21.15.73:0/250464355 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0bc0d00f0 con 0x7ff0bc15e930 2024-03-29T04:09:03.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.685+0000 7ff0c0dbe640 1 --2- 172.21.15.73:0/250464355 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0bc15e930 0x7ff0bc0cf130 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff0b00097a0 tx=0x7ff0b002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b770360572173771 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:03.666 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.685+0000 7ff0bb7fe640 1 -- 172.21.15.73:0/250464355 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b0031780 con 0x7ff0bc15e930 2024-03-29T04:09:03.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.685+0000 7ff0bb7fe640 1 -- 172.21.15.73:0/250464355 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0b0037070 con 0x7ff0bc15e930 2024-03-29T04:09:03.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.685+0000 7ff0bb7fe640 1 -- 172.21.15.73:0/250464355 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b0031b40 con 0x7ff0bc15e930 2024-03-29T04:09:03.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.685+0000 7ff0c3022640 1 -- 172.21.15.73:0/250464355 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0bc15e930 msgr2=0x7ff0bc0cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:03.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.685+0000 7ff0c3022640 1 --2- 172.21.15.73:0/250464355 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0bc15e930 0x7ff0bc0cf130 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff0b00097a0 tx=0x7ff0b002b820 comp rx=0 tx=0).stop 2024-03-29T04:09:03.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.685+0000 7ff0c3022640 1 -- 172.21.15.73:0/250464355 shutdown_connections 2024-03-29T04:09:03.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.685+0000 7ff0c3022640 1 --2- 172.21.15.73:0/250464355 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0bc0cf670 0x7ff0bc0d2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:03.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.685+0000 7ff0c3022640 1 --2- 172.21.15.73:0/250464355 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0bc15e930 0x7ff0bc0cf130 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:03.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.685+0000 7ff0c3022640 1 -- 172.21.15.73:0/250464355 >> 172.21.15.73:0/250464355 conn(0x7ff0bc08bfc0 msgr2=0x7ff0bc0d4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:03.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.686+0000 7ff0c3022640 1 -- 172.21.15.73:0/250464355 shutdown_connections 2024-03-29T04:09:03.667 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.686+0000 7ff0c3022640 1 -- 172.21.15.73:0/250464355 wait complete. 2024-03-29T04:09:03.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.687+0000 7ff0c3022640 1 Processor -- start 2024-03-29T04:09:03.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.687+0000 7ff0c3022640 1 -- start start 2024-03-29T04:09:03.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.688+0000 7ff0c3022640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0bc0b3c50 0x7ff0bc158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:03.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.688+0000 7ff0c3022640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0bc0cf670 0x7ff0bc15ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:03.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.688+0000 7ff0c3022640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0bc15e930 0x7ff0bc15bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:03.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.688+0000 7ff0c3022640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff0bc15ee90 con 0x7ff0bc0b3c50 2024-03-29T04:09:03.670 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.688+0000 7ff0c3022640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff0bc15ed10 con 0x7ff0bc0cf670 2024-03-29T04:09:03.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.688+0000 7ff0c3022640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff0bc06dc20 con 0x7ff0bc15e930 2024-03-29T04:09:03.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.688+0000 7ff0c0dbe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0bc0b3c50 0x7ff0bc158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:03.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.688+0000 7ff0c0dbe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0bc0b3c50 0x7ff0bc158660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47188/0 (socket says 172.21.15.73:47188) 2024-03-29T04:09:03.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.688+0000 7ff0c0dbe640 1 -- 172.21.15.73:0/744076541 learned_addr learned my addr 172.21.15.73:0/744076541 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:03.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.688+0000 7ff0bbfff640 1 --2- 172.21.15.73:0/744076541 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0bc0cf670 0x7ff0bc15ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:03.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.688+0000 7ff0c15bf640 1 --2- 172.21.15.73:0/744076541 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0bc15e930 0x7ff0bc15bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:03.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.688+0000 7ff0c0dbe640 1 -- 172.21.15.73:0/744076541 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0bc15e930 msgr2=0x7ff0bc15bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:03.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.688+0000 7ff0c0dbe640 1 --2- 172.21.15.73:0/744076541 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0bc15e930 0x7ff0bc15bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:03.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.688+0000 7ff0c0dbe640 1 -- 172.21.15.73:0/744076541 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0bc0cf670 msgr2=0x7ff0bc15ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:03.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.688+0000 7ff0c0dbe640 1 --2- 172.21.15.73:0/744076541 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0bc0cf670 0x7ff0bc15ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:03.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.688+0000 7ff0c0dbe640 1 -- 172.21.15.73:0/744076541 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0bc15a370 con 0x7ff0bc0b3c50 2024-03-29T04:09:03.671 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.688+0000 7ff0c0dbe640 1 --2- 172.21.15.73:0/744076541 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0bc0b3c50 0x7ff0bc158660 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff0b00098c0 tx=0x7ff0b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:03.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.688+0000 7ff0b97fa640 1 -- 172.21.15.73:0/744076541 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b0032610 con 0x7ff0bc0b3c50 2024-03-29T04:09:03.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.688+0000 7ff0b97fa640 1 -- 172.21.15.73:0/744076541 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0b00327d0 con 0x7ff0bc0b3c50 2024-03-29T04:09:03.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.688+0000 7ff0c3022640 1 -- 172.21.15.73:0/744076541 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0bc15a650 con 0x7ff0bc0b3c50 2024-03-29T04:09:03.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.688+0000 7ff0b97fa640 1 -- 172.21.15.73:0/744076541 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b0032bc0 con 0x7ff0bc0b3c50 2024-03-29T04:09:03.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.688+0000 7ff0c3022640 1 -- 172.21.15.73:0/744076541 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0bc159fd0 con 0x7ff0bc0b3c50 2024-03-29T04:09:03.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.689+0000 7ff0c3022640 1 -- 172.21.15.73:0/744076541 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0bc068640 con 0x7ff0bc0b3c50 2024-03-29T04:09:03.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.690+0000 7ff0b97fa640 1 -- 172.21.15.73:0/744076541 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff0b004e440 con 0x7ff0bc0b3c50 2024-03-29T04:09:03.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.690+0000 7ff0b97fa640 1 --2- 172.21.15.73:0/744076541 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff0a006c560 0x7ff0a006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:03.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.690+0000 7ff0b97fa640 1 -- 172.21.15.73:0/744076541 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7ff0b00ad240 con 0x7ff0bc0b3c50 2024-03-29T04:09:03.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.690+0000 7ff0bbfff640 1 --2- 172.21.15.73:0/744076541 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff0a006c560 0x7ff0a006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:03.672 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.691+0000 7ff0bbfff640 1 --2- 172.21.15.73:0/744076541 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff0a006c560 0x7ff0a006ea20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc157ea0 tx=0x7ff0a8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:03.674 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.695+0000 7ff0b97fa640 1 -- 172.21.15.73:0/744076541 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7ff0b0040070 con 0x7ff0bc0b3c50 2024-03-29T04:09:03.685 INFO:tasks.ceph.mds.a.smithi073.stderr:2024-03-29T04:09:03.706+0000 7fd5c06a2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-29T04:09:03.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.963+0000 7ff0c3022640 1 -- 172.21.15.73:0/744076541 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7ff0bc0d4a80 con 0x7ff0bc0b3c50 2024-03-29T04:09:03.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.963+0000 7ff0b97fa640 1 -- 172.21.15.73:0/744076541 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1656 (secure 0 0 0) 0x7ff0b002f050 con 0x7ff0bc0b3c50 2024-03-29T04:09:03.943 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:09:03.943 INFO:teuthology.orchestra.run.smithi073.stdout:{"fsid":"6bff1617-b138-4517-acca-3ecaae3f2bb3","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":76,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":32,"num_osds":8,"num_up_osds":8,"osd_up_since":1711685278,"num_in_osds":8,"osd_in_since":1711685269,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":225107968,"bytes_avail":772869005312,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":13,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5055}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-03-29T04:08:59.531582+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-03-29T04:09:03.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.965+0000 7ff0c3022640 1 -- 172.21.15.73:0/744076541 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff0a006c560 msgr2=0x7ff0a006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:03.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.965+0000 7ff0c3022640 1 --2- 172.21.15.73:0/744076541 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff0a006c560 0x7ff0a006ea20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc157ea0 tx=0x7ff0a8009190 comp rx=0 tx=0).stop 2024-03-29T04:09:03.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.965+0000 7ff0c3022640 1 -- 172.21.15.73:0/744076541 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0bc0b3c50 msgr2=0x7ff0bc158660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:03.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.965+0000 7ff0c3022640 1 --2- 172.21.15.73:0/744076541 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0bc0b3c50 0x7ff0bc158660 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff0b00098c0 tx=0x7ff0b00046c0 comp rx=0 tx=0).stop 2024-03-29T04:09:03.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.965+0000 7ff0c3022640 1 -- 172.21.15.73:0/744076541 shutdown_connections 2024-03-29T04:09:03.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.965+0000 7ff0c3022640 1 --2- 172.21.15.73:0/744076541 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff0bc15e930 0x7ff0bc15bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:03.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.965+0000 7ff0c3022640 1 --2- 172.21.15.73:0/744076541 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff0a006c560 0x7ff0a006ea20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:03.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.965+0000 7ff0c3022640 1 --2- 172.21.15.73:0/744076541 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0bc0cf670 0x7ff0bc15ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:03.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.965+0000 7ff0c3022640 1 --2- 172.21.15.73:0/744076541 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0bc0b3c50 0x7ff0bc158660 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:03.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.965+0000 7ff0c3022640 1 -- 172.21.15.73:0/744076541 >> 172.21.15.73:0/744076541 conn(0x7ff0bc08bfc0 msgr2=0x7ff0bc15d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:03.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.965+0000 7ff0c3022640 1 -- 172.21.15.73:0/744076541 shutdown_connections 2024-03-29T04:09:03.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:03.965+0000 7ff0c3022640 1 -- 172.21.15.73:0/744076541 wait complete. 2024-03-29T04:09:03.956 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-03-29T04:09:03.956 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-29T04:09:04.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.077+0000 7f9dad5a8640 1 Processor -- start 2024-03-29T04:09:04.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.077+0000 7f9dad5a8640 1 -- start start 2024-03-29T04:09:04.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.077+0000 7f9dad5a8640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9da80b1430 0x7f9da80b1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:04.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.077+0000 7f9dad5a8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9da815d4b0 0x7f9da80cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:04.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.078+0000 7f9dad5a8640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9da806b880 con 0x7f9da8160300 2024-03-29T04:09:04.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.078+0000 7f9dad5a8640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f9da806c490 con 0x7f9da80b1430 2024-03-29T04:09:04.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.078+0000 7f9dad5a8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9da806bb60 con 0x7f9da815d4b0 2024-03-29T04:09:04.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.078+0000 7f9da6ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9da80b1430 0x7f9da80b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:04.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.078+0000 7f9da6ffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9da80b1430 0x7f9da80b1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47196/0 (socket says 172.21.15.73:47196) 2024-03-29T04:09:04.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.078+0000 7f9da6ffd640 1 -- 172.21.15.73:0/824377498 learned_addr learned my addr 172.21.15.73:0/824377498 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:04.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.078+0000 7f9da6ffd640 1 -- 172.21.15.73:0/824377498 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9da815d4b0 msgr2=0x7f9da80cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:04.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.078+0000 7f9da6ffd640 1 --2- 172.21.15.73:0/824377498 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9da815d4b0 0x7f9da80cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:04.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.078+0000 7f9da6ffd640 1 -- 172.21.15.73:0/824377498 >> v1:172.21.15.142:6789/0 conn(0x7f9da8160300 legacy=0x7f9da815cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:04.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.078+0000 7f9da6ffd640 1 -- 172.21.15.73:0/824377498 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9da806be40 con 0x7f9da80b1430 2024-03-29T04:09:04.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.079+0000 7f9da6ffd640 1 --2- 172.21.15.73:0/824377498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9da80b1430 0x7f9da80b1810 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9d98009870 tx=0x7f9d9802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6125fc55051c1b77 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:04.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.079+0000 7f9da5ffb640 1 -- 172.21.15.73:0/824377498 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d98035020 con 0x7f9da80b1430 2024-03-29T04:09:04.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.079+0000 7f9da5ffb640 1 -- 172.21.15.73:0/824377498 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d98031640 con 0x7f9da80b1430 2024-03-29T04:09:04.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.079+0000 7f9da5ffb640 1 -- 172.21.15.73:0/824377498 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d9802d040 con 0x7f9da80b1430 2024-03-29T04:09:04.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.080+0000 7f9dad5a8640 1 -- 172.21.15.73:0/824377498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9da80b1430 msgr2=0x7f9da80b1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:04.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.080+0000 7f9dad5a8640 1 --2- 172.21.15.73:0/824377498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9da80b1430 0x7f9da80b1810 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9d98009870 tx=0x7f9d9802b8f0 comp rx=0 tx=0).stop 2024-03-29T04:09:04.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.080+0000 7f9dad5a8640 1 -- 172.21.15.73:0/824377498 shutdown_connections 2024-03-29T04:09:04.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.080+0000 7f9dad5a8640 1 --2- 172.21.15.73:0/824377498 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9da815d4b0 0x7f9da80cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:04.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.080+0000 7f9dad5a8640 1 --2- 172.21.15.73:0/824377498 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9da80b1430 0x7f9da80b1810 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:04.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.080+0000 7f9dad5a8640 1 -- 172.21.15.73:0/824377498 >> 172.21.15.73:0/824377498 conn(0x7f9da80b6860 msgr2=0x7f9da80b6c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:04.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.080+0000 7f9dad5a8640 1 -- 172.21.15.73:0/824377498 shutdown_connections 2024-03-29T04:09:04.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.080+0000 7f9dad5a8640 1 -- 172.21.15.73:0/824377498 wait complete. 2024-03-29T04:09:04.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.081+0000 7f9dad5a8640 1 Processor -- start 2024-03-29T04:09:04.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.081+0000 7f9dad5a8640 1 -- start start 2024-03-29T04:09:04.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.082+0000 7f9dad5a8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9da80b1430 0x7f9da80cc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:04.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.082+0000 7f9dad5a8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9da815d4b0 0x7f9da80ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:04.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.082+0000 7f9dad5a8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9da8160300 0x7f9da81429e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:04.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.082+0000 7f9dad5a8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9da806b510 con 0x7f9da80b1430 2024-03-29T04:09:04.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.082+0000 7f9dad5a8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9da80734f0 con 0x7f9da815d4b0 2024-03-29T04:09:04.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.082+0000 7f9dad5a8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9da80b1d50 con 0x7f9da8160300 2024-03-29T04:09:04.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.082+0000 7f9da6ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9da80b1430 0x7f9da80cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:04.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.082+0000 7f9da6ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9da80b1430 0x7f9da80cc710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47202/0 (socket says 172.21.15.73:47202) 2024-03-29T04:09:04.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.082+0000 7f9da6ffd640 1 -- 172.21.15.73:0/1497629551 learned_addr learned my addr 172.21.15.73:0/1497629551 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:04.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.082+0000 7f9da6ffd640 1 -- 172.21.15.73:0/1497629551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9da8160300 msgr2=0x7f9da81429e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:04.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.082+0000 7f9da6ffd640 1 --2- 172.21.15.73:0/1497629551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9da8160300 0x7f9da81429e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:04.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.082+0000 7f9da6ffd640 1 -- 172.21.15.73:0/1497629551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9da815d4b0 msgr2=0x7f9da80ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:04.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.082+0000 7f9da6ffd640 1 --2- 172.21.15.73:0/1497629551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9da815d4b0 0x7f9da80ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:04.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.082+0000 7f9da6ffd640 1 -- 172.21.15.73:0/1497629551 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9da80b4ef0 con 0x7f9da80b1430 2024-03-29T04:09:04.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.082+0000 7f9da6ffd640 1 --2- 172.21.15.73:0/1497629551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9da80b1430 0x7f9da80cc710 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9d9802b930 tx=0x7f9d980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:04.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.082+0000 7f9d8f7fe640 1 -- 172.21.15.73:0/1497629551 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d9803ac60 con 0x7f9da80b1430 2024-03-29T04:09:04.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.083+0000 7f9d8f7fe640 1 -- 172.21.15.73:0/1497629551 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d9803ae20 con 0x7f9da80b1430 2024-03-29T04:09:04.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.083+0000 7f9dad5a8640 1 -- 172.21.15.73:0/1497629551 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9da80b51d0 con 0x7f9da80b1430 2024-03-29T04:09:04.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.083+0000 7f9d8f7fe640 1 -- 172.21.15.73:0/1497629551 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d98044630 con 0x7f9da80b1430 2024-03-29T04:09:04.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.083+0000 7f9dad5a8640 1 -- 172.21.15.73:0/1497629551 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9da80b5790 con 0x7f9da80b1430 2024-03-29T04:09:04.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.083+0000 7f9dad5a8640 1 -- 172.21.15.73:0/1497629551 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9da8068640 con 0x7f9da80b1430 2024-03-29T04:09:04.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.084+0000 7f9d8f7fe640 1 -- 172.21.15.73:0/1497629551 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f9d9804b060 con 0x7f9da80b1430 2024-03-29T04:09:04.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.084+0000 7f9d8f7fe640 1 --2- 172.21.15.73:0/1497629551 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9d9406c530 0x7f9d9406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:04.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.084+0000 7f9d8f7fe640 1 -- 172.21.15.73:0/1497629551 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f9d980ad420 con 0x7f9da80b1430 2024-03-29T04:09:04.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.084+0000 7f9da67fc640 1 --2- 172.21.15.73:0/1497629551 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9d9406c530 0x7f9d9406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:04.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.085+0000 7f9da67fc640 1 --2- 172.21.15.73:0/1497629551 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9d9406c530 0x7f9d9406e9f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9da8150520 tx=0x7f9d9c007990 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:04.068 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.089+0000 7f9d8f7fe640 1 -- 172.21.15.73:0/1497629551 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f9d9803f070 con 0x7f9da80b1430 2024-03-29T04:09:04.246 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.266+0000 7f9dad5a8640 1 -- 172.21.15.73:0/1497629551 --> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9da815ef70 con 0x7f9d9406c530 2024-03-29T04:09:04.251 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.272+0000 7f9d8f7fe640 1 -- 172.21.15.73:0/1497629551 <== mgr.4104 v2:172.21.15.73:6832/1640471941 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239854 (secure 0 0 0) 0x7f9da815ef70 con 0x7f9d9406c530 2024-03-29T04:09:04.254 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:09:04.255 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-29T04:09:04.256 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.275+0000 7f9dad5a8640 1 -- 172.21.15.73:0/1497629551 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9d9406c530 msgr2=0x7f9d9406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:04.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.275+0000 7f9dad5a8640 1 --2- 172.21.15.73:0/1497629551 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9d9406c530 0x7f9d9406e9f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9da8150520 tx=0x7f9d9c007990 comp rx=0 tx=0).stop 2024-03-29T04:09:04.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.275+0000 7f9dad5a8640 1 -- 172.21.15.73:0/1497629551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9da80b1430 msgr2=0x7f9da80cc710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:04.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.275+0000 7f9dad5a8640 1 --2- 172.21.15.73:0/1497629551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9da80b1430 0x7f9da80cc710 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9d9802b930 tx=0x7f9d980046c0 comp rx=0 tx=0).stop 2024-03-29T04:09:04.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.275+0000 7f9dad5a8640 1 -- 172.21.15.73:0/1497629551 shutdown_connections 2024-03-29T04:09:04.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.275+0000 7f9dad5a8640 1 --2- 172.21.15.73:0/1497629551 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9da8160300 0x7f9da81429e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:04.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.275+0000 7f9dad5a8640 1 --2- 172.21.15.73:0/1497629551 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9d9406c530 0x7f9d9406e9f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:04.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.275+0000 7f9dad5a8640 1 --2- 172.21.15.73:0/1497629551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9da815d4b0 0x7f9da80ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:04.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.275+0000 7f9dad5a8640 1 --2- 172.21.15.73:0/1497629551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9da80b1430 0x7f9da80cc710 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:04.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.275+0000 7f9dad5a8640 1 -- 172.21.15.73:0/1497629551 >> 172.21.15.73:0/1497629551 conn(0x7f9da80b6860 msgr2=0x7f9da815dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:04.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.275+0000 7f9dad5a8640 1 -- 172.21.15.73:0/1497629551 shutdown_connections 2024-03-29T04:09:04.257 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:04.275+0000 7f9dad5a8640 1 -- 172.21.15.73:0/1497629551 wait complete. 2024-03-29T04:09:04.265 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2024-03-29T04:09:03.532182+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219832,"kb_used_data":3652,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754888,"statfs":{"total":773094113280,"available":772869005312,"internally_reserved":0,"allocated":3739648,"data_stored":2123381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.817193"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.719918+0000","last_change":"2024-03-29T04:08:57.719918+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.719918+0000","last_undegraded":"2024-03-29T04:08:57.719918+0000","last_fullsized":"2024-03-29T04:08:57.719918+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.825613+0000","last_change":"2024-03-29T04:08:57.825613+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.825613+0000","last_undegraded":"2024-03-29T04:08:57.825613+0000","last_fullsized":"2024-03-29T04:08:57.825613+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.716380+0000","last_change":"2024-03-29T04:08:57.716380+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.716380+0000","last_undegraded":"2024-03-29T04:08:57.716380+0000","last_fullsized":"2024-03-29T04:08:57.716380+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.719295+0000","last_change":"2024-03-29T04:08:57.719295+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.719295+0000","last_undegraded":"2024-03-29T04:08:57.719295+0000","last_fullsized":"2024-03-29T04:08:57.719295+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.717547+0000","last_change":"2024-03-29T04:08:57.717547+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.717547+0000","last_undegraded":"2024-03-29T04:08:57.717547+0000","last_fullsized":"2024-03-29T04:08:57.717547+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.716711+0000","last_change":"2024-03-29T04:08:57.716711+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.716711+0000","last_undegraded":"2024-03-29T04:08:57.716711+0000","last_fullsized":"2024-03-29T04:08:57.716711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.717079+0000","last_change":"2024-03-29T04:08:57.717079+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.717079+0000","last_undegraded":"2024-03-29T04:08:57.717079+0000","last_fullsized":"2024-03-29T04:08:57.717079+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.716813+0000","last_change":"2024-03-29T04:08:57.716813+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.716813+0000","last_undegraded":"2024-03-29T04:08:57.716813+0000","last_fullsized":"2024-03-29T04:08:57.716813+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.716285+0000","last_change":"2024-03-29T04:08:57.716285+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.716285+0000","last_undegraded":"2024-03-29T04:08:57.716285+0000","last_fullsized":"2024-03-29T04:08:57.716285+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.825205+0000","last_change":"2024-03-29T04:08:57.825205+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.825205+0000","last_undegraded":"2024-03-29T04:08:57.825205+0000","last_fullsized":"2024-03-29T04:08:57.825205+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.720451+0000","last_change":"2024-03-29T04:08:57.720451+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.720451+0000","last_undegraded":"2024-03-29T04:08:57.720451+0000","last_fullsized":"2024-03-29T04:08:57.720451+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.716382+0000","last_change":"2024-03-29T04:08:57.716382+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.716382+0000","last_undegraded":"2024-03-29T04:08:57.716382+0000","last_fullsized":"2024-03-29T04:08:57.716382+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.716729+0000","last_change":"2024-03-29T04:08:57.716729+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.716729+0000","last_undegraded":"2024-03-29T04:08:57.716729+0000","last_fullsized":"2024-03-29T04:08:57.716729+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.719925+0000","last_change":"2024-03-29T04:08:57.719925+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.719925+0000","last_undegraded":"2024-03-29T04:08:57.719925+0000","last_fullsized":"2024-03-29T04:08:57.719925+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.716601+0000","last_change":"2024-03-29T04:08:57.716601+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.716601+0000","last_undegraded":"2024-03-29T04:08:57.716601+0000","last_fullsized":"2024-03-29T04:08:57.716601+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.717034+0000","last_change":"2024-03-29T04:08:57.717034+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.717034+0000","last_undegraded":"2024-03-29T04:08:57.717034+0000","last_fullsized":"2024-03-29T04:08:57.717034+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.720010+0000","last_change":"2024-03-29T04:08:57.720010+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.720010+0000","last_undegraded":"2024-03-29T04:08:57.720010+0000","last_fullsized":"2024-03-29T04:08:57.720010+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.716729+0000","last_change":"2024-03-29T04:08:57.716729+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.716729+0000","last_undegraded":"2024-03-29T04:08:57.716729+0000","last_fullsized":"2024-03-29T04:08:57.716729+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.717112+0000","last_change":"2024-03-29T04:08:57.717112+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.717112+0000","last_undegraded":"2024-03-29T04:08:57.717112+0000","last_fullsized":"2024-03-29T04:08:57.717112+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.717521+0000","last_change":"2024-03-29T04:08:57.717521+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.717521+0000","last_undegraded":"2024-03-29T04:08:57.717521+0000","last_fullsized":"2024-03-29T04:08:57.717521+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.825128+0000","last_change":"2024-03-29T04:08:57.825128+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.825128+0000","last_undegraded":"2024-03-29T04:08:57.825128+0000","last_fullsized":"2024-03-29T04:08:57.825128+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.719939+0000","last_change":"2024-03-29T04:08:57.719939+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.719939+0000","last_undegraded":"2024-03-29T04:08:57.719939+0000","last_fullsized":"2024-03-29T04:08:57.719939+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.718145+0000","last_change":"2024-03-29T04:08:57.718145+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.718145+0000","last_undegraded":"2024-03-29T04:08:57.718145+0000","last_fullsized":"2024-03-29T04:08:57.718145+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.720410+0000","last_change":"2024-03-29T04:08:57.720410+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.720410+0000","last_undegraded":"2024-03-29T04:08:57.720410+0000","last_fullsized":"2024-03-29T04:08:57.720410+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.719548+0000","last_change":"2024-03-29T04:08:57.719548+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.719548+0000","last_undegraded":"2024-03-29T04:08:57.719548+0000","last_fullsized":"2024-03-29T04:08:57.719548+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.824634+0000","last_change":"2024-03-29T04:08:57.824634+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.824634+0000","last_undegraded":"2024-03-29T04:08:57.824634+0000","last_fullsized":"2024-03-29T04:08:57.824634+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.718652+0000","last_change":"2024-03-29T04:08:57.718652+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.718652+0000","last_undegraded":"2024-03-29T04:08:57.718652+0000","last_fullsized":"2024-03-29T04:08:57.718652+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.824633+0000","last_change":"2024-03-29T04:08:57.824633+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.824633+0000","last_undegraded":"2024-03-29T04:08:57.824633+0000","last_fullsized":"2024-03-29T04:08:57.824633+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.718642+0000","last_change":"2024-03-29T04:08:57.718642+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.718642+0000","last_undegraded":"2024-03-29T04:08:57.718642+0000","last_fullsized":"2024-03-29T04:08:57.718642+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.716640+0000","last_change":"2024-03-29T04:08:57.716640+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.716640+0000","last_undegraded":"2024-03-29T04:08:57.716640+0000","last_fullsized":"2024-03-29T04:08:57.716640+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.716318+0000","last_change":"2024-03-29T04:08:57.716318+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.716318+0000","last_undegraded":"2024-03-29T04:08:57.716318+0000","last_fullsized":"2024-03-29T04:08:57.716318+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-29T04:08:58.714514+0000","last_change":"2024-03-29T04:08:58.714514+0000","last_active":"2024-03-29T04:08:58.714514+0000","last_peered":"2024-03-29T04:08:58.714514+0000","last_clean":"2024-03-29T04:08:58.714514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:58.714514+0000","last_undegraded":"2024-03-29T04:08:58.714514+0000","last_fullsized":"2024-03-29T04:08:58.714514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-03-29T04:08:57.719939+0000","last_change":"2024-03-29T04:08:57.719939+0000","last_active":"2024-03-29T04:08:57.709012+0000","last_peered":"2024-03-29T04:08:57.709012+0000","last_clean":"2024-03-29T04:08:57.709012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-29T04:08:57.719939+0000","last_undegraded":"2024-03-29T04:08:57.719939+0000","last_fullsized":"2024-03-29T04:08:57.719939+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":184,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-29T04:08:57.718690+0000","last_change":"2024-03-29T04:08:01.885311+0000","last_active":"2024-03-29T04:08:57.718690+0000","last_peered":"2024-03-29T04:08:57.718690+0000","last_clean":"2024-03-29T04:08:57.718690+0000","last_became_active":"2024-03-29T04:08:01.884340+0000","last_became_peered":"2024-03-29T04:08:01.884340+0000","last_unstale":"2024-03-29T04:08:57.718690+0000","last_undegraded":"2024-03-29T04:08:57.718690+0000","last_fullsized":"2024-03-29T04:08:57.718690+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:00.511520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:00.511520+0000","last_clean_scrub_stamp":"2024-03-29T04:08:00.511520+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:40:25.245419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":905216,"data_stored":704563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":120012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":120012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":311296,"data_stored":114195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":120012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":120012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":120012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":704563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-29T04:09:06.123 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-29T04:09:06.125 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-29T04:09:07.269 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-29T04:09:07.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.392+0000 7f709027e640 1 Processor -- start 2024-03-29T04:09:07.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.392+0000 7f709027e640 1 -- start start 2024-03-29T04:09:07.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.393+0000 7f709027e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f708815e880 0x7f70880cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:07.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.393+0000 7f709027e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f70880b4340 0x7f70880d0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:07.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.393+0000 7f709027e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70880cf7f0 con 0x7f708815ec60 2024-03-29T04:09:07.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.393+0000 7f709027e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f70880cfe00 con 0x7f708815e880 2024-03-29T04:09:07.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.393+0000 7f709027e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f70880cea70 con 0x7f70880b4340 2024-03-29T04:09:07.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.393+0000 7f708e01a640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f708815e880 0x7f70880cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:07.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.393+0000 7f708d819640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f708815ec60 0x7f70880ce280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57422/0 (socket says 172.21.15.73:57422) 2024-03-29T04:09:07.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.393+0000 7f708d819640 1 -- 172.21.15.73:0/1303330547 learned_addr learned my addr 172.21.15.73:0/1303330547 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:09:07.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.393+0000 7f708e01a640 1 --2- 172.21.15.73:0/1303330547 >> v2:172.21.15.73:3300/0 conn(0x7f708815e880 0x7f70880cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47206/0 (socket says 172.21.15.73:47206) 2024-03-29T04:09:07.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.393+0000 7f708e81b640 1 --2- 172.21.15.73:0/1303330547 >> v2:172.21.15.142:3300/0 conn(0x7f70880b4340 0x7f70880d0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:07.373 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.393+0000 7f708e01a640 1 -- 172.21.15.73:0/1303330547 >> v2:172.21.15.142:3300/0 conn(0x7f70880b4340 msgr2=0x7f70880d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:07.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.393+0000 7f708e01a640 1 --2- 172.21.15.73:0/1303330547 >> v2:172.21.15.142:3300/0 conn(0x7f70880b4340 0x7f70880d0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:07.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.393+0000 7f708e01a640 1 -- 172.21.15.73:0/1303330547 >> v1:172.21.15.73:6789/0 conn(0x7f708815ec60 legacy=0x7f70880ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:07.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.393+0000 7f708e01a640 1 -- 172.21.15.73:0/1303330547 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70880ced50 con 0x7f708815e880 2024-03-29T04:09:07.374 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.393+0000 7f708d018640 1 -- 172.21.15.73:0/1303330547 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 41811426 0 0) 0x7f70880cf7f0 con 0x7f708815ec60 2024-03-29T04:09:07.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.394+0000 7f708e01a640 1 --2- 172.21.15.73:0/1303330547 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f708815e880 0x7f70880cdd40 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f708806c5d0 tx=0x7f708402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db0f6537b3425b61 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:07.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.394+0000 7f708d018640 1 -- 172.21.15.73:0/1303330547 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7084035020 con 0x7f708815e880 2024-03-29T04:09:07.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.394+0000 7f708d018640 1 -- 172.21.15.73:0/1303330547 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7084031830 con 0x7f708815e880 2024-03-29T04:09:07.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.395+0000 7f708d018640 1 -- 172.21.15.73:0/1303330547 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7084031c00 con 0x7f708815e880 2024-03-29T04:09:07.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.395+0000 7f709027e640 1 -- 172.21.15.73:0/1303330547 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f708815e880 msgr2=0x7f70880cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:07.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.395+0000 7f709027e640 1 --2- 172.21.15.73:0/1303330547 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f708815e880 0x7f70880cdd40 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f708806c5d0 tx=0x7f708402b8d0 comp rx=0 tx=0).stop 2024-03-29T04:09:07.375 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.395+0000 7f709027e640 1 -- 172.21.15.73:0/1303330547 shutdown_connections 2024-03-29T04:09:07.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.395+0000 7f709027e640 1 --2- 172.21.15.73:0/1303330547 >> v2:172.21.15.142:3300/0 conn(0x7f70880b4340 0x7f70880d0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:07.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.395+0000 7f709027e640 1 --2- 172.21.15.73:0/1303330547 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f708815e880 0x7f70880cdd40 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:07.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.395+0000 7f709027e640 1 -- 172.21.15.73:0/1303330547 >> 172.21.15.73:0/1303330547 conn(0x7f70880b6860 msgr2=0x7f70880b6c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:07.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.395+0000 7f709027e640 1 -- 172.21.15.73:0/1303330547 shutdown_connections 2024-03-29T04:09:07.376 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.395+0000 7f709027e640 1 -- 172.21.15.73:0/1303330547 wait complete. 2024-03-29T04:09:07.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.396+0000 7f709027e640 1 Processor -- start 2024-03-29T04:09:07.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.396+0000 7f709027e640 1 -- start start 2024-03-29T04:09:07.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.397+0000 7f709027e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70880b4340 0x7f7088160d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:07.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.397+0000 7f709027e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f708815e880 0x7f70881612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:07.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.397+0000 7f709027e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f708815ec60 0x7f70881f4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:07.378 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.397+0000 7f709027e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f70880d0950 con 0x7f70880b4340 2024-03-29T04:09:07.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.397+0000 7f709027e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f70880d07d0 con 0x7f708815ec60 2024-03-29T04:09:07.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.397+0000 7f709027e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f70880d0ad0 con 0x7f708815e880 2024-03-29T04:09:07.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.397+0000 7f708e01a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70880b4340 0x7f7088160d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:07.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.397+0000 7f708e01a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70880b4340 0x7f7088160d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:47214/0 (socket says 172.21.15.73:47214) 2024-03-29T04:09:07.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.397+0000 7f708e01a640 1 -- 172.21.15.73:0/2966433535 learned_addr learned my addr 172.21.15.73:0/2966433535 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:07.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.397+0000 7f708d819640 1 --2- 172.21.15.73:0/2966433535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f708815e880 0x7f70881612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:07.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.397+0000 7f708e81b640 1 --2- 172.21.15.73:0/2966433535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f708815ec60 0x7f70881f4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:07.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.397+0000 7f708e01a640 1 -- 172.21.15.73:0/2966433535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f708815e880 msgr2=0x7f70881612d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:07.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.397+0000 7f708e01a640 1 --2- 172.21.15.73:0/2966433535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f708815e880 0x7f70881612d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:07.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.397+0000 7f708e01a640 1 -- 172.21.15.73:0/2966433535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f708815ec60 msgr2=0x7f70881f4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:07.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.397+0000 7f708e01a640 1 --2- 172.21.15.73:0/2966433535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f708815ec60 0x7f70881f4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:07.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.397+0000 7f708e01a640 1 -- 172.21.15.73:0/2966433535 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70880af5b0 con 0x7f70880b4340 2024-03-29T04:09:07.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.397+0000 7f708d819640 1 --2- 172.21.15.73:0/2966433535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f708815e880 0x7f70881612d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:09:07.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.397+0000 7f708e81b640 1 --2- 172.21.15.73:0/2966433535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f708815ec60 0x7f70881f4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:09:07.379 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.398+0000 7f708e01a640 1 --2- 172.21.15.73:0/2966433535 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70880b4340 0x7f7088160d90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7084009890 tx=0x7f70840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:07.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.398+0000 7f707effd640 1 -- 172.21.15.73:0/2966433535 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7084041070 con 0x7f70880b4340 2024-03-29T04:09:07.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.398+0000 7f707effd640 1 -- 172.21.15.73:0/2966433535 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f708403aa30 con 0x7f70880b4340 2024-03-29T04:09:07.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.398+0000 7f709027e640 1 -- 172.21.15.73:0/2966433535 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7088161900 con 0x7f70880b4340 2024-03-29T04:09:07.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.398+0000 7f707effd640 1 -- 172.21.15.73:0/2966433535 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7084035040 con 0x7f70880b4340 2024-03-29T04:09:07.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.398+0000 7f709027e640 1 -- 172.21.15.73:0/2966433535 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70880b4cc0 con 0x7f70880b4340 2024-03-29T04:09:07.380 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.399+0000 7f709027e640 1 -- 172.21.15.73:0/2966433535 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7088068640 con 0x7f70880b4340 2024-03-29T04:09:07.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.399+0000 7f707effd640 1 -- 172.21.15.73:0/2966433535 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f7084038020 con 0x7f70880b4340 2024-03-29T04:09:07.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.400+0000 7f707effd640 1 --2- 172.21.15.73:0/2966433535 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f706c06c560 0x7f706c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:07.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.400+0000 7f707effd640 1 -- 172.21.15.73:0/2966433535 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f70840ad100 con 0x7f70880b4340 2024-03-29T04:09:07.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.400+0000 7f708d819640 1 --2- 172.21.15.73:0/2966433535 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f706c06c560 0x7f706c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:07.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.400+0000 7f708d819640 1 --2- 172.21.15.73:0/2966433535 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f706c06c560 0x7f706c06ea20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f70880b0fe0 tx=0x7f7078009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:07.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.408+0000 7f707effd640 1 -- 172.21.15.73:0/2966433535 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f708402f2e0 con 0x7f70880b4340 2024-03-29T04:09:07.564 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.585+0000 7f709027e640 1 -- 172.21.15.73:0/2966433535 --> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7088161e50 con 0x7f706c06c560 2024-03-29T04:09:07.570 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.591+0000 7f707effd640 1 -- 172.21.15.73:0/2966433535 <== mgr.4104 v2:172.21.15.73:6832/1640471941 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251951 (secure 0 0 0) 0x7f7088161e50 con 0x7f706c06c560 2024-03-29T04:09:07.573 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:09:07.574 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-29T04:09:07.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.593+0000 7f709027e640 1 -- 172.21.15.73:0/2966433535 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f706c06c560 msgr2=0x7f706c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:07.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.593+0000 7f709027e640 1 --2- 172.21.15.73:0/2966433535 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f706c06c560 0x7f706c06ea20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f70880b0fe0 tx=0x7f7078009040 comp rx=0 tx=0).stop 2024-03-29T04:09:07.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.593+0000 7f709027e640 1 -- 172.21.15.73:0/2966433535 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70880b4340 msgr2=0x7f7088160d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:07.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.593+0000 7f709027e640 1 --2- 172.21.15.73:0/2966433535 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70880b4340 0x7f7088160d90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7084009890 tx=0x7f70840046c0 comp rx=0 tx=0).stop 2024-03-29T04:09:07.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.594+0000 7f709027e640 1 -- 172.21.15.73:0/2966433535 shutdown_connections 2024-03-29T04:09:07.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.594+0000 7f709027e640 1 --2- 172.21.15.73:0/2966433535 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f706c06c560 0x7f706c06ea20 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:07.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.594+0000 7f709027e640 1 --2- 172.21.15.73:0/2966433535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f708815ec60 0x7f70881f4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:07.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.594+0000 7f709027e640 1 --2- 172.21.15.73:0/2966433535 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f708815e880 0x7f70881612d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:07.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.594+0000 7f709027e640 1 --2- 172.21.15.73:0/2966433535 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70880b4340 0x7f7088160d90 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:07.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.594+0000 7f709027e640 1 -- 172.21.15.73:0/2966433535 >> 172.21.15.73:0/2966433535 conn(0x7f70880b6860 msgr2=0x7f70880b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:07.576 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.594+0000 7f709027e640 1 -- 172.21.15.73:0/2966433535 shutdown_connections 2024-03-29T04:09:07.577 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.594+0000 7f709027e640 1 -- 172.21.15.73:0/2966433535 wait complete. 2024-03-29T04:09:07.584 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2024-03-29T04:09:07.532897+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220204,"kb_used_data":4040,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754516,"statfs":{"total":773094113280,"available":772868624384,"internally_reserved":0,"allocated":4136960,"data_stored":2300388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001363"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.914174+0000","last_change":"2024-03-29T04:08:59.743547+0000","last_active":"2024-03-29T04:09:00.914174+0000","last_peered":"2024-03-29T04:09:00.914174+0000","last_clean":"2024-03-29T04:09:00.914174+0000","last_became_active":"2024-03-29T04:08:59.743093+0000","last_became_peered":"2024-03-29T04:08:59.743093+0000","last_unstale":"2024-03-29T04:09:00.914174+0000","last_undegraded":"2024-03-29T04:09:00.914174+0000","last_fullsized":"2024-03-29T04:09:00.914174+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:28:05.190233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.743379+0000","last_change":"2024-03-29T04:08:59.744005+0000","last_active":"2024-03-29T04:09:00.743379+0000","last_peered":"2024-03-29T04:09:00.743379+0000","last_clean":"2024-03-29T04:09:00.743379+0000","last_became_active":"2024-03-29T04:08:59.743740+0000","last_became_peered":"2024-03-29T04:08:59.743740+0000","last_unstale":"2024-03-29T04:09:00.743379+0000","last_undegraded":"2024-03-29T04:09:00.743379+0000","last_fullsized":"2024-03-29T04:09:00.743379+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:17:13.391068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.743271+0000","last_change":"2024-03-29T04:08:59.742903+0000","last_active":"2024-03-29T04:09:00.743271+0000","last_peered":"2024-03-29T04:09:00.743271+0000","last_clean":"2024-03-29T04:09:00.743271+0000","last_became_active":"2024-03-29T04:08:59.742406+0000","last_became_peered":"2024-03-29T04:08:59.742406+0000","last_unstale":"2024-03-29T04:09:00.743271+0000","last_undegraded":"2024-03-29T04:09:00.743271+0000","last_fullsized":"2024-03-29T04:09:00.743271+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:11:56.766846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.913712+0000","last_change":"2024-03-29T04:08:59.736620+0000","last_active":"2024-03-29T04:09:00.913712+0000","last_peered":"2024-03-29T04:09:00.913712+0000","last_clean":"2024-03-29T04:09:00.913712+0000","last_became_active":"2024-03-29T04:08:59.736326+0000","last_became_peered":"2024-03-29T04:08:59.736326+0000","last_unstale":"2024-03-29T04:09:00.913712+0000","last_undegraded":"2024-03-29T04:09:00.913712+0000","last_fullsized":"2024-03-29T04:09:00.913712+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:35:38.568846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.742103+0000","last_change":"2024-03-29T04:08:59.746701+0000","last_active":"2024-03-29T04:09:00.742103+0000","last_peered":"2024-03-29T04:09:00.742103+0000","last_clean":"2024-03-29T04:09:00.742103+0000","last_became_active":"2024-03-29T04:08:59.746439+0000","last_became_peered":"2024-03-29T04:08:59.746439+0000","last_unstale":"2024-03-29T04:09:00.742103+0000","last_undegraded":"2024-03-29T04:09:00.742103+0000","last_fullsized":"2024-03-29T04:09:00.742103+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:16:44.019425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.742556+0000","last_change":"2024-03-29T04:08:59.745640+0000","last_active":"2024-03-29T04:09:00.742556+0000","last_peered":"2024-03-29T04:09:00.742556+0000","last_clean":"2024-03-29T04:09:00.742556+0000","last_became_active":"2024-03-29T04:08:59.745286+0000","last_became_peered":"2024-03-29T04:08:59.745286+0000","last_unstale":"2024-03-29T04:09:00.742556+0000","last_undegraded":"2024-03-29T04:09:00.742556+0000","last_fullsized":"2024-03-29T04:09:00.742556+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:11:56.766846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.914092+0000","last_change":"2024-03-29T04:08:59.753844+0000","last_active":"2024-03-29T04:09:00.914092+0000","last_peered":"2024-03-29T04:09:00.914092+0000","last_clean":"2024-03-29T04:09:00.914092+0000","last_became_active":"2024-03-29T04:08:59.753500+0000","last_became_peered":"2024-03-29T04:08:59.753500+0000","last_unstale":"2024-03-29T04:09:00.914092+0000","last_undegraded":"2024-03-29T04:09:00.914092+0000","last_fullsized":"2024-03-29T04:09:00.914092+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:25:19.112603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.913460+0000","last_change":"2024-03-29T04:08:59.751747+0000","last_active":"2024-03-29T04:09:00.913460+0000","last_peered":"2024-03-29T04:09:00.913460+0000","last_clean":"2024-03-29T04:09:00.913460+0000","last_became_active":"2024-03-29T04:08:59.751478+0000","last_became_peered":"2024-03-29T04:08:59.751478+0000","last_unstale":"2024-03-29T04:09:00.913460+0000","last_undegraded":"2024-03-29T04:09:00.913460+0000","last_fullsized":"2024-03-29T04:09:00.913460+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:51:37.526302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.916652+0000","last_change":"2024-03-29T04:08:59.735432+0000","last_active":"2024-03-29T04:09:00.916652+0000","last_peered":"2024-03-29T04:09:00.916652+0000","last_clean":"2024-03-29T04:09:00.916652+0000","last_became_active":"2024-03-29T04:08:59.735110+0000","last_became_peered":"2024-03-29T04:08:59.735110+0000","last_unstale":"2024-03-29T04:09:00.916652+0000","last_undegraded":"2024-03-29T04:09:00.916652+0000","last_fullsized":"2024-03-29T04:09:00.916652+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:35:38.568846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.913405+0000","last_change":"2024-03-29T04:08:59.748809+0000","last_active":"2024-03-29T04:09:00.913405+0000","last_peered":"2024-03-29T04:09:00.913405+0000","last_clean":"2024-03-29T04:09:00.913405+0000","last_became_active":"2024-03-29T04:08:59.748543+0000","last_became_peered":"2024-03-29T04:08:59.748543+0000","last_unstale":"2024-03-29T04:09:00.913405+0000","last_undegraded":"2024-03-29T04:09:00.913405+0000","last_fullsized":"2024-03-29T04:09:00.913405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:12:59.127465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.914241+0000","last_change":"2024-03-29T04:08:59.753814+0000","last_active":"2024-03-29T04:09:00.914241+0000","last_peered":"2024-03-29T04:09:00.914241+0000","last_clean":"2024-03-29T04:09:00.914241+0000","last_became_active":"2024-03-29T04:08:59.752413+0000","last_became_peered":"2024-03-29T04:08:59.752413+0000","last_unstale":"2024-03-29T04:09:00.914241+0000","last_undegraded":"2024-03-29T04:09:00.914241+0000","last_fullsized":"2024-03-29T04:09:00.914241+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:58:41.449063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.743135+0000","last_change":"2024-03-29T04:08:59.748460+0000","last_active":"2024-03-29T04:09:00.743135+0000","last_peered":"2024-03-29T04:09:00.743135+0000","last_clean":"2024-03-29T04:09:00.743135+0000","last_became_active":"2024-03-29T04:08:59.747869+0000","last_became_peered":"2024-03-29T04:08:59.747869+0000","last_unstale":"2024-03-29T04:09:00.743135+0000","last_undegraded":"2024-03-29T04:09:00.743135+0000","last_fullsized":"2024-03-29T04:09:00.743135+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:46:34.931889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.742808+0000","last_change":"2024-03-29T04:08:59.744402+0000","last_active":"2024-03-29T04:09:00.742808+0000","last_peered":"2024-03-29T04:09:00.742808+0000","last_clean":"2024-03-29T04:09:00.742808+0000","last_became_active":"2024-03-29T04:08:59.744155+0000","last_became_peered":"2024-03-29T04:08:59.744155+0000","last_unstale":"2024-03-29T04:09:00.742808+0000","last_undegraded":"2024-03-29T04:09:00.742808+0000","last_fullsized":"2024-03-29T04:09:00.742808+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:30:59.082898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.742578+0000","last_change":"2024-03-29T04:08:59.747532+0000","last_active":"2024-03-29T04:09:00.742578+0000","last_peered":"2024-03-29T04:09:00.742578+0000","last_clean":"2024-03-29T04:09:00.742578+0000","last_became_active":"2024-03-29T04:08:59.746369+0000","last_became_peered":"2024-03-29T04:08:59.746369+0000","last_unstale":"2024-03-29T04:09:00.742578+0000","last_undegraded":"2024-03-29T04:09:00.742578+0000","last_fullsized":"2024-03-29T04:09:00.742578+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:54:20.236800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.742802+0000","last_change":"2024-03-29T04:08:59.747419+0000","last_active":"2024-03-29T04:09:00.742802+0000","last_peered":"2024-03-29T04:09:00.742802+0000","last_clean":"2024-03-29T04:09:00.742802+0000","last_became_active":"2024-03-29T04:08:59.747088+0000","last_became_peered":"2024-03-29T04:08:59.747088+0000","last_unstale":"2024-03-29T04:09:00.742802+0000","last_undegraded":"2024-03-29T04:09:00.742802+0000","last_fullsized":"2024-03-29T04:09:00.742802+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:08:32.271854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.913719+0000","last_change":"2024-03-29T04:08:59.753652+0000","last_active":"2024-03-29T04:09:00.913719+0000","last_peered":"2024-03-29T04:09:00.913719+0000","last_clean":"2024-03-29T04:09:00.913719+0000","last_became_active":"2024-03-29T04:08:59.753380+0000","last_became_peered":"2024-03-29T04:08:59.753380+0000","last_unstale":"2024-03-29T04:09:00.913719+0000","last_undegraded":"2024-03-29T04:09:00.913719+0000","last_fullsized":"2024-03-29T04:09:00.913719+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:46:34.931889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.914063+0000","last_change":"2024-03-29T04:08:59.754178+0000","last_active":"2024-03-29T04:09:00.914063+0000","last_peered":"2024-03-29T04:09:00.914063+0000","last_clean":"2024-03-29T04:09:00.914063+0000","last_became_active":"2024-03-29T04:08:59.753846+0000","last_became_peered":"2024-03-29T04:08:59.753846+0000","last_unstale":"2024-03-29T04:09:00.914063+0000","last_undegraded":"2024-03-29T04:09:00.914063+0000","last_fullsized":"2024-03-29T04:09:00.914063+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:20:40.017976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.743422+0000","last_change":"2024-03-29T04:08:59.745275+0000","last_active":"2024-03-29T04:09:00.743422+0000","last_peered":"2024-03-29T04:09:00.743422+0000","last_clean":"2024-03-29T04:09:00.743422+0000","last_became_active":"2024-03-29T04:08:59.744958+0000","last_became_peered":"2024-03-29T04:08:59.744958+0000","last_unstale":"2024-03-29T04:09:00.743422+0000","last_undegraded":"2024-03-29T04:09:00.743422+0000","last_fullsized":"2024-03-29T04:09:00.743422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:20:41.817427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.743117+0000","last_change":"2024-03-29T04:08:59.752022+0000","last_active":"2024-03-29T04:09:00.743117+0000","last_peered":"2024-03-29T04:09:00.743117+0000","last_clean":"2024-03-29T04:09:00.743117+0000","last_became_active":"2024-03-29T04:08:59.751582+0000","last_became_peered":"2024-03-29T04:08:59.751582+0000","last_unstale":"2024-03-29T04:09:00.743117+0000","last_undegraded":"2024-03-29T04:09:00.743117+0000","last_fullsized":"2024-03-29T04:09:00.743117+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:58:41.449063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.742353+0000","last_change":"2024-03-29T04:08:59.740288+0000","last_active":"2024-03-29T04:09:00.742353+0000","last_peered":"2024-03-29T04:09:00.742353+0000","last_clean":"2024-03-29T04:09:00.742353+0000","last_became_active":"2024-03-29T04:08:59.738304+0000","last_became_peered":"2024-03-29T04:08:59.738304+0000","last_unstale":"2024-03-29T04:09:00.742353+0000","last_undegraded":"2024-03-29T04:09:00.742353+0000","last_fullsized":"2024-03-29T04:09:00.742353+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T11:22:21.060272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.916321+0000","last_change":"2024-03-29T04:08:59.745073+0000","last_active":"2024-03-29T04:09:00.916321+0000","last_peered":"2024-03-29T04:09:00.916321+0000","last_clean":"2024-03-29T04:09:00.916321+0000","last_became_active":"2024-03-29T04:08:59.744727+0000","last_became_peered":"2024-03-29T04:08:59.744727+0000","last_unstale":"2024-03-29T04:09:00.916321+0000","last_undegraded":"2024-03-29T04:09:00.916321+0000","last_fullsized":"2024-03-29T04:09:00.916321+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:05:07.649615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.916264+0000","last_change":"2024-03-29T04:08:59.747259+0000","last_active":"2024-03-29T04:09:00.916264+0000","last_peered":"2024-03-29T04:09:00.916264+0000","last_clean":"2024-03-29T04:09:00.916264+0000","last_became_active":"2024-03-29T04:08:59.746927+0000","last_became_peered":"2024-03-29T04:08:59.746927+0000","last_unstale":"2024-03-29T04:09:00.916264+0000","last_undegraded":"2024-03-29T04:09:00.916264+0000","last_fullsized":"2024-03-29T04:09:00.916264+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:16:02.648479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.912915+0000","last_change":"2024-03-29T04:08:59.745488+0000","last_active":"2024-03-29T04:09:00.912915+0000","last_peered":"2024-03-29T04:09:00.912915+0000","last_clean":"2024-03-29T04:09:00.912915+0000","last_became_active":"2024-03-29T04:08:59.745251+0000","last_became_peered":"2024-03-29T04:08:59.745251+0000","last_unstale":"2024-03-29T04:09:00.912915+0000","last_undegraded":"2024-03-29T04:09:00.912915+0000","last_fullsized":"2024-03-29T04:09:00.912915+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:28:05.190233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.742775+0000","last_change":"2024-03-29T04:08:59.738064+0000","last_active":"2024-03-29T04:09:00.742775+0000","last_peered":"2024-03-29T04:09:00.742775+0000","last_clean":"2024-03-29T04:09:00.742775+0000","last_became_active":"2024-03-29T04:08:59.737721+0000","last_became_peered":"2024-03-29T04:08:59.737721+0000","last_unstale":"2024-03-29T04:09:00.742775+0000","last_undegraded":"2024-03-29T04:09:00.742775+0000","last_fullsized":"2024-03-29T04:09:00.742775+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:14:24.705477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.913631+0000","last_change":"2024-03-29T04:08:59.745999+0000","last_active":"2024-03-29T04:09:00.913631+0000","last_peered":"2024-03-29T04:09:00.913631+0000","last_clean":"2024-03-29T04:09:00.913631+0000","last_became_active":"2024-03-29T04:08:59.745726+0000","last_became_peered":"2024-03-29T04:08:59.745726+0000","last_unstale":"2024-03-29T04:09:00.913631+0000","last_undegraded":"2024-03-29T04:09:00.913631+0000","last_fullsized":"2024-03-29T04:09:00.913631+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:06:38.159731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.743489+0000","last_change":"2024-03-29T04:08:59.749687+0000","last_active":"2024-03-29T04:09:00.743489+0000","last_peered":"2024-03-29T04:09:00.743489+0000","last_clean":"2024-03-29T04:09:00.743489+0000","last_became_active":"2024-03-29T04:08:59.749431+0000","last_became_peered":"2024-03-29T04:08:59.749431+0000","last_unstale":"2024-03-29T04:09:00.743489+0000","last_undegraded":"2024-03-29T04:09:00.743489+0000","last_fullsized":"2024-03-29T04:09:00.743489+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T13:33:23.416060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.913726+0000","last_change":"2024-03-29T04:08:59.736759+0000","last_active":"2024-03-29T04:09:00.913726+0000","last_peered":"2024-03-29T04:09:00.913726+0000","last_clean":"2024-03-29T04:09:00.913726+0000","last_became_active":"2024-03-29T04:08:59.736467+0000","last_became_peered":"2024-03-29T04:08:59.736467+0000","last_unstale":"2024-03-29T04:09:00.913726+0000","last_undegraded":"2024-03-29T04:09:00.913726+0000","last_fullsized":"2024-03-29T04:09:00.913726+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:51:37.526302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.743289+0000","last_change":"2024-03-29T04:08:59.741448+0000","last_active":"2024-03-29T04:09:00.743289+0000","last_peered":"2024-03-29T04:09:00.743289+0000","last_clean":"2024-03-29T04:09:00.743289+0000","last_became_active":"2024-03-29T04:08:59.740195+0000","last_became_peered":"2024-03-29T04:08:59.740195+0000","last_unstale":"2024-03-29T04:09:00.743289+0000","last_undegraded":"2024-03-29T04:09:00.743289+0000","last_fullsized":"2024-03-29T04:09:00.743289+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:54:20.236800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.916368+0000","last_change":"2024-03-29T04:08:59.747157+0000","last_active":"2024-03-29T04:09:00.916368+0000","last_peered":"2024-03-29T04:09:00.916368+0000","last_clean":"2024-03-29T04:09:00.916368+0000","last_became_active":"2024-03-29T04:08:59.746850+0000","last_became_peered":"2024-03-29T04:08:59.746850+0000","last_unstale":"2024-03-29T04:09:00.916368+0000","last_undegraded":"2024-03-29T04:09:00.916368+0000","last_fullsized":"2024-03-29T04:09:00.916368+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:47:42.441467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.913822+0000","last_change":"2024-03-29T04:08:59.753275+0000","last_active":"2024-03-29T04:09:00.913822+0000","last_peered":"2024-03-29T04:09:00.913822+0000","last_clean":"2024-03-29T04:09:00.913822+0000","last_became_active":"2024-03-29T04:08:59.752994+0000","last_became_peered":"2024-03-29T04:08:59.752994+0000","last_unstale":"2024-03-29T04:09:00.913822+0000","last_undegraded":"2024-03-29T04:09:00.913822+0000","last_fullsized":"2024-03-29T04:09:00.913822+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T11:37:29.812173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.913543+0000","last_change":"2024-03-29T04:08:59.749093+0000","last_active":"2024-03-29T04:09:00.913543+0000","last_peered":"2024-03-29T04:09:00.913543+0000","last_clean":"2024-03-29T04:09:00.913543+0000","last_became_active":"2024-03-29T04:08:59.748647+0000","last_became_peered":"2024-03-29T04:08:59.748647+0000","last_unstale":"2024-03-29T04:09:00.913543+0000","last_undegraded":"2024-03-29T04:09:00.913543+0000","last_fullsized":"2024-03-29T04:09:00.913543+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:45:59.132925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.913541+0000","last_change":"2024-03-29T04:08:59.755705+0000","last_active":"2024-03-29T04:09:00.913541+0000","last_peered":"2024-03-29T04:09:00.913541+0000","last_clean":"2024-03-29T04:09:00.913541+0000","last_became_active":"2024-03-29T04:08:59.755359+0000","last_became_peered":"2024-03-29T04:08:59.755359+0000","last_unstale":"2024-03-29T04:09:00.913541+0000","last_undegraded":"2024-03-29T04:09:00.913541+0000","last_fullsized":"2024-03-29T04:09:00.913541+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:14:24.705477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.913051+0000","last_change":"2024-03-29T04:08:59.746715+0000","last_active":"2024-03-29T04:09:00.913051+0000","last_peered":"2024-03-29T04:09:00.913051+0000","last_clean":"2024-03-29T04:09:00.913051+0000","last_became_active":"2024-03-29T04:08:59.746450+0000","last_became_peered":"2024-03-29T04:08:59.746450+0000","last_unstale":"2024-03-29T04:09:00.913051+0000","last_undegraded":"2024-03-29T04:09:00.913051+0000","last_fullsized":"2024-03-29T04:09:00.913051+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:32:11.047987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.914247+0000","last_change":"2024-03-29T04:08:58.740024+0000","last_active":"2024-03-29T04:09:00.914247+0000","last_peered":"2024-03-29T04:09:00.914247+0000","last_clean":"2024-03-29T04:09:00.914247+0000","last_became_active":"2024-03-29T04:08:58.739675+0000","last_became_peered":"2024-03-29T04:08:58.739675+0000","last_unstale":"2024-03-29T04:09:00.914247+0000","last_undegraded":"2024-03-29T04:09:00.914247+0000","last_fullsized":"2024-03-29T04:09:00.914247+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:07:14.567159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.914223+0000","last_change":"2024-03-29T04:08:59.744452+0000","last_active":"2024-03-29T04:09:00.914223+0000","last_peered":"2024-03-29T04:09:00.914223+0000","last_clean":"2024-03-29T04:09:00.914223+0000","last_became_active":"2024-03-29T04:08:59.744164+0000","last_became_peered":"2024-03-29T04:08:59.744164+0000","last_unstale":"2024-03-29T04:09:00.914223+0000","last_undegraded":"2024-03-29T04:09:00.914223+0000","last_fullsized":"2024-03-29T04:09:00.914223+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:32:11.047987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.913097+0000","last_change":"2024-03-29T04:08:58.736309+0000","last_active":"2024-03-29T04:09:00.913097+0000","last_peered":"2024-03-29T04:09:00.913097+0000","last_clean":"2024-03-29T04:09:00.913097+0000","last_became_active":"2024-03-29T04:08:58.736063+0000","last_became_peered":"2024-03-29T04:08:58.736063+0000","last_unstale":"2024-03-29T04:09:00.913097+0000","last_undegraded":"2024-03-29T04:09:00.913097+0000","last_fullsized":"2024-03-29T04:09:00.913097+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:07:14.567159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.916524+0000","last_change":"2024-03-29T04:08:59.747252+0000","last_active":"2024-03-29T04:09:00.916524+0000","last_peered":"2024-03-29T04:09:00.916524+0000","last_clean":"2024-03-29T04:09:00.916524+0000","last_became_active":"2024-03-29T04:08:59.746941+0000","last_became_peered":"2024-03-29T04:08:59.746941+0000","last_unstale":"2024-03-29T04:09:00.916524+0000","last_undegraded":"2024-03-29T04:09:00.916524+0000","last_fullsized":"2024-03-29T04:09:00.916524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:12:59.127465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.743074+0000","last_change":"2024-03-29T04:08:58.741509+0000","last_active":"2024-03-29T04:09:00.743074+0000","last_peered":"2024-03-29T04:09:00.743074+0000","last_clean":"2024-03-29T04:09:00.743074+0000","last_became_active":"2024-03-29T04:08:58.740918+0000","last_became_peered":"2024-03-29T04:08:58.740918+0000","last_unstale":"2024-03-29T04:09:00.743074+0000","last_undegraded":"2024-03-29T04:09:00.743074+0000","last_fullsized":"2024-03-29T04:09:00.743074+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:16:01.642976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.913868+0000","last_change":"2024-03-29T04:08:59.736630+0000","last_active":"2024-03-29T04:09:00.913868+0000","last_peered":"2024-03-29T04:09:00.913868+0000","last_clean":"2024-03-29T04:09:00.913868+0000","last_became_active":"2024-03-29T04:08:59.736247+0000","last_became_peered":"2024-03-29T04:08:59.736247+0000","last_unstale":"2024-03-29T04:09:00.913868+0000","last_undegraded":"2024-03-29T04:09:00.913868+0000","last_fullsized":"2024-03-29T04:09:00.913868+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:08:32.271854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.742462+0000","last_change":"2024-03-29T04:08:58.734252+0000","last_active":"2024-03-29T04:09:00.742462+0000","last_peered":"2024-03-29T04:09:00.742462+0000","last_clean":"2024-03-29T04:09:00.742462+0000","last_became_active":"2024-03-29T04:08:58.733952+0000","last_became_peered":"2024-03-29T04:08:58.733952+0000","last_unstale":"2024-03-29T04:09:00.742462+0000","last_undegraded":"2024-03-29T04:09:00.742462+0000","last_fullsized":"2024-03-29T04:09:00.742462+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T11:05:54.187998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.913914+0000","last_change":"2024-03-29T04:08:59.746232+0000","last_active":"2024-03-29T04:09:00.913914+0000","last_peered":"2024-03-29T04:09:00.913914+0000","last_clean":"2024-03-29T04:09:00.913914+0000","last_became_active":"2024-03-29T04:08:59.745884+0000","last_became_peered":"2024-03-29T04:08:59.745884+0000","last_unstale":"2024-03-29T04:09:00.913914+0000","last_undegraded":"2024-03-29T04:09:00.913914+0000","last_fullsized":"2024-03-29T04:09:00.913914+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:11:56.766846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.916585+0000","last_change":"2024-03-29T04:08:58.735622+0000","last_active":"2024-03-29T04:09:00.916585+0000","last_peered":"2024-03-29T04:09:00.916585+0000","last_clean":"2024-03-29T04:09:00.916585+0000","last_became_active":"2024-03-29T04:08:58.735273+0000","last_became_peered":"2024-03-29T04:08:58.735273+0000","last_unstale":"2024-03-29T04:09:00.916585+0000","last_undegraded":"2024-03-29T04:09:00.916585+0000","last_fullsized":"2024-03-29T04:09:00.916585+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T11:23:24.248949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.743069+0000","last_change":"2024-03-29T04:08:59.744088+0000","last_active":"2024-03-29T04:09:00.743069+0000","last_peered":"2024-03-29T04:09:00.743069+0000","last_clean":"2024-03-29T04:09:00.743069+0000","last_became_active":"2024-03-29T04:08:59.743632+0000","last_became_peered":"2024-03-29T04:08:59.743632+0000","last_unstale":"2024-03-29T04:09:00.743069+0000","last_undegraded":"2024-03-29T04:09:00.743069+0000","last_fullsized":"2024-03-29T04:09:00.743069+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T13:20:21.022838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.916187+0000","last_change":"2024-03-29T04:08:58.736168+0000","last_active":"2024-03-29T04:09:00.916187+0000","last_peered":"2024-03-29T04:09:00.916187+0000","last_clean":"2024-03-29T04:09:00.916187+0000","last_became_active":"2024-03-29T04:08:58.735857+0000","last_became_peered":"2024-03-29T04:08:58.735857+0000","last_unstale":"2024-03-29T04:09:00.916187+0000","last_undegraded":"2024-03-29T04:09:00.916187+0000","last_fullsized":"2024-03-29T04:09:00.916187+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:52:07.914816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.916098+0000","last_change":"2024-03-29T04:08:59.745424+0000","last_active":"2024-03-29T04:09:00.916098+0000","last_peered":"2024-03-29T04:09:00.916098+0000","last_clean":"2024-03-29T04:09:00.916098+0000","last_became_active":"2024-03-29T04:08:59.745159+0000","last_became_peered":"2024-03-29T04:08:59.745159+0000","last_unstale":"2024-03-29T04:09:00.916098+0000","last_undegraded":"2024-03-29T04:09:00.916098+0000","last_fullsized":"2024-03-29T04:09:00.916098+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:28:05.190233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.742148+0000","last_change":"2024-03-29T04:08:58.744156+0000","last_active":"2024-03-29T04:09:00.742148+0000","last_peered":"2024-03-29T04:09:00.742148+0000","last_clean":"2024-03-29T04:09:00.742148+0000","last_became_active":"2024-03-29T04:08:58.743868+0000","last_became_peered":"2024-03-29T04:08:58.743868+0000","last_unstale":"2024-03-29T04:09:00.742148+0000","last_undegraded":"2024-03-29T04:09:00.742148+0000","last_fullsized":"2024-03-29T04:09:00.742148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:29:05.825245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.913166+0000","last_change":"2024-03-29T04:08:59.741356+0000","last_active":"2024-03-29T04:09:00.913166+0000","last_peered":"2024-03-29T04:09:00.913166+0000","last_clean":"2024-03-29T04:09:00.913166+0000","last_became_active":"2024-03-29T04:08:59.739052+0000","last_became_peered":"2024-03-29T04:08:59.739052+0000","last_unstale":"2024-03-29T04:09:00.913166+0000","last_undegraded":"2024-03-29T04:09:00.913166+0000","last_fullsized":"2024-03-29T04:09:00.913166+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:47:42.441467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.915987+0000","last_change":"2024-03-29T04:08:58.734800+0000","last_active":"2024-03-29T04:09:00.915987+0000","last_peered":"2024-03-29T04:09:00.915987+0000","last_clean":"2024-03-29T04:09:00.915987+0000","last_became_active":"2024-03-29T04:08:58.734279+0000","last_became_peered":"2024-03-29T04:08:58.734279+0000","last_unstale":"2024-03-29T04:09:00.915987+0000","last_undegraded":"2024-03-29T04:09:00.915987+0000","last_fullsized":"2024-03-29T04:09:00.915987+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:37:55.249310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.743397+0000","last_change":"2024-03-29T04:08:59.751160+0000","last_active":"2024-03-29T04:09:00.743397+0000","last_peered":"2024-03-29T04:09:00.743397+0000","last_clean":"2024-03-29T04:09:00.743397+0000","last_became_active":"2024-03-29T04:08:59.750864+0000","last_became_peered":"2024-03-29T04:08:59.750864+0000","last_unstale":"2024-03-29T04:09:00.743397+0000","last_undegraded":"2024-03-29T04:09:00.743397+0000","last_fullsized":"2024-03-29T04:09:00.743397+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:58:41.449063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.743182+0000","last_change":"2024-03-29T04:08:58.741302+0000","last_active":"2024-03-29T04:09:00.743182+0000","last_peered":"2024-03-29T04:09:00.743182+0000","last_clean":"2024-03-29T04:09:00.743182+0000","last_became_active":"2024-03-29T04:08:58.741005+0000","last_became_peered":"2024-03-29T04:08:58.741005+0000","last_unstale":"2024-03-29T04:09:00.743182+0000","last_undegraded":"2024-03-29T04:09:00.743182+0000","last_fullsized":"2024-03-29T04:09:00.743182+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:53:18.542411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.743096+0000","last_change":"2024-03-29T04:08:59.748024+0000","last_active":"2024-03-29T04:09:00.743096+0000","last_peered":"2024-03-29T04:09:00.743096+0000","last_clean":"2024-03-29T04:09:00.743096+0000","last_became_active":"2024-03-29T04:08:59.745932+0000","last_became_peered":"2024-03-29T04:08:59.745932+0000","last_unstale":"2024-03-29T04:09:00.743096+0000","last_undegraded":"2024-03-29T04:09:00.743096+0000","last_fullsized":"2024-03-29T04:09:00.743096+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:25:19.112603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.913186+0000","last_change":"2024-03-29T04:08:58.735600+0000","last_active":"2024-03-29T04:09:00.913186+0000","last_peered":"2024-03-29T04:09:00.913186+0000","last_clean":"2024-03-29T04:09:00.913186+0000","last_became_active":"2024-03-29T04:08:58.735356+0000","last_became_peered":"2024-03-29T04:08:58.735356+0000","last_unstale":"2024-03-29T04:09:00.913186+0000","last_undegraded":"2024-03-29T04:09:00.913186+0000","last_fullsized":"2024-03-29T04:09:00.913186+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T11:07:50.501006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.743236+0000","last_change":"2024-03-29T04:08:59.751326+0000","last_active":"2024-03-29T04:09:00.743236+0000","last_peered":"2024-03-29T04:09:00.743236+0000","last_clean":"2024-03-29T04:09:00.743236+0000","last_became_active":"2024-03-29T04:08:59.750775+0000","last_became_peered":"2024-03-29T04:08:59.750775+0000","last_unstale":"2024-03-29T04:09:00.743236+0000","last_undegraded":"2024-03-29T04:09:00.743236+0000","last_fullsized":"2024-03-29T04:09:00.743236+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:35:06.557914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.743254+0000","last_change":"2024-03-29T04:08:58.741332+0000","last_active":"2024-03-29T04:09:00.743254+0000","last_peered":"2024-03-29T04:09:00.743254+0000","last_clean":"2024-03-29T04:09:00.743254+0000","last_became_active":"2024-03-29T04:08:58.741064+0000","last_became_peered":"2024-03-29T04:08:58.741064+0000","last_unstale":"2024-03-29T04:09:00.743254+0000","last_undegraded":"2024-03-29T04:09:00.743254+0000","last_fullsized":"2024-03-29T04:09:00.743254+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:40:08.759025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.743183+0000","last_change":"2024-03-29T04:08:59.743522+0000","last_active":"2024-03-29T04:09:00.743183+0000","last_peered":"2024-03-29T04:09:00.743183+0000","last_clean":"2024-03-29T04:09:00.743183+0000","last_became_active":"2024-03-29T04:08:59.742887+0000","last_became_peered":"2024-03-29T04:08:59.742887+0000","last_unstale":"2024-03-29T04:09:00.743183+0000","last_undegraded":"2024-03-29T04:09:00.743183+0000","last_fullsized":"2024-03-29T04:09:00.743183+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T11:37:29.812173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.743276+0000","last_change":"2024-03-29T04:08:58.738558+0000","last_active":"2024-03-29T04:09:00.743276+0000","last_peered":"2024-03-29T04:09:00.743276+0000","last_clean":"2024-03-29T04:09:00.743276+0000","last_became_active":"2024-03-29T04:08:58.738075+0000","last_became_peered":"2024-03-29T04:08:58.738075+0000","last_unstale":"2024-03-29T04:09:00.743276+0000","last_undegraded":"2024-03-29T04:09:00.743276+0000","last_fullsized":"2024-03-29T04:09:00.743276+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:32:10.042485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.912956+0000","last_change":"2024-03-29T04:08:59.738552+0000","last_active":"2024-03-29T04:09:00.912956+0000","last_peered":"2024-03-29T04:09:00.912956+0000","last_clean":"2024-03-29T04:09:00.912956+0000","last_became_active":"2024-03-29T04:08:59.738296+0000","last_became_peered":"2024-03-29T04:08:59.738296+0000","last_unstale":"2024-03-29T04:09:00.912956+0000","last_undegraded":"2024-03-29T04:09:00.912956+0000","last_fullsized":"2024-03-29T04:09:00.912956+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:05:07.649615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.916589+0000","last_change":"2024-03-29T04:08:58.739182+0000","last_active":"2024-03-29T04:09:00.916589+0000","last_peered":"2024-03-29T04:09:00.916589+0000","last_clean":"2024-03-29T04:09:00.916589+0000","last_became_active":"2024-03-29T04:08:58.738891+0000","last_became_peered":"2024-03-29T04:08:58.738891+0000","last_unstale":"2024-03-29T04:09:00.916589+0000","last_undegraded":"2024-03-29T04:09:00.916589+0000","last_fullsized":"2024-03-29T04:09:00.916589+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:13:18.921275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.743053+0000","last_change":"2024-03-29T04:08:59.745692+0000","last_active":"2024-03-29T04:09:00.743053+0000","last_peered":"2024-03-29T04:09:00.743053+0000","last_clean":"2024-03-29T04:09:00.743053+0000","last_became_active":"2024-03-29T04:08:59.745323+0000","last_became_peered":"2024-03-29T04:08:59.745323+0000","last_unstale":"2024-03-29T04:09:00.743053+0000","last_undegraded":"2024-03-29T04:09:00.743053+0000","last_fullsized":"2024-03-29T04:09:00.743053+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:20:40.017976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.913009+0000","last_change":"2024-03-29T04:08:58.736839+0000","last_active":"2024-03-29T04:09:00.913009+0000","last_peered":"2024-03-29T04:09:00.913009+0000","last_clean":"2024-03-29T04:09:00.913009+0000","last_became_active":"2024-03-29T04:08:58.736418+0000","last_became_peered":"2024-03-29T04:08:58.736418+0000","last_unstale":"2024-03-29T04:09:00.913009+0000","last_undegraded":"2024-03-29T04:09:00.913009+0000","last_fullsized":"2024-03-29T04:09:00.913009+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:30:58.077396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.913596+0000","last_change":"2024-03-29T04:08:59.749660+0000","last_active":"2024-03-29T04:09:00.913596+0000","last_peered":"2024-03-29T04:09:00.913596+0000","last_clean":"2024-03-29T04:09:00.913596+0000","last_became_active":"2024-03-29T04:08:59.749402+0000","last_became_peered":"2024-03-29T04:08:59.749402+0000","last_unstale":"2024-03-29T04:09:00.913596+0000","last_undegraded":"2024-03-29T04:09:00.913596+0000","last_fullsized":"2024-03-29T04:09:00.913596+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T13:20:21.022838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.742339+0000","last_change":"2024-03-29T04:08:58.737991+0000","last_active":"2024-03-29T04:09:00.742339+0000","last_peered":"2024-03-29T04:09:00.742339+0000","last_clean":"2024-03-29T04:09:00.742339+0000","last_became_active":"2024-03-29T04:08:58.737701+0000","last_became_peered":"2024-03-29T04:08:58.737701+0000","last_unstale":"2024-03-29T04:09:00.742339+0000","last_undegraded":"2024-03-29T04:09:00.742339+0000","last_fullsized":"2024-03-29T04:09:00.742339+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T09:28:04.184731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.913699+0000","last_change":"2024-03-29T04:08:59.748135+0000","last_active":"2024-03-29T04:09:00.913699+0000","last_peered":"2024-03-29T04:09:00.913699+0000","last_clean":"2024-03-29T04:09:00.913699+0000","last_became_active":"2024-03-29T04:08:59.746812+0000","last_became_peered":"2024-03-29T04:08:59.746812+0000","last_unstale":"2024-03-29T04:09:00.913699+0000","last_undegraded":"2024-03-29T04:09:00.913699+0000","last_fullsized":"2024-03-29T04:09:00.913699+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:29:06.830747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.742324+0000","last_change":"2024-03-29T04:08:58.735372+0000","last_active":"2024-03-29T04:09:00.742324+0000","last_peered":"2024-03-29T04:09:00.742324+0000","last_clean":"2024-03-29T04:09:00.742324+0000","last_became_active":"2024-03-29T04:08:58.735105+0000","last_became_peered":"2024-03-29T04:08:58.735105+0000","last_unstale":"2024-03-29T04:09:00.742324+0000","last_undegraded":"2024-03-29T04:09:00.742324+0000","last_fullsized":"2024-03-29T04:09:00.742324+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:45:58.127423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.916553+0000","last_change":"2024-03-29T04:08:59.739103+0000","last_active":"2024-03-29T04:09:00.916553+0000","last_peered":"2024-03-29T04:09:00.916553+0000","last_clean":"2024-03-29T04:09:00.916553+0000","last_became_active":"2024-03-29T04:08:59.738721+0000","last_became_peered":"2024-03-29T04:08:59.738721+0000","last_unstale":"2024-03-29T04:09:00.916553+0000","last_undegraded":"2024-03-29T04:09:00.916553+0000","last_fullsized":"2024-03-29T04:09:00.916553+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:06:38.159731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.913760+0000","last_change":"2024-03-29T04:08:58.735707+0000","last_active":"2024-03-29T04:09:00.913760+0000","last_peered":"2024-03-29T04:09:00.913760+0000","last_clean":"2024-03-29T04:09:00.913760+0000","last_became_active":"2024-03-29T04:08:58.735412+0000","last_became_peered":"2024-03-29T04:08:58.735412+0000","last_unstale":"2024-03-29T04:09:00.913760+0000","last_undegraded":"2024-03-29T04:09:00.913760+0000","last_fullsized":"2024-03-29T04:09:00.913760+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:10:00.078096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.743363+0000","last_change":"2024-03-29T04:08:59.739165+0000","last_active":"2024-03-29T04:09:00.743363+0000","last_peered":"2024-03-29T04:09:00.743363+0000","last_clean":"2024-03-29T04:09:00.743363+0000","last_became_active":"2024-03-29T04:08:59.738837+0000","last_became_peered":"2024-03-29T04:08:59.738837+0000","last_unstale":"2024-03-29T04:09:00.743363+0000","last_undegraded":"2024-03-29T04:09:00.743363+0000","last_fullsized":"2024-03-29T04:09:00.743363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:25:19.112603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.916458+0000","last_change":"2024-03-29T04:08:58.734766+0000","last_active":"2024-03-29T04:09:00.916458+0000","last_peered":"2024-03-29T04:09:00.916458+0000","last_clean":"2024-03-29T04:09:00.916458+0000","last_became_active":"2024-03-29T04:08:58.734472+0000","last_became_peered":"2024-03-29T04:08:58.734472+0000","last_unstale":"2024-03-29T04:09:00.916458+0000","last_undegraded":"2024-03-29T04:09:00.916458+0000","last_fullsized":"2024-03-29T04:09:00.916458+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:30:58.077396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.913847+0000","last_change":"2024-03-29T04:08:59.737076+0000","last_active":"2024-03-29T04:09:00.913847+0000","last_peered":"2024-03-29T04:09:00.913847+0000","last_clean":"2024-03-29T04:09:00.913847+0000","last_became_active":"2024-03-29T04:08:59.736772+0000","last_became_peered":"2024-03-29T04:08:59.736772+0000","last_unstale":"2024-03-29T04:09:00.913847+0000","last_undegraded":"2024-03-29T04:09:00.913847+0000","last_fullsized":"2024-03-29T04:09:00.913847+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:14:24.705477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.916522+0000","last_change":"2024-03-29T04:08:58.735341+0000","last_active":"2024-03-29T04:09:00.916522+0000","last_peered":"2024-03-29T04:09:00.916522+0000","last_clean":"2024-03-29T04:09:00.916522+0000","last_became_active":"2024-03-29T04:08:58.735087+0000","last_became_peered":"2024-03-29T04:08:58.735087+0000","last_unstale":"2024-03-29T04:09:00.916522+0000","last_undegraded":"2024-03-29T04:09:00.916522+0000","last_fullsized":"2024-03-29T04:09:00.916522+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T10:00:51.987476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.742682+0000","last_change":"2024-03-29T04:08:59.746404+0000","last_active":"2024-03-29T04:09:00.742682+0000","last_peered":"2024-03-29T04:09:00.742682+0000","last_clean":"2024-03-29T04:09:00.742682+0000","last_became_active":"2024-03-29T04:08:59.746125+0000","last_became_peered":"2024-03-29T04:08:59.746125+0000","last_unstale":"2024-03-29T04:09:00.742682+0000","last_undegraded":"2024-03-29T04:09:00.742682+0000","last_fullsized":"2024-03-29T04:09:00.742682+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T10:00:52.992978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.916353+0000","last_change":"2024-03-29T04:08:58.736432+0000","last_active":"2024-03-29T04:09:00.916353+0000","last_peered":"2024-03-29T04:09:00.916353+0000","last_clean":"2024-03-29T04:09:00.916353+0000","last_became_active":"2024-03-29T04:08:58.736067+0000","last_became_peered":"2024-03-29T04:08:58.736067+0000","last_unstale":"2024-03-29T04:09:00.916353+0000","last_undegraded":"2024-03-29T04:09:00.916353+0000","last_fullsized":"2024-03-29T04:09:00.916353+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T11:22:20.054769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.742245+0000","last_change":"2024-03-29T04:08:59.740057+0000","last_active":"2024-03-29T04:09:00.742245+0000","last_peered":"2024-03-29T04:09:00.742245+0000","last_clean":"2024-03-29T04:09:00.742245+0000","last_became_active":"2024-03-29T04:08:59.739778+0000","last_became_peered":"2024-03-29T04:08:59.739778+0000","last_unstale":"2024-03-29T04:09:00.742245+0000","last_undegraded":"2024-03-29T04:09:00.742245+0000","last_fullsized":"2024-03-29T04:09:00.742245+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:52:08.920318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.913166+0000","last_change":"2024-03-29T04:08:58.744612+0000","last_active":"2024-03-29T04:09:00.913166+0000","last_peered":"2024-03-29T04:09:00.913166+0000","last_clean":"2024-03-29T04:09:00.913166+0000","last_became_active":"2024-03-29T04:08:58.744320+0000","last_became_peered":"2024-03-29T04:08:58.744320+0000","last_unstale":"2024-03-29T04:09:00.913166+0000","last_undegraded":"2024-03-29T04:09:00.913166+0000","last_fullsized":"2024-03-29T04:09:00.913166+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:43:49.194799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.742376+0000","last_change":"2024-03-29T04:08:59.743275+0000","last_active":"2024-03-29T04:09:00.742376+0000","last_peered":"2024-03-29T04:09:00.742376+0000","last_clean":"2024-03-29T04:09:00.742376+0000","last_became_active":"2024-03-29T04:08:59.743007+0000","last_became_peered":"2024-03-29T04:08:59.743007+0000","last_unstale":"2024-03-29T04:09:00.742376+0000","last_undegraded":"2024-03-29T04:09:00.742376+0000","last_fullsized":"2024-03-29T04:09:00.742376+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:13:19.926777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.913777+0000","last_change":"2024-03-29T04:08:58.735743+0000","last_active":"2024-03-29T04:09:00.913777+0000","last_peered":"2024-03-29T04:09:00.913777+0000","last_clean":"2024-03-29T04:09:00.913777+0000","last_became_active":"2024-03-29T04:08:58.735419+0000","last_became_peered":"2024-03-29T04:08:58.735419+0000","last_unstale":"2024-03-29T04:09:00.913777+0000","last_undegraded":"2024-03-29T04:09:00.913777+0000","last_fullsized":"2024-03-29T04:09:00.913777+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T10:00:51.987476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.742029+0000","last_change":"2024-03-29T04:08:59.741226+0000","last_active":"2024-03-29T04:09:00.742029+0000","last_peered":"2024-03-29T04:09:00.742029+0000","last_clean":"2024-03-29T04:09:00.742029+0000","last_became_active":"2024-03-29T04:08:59.740379+0000","last_became_peered":"2024-03-29T04:08:59.740379+0000","last_unstale":"2024-03-29T04:09:00.742029+0000","last_undegraded":"2024-03-29T04:09:00.742029+0000","last_fullsized":"2024-03-29T04:09:00.742029+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:00:34.458542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.916074+0000","last_change":"2024-03-29T04:08:58.737885+0000","last_active":"2024-03-29T04:09:00.916074+0000","last_peered":"2024-03-29T04:09:00.916074+0000","last_clean":"2024-03-29T04:09:00.916074+0000","last_became_active":"2024-03-29T04:08:58.737221+0000","last_became_peered":"2024-03-29T04:08:58.737221+0000","last_unstale":"2024-03-29T04:09:00.916074+0000","last_undegraded":"2024-03-29T04:09:00.916074+0000","last_fullsized":"2024-03-29T04:09:00.916074+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:00:33.453040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.913915+0000","last_change":"2024-03-29T04:08:59.753351+0000","last_active":"2024-03-29T04:09:00.913915+0000","last_peered":"2024-03-29T04:09:00.913915+0000","last_clean":"2024-03-29T04:09:00.913915+0000","last_became_active":"2024-03-29T04:08:59.753033+0000","last_became_peered":"2024-03-29T04:08:59.753033+0000","last_unstale":"2024-03-29T04:09:00.913915+0000","last_undegraded":"2024-03-29T04:09:00.913915+0000","last_fullsized":"2024-03-29T04:09:00.913915+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:54:20.236800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.742640+0000","last_change":"2024-03-29T04:08:58.737943+0000","last_active":"2024-03-29T04:09:00.742640+0000","last_peered":"2024-03-29T04:09:00.742640+0000","last_clean":"2024-03-29T04:09:00.742640+0000","last_became_active":"2024-03-29T04:08:58.737445+0000","last_became_peered":"2024-03-29T04:08:58.737445+0000","last_unstale":"2024-03-29T04:09:00.742640+0000","last_undegraded":"2024-03-29T04:09:00.742640+0000","last_fullsized":"2024-03-29T04:09:00.742640+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T06:45:58.127423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.742552+0000","last_change":"2024-03-29T04:08:59.741075+0000","last_active":"2024-03-29T04:09:00.742552+0000","last_peered":"2024-03-29T04:09:00.742552+0000","last_clean":"2024-03-29T04:09:00.742552+0000","last_became_active":"2024-03-29T04:08:59.740781+0000","last_became_peered":"2024-03-29T04:08:59.740781+0000","last_unstale":"2024-03-29T04:09:00.742552+0000","last_undegraded":"2024-03-29T04:09:00.742552+0000","last_fullsized":"2024-03-29T04:09:00.742552+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T11:23:25.254452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.913803+0000","last_change":"2024-03-29T04:08:58.738900+0000","last_active":"2024-03-29T04:09:00.913803+0000","last_peered":"2024-03-29T04:09:00.913803+0000","last_clean":"2024-03-29T04:09:00.913803+0000","last_became_active":"2024-03-29T04:08:58.737653+0000","last_became_peered":"2024-03-29T04:08:58.737653+0000","last_unstale":"2024-03-29T04:09:00.913803+0000","last_undegraded":"2024-03-29T04:09:00.913803+0000","last_fullsized":"2024-03-29T04:09:00.913803+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:43:49.194799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.743362+0000","last_change":"2024-03-29T04:08:59.741010+0000","last_active":"2024-03-29T04:09:00.743362+0000","last_peered":"2024-03-29T04:09:00.743362+0000","last_clean":"2024-03-29T04:09:00.743362+0000","last_became_active":"2024-03-29T04:08:59.740702+0000","last_became_peered":"2024-03-29T04:08:59.740702+0000","last_unstale":"2024-03-29T04:09:00.743362+0000","last_undegraded":"2024-03-29T04:09:00.743362+0000","last_fullsized":"2024-03-29T04:09:00.743362+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T14:20:40.017976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.913280+0000","last_change":"2024-03-29T04:08:58.741199+0000","last_active":"2024-03-29T04:09:00.913280+0000","last_peered":"2024-03-29T04:09:00.913280+0000","last_clean":"2024-03-29T04:09:00.913280+0000","last_became_active":"2024-03-29T04:08:58.740915+0000","last_became_peered":"2024-03-29T04:08:58.740915+0000","last_unstale":"2024-03-29T04:09:00.913280+0000","last_undegraded":"2024-03-29T04:09:00.913280+0000","last_fullsized":"2024-03-29T04:09:00.913280+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:10:00.078096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.913150+0000","last_change":"2024-03-29T04:08:59.742730+0000","last_active":"2024-03-29T04:09:00.913150+0000","last_peered":"2024-03-29T04:09:00.913150+0000","last_clean":"2024-03-29T04:09:00.913150+0000","last_became_active":"2024-03-29T04:08:59.742440+0000","last_became_peered":"2024-03-29T04:08:59.742440+0000","last_unstale":"2024-03-29T04:09:00.913150+0000","last_undegraded":"2024-03-29T04:09:00.913150+0000","last_fullsized":"2024-03-29T04:09:00.913150+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:16:02.648479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.913879+0000","last_change":"2024-03-29T04:08:58.736170+0000","last_active":"2024-03-29T04:09:00.913879+0000","last_peered":"2024-03-29T04:09:00.913879+0000","last_clean":"2024-03-29T04:09:00.913879+0000","last_became_active":"2024-03-29T04:08:58.735548+0000","last_became_peered":"2024-03-29T04:08:58.735548+0000","last_unstale":"2024-03-29T04:09:00.913879+0000","last_undegraded":"2024-03-29T04:09:00.913879+0000","last_fullsized":"2024-03-29T04:09:00.913879+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T11:07:50.501006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.913660+0000","last_change":"2024-03-29T04:08:59.745593+0000","last_active":"2024-03-29T04:09:00.913660+0000","last_peered":"2024-03-29T04:09:00.913660+0000","last_clean":"2024-03-29T04:09:00.913660+0000","last_became_active":"2024-03-29T04:08:59.745234+0000","last_became_peered":"2024-03-29T04:08:59.745234+0000","last_unstale":"2024-03-29T04:09:00.913660+0000","last_undegraded":"2024-03-29T04:09:00.913660+0000","last_fullsized":"2024-03-29T04:09:00.913660+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:40:09.764527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.913269+0000","last_change":"2024-03-29T04:08:58.738871+0000","last_active":"2024-03-29T04:09:00.913269+0000","last_peered":"2024-03-29T04:09:00.913269+0000","last_clean":"2024-03-29T04:09:00.913269+0000","last_became_active":"2024-03-29T04:08:58.738576+0000","last_became_peered":"2024-03-29T04:08:58.738576+0000","last_unstale":"2024-03-29T04:09:00.913269+0000","last_undegraded":"2024-03-29T04:09:00.913269+0000","last_fullsized":"2024-03-29T04:09:00.913269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T04:23:34.502366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.913174+0000","last_change":"2024-03-29T04:08:59.747753+0000","last_active":"2024-03-29T04:09:00.913174+0000","last_peered":"2024-03-29T04:09:00.913174+0000","last_clean":"2024-03-29T04:09:00.913174+0000","last_became_active":"2024-03-29T04:08:59.747277+0000","last_became_peered":"2024-03-29T04:08:59.747277+0000","last_unstale":"2024-03-29T04:09:00.913174+0000","last_undegraded":"2024-03-29T04:09:00.913174+0000","last_fullsized":"2024-03-29T04:09:00.913174+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:05:07.649615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.913093+0000","last_change":"2024-03-29T04:08:58.739480+0000","last_active":"2024-03-29T04:09:00.913093+0000","last_peered":"2024-03-29T04:09:00.913093+0000","last_clean":"2024-03-29T04:09:00.913093+0000","last_became_active":"2024-03-29T04:08:58.739129+0000","last_became_peered":"2024-03-29T04:08:58.739129+0000","last_unstale":"2024-03-29T04:09:00.913093+0000","last_undegraded":"2024-03-29T04:09:00.913093+0000","last_fullsized":"2024-03-29T04:09:00.913093+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T08:07:14.567159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.742270+0000","last_change":"2024-03-29T04:08:59.750327+0000","last_active":"2024-03-29T04:09:00.742270+0000","last_peered":"2024-03-29T04:09:00.742270+0000","last_clean":"2024-03-29T04:09:00.742270+0000","last_became_active":"2024-03-29T04:08:59.748636+0000","last_became_peered":"2024-03-29T04:08:59.748636+0000","last_unstale":"2024-03-29T04:09:00.742270+0000","last_undegraded":"2024-03-29T04:09:00.742270+0000","last_fullsized":"2024-03-29T04:09:00.742270+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T11:37:29.812173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.916477+0000","last_change":"2024-03-29T04:08:58.733790+0000","last_active":"2024-03-29T04:09:00.916477+0000","last_peered":"2024-03-29T04:09:00.916477+0000","last_clean":"2024-03-29T04:09:00.916477+0000","last_became_active":"2024-03-29T04:08:58.733326+0000","last_became_peered":"2024-03-29T04:08:58.733326+0000","last_unstale":"2024-03-29T04:09:00.916477+0000","last_undegraded":"2024-03-29T04:09:00.916477+0000","last_fullsized":"2024-03-29T04:09:00.916477+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:16:43.013923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.916258+0000","last_change":"2024-03-29T04:08:59.747320+0000","last_active":"2024-03-29T04:09:00.916258+0000","last_peered":"2024-03-29T04:09:00.916258+0000","last_clean":"2024-03-29T04:09:00.916258+0000","last_became_active":"2024-03-29T04:08:59.746379+0000","last_became_peered":"2024-03-29T04:08:59.746379+0000","last_unstale":"2024-03-29T04:09:00.916258+0000","last_undegraded":"2024-03-29T04:09:00.916258+0000","last_fullsized":"2024-03-29T04:09:00.916258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:32:11.047987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.742425+0000","last_change":"2024-03-29T04:08:58.736518+0000","last_active":"2024-03-29T04:09:00.742425+0000","last_peered":"2024-03-29T04:09:00.742425+0000","last_clean":"2024-03-29T04:09:00.742425+0000","last_became_active":"2024-03-29T04:08:58.736231+0000","last_became_peered":"2024-03-29T04:08:58.736231+0000","last_unstale":"2024-03-29T04:09:00.742425+0000","last_undegraded":"2024-03-29T04:09:00.742425+0000","last_fullsized":"2024-03-29T04:09:00.742425+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T15:40:08.759025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.913587+0000","last_change":"2024-03-29T04:08:59.753689+0000","last_active":"2024-03-29T04:09:00.913587+0000","last_peered":"2024-03-29T04:09:00.913587+0000","last_clean":"2024-03-29T04:09:00.913587+0000","last_became_active":"2024-03-29T04:08:59.752193+0000","last_became_peered":"2024-03-29T04:08:59.752193+0000","last_unstale":"2024-03-29T04:09:00.913587+0000","last_undegraded":"2024-03-29T04:09:00.913587+0000","last_fullsized":"2024-03-29T04:09:00.913587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:58.714514+0000","last_clean_scrub_stamp":"2024-03-29T04:08:58.714514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T07:08:32.271854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.913973+0000","last_change":"2024-03-29T04:08:58.734691+0000","last_active":"2024-03-29T04:09:00.913973+0000","last_peered":"2024-03-29T04:09:00.913973+0000","last_clean":"2024-03-29T04:09:00.913973+0000","last_became_active":"2024-03-29T04:08:58.733749+0000","last_became_peered":"2024-03-29T04:08:58.733749+0000","last_unstale":"2024-03-29T04:09:00.913973+0000","last_undegraded":"2024-03-29T04:09:00.913973+0000","last_fullsized":"2024-03-29T04:09:00.913973+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:57.709012+0000","last_clean_scrub_stamp":"2024-03-29T04:08:57.709012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T12:30:58.077396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":190,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-29T04:09:00.913662+0000","last_change":"2024-03-29T04:08:01.885311+0000","last_active":"2024-03-29T04:09:00.913662+0000","last_peered":"2024-03-29T04:09:00.913662+0000","last_clean":"2024-03-29T04:09:00.913662+0000","last_became_active":"2024-03-29T04:08:01.884340+0000","last_became_peered":"2024-03-29T04:08:01.884340+0000","last_unstale":"2024-03-29T04:09:00.913662+0000","last_undegraded":"2024-03-29T04:09:00.913662+0000","last_fullsized":"2024-03-29T04:09:00.913662+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:00.511520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:00.511520+0000","last_clean_scrub_stamp":"2024-03-29T04:08:00.511520+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:40:25.245419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":958464,"data_stored":729812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":139970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":140026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":139458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":140988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":139424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":140988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343888,"statfs":{"total":96636764160,"available":96608141312,"internally_reserved":0,"allocated":954368,"data_stored":729722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-29T04:09:07.588 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-29T04:09:07.588 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-03-29T04:09:07.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.755+0000 7fc49f455640 1 Processor -- start 2024-03-29T04:09:07.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.755+0000 7fc49f455640 1 -- start start 2024-03-29T04:09:07.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.756+0000 7fc49f455640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc49815e4d0 0x7fc49806c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:07.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.756+0000 7fc49f455640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc49815e8b0 0x7fc4980d2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:07.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.756+0000 7fc49f455640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4980d13e0 con 0x7fc4980d0e70 2024-03-29T04:09:07.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.756+0000 7fc49f455640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fc4980cf6b0 con 0x7fc49815e4d0 2024-03-29T04:09:07.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.756+0000 7fc49f455640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc4980d16c0 con 0x7fc49815e8b0 2024-03-29T04:09:07.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.756+0000 7fc49c9f0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc49815e8b0 0x7fc4980d2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:07.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.756+0000 7fc49d1f1640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc49815e4d0 0x7fc49806c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:07.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.756+0000 7fc49c9f0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc49815e8b0 0x7fc4980d2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:37644/0 (socket says 172.21.15.73:37644) 2024-03-29T04:09:07.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.756+0000 7fc49c9f0640 1 -- 172.21.15.73:0/2304695147 learned_addr learned my addr 172.21.15.73:0/2304695147 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:07.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.756+0000 7fc49d9f2640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fc4980d0e70 0x7fc4980d2bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.73:36096/0 (socket says 172.21.15.73:36096) 2024-03-29T04:09:07.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.756+0000 7fc49d1f1640 1 -- 172.21.15.73:0/2304695147 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc49815e8b0 msgr2=0x7fc4980d2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:07.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.756+0000 7fc49d1f1640 1 --2- 172.21.15.73:0/2304695147 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc49815e8b0 0x7fc4980d2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:07.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.756+0000 7fc49d1f1640 1 -- 172.21.15.73:0/2304695147 >> v1:172.21.15.142:6789/0 conn(0x7fc4980d0e70 legacy=0x7fc4980d2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:07.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.756+0000 7fc48ffff640 1 -- 172.21.15.73:0/2304695147 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 69910054 0 0) 0x7fc4980d13e0 con 0x7fc4980d0e70 2024-03-29T04:09:07.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.756+0000 7fc49d1f1640 1 -- 172.21.15.73:0/2304695147 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4980d19a0 con 0x7fc49815e4d0 2024-03-29T04:09:07.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.756+0000 7fc49c9f0640 1 --2- 172.21.15.73:0/2304695147 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc49815e8b0 0x7fc4980d2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:09:07.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.757+0000 7fc49d1f1640 1 --2- 172.21.15.73:0/2304695147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc49815e4d0 0x7fc49806c740 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc4940097a0 tx=0x7fc49402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc2d5046953057bd server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:07.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.757+0000 7fc48ffff640 1 -- 172.21.15.73:0/2304695147 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc494035020 con 0x7fc49815e4d0 2024-03-29T04:09:07.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.757+0000 7fc48ffff640 1 -- 172.21.15.73:0/2304695147 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc494031830 con 0x7fc49815e4d0 2024-03-29T04:09:07.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.757+0000 7fc48ffff640 1 -- 172.21.15.73:0/2304695147 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc494031c00 con 0x7fc49815e4d0 2024-03-29T04:09:07.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.758+0000 7fc49f455640 1 -- 172.21.15.73:0/2304695147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc49815e4d0 msgr2=0x7fc49806c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:07.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.758+0000 7fc49f455640 1 --2- 172.21.15.73:0/2304695147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc49815e4d0 0x7fc49806c740 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc4940097a0 tx=0x7fc49402b8d0 comp rx=0 tx=0).stop 2024-03-29T04:09:07.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.758+0000 7fc49f455640 1 -- 172.21.15.73:0/2304695147 shutdown_connections 2024-03-29T04:09:07.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.758+0000 7fc49f455640 1 --2- 172.21.15.73:0/2304695147 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc49815e8b0 0x7fc4980d2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:07.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.758+0000 7fc49f455640 1 --2- 172.21.15.73:0/2304695147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc49815e4d0 0x7fc49806c740 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:07.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.758+0000 7fc49f455640 1 -- 172.21.15.73:0/2304695147 >> 172.21.15.73:0/2304695147 conn(0x7fc49808bfc0 msgr2=0x7fc4980d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:07.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.758+0000 7fc49f455640 1 -- 172.21.15.73:0/2304695147 shutdown_connections 2024-03-29T04:09:07.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.758+0000 7fc49f455640 1 -- 172.21.15.73:0/2304695147 wait complete. 2024-03-29T04:09:07.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.759+0000 7fc49f455640 1 Processor -- start 2024-03-29T04:09:07.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.759+0000 7fc49f455640 1 -- start start 2024-03-29T04:09:07.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.760+0000 7fc49f455640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4980d0e70 0x7fc4980ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:07.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.760+0000 7fc49f455640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc49815e4d0 0x7fc4981590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:07.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.760+0000 7fc49f455640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc49815e8b0 0x7fc4980ca550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:07.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.760+0000 7fc49f455640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc4980d2890 con 0x7fc49815e4d0 2024-03-29T04:09:07.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.760+0000 7fc49f455640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc4980cf2d0 con 0x7fc49815e8b0 2024-03-29T04:09:07.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.760+0000 7fc49f455640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc4980cc870 con 0x7fc4980d0e70 2024-03-29T04:09:07.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.760+0000 7fc49c9f0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc49815e4d0 0x7fc4981590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:07.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.760+0000 7fc49c9f0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc49815e4d0 0x7fc4981590d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53916/0 (socket says 172.21.15.73:53916) 2024-03-29T04:09:07.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.760+0000 7fc49c9f0640 1 -- 172.21.15.73:0/1714993173 learned_addr learned my addr 172.21.15.73:0/1714993173 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:07.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.760+0000 7fc49d9f2640 1 --2- 172.21.15.73:0/1714993173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc49815e8b0 0x7fc4980ca550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:07.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.760+0000 7fc49d1f1640 1 --2- 172.21.15.73:0/1714993173 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4980d0e70 0x7fc4980ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:07.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.760+0000 7fc49c9f0640 1 -- 172.21.15.73:0/1714993173 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4980d0e70 msgr2=0x7fc4980ce1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:07.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.760+0000 7fc49c9f0640 1 --2- 172.21.15.73:0/1714993173 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4980d0e70 0x7fc4980ce1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:07.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.760+0000 7fc49c9f0640 1 -- 172.21.15.73:0/1714993173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc49815e8b0 msgr2=0x7fc4980ca550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:07.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.760+0000 7fc49c9f0640 1 --2- 172.21.15.73:0/1714993173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc49815e8b0 0x7fc4980ca550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:07.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.760+0000 7fc49c9f0640 1 -- 172.21.15.73:0/1714993173 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4980c9710 con 0x7fc49815e4d0 2024-03-29T04:09:07.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.761+0000 7fc49c9f0640 1 --2- 172.21.15.73:0/1714993173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc49815e4d0 0x7fc4981590d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc48800e9e0 tx=0x7fc48800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:07.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.761+0000 7fc48dffb640 1 -- 172.21.15.73:0/1714993173 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc488005990 con 0x7fc49815e4d0 2024-03-29T04:09:07.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.761+0000 7fc49f455640 1 -- 172.21.15.73:0/1714993173 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4980c9430 con 0x7fc49815e4d0 2024-03-29T04:09:07.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.761+0000 7fc48dffb640 1 -- 172.21.15.73:0/1714993173 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc488005b30 con 0x7fc49815e4d0 2024-03-29T04:09:07.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.761+0000 7fc48dffb640 1 -- 172.21.15.73:0/1714993173 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc488020060 con 0x7fc49815e4d0 2024-03-29T04:09:07.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.761+0000 7fc49f455640 1 -- 172.21.15.73:0/1714993173 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4980cc500 con 0x7fc49815e4d0 2024-03-29T04:09:07.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.762+0000 7fc48dffb640 1 -- 172.21.15.73:0/1714993173 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc48800c9d0 con 0x7fc49815e4d0 2024-03-29T04:09:07.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.762+0000 7fc49f455640 1 -- 172.21.15.73:0/1714993173 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4980a2500 con 0x7fc49815e4d0 2024-03-29T04:09:07.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.762+0000 7fc48dffb640 1 --2- 172.21.15.73:0/1714993173 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fc47c06c530 0x7fc47c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:07.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.763+0000 7fc48dffb640 1 -- 172.21.15.73:0/1714993173 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fc48808bcd0 con 0x7fc49815e4d0 2024-03-29T04:09:07.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.763+0000 7fc49d1f1640 1 --2- 172.21.15.73:0/1714993173 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fc47c06c530 0x7fc47c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:07.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.763+0000 7fc49d1f1640 1 --2- 172.21.15.73:0/1714993173 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fc47c06c530 0x7fc47c06e9f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc494036000 tx=0x7fc49403d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:07.757 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:07.769+0000 7fc48dffb640 1 -- 172.21.15.73:0/1714993173 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fc488017020 con 0x7fc49815e4d0 2024-03-29T04:09:08.020 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.041+0000 7fc49f455640 1 -- 172.21.15.73:0/1714993173 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fc4980ca330 con 0x7fc49815e4d0 2024-03-29T04:09:08.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.043+0000 7fc48dffb640 1 -- 172.21.15.73:0/1714993173 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7fc488059c20 con 0x7fc49815e4d0 2024-03-29T04:09:08.023 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2024-03-29T04:09:08.023 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQBsPgZm/zLXOBAAAojJQ+pg3lyn0+VyZVyLKw== 2024-03-29T04:09:08.023 INFO:teuthology.orchestra.run.smithi073.stdout: caps mds = "allow" 2024-03-29T04:09:08.023 INFO:teuthology.orchestra.run.smithi073.stdout: caps mon = "allow r" 2024-03-29T04:09:08.023 INFO:teuthology.orchestra.run.smithi073.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-03-29T04:09:08.023 INFO:teuthology.orchestra.run.smithi073.stderr:updated caps for client.0 2024-03-29T04:09:08.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.045+0000 7fc49f455640 1 -- 172.21.15.73:0/1714993173 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fc47c06c530 msgr2=0x7fc47c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:08.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.045+0000 7fc49f455640 1 --2- 172.21.15.73:0/1714993173 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fc47c06c530 0x7fc47c06e9f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc494036000 tx=0x7fc49403d040 comp rx=0 tx=0).stop 2024-03-29T04:09:08.025 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.045+0000 7fc49f455640 1 -- 172.21.15.73:0/1714993173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc49815e4d0 msgr2=0x7fc4981590d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:08.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.045+0000 7fc49f455640 1 --2- 172.21.15.73:0/1714993173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc49815e4d0 0x7fc4981590d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc48800e9e0 tx=0x7fc48800eea0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.045+0000 7fc49f455640 1 -- 172.21.15.73:0/1714993173 shutdown_connections 2024-03-29T04:09:08.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.045+0000 7fc49f455640 1 --2- 172.21.15.73:0/1714993173 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fc47c06c530 0x7fc47c06e9f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.045+0000 7fc49f455640 1 --2- 172.21.15.73:0/1714993173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc49815e8b0 0x7fc4980ca550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.045+0000 7fc49f455640 1 --2- 172.21.15.73:0/1714993173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc49815e4d0 0x7fc4981590d0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.026 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.045+0000 7fc49f455640 1 --2- 172.21.15.73:0/1714993173 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4980d0e70 0x7fc4980ce1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.045+0000 7fc49f455640 1 -- 172.21.15.73:0/1714993173 >> 172.21.15.73:0/1714993173 conn(0x7fc49808bfc0 msgr2=0x7fc49815f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:08.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.045+0000 7fc49f455640 1 -- 172.21.15.73:0/1714993173 shutdown_connections 2024-03-29T04:09:08.027 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.045+0000 7fc49f455640 1 -- 172.21.15.73:0/1714993173 wait complete. 2024-03-29T04:09:08.036 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-29T04:09:08.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.157+0000 7f38752f1640 1 Processor -- start 2024-03-29T04:09:08.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.157+0000 7f38752f1640 1 -- start start 2024-03-29T04:09:08.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.158+0000 7f38752f1640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f38700b3c50 0x7f38700d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:08.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.158+0000 7f38752f1640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f38700d3140 0x7f387006cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:08.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.158+0000 7f38752f1640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38700cfb30 con 0x7f387015e930 2024-03-29T04:09:08.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.158+0000 7f38752f1640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f38700d3590 con 0x7f38700b3c50 2024-03-29T04:09:08.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.158+0000 7f38752f1640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f387006c780 con 0x7f38700d3140 2024-03-29T04:09:08.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.158+0000 7f386e7fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f38700b3c50 0x7f38700d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:08.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.158+0000 7f386e7fc640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f38700b3c50 0x7f38700d2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53932/0 (socket says 172.21.15.73:53932) 2024-03-29T04:09:08.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.158+0000 7f386e7fc640 1 -- 172.21.15.73:0/3414679102 learned_addr learned my addr 172.21.15.73:0/3414679102 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:08.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.158+0000 7f386effd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f387015e930 0x7f38700cf130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:48090/0 (socket says 172.21.15.73:48090) 2024-03-29T04:09:08.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.158+0000 7f386f7fe640 1 --2- 172.21.15.73:0/3414679102 >> v2:172.21.15.142:3300/0 conn(0x7f38700d3140 0x7f387006cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:08.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.158+0000 7f386dffb640 1 -- 172.21.15.73:0/3414679102 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3618211122 0 0) 0x7f38700cfb30 con 0x7f387015e930 2024-03-29T04:09:08.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.158+0000 7f386dffb640 1 -- 172.21.15.73:0/3414679102 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3858003520 con 0x7f387015e930 2024-03-29T04:09:08.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.159+0000 7f386e7fc640 1 -- 172.21.15.73:0/3414679102 >> v2:172.21.15.142:3300/0 conn(0x7f38700d3140 msgr2=0x7f387006cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:08.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.159+0000 7f386e7fc640 1 --2- 172.21.15.73:0/3414679102 >> v2:172.21.15.142:3300/0 conn(0x7f38700d3140 0x7f387006cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.159+0000 7f386e7fc640 1 -- 172.21.15.73:0/3414679102 >> v1:172.21.15.73:6789/0 conn(0x7f387015e930 legacy=0x7f38700cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:08.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.159+0000 7f386e7fc640 1 -- 172.21.15.73:0/3414679102 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38700cfe10 con 0x7f38700b3c50 2024-03-29T04:09:08.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.159+0000 7f386e7fc640 1 --2- 172.21.15.73:0/3414679102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38700b3c50 0x7f38700d2c00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f387008cc70 tx=0x7f386002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a71d09cc2a6af1a server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:08.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.159+0000 7f386dffb640 1 -- 172.21.15.73:0/3414679102 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3860035020 con 0x7f38700b3c50 2024-03-29T04:09:08.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.159+0000 7f386dffb640 1 -- 172.21.15.73:0/3414679102 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3860031870 con 0x7f38700b3c50 2024-03-29T04:09:08.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.159+0000 7f386dffb640 1 -- 172.21.15.73:0/3414679102 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3860031c40 con 0x7f38700b3c50 2024-03-29T04:09:08.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.160+0000 7f38752f1640 1 -- 172.21.15.73:0/3414679102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38700b3c50 msgr2=0x7f38700d2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:08.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.160+0000 7f38752f1640 1 --2- 172.21.15.73:0/3414679102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38700b3c50 0x7f38700d2c00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f387008cc70 tx=0x7f386002b910 comp rx=0 tx=0).stop 2024-03-29T04:09:08.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.160+0000 7f38752f1640 1 -- 172.21.15.73:0/3414679102 shutdown_connections 2024-03-29T04:09:08.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.160+0000 7f38752f1640 1 --2- 172.21.15.73:0/3414679102 >> v2:172.21.15.142:3300/0 conn(0x7f38700d3140 0x7f387006cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.160+0000 7f38752f1640 1 --2- 172.21.15.73:0/3414679102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38700b3c50 0x7f38700d2c00 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.160+0000 7f38752f1640 1 -- 172.21.15.73:0/3414679102 >> 172.21.15.73:0/3414679102 conn(0x7f387008bfc0 msgr2=0x7f38700d4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:08.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.160+0000 7f38752f1640 1 -- 172.21.15.73:0/3414679102 shutdown_connections 2024-03-29T04:09:08.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.160+0000 7f38752f1640 1 -- 172.21.15.73:0/3414679102 wait complete. 2024-03-29T04:09:08.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.162+0000 7f38752f1640 1 Processor -- start 2024-03-29T04:09:08.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.162+0000 7f38752f1640 1 -- start start 2024-03-29T04:09:08.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.163+0000 7f38752f1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38700b3c50 0x7f38701461f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:08.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.163+0000 7f38752f1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38700d3140 0x7f38701619d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:08.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.163+0000 7f38752f1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f387015e930 0x7f38700ca050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:08.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.163+0000 7f38752f1640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f38700cf840 con 0x7f38700b3c50 2024-03-29T04:09:08.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.163+0000 7f38752f1640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f38700d03d0 con 0x7f387015e930 2024-03-29T04:09:08.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.163+0000 7f38752f1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f387015ed10 con 0x7f38700d3140 2024-03-29T04:09:08.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.163+0000 7f386effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38700b3c50 0x7f38701461f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:08.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.163+0000 7f386effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38700b3c50 0x7f38701461f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53944/0 (socket says 172.21.15.73:53944) 2024-03-29T04:09:08.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.163+0000 7f386effd640 1 -- 172.21.15.73:0/1292205257 learned_addr learned my addr 172.21.15.73:0/1292205257 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:08.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.164+0000 7f386e7fc640 1 --2- 172.21.15.73:0/1292205257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38700d3140 0x7f38701619d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:08.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.164+0000 7f386effd640 1 -- 172.21.15.73:0/1292205257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38700d3140 msgr2=0x7f38701619d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:08.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.164+0000 7f386f7fe640 1 --2- 172.21.15.73:0/1292205257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f387015e930 0x7f38700ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:08.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.164+0000 7f386effd640 1 --2- 172.21.15.73:0/1292205257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38700d3140 0x7f38701619d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.164+0000 7f386effd640 1 -- 172.21.15.73:0/1292205257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f387015e930 msgr2=0x7f38700ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:08.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.164+0000 7f386effd640 1 --2- 172.21.15.73:0/1292205257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f387015e930 0x7f38700ca050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.164+0000 7f386effd640 1 -- 172.21.15.73:0/1292205257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3870161f10 con 0x7f38700b3c50 2024-03-29T04:09:08.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.164+0000 7f386e7fc640 1 --2- 172.21.15.73:0/1292205257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38700d3140 0x7f38701619d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:09:08.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.164+0000 7f386effd640 1 --2- 172.21.15.73:0/1292205257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38700b3c50 0x7f38701461f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f386400c460 tx=0x7f386400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:08.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.164+0000 7f38577fe640 1 -- 172.21.15.73:0/1292205257 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3864018070 con 0x7f38700b3c50 2024-03-29T04:09:08.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.164+0000 7f38577fe640 1 -- 172.21.15.73:0/1292205257 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38640074a0 con 0x7f38700b3c50 2024-03-29T04:09:08.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.164+0000 7f38577fe640 1 -- 172.21.15.73:0/1292205257 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3864004a20 con 0x7f38700b3c50 2024-03-29T04:09:08.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.164+0000 7f38752f1640 1 -- 172.21.15.73:0/1292205257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3870158b20 con 0x7f38700b3c50 2024-03-29T04:09:08.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.164+0000 7f38752f1640 1 -- 172.21.15.73:0/1292205257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38701590e0 con 0x7f38700b3c50 2024-03-29T04:09:08.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.165+0000 7f38752f1640 1 -- 172.21.15.73:0/1292205257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3870068640 con 0x7f38700b3c50 2024-03-29T04:09:08.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.165+0000 7f38577fe640 1 -- 172.21.15.73:0/1292205257 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f386401b070 con 0x7f38700b3c50 2024-03-29T04:09:08.147 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.166+0000 7f38577fe640 1 --2- 172.21.15.73:0/1292205257 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f385c06c530 0x7f385c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:08.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.166+0000 7f386e7fc640 1 --2- 172.21.15.73:0/1292205257 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f385c06c530 0x7f385c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:08.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.166+0000 7f38577fe640 1 -- 172.21.15.73:0/1292205257 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f386408a880 con 0x7f38700b3c50 2024-03-29T04:09:08.148 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.166+0000 7f386e7fc640 1 --2- 172.21.15.73:0/1292205257 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f385c06c530 0x7f385c06e9f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3860036000 tx=0x7f3860008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:08.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.170+0000 7f38577fe640 1 -- 172.21.15.73:0/1292205257 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f3864007650 con 0x7f38700b3c50 2024-03-29T04:09:08.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.389+0000 7f38752f1640 1 -- 172.21.15.73:0/1292205257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f38700d17b0 con 0x7f38700b3c50 2024-03-29T04:09:08.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.390+0000 7f38577fe640 1 -- 172.21.15.73:0/1292205257 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5181 (secure 0 0 0) 0x7f3864058ff0 con 0x7f38700b3c50 2024-03-29T04:09:08.370 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:09:08.370 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4739,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1125143848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1125143848},{"type":"v1","addr":"172.21.15.73:6837","nonce":1125143848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4742,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2988261972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2988261972},{"type":"v1","addr":"172.21.15.142:6835","nonce":2988261972}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5029,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/510984531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":510984531},{"type":"v1","addr":"172.21.15.142:6834","nonce":510984531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-29T04:08:59.079178+0000","modified":"2024-03-29T04:09:01.095589+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5055},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5055":{"gid":5055,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6836/936189393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":936189393},{"type":"v1","addr":"172.21.15.73:6836","nonce":936189393}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5055,"qdb_cluster":[5055]},"id":2}]} 2024-03-29T04:09:08.370 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 13 2024-03-29T04:09:08.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.391+0000 7f38752f1640 1 -- 172.21.15.73:0/1292205257 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f385c06c530 msgr2=0x7f385c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:08.371 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.391+0000 7f38752f1640 1 --2- 172.21.15.73:0/1292205257 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f385c06c530 0x7f385c06e9f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3860036000 tx=0x7f3860008030 comp rx=0 tx=0).stop 2024-03-29T04:09:08.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.391+0000 7f38752f1640 1 -- 172.21.15.73:0/1292205257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38700b3c50 msgr2=0x7f38701461f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:08.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.391+0000 7f38752f1640 1 --2- 172.21.15.73:0/1292205257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38700b3c50 0x7f38701461f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f386400c460 tx=0x7f386400c920 comp rx=0 tx=0).stop 2024-03-29T04:09:08.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.392+0000 7f38752f1640 1 -- 172.21.15.73:0/1292205257 shutdown_connections 2024-03-29T04:09:08.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.392+0000 7f38752f1640 1 --2- 172.21.15.73:0/1292205257 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f385c06c530 0x7f385c06e9f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.392+0000 7f38752f1640 1 --2- 172.21.15.73:0/1292205257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f387015e930 0x7f38700ca050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.392+0000 7f38752f1640 1 --2- 172.21.15.73:0/1292205257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f38700d3140 0x7f38701619d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.392+0000 7f38752f1640 1 --2- 172.21.15.73:0/1292205257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38700b3c50 0x7f38701461f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.392+0000 7f38752f1640 1 -- 172.21.15.73:0/1292205257 >> 172.21.15.73:0/1292205257 conn(0x7f387008bfc0 msgr2=0x7f38700caad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:08.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.392+0000 7f38752f1640 1 -- 172.21.15.73:0/1292205257 shutdown_connections 2024-03-29T04:09:08.372 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.392+0000 7f38752f1640 1 -- 172.21.15.73:0/1292205257 wait complete. 2024-03-29T04:09:08.785 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-29T04:08:59.079178+0000', 'modified': '2024-03-29T04:09:01.095589+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5055}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5055': {'gid': 5055, 'name': 'a', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.73:6836/936189393', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6834', 'nonce': 936189393}, {'type': 'v1', 'addr': '172.21.15.73:6836', 'nonce': 936189393}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5055, 'qdb_cluster': [5055]} 2024-03-29T04:09:08.785 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-29T04:09:08.785 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-03-29T04:09:08.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.909+0000 7f0ea28d3640 1 Processor -- start 2024-03-29T04:09:08.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.909+0000 7f0ea28d3640 1 -- start start 2024-03-29T04:09:08.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.909+0000 7f0ea28d3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0e9c15e6b0 0x7f0e9c0d2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:08.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.909+0000 7f0ea28d3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e9c0d26d0 0x7f0e9c0d2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:08.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.909+0000 7f0ea28d3640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e9c0cf310 con 0x7f0e9c0d30e0 2024-03-29T04:09:08.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.909+0000 7f0ea28d3640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f0e9c06e640 con 0x7f0e9c15e6b0 2024-03-29T04:09:08.889 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.909+0000 7f0ea28d3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f0e9c0d4f70 con 0x7f0e9c0d26d0 2024-03-29T04:09:08.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.910+0000 7f0e9b7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e9c0d26d0 0x7f0e9c0d2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:08.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.910+0000 7f0e9bfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0e9c15e6b0 0x7f0e9c0d2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:08.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.910+0000 7f0e9bfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0e9c15e6b0 0x7f0e9c0d2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:56562/0 (socket says 172.21.15.73:56562) 2024-03-29T04:09:08.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.910+0000 7f0e9b7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e9c0d26d0 0x7f0e9c0d2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:37682/0 (socket says 172.21.15.73:37682) 2024-03-29T04:09:08.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.910+0000 7f0ea0e70640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f0e9c0d30e0 0x7f0e9c162330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.73:36106/0 (socket says 172.21.15.73:36106) 2024-03-29T04:09:08.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.910+0000 7f0e9bfff640 1 -- 172.21.15.73:0/1352704122 learned_addr learned my addr 172.21.15.73:0/1352704122 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:08.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.910+0000 7f0e9bfff640 1 -- 172.21.15.73:0/1352704122 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e9c0d26d0 msgr2=0x7f0e9c0d2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:08.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.910+0000 7f0e9bfff640 1 --2- 172.21.15.73:0/1352704122 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e9c0d26d0 0x7f0e9c0d2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.910+0000 7f0e9bfff640 1 -- 172.21.15.73:0/1352704122 >> v1:172.21.15.142:6789/0 conn(0x7f0e9c0d30e0 legacy=0x7f0e9c162330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:08.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.910+0000 7f0e9bfff640 1 -- 172.21.15.73:0/1352704122 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e9c0cf5b0 con 0x7f0e9c15e6b0 2024-03-29T04:09:08.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.910+0000 7f0e9b7fe640 1 --2- 172.21.15.73:0/1352704122 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e9c0d26d0 0x7f0e9c0d2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:09:08.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.911+0000 7f0e9bfff640 1 --2- 172.21.15.73:0/1352704122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e9c15e6b0 0x7f0e9c0d2190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c009870 tx=0x7f0e8c02b7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ee34b45fd39580a server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:08.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.911+0000 7f0e9affd640 1 -- 172.21.15.73:0/1352704122 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c037070 con 0x7f0e9c15e6b0 2024-03-29T04:09:08.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.911+0000 7f0e9affd640 1 -- 172.21.15.73:0/1352704122 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e8c004230 con 0x7f0e9c15e6b0 2024-03-29T04:09:08.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.911+0000 7f0e9affd640 1 -- 172.21.15.73:0/1352704122 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c003610 con 0x7f0e9c15e6b0 2024-03-29T04:09:08.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.912+0000 7f0ea28d3640 1 -- 172.21.15.73:0/1352704122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e9c15e6b0 msgr2=0x7f0e9c0d2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:08.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.912+0000 7f0ea28d3640 1 --2- 172.21.15.73:0/1352704122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e9c15e6b0 0x7f0e9c0d2190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c009870 tx=0x7f0e8c02b7e0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.912+0000 7f0ea28d3640 1 -- 172.21.15.73:0/1352704122 shutdown_connections 2024-03-29T04:09:08.892 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.912+0000 7f0ea28d3640 1 --2- 172.21.15.73:0/1352704122 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e9c0d26d0 0x7f0e9c0d2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.912+0000 7f0ea28d3640 1 --2- 172.21.15.73:0/1352704122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e9c15e6b0 0x7f0e9c0d2190 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.912+0000 7f0ea28d3640 1 -- 172.21.15.73:0/1352704122 >> 172.21.15.73:0/1352704122 conn(0x7f0e9c08bfc0 msgr2=0x7f0e9c0d45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:08.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.912+0000 7f0ea28d3640 1 -- 172.21.15.73:0/1352704122 shutdown_connections 2024-03-29T04:09:08.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.912+0000 7f0ea28d3640 1 -- 172.21.15.73:0/1352704122 wait complete. 2024-03-29T04:09:08.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.913+0000 7f0ea28d3640 1 Processor -- start 2024-03-29T04:09:08.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.913+0000 7f0ea28d3640 1 -- start start 2024-03-29T04:09:08.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.914+0000 7f0ea28d3640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e9c0d26d0 0x7f0e9c15d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:08.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.914+0000 7f0ea28d3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e9c0d30e0 0x7f0e9c0ce010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:08.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.914+0000 7f0ea28d3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e9c15e6b0 0x7f0e9c1f4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:08.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.914+0000 7f0ea28d3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9c0cfe50 con 0x7f0e9c15e6b0 2024-03-29T04:09:08.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.914+0000 7f0ea28d3640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9c0cfb70 con 0x7f0e9c0d30e0 2024-03-29T04:09:08.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.914+0000 7f0ea28d3640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f0e9c0d0130 con 0x7f0e9c0d26d0 2024-03-29T04:09:08.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.914+0000 7f0ea0e70640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e9c15e6b0 0x7f0e9c1f4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:08.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.914+0000 7f0ea0e70640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e9c15e6b0 0x7f0e9c1f4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53958/0 (socket says 172.21.15.73:53958) 2024-03-29T04:09:08.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.914+0000 7f0ea0e70640 1 -- 172.21.15.73:0/3064778915 learned_addr learned my addr 172.21.15.73:0/3064778915 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:08.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.914+0000 7f0e9b7fe640 1 --2- 172.21.15.73:0/3064778915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e9c0d30e0 0x7f0e9c0ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:08.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.914+0000 7f0e9bfff640 1 --2- 172.21.15.73:0/3064778915 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e9c0d26d0 0x7f0e9c15d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:08.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.914+0000 7f0ea0e70640 1 -- 172.21.15.73:0/3064778915 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e9c0d26d0 msgr2=0x7f0e9c15d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:08.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.914+0000 7f0ea0e70640 1 --2- 172.21.15.73:0/3064778915 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e9c0d26d0 0x7f0e9c15d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.914+0000 7f0ea0e70640 1 -- 172.21.15.73:0/3064778915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e9c0d30e0 msgr2=0x7f0e9c0ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:08.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.914+0000 7f0ea0e70640 1 --2- 172.21.15.73:0/3064778915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e9c0d30e0 0x7f0e9c0ce010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.914+0000 7f0ea0e70640 1 -- 172.21.15.73:0/3064778915 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e9c0cc8c0 con 0x7f0e9c15e6b0 2024-03-29T04:09:08.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.914+0000 7f0ea0e70640 1 --2- 172.21.15.73:0/3064778915 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e9c15e6b0 0x7f0e9c1f4c60 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0e9400caf0 tx=0x7f0e940020f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:08.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.914+0000 7f0e98ff9640 1 -- 172.21.15.73:0/3064778915 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e94018070 con 0x7f0e9c15e6b0 2024-03-29T04:09:08.896 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.915+0000 7f0e98ff9640 1 -- 172.21.15.73:0/3064778915 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e9400a760 con 0x7f0e9c15e6b0 2024-03-29T04:09:08.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.915+0000 7f0ea28d3640 1 -- 172.21.15.73:0/3064778915 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e9c0ccba0 con 0x7f0e9c15e6b0 2024-03-29T04:09:08.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.915+0000 7f0e98ff9640 1 -- 172.21.15.73:0/3064778915 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e9400ab90 con 0x7f0e9c15e6b0 2024-03-29T04:09:08.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.915+0000 7f0ea28d3640 1 -- 172.21.15.73:0/3064778915 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e9c0cd160 con 0x7f0e9c15e6b0 2024-03-29T04:09:08.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.916+0000 7f0e98ff9640 1 -- 172.21.15.73:0/3064778915 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f0e9401b070 con 0x7f0e9c15e6b0 2024-03-29T04:09:08.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.916+0000 7f0e98ff9640 1 --2- 172.21.15.73:0/3064778915 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f0e8806c530 0x7f0e8806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:08.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.917+0000 7f0e98ff9640 1 -- 172.21.15.73:0/3064778915 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f0e9408ae70 con 0x7f0e9c15e6b0 2024-03-29T04:09:08.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.917+0000 7f0e9bfff640 1 --2- 172.21.15.73:0/3064778915 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f0e8806c530 0x7f0e8806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:08.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.917+0000 7f0e9bfff640 1 --2- 172.21.15.73:0/3064778915 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f0e8806c530 0x7f0e8806e9f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c034000 tx=0x7f0e8c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:08.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.918+0000 7f0ea5597740 1 Processor -- start 2024-03-29T04:09:08.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.918+0000 7f0ea5597740 1 -- start start 2024-03-29T04:09:08.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.918+0000 7f0ea5597740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5625e0d73860 0x5625e0d46800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:08.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.918+0000 7f0ea5597740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5625e0d73c40 0x5625e0d765f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:08.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.918+0000 7f0ea5597740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5625e0d46d40 0x5625e0d76b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:08.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.919+0000 7f0ea5597740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5625e0cb0020 con 0x5625e0d73c40 2024-03-29T04:09:08.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.919+0000 7f0ea5597740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5625e0c585f0 con 0x5625e0d73860 2024-03-29T04:09:08.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.919+0000 7f0ea5597740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x5625e0cabfd0 con 0x5625e0d46d40 2024-03-29T04:09:08.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.919+0000 7f0e9b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5625e0d73c40 0x5625e0d765f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:08.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.919+0000 7f0e9b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5625e0d73c40 0x5625e0d765f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53970/0 (socket says 172.21.15.73:53970) 2024-03-29T04:09:08.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.919+0000 7f0e9b7fe640 1 -- 172.21.15.73:0/1227542678 learned_addr learned my addr 172.21.15.73:0/1227542678 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:08.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.919+0000 7f0ea0e70640 1 --2- 172.21.15.73:0/1227542678 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5625e0d46d40 0x5625e0d76b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:08.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.919+0000 7f0e9bfff640 1 --2- 172.21.15.73:0/1227542678 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5625e0d73860 0x5625e0d46800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:08.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.919+0000 7f0e9b7fe640 1 -- 172.21.15.73:0/1227542678 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5625e0d46d40 msgr2=0x5625e0d76b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:08.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.919+0000 7f0e9b7fe640 1 --2- 172.21.15.73:0/1227542678 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5625e0d46d40 0x5625e0d76b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.919+0000 7f0e9b7fe640 1 -- 172.21.15.73:0/1227542678 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5625e0d73860 msgr2=0x5625e0d46800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:08.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.919+0000 7f0e9b7fe640 1 --2- 172.21.15.73:0/1227542678 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5625e0d73860 0x5625e0d46800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.919+0000 7f0e9b7fe640 1 -- 172.21.15.73:0/1227542678 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625e09c42d0 con 0x5625e0d73c40 2024-03-29T04:09:08.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.919+0000 7f0e9bfff640 1 --2- 172.21.15.73:0/1227542678 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5625e0d73860 0x5625e0d46800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:09:08.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.919+0000 7f0e9b7fe640 1 --2- 172.21.15.73:0/1227542678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5625e0d73c40 0x5625e0d765f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0e90009c10 tx=0x7f0e90011690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9790c52fe4c2f6e3 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:08.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.919+0000 7f0e81ffb640 1 -- 172.21.15.73:0/1227542678 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e90019070 con 0x5625e0d73c40 2024-03-29T04:09:08.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.919+0000 7f0e81ffb640 1 -- 172.21.15.73:0/1227542678 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e90009d00 con 0x5625e0d73c40 2024-03-29T04:09:08.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.919+0000 7f0e81ffb640 1 -- 172.21.15.73:0/1227542678 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e90004250 con 0x5625e0d73c40 2024-03-29T04:09:08.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.920+0000 7f0ea5597740 1 -- 172.21.15.73:0/1227542678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5625e0d73c40 msgr2=0x5625e0d765f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:08.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.920+0000 7f0ea5597740 1 --2- 172.21.15.73:0/1227542678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5625e0d73c40 0x5625e0d765f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0e90009c10 tx=0x7f0e90011690 comp rx=0 tx=0).stop 2024-03-29T04:09:08.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.920+0000 7f0ea5597740 1 -- 172.21.15.73:0/1227542678 shutdown_connections 2024-03-29T04:09:08.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.920+0000 7f0ea5597740 1 --2- 172.21.15.73:0/1227542678 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5625e0d46d40 0x5625e0d76b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.920+0000 7f0ea5597740 1 --2- 172.21.15.73:0/1227542678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5625e0d73c40 0x5625e0d765f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.920+0000 7f0ea5597740 1 --2- 172.21.15.73:0/1227542678 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5625e0d73860 0x5625e0d46800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.920+0000 7f0ea5597740 1 -- 172.21.15.73:0/1227542678 >> 172.21.15.73:0/1227542678 conn(0x5625e0d48a70 msgr2=0x5625e0d915f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:08.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.920+0000 7f0ea5597740 1 -- 172.21.15.73:0/1227542678 shutdown_connections 2024-03-29T04:09:08.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.920+0000 7f0ea5597740 1 -- 172.21.15.73:0/1227542678 wait complete. 2024-03-29T04:09:08.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.920+0000 7f0ea5597740 1 -- start start 2024-03-29T04:09:08.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.921+0000 7f0ea5597740 1 Processor -- start 2024-03-29T04:09:08.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.921+0000 7f0ea5597740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5625e0d73860 0x5625e0d74fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:08.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.921+0000 7f0ea5597740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5625e0d73c40 0x5625e0d76640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:08.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.921+0000 7f0ea5597740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5625e0da27d0 0x5625e0d6bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:08.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.921+0000 7f0ea5597740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5625e0d4b110 con 0x5625e0da27d0 2024-03-29T04:09:08.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.922+0000 7f0ea5597740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5625e0c6b9c0 con 0x5625e0d73c40 2024-03-29T04:09:08.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.922+0000 7f0ea5597740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x5625e0d4d950 con 0x5625e0d73860 2024-03-29T04:09:08.907 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.922+0000 7f0ea5597740 10 client.0 _ll_register_callbacks cb 0x5625e0c4ffc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-29T04:09:08.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.922+0000 7f0ea0e70640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5625e0da27d0 0x5625e0d6bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:08.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.922+0000 7f0ea0e70640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5625e0da27d0 0x5625e0d6bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53982/0 (socket says 172.21.15.73:53982) 2024-03-29T04:09:08.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.922+0000 7f0ea0e70640 1 -- 172.21.15.73:0/444815340 learned_addr learned my addr 172.21.15.73:0/444815340 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:08.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.922+0000 7f0e9bfff640 1 --2- 172.21.15.73:0/444815340 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5625e0d73860 0x5625e0d74fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:08.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.922+0000 7f0e9b7fe640 1 --2- 172.21.15.73:0/444815340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5625e0d73c40 0x5625e0d76640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:08.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.922+0000 7f0ea0e70640 1 -- 172.21.15.73:0/444815340 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5625e0d73860 msgr2=0x5625e0d74fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:08.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.922+0000 7f0ea0e70640 1 --2- 172.21.15.73:0/444815340 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5625e0d73860 0x5625e0d74fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.922+0000 7f0ea0e70640 1 -- 172.21.15.73:0/444815340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5625e0d73c40 msgr2=0x5625e0d76640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:08.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.922+0000 7f0ea0e70640 1 --2- 172.21.15.73:0/444815340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5625e0d73c40 0x5625e0d76640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.922+0000 7f0ea0e70640 1 -- 172.21.15.73:0/444815340 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625e0a8e6b0 con 0x5625e0da27d0 2024-03-29T04:09:08.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.922+0000 7f0e9b7fe640 1 --2- 172.21.15.73:0/444815340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5625e0d73c40 0x5625e0d76640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:09:08.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.922+0000 7f0ea0e70640 1 --2- 172.21.15.73:0/444815340 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5625e0da27d0 0x5625e0d6bb70 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0e9400cac0 tx=0x7f0e94058f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce00c829f2aabdf0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:08.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.922+0000 7f0e7affd640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-03-29T04:09:08.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.922+0000 7f0e7affd640 1 -- 172.21.15.73:0/444815340 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e94071020 con 0x5625e0da27d0 2024-03-29T04:09:08.908 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.922+0000 7f0e7affd640 1 -- 172.21.15.73:0/444815340 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f0e94058490 con 0x5625e0da27d0 2024-03-29T04:09:08.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.922+0000 7f0ea5597740 1 -- 172.21.15.73:0/444815340 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e90009d00 con 0x5625e0da27d0 2024-03-29T04:09:08.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.922+0000 7f0e7affd640 1 -- 172.21.15.73:0/444815340 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f0e940890d0 con 0x5625e0da27d0 2024-03-29T04:09:08.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.922+0000 7f0ea5597740 10 client.5256 fetch_fsmap learned FSMap version 13 2024-03-29T04:09:08.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.922+0000 7f0ea5597740 1 -- 172.21.15.73:0/444815340 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x5625e0d78550 con 0x5625e0da27d0 2024-03-29T04:09:08.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.922+0000 7f0e7affd640 1 -- 172.21.15.73:0/444815340 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e90009d00 con 0x5625e0da27d0 2024-03-29T04:09:08.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.923+0000 7f0e7affd640 1 -- 172.21.15.73:0/444815340 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 13) ==== 3494+0+0 (secure 0 0 0) 0x7f0e9405f350 con 0x5625e0da27d0 2024-03-29T04:09:08.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.923+0000 7f0ea5597740 10 client.5256 fetch_fsmap finished waiting for FSMap version 13 2024-03-29T04:09:08.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.923+0000 7f0ea5597740 10 client.5256 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-29T04:09:08.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.923+0000 7f0ea5597740 20 client.5256 populate_metadata read hostname 'smithi073' 2024-03-29T04:09:08.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.923+0000 7f0ea5597740 1 --2- 172.21.15.73:0/444815340 >> [v2:172.21.15.73:6834/936189393,v1:172.21.15.73:6836/936189393] conn(0x5625e0da31d0 0x5625e0dafb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:08.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.923+0000 7f0ea5597740 4 client.5256 mds_command: new command op to 5055 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-29T04:09:08.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.923+0000 7f0ea5597740 1 -- 172.21.15.73:0/444815340 --> [v2:172.21.15.73:6834/936189393,v1:172.21.15.73:6836/936189393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5625e0c844e0 con 0x5625e0da31d0 2024-03-29T04:09:08.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.923+0000 7f0e9bfff640 1 --2- 172.21.15.73:0/444815340 >> [v2:172.21.15.73:6834/936189393,v1:172.21.15.73:6836/936189393] conn(0x5625e0da31d0 0x5625e0dafb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:08.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.923+0000 7f0e7affd640 10 client.5256 ms_handle_connect on v2:172.21.15.73:6834/936189393 2024-03-29T04:09:08.909 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.923+0000 7f0e9bfff640 1 --2- 172.21.15.73:0/444815340 >> [v2:172.21.15.73:6834/936189393,v1:172.21.15.73:6836/936189393] conn(0x5625e0da31d0 0x5625e0dafb10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=451c5c11fd5120b1 server_cookie=5546945cc453d7f4 in_seq=0 out_seq=0 2024-03-29T04:09:08.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.924+0000 7f0e7affd640 1 -- 172.21.15.73:0/444815340 <== mds.0 v2:172.21.15.73:6834/936189393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x5625e0c844e0 con 0x5625e0da31d0 2024-03-29T04:09:08.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.924+0000 7f0e7affd640 10 client.5256 handle_command_reply: tid=0 2024-03-29T04:09:08.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.924+0000 7f0ea5597740 1 client.5256 shutdown 2024-03-29T04:09:08.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.924+0000 7f0ea5597740 1 -- 172.21.15.73:0/444815340 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5625e0da27d0 msgr2=0x5625e0d6bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:08.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.924+0000 7f0ea5597740 1 --2- 172.21.15.73:0/444815340 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5625e0da27d0 0x5625e0d6bb70 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0e9400cac0 tx=0x7f0e94058f80 comp rx=0 tx=0).stop 2024-03-29T04:09:08.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.924+0000 7f0ea5597740 1 -- 172.21.15.73:0/444815340 shutdown_connections 2024-03-29T04:09:08.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.924+0000 7f0ea5597740 1 --2- 172.21.15.73:0/444815340 >> [v2:172.21.15.73:6834/936189393,v1:172.21.15.73:6836/936189393] conn(0x5625e0da31d0 0x5625e0dafb10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.924+0000 7f0ea5597740 1 --2- 172.21.15.73:0/444815340 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5625e0da27d0 0x5625e0d6bb70 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.924+0000 7f0ea5597740 1 --2- 172.21.15.73:0/444815340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5625e0d73c40 0x5625e0d76640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.924+0000 7f0e7affd640 0 client.5256 ms_handle_reset on v2:172.21.15.73:6834/936189393 2024-03-29T04:09:08.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.924+0000 7f0ea5597740 1 --2- 172.21.15.73:0/444815340 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5625e0d73860 0x5625e0d74fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.924+0000 7f0ea5597740 1 -- 172.21.15.73:0/444815340 >> 172.21.15.73:0/444815340 conn(0x5625e0d46d40 msgr2=0x5625e0d94a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:08.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.924+0000 7f0ea5597740 1 -- 172.21.15.73:0/444815340 shutdown_connections 2024-03-29T04:09:08.910 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.924+0000 7f0ea5597740 1 -- 172.21.15.73:0/444815340 wait complete. 2024-03-29T04:09:08.911 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.924+0000 7f0ea5597740 20 client.5256 trim_cache size 0 max 16384 2024-03-29T04:09:08.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.946+0000 7f0ea5597740 1 Processor -- start 2024-03-29T04:09:08.926 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.946+0000 7f0ea5597740 1 -- start start 2024-03-29T04:09:08.928 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.947+0000 7f0ea5597740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5625e0d73860 0x5625e0d791c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:08.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.947+0000 7f0ea5597740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5625e0d73c40 0x5625e0d8f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:08.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.947+0000 7f0ea5597740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5625e0da27d0 0x5625e0d61360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:08.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.947+0000 7f0ea5597740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9c1ffe40 con 0x5625e0d73860 2024-03-29T04:09:08.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.947+0000 7f0ea5597740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9c1ff1a0 con 0x5625e0da27d0 2024-03-29T04:09:08.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.947+0000 7f0ea5597740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f0e9c1ff7f0 con 0x5625e0d73c40 2024-03-29T04:09:08.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.948+0000 7f0e9bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5625e0d73860 0x5625e0d791c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:08.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.948+0000 7f0e9bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5625e0d73860 0x5625e0d791c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53988/0 (socket says 172.21.15.73:53988) 2024-03-29T04:09:08.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.948+0000 7f0e9bfff640 1 -- 172.21.15.73:0/2548029273 learned_addr learned my addr 172.21.15.73:0/2548029273 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:08.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.948+0000 7f0e9bfff640 1 -- 172.21.15.73:0/2548029273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5625e0d73c40 msgr2=0x5625e0d8f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:08.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.948+0000 7f0e9bfff640 1 --2- 172.21.15.73:0/2548029273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5625e0d73c40 0x5625e0d8f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.948+0000 7f0e9bfff640 1 -- 172.21.15.73:0/2548029273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5625e0da27d0 msgr2=0x5625e0d61360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:08.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.948+0000 7f0e9bfff640 1 --2- 172.21.15.73:0/2548029273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5625e0da27d0 0x5625e0d61360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.948+0000 7f0e9bfff640 1 -- 172.21.15.73:0/2548029273 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625e0d71bc0 con 0x5625e0d73860 2024-03-29T04:09:08.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.948+0000 7f0e9bfff640 1 --2- 172.21.15.73:0/2548029273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5625e0d73860 0x5625e0d791c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c0090b0 tx=0x7f0e8c030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562ec7d4d9c92192 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:08.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.948+0000 7f0e817fa640 1 -- 172.21.15.73:0/2548029273 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c037040 con 0x5625e0d73860 2024-03-29T04:09:08.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.948+0000 7f0e817fa640 1 -- 172.21.15.73:0/2548029273 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e8c050d40 con 0x5625e0d73860 2024-03-29T04:09:08.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.948+0000 7f0e817fa640 1 -- 172.21.15.73:0/2548029273 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c003bc0 con 0x5625e0d73860 2024-03-29T04:09:08.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.949+0000 7f0ea5597740 1 -- 172.21.15.73:0/2548029273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5625e0d73860 msgr2=0x5625e0d791c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:08.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.949+0000 7f0ea5597740 1 --2- 172.21.15.73:0/2548029273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5625e0d73860 0x5625e0d791c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c0090b0 tx=0x7f0e8c030000 comp rx=0 tx=0).stop 2024-03-29T04:09:08.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.949+0000 7f0ea5597740 1 -- 172.21.15.73:0/2548029273 shutdown_connections 2024-03-29T04:09:08.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.949+0000 7f0ea5597740 1 --2- 172.21.15.73:0/2548029273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5625e0da27d0 0x5625e0d61360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.949+0000 7f0ea5597740 1 --2- 172.21.15.73:0/2548029273 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5625e0d73c40 0x5625e0d8f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.949+0000 7f0ea5597740 1 --2- 172.21.15.73:0/2548029273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5625e0d73860 0x5625e0d791c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.949+0000 7f0ea5597740 1 -- 172.21.15.73:0/2548029273 >> 172.21.15.73:0/2548029273 conn(0x5625e0d46d40 msgr2=0x5625e0d76620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:08.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.949+0000 7f0ea5597740 1 -- 172.21.15.73:0/2548029273 shutdown_connections 2024-03-29T04:09:08.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.949+0000 7f0ea5597740 1 -- 172.21.15.73:0/2548029273 wait complete. 2024-03-29T04:09:08.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.950+0000 7f0ea5597740 1 -- start start 2024-03-29T04:09:08.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.950+0000 7f0ea5597740 1 Processor -- start 2024-03-29T04:09:08.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.951+0000 7f0ea5597740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5625e0d73860 0x5625e0e05330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:08.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.951+0000 7f0ea5597740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5625e0d73c40 0x5625e0d65200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:08.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.951+0000 7f0ea5597740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5625e0da27d0 0x5625e0d65740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:08.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.951+0000 7f0ea5597740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5625e0da3050 con 0x5625e0d73c40 2024-03-29T04:09:08.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.951+0000 7f0ea5597740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5625e0d78840 con 0x5625e0d73860 2024-03-29T04:09:08.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.951+0000 7f0ea5597740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x5625e0da3620 con 0x5625e0da27d0 2024-03-29T04:09:08.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.951+0000 7f0ea5597740 10 client.0 _ll_register_callbacks cb 0x7f0e94001630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-29T04:09:08.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.951+0000 7f0e9b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5625e0d73c40 0x5625e0d65200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:08.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.951+0000 7f0e9b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5625e0d73c40 0x5625e0d65200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53990/0 (socket says 172.21.15.73:53990) 2024-03-29T04:09:08.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.951+0000 7f0e9b7fe640 1 -- 172.21.15.73:0/3500482914 learned_addr learned my addr 172.21.15.73:0/3500482914 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:08.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.952+0000 7f0e9b7fe640 1 -- 172.21.15.73:0/3500482914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5625e0da27d0 msgr2=0x5625e0d65740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:08.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.952+0000 7f0e9bfff640 1 --2- 172.21.15.73:0/3500482914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5625e0d73860 0x5625e0e05330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:08.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.952+0000 7f0ea0e70640 1 --2- 172.21.15.73:0/3500482914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5625e0da27d0 0x5625e0d65740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:08.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.952+0000 7f0e9b7fe640 1 --2- 172.21.15.73:0/3500482914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5625e0da27d0 0x5625e0d65740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.952+0000 7f0e9b7fe640 1 -- 172.21.15.73:0/3500482914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5625e0d73860 msgr2=0x5625e0e05330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:08.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.952+0000 7f0e9b7fe640 1 --2- 172.21.15.73:0/3500482914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5625e0d73860 0x5625e0e05330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.952+0000 7f0e9b7fe640 1 -- 172.21.15.73:0/3500482914 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625e0d92e20 con 0x5625e0d73c40 2024-03-29T04:09:08.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.952+0000 7f0e9b7fe640 1 --2- 172.21.15.73:0/3500482914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5625e0d73c40 0x5625e0d65200 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0e90018000 tx=0x7f0e900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d36cb4313da4d42b server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:08.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.952+0000 7f0e7affd640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-03-29T04:09:08.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.952+0000 7f0e7affd640 1 -- 172.21.15.73:0/3500482914 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e9002b060 con 0x5625e0d73c40 2024-03-29T04:09:08.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.952+0000 7f0e7affd640 1 -- 172.21.15.73:0/3500482914 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f0e90003610 con 0x5625e0d73c40 2024-03-29T04:09:08.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.952+0000 7f0ea5597740 1 -- 172.21.15.73:0/3500482914 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e8c050d40 con 0x5625e0d73c40 2024-03-29T04:09:08.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.952+0000 7f0e7affd640 1 -- 172.21.15.73:0/3500482914 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f0e90019040 con 0x5625e0d73c40 2024-03-29T04:09:08.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.952+0000 7f0ea5597740 10 client.5262 fetch_fsmap learned FSMap version 13 2024-03-29T04:09:08.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.952+0000 7f0ea5597740 1 -- 172.21.15.73:0/3500482914 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x5625e0daa090 con 0x5625e0d73c40 2024-03-29T04:09:08.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.952+0000 7f0e7affd640 1 -- 172.21.15.73:0/3500482914 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e8c050d40 con 0x5625e0d73c40 2024-03-29T04:09:08.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.952+0000 7f0e7affd640 1 -- 172.21.15.73:0/3500482914 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 13) ==== 3494+0+0 (secure 0 0 0) 0x7f0e90003810 con 0x5625e0d73c40 2024-03-29T04:09:08.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.952+0000 7f0ea5597740 10 client.5262 fetch_fsmap finished waiting for FSMap version 13 2024-03-29T04:09:08.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.952+0000 7f0ea5597740 10 client.5262 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-29T04:09:08.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.952+0000 7f0ea5597740 20 client.5262 populate_metadata read hostname 'smithi073' 2024-03-29T04:09:08.937 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.952+0000 7f0ea5597740 1 --2- 172.21.15.73:0/3500482914 >> [v2:172.21.15.73:6834/936189393,v1:172.21.15.73:6836/936189393] conn(0x5625e0d6e4d0 0x5625e0d6e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:08.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.952+0000 7f0ea5597740 4 client.5262 mds_command: new command op to 5055 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-29T04:09:08.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.952+0000 7f0ea5597740 1 -- 172.21.15.73:0/3500482914 --> [v2:172.21.15.73:6834/936189393,v1:172.21.15.73:6836/936189393] -- command(tid 0: {"prefix": "status"}) -- 0x5625e0d79c60 con 0x5625e0d6e4d0 2024-03-29T04:09:08.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.953+0000 7f0e9bfff640 1 --2- 172.21.15.73:0/3500482914 >> [v2:172.21.15.73:6834/936189393,v1:172.21.15.73:6836/936189393] conn(0x5625e0d6e4d0 0x5625e0d6e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:08.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.953+0000 7f0e7affd640 10 client.5262 ms_handle_connect on v2:172.21.15.73:6834/936189393 2024-03-29T04:09:08.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.953+0000 7f0e9bfff640 1 --2- 172.21.15.73:0/3500482914 >> [v2:172.21.15.73:6834/936189393,v1:172.21.15.73:6836/936189393] conn(0x5625e0d6e4d0 0x5625e0d6e8b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37bb9a621c3b82cb server_cookie=24dbe5dd2e3131fd in_seq=0 out_seq=0 2024-03-29T04:09:08.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.953+0000 7f0e7affd640 1 -- 172.21.15.73:0/3500482914 <== mds.0 v2:172.21.15.73:6834/936189393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5625e0d79c60 con 0x5625e0d6e4d0 2024-03-29T04:09:08.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.953+0000 7f0e7affd640 10 client.5262 handle_command_reply: tid=0 2024-03-29T04:09:08.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.953+0000 7f0ea5597740 1 client.5262 shutdown 2024-03-29T04:09:08.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.953+0000 7f0ea5597740 1 -- 172.21.15.73:0/3500482914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5625e0d73c40 msgr2=0x5625e0d65200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:08.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.953+0000 7f0ea5597740 1 --2- 172.21.15.73:0/3500482914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5625e0d73c40 0x5625e0d65200 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0e90018000 tx=0x7f0e900046c0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.953+0000 7f0ea5597740 1 -- 172.21.15.73:0/3500482914 shutdown_connections 2024-03-29T04:09:08.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.953+0000 7f0ea5597740 1 --2- 172.21.15.73:0/3500482914 >> [v2:172.21.15.73:6834/936189393,v1:172.21.15.73:6836/936189393] conn(0x5625e0d6e4d0 0x5625e0d6e8b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.953+0000 7f0ea5597740 1 --2- 172.21.15.73:0/3500482914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x5625e0da27d0 0x5625e0d65740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.953+0000 7f0e7affd640 0 client.5262 ms_handle_reset on v2:172.21.15.73:6834/936189393 2024-03-29T04:09:08.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.953+0000 7f0ea5597740 1 --2- 172.21.15.73:0/3500482914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5625e0d73c40 0x5625e0d65200 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.953+0000 7f0ea5597740 1 --2- 172.21.15.73:0/3500482914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5625e0d73860 0x5625e0e05330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.953+0000 7f0ea5597740 1 -- 172.21.15.73:0/3500482914 >> 172.21.15.73:0/3500482914 conn(0x5625e0d46d40 msgr2=0x5625e0d8f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:08.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.953+0000 7f0ea5597740 1 -- 172.21.15.73:0/3500482914 shutdown_connections 2024-03-29T04:09:08.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.953+0000 7f0ea5597740 1 -- 172.21.15.73:0/3500482914 wait complete. 2024-03-29T04:09:08.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.954+0000 7f0ea5597740 20 client.5262 trim_cache size 0 max 16384 2024-03-29T04:09:08.939 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-29T04:09:08.939 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "6bff1617-b138-4517-acca-3ecaae3f2bb3", 2024-03-29T04:09:08.939 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 0, 2024-03-29T04:09:08.939 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 5055, 2024-03-29T04:09:08.940 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2024-03-29T04:09:08.940 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2024-03-29T04:09:08.940 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2024-03-29T04:09:08.940 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 9.2213553620000006, 2024-03-29T04:09:08.940 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 13, 2024-03-29T04:09:08.940 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 32, 2024-03-29T04:09:08.940 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 32, 2024-03-29T04:09:08.940 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 16.101562423000001 2024-03-29T04:09:08.940 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-29T04:09:08.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.954+0000 7f0ea28d3640 1 -- 172.21.15.73:0/3064778915 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f0e8806c530 msgr2=0x7f0e8806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:08.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.954+0000 7f0ea28d3640 1 --2- 172.21.15.73:0/3064778915 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f0e8806c530 0x7f0e8806e9f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c034000 tx=0x7f0e8c008030 comp rx=0 tx=0).stop 2024-03-29T04:09:08.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.954+0000 7f0ea28d3640 1 -- 172.21.15.73:0/3064778915 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e9c15e6b0 msgr2=0x7f0e9c1f4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:08.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.954+0000 7f0ea28d3640 1 --2- 172.21.15.73:0/3064778915 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e9c15e6b0 0x7f0e9c1f4c60 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0e9400caf0 tx=0x7f0e940020f0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.954+0000 7f0ea28d3640 1 -- 172.21.15.73:0/3064778915 shutdown_connections 2024-03-29T04:09:08.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.954+0000 7f0ea28d3640 1 --2- 172.21.15.73:0/3064778915 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e9c15e6b0 0x7f0e9c1f4c60 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.954+0000 7f0ea28d3640 1 --2- 172.21.15.73:0/3064778915 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f0e8806c530 0x7f0e8806e9f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.954+0000 7f0ea28d3640 1 --2- 172.21.15.73:0/3064778915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e9c0d30e0 0x7f0e9c0ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.941 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.954+0000 7f0ea28d3640 1 --2- 172.21.15.73:0/3064778915 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0e9c0d26d0 0x7f0e9c15d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:08.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.954+0000 7f0ea28d3640 1 -- 172.21.15.73:0/3064778915 >> 172.21.15.73:0/3064778915 conn(0x7f0e9c08bfc0 msgr2=0x7f0e9c0b10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:08.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.954+0000 7f0ea28d3640 1 -- 172.21.15.73:0/3064778915 shutdown_connections 2024-03-29T04:09:08.942 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:08.954+0000 7f0ea28d3640 1 -- 172.21.15.73:0/3064778915 wait complete. 2024-03-29T04:09:08.944 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-29T04:09:09.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.066+0000 7f7b39ee4640 1 Processor -- start 2024-03-29T04:09:09.046 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.066+0000 7f7b39ee4640 1 -- start start 2024-03-29T04:09:09.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.067+0000 7f7b39ee4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b3415e930 0x7f7b340cf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:09.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.067+0000 7f7b39ee4640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7b340d3310 0x7f7b3406cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:09.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.067+0000 7f7b39ee4640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b340cfb30 con 0x7f7b340cf670 2024-03-29T04:09:09.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.067+0000 7f7b39ee4640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f7b3406c780 con 0x7f7b340d3310 2024-03-29T04:09:09.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.067+0000 7f7b39ee4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7b340cfe10 con 0x7f7b3415e930 2024-03-29T04:09:09.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.067+0000 7f7b33fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7b340d3310 0x7f7b3406cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:09.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.067+0000 7f7b2affd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7b340cf670 0x7f7b340d2c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:48096/0 (socket says 172.21.15.73:48096) 2024-03-29T04:09:09.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.067+0000 7f7b33fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7b340d3310 0x7f7b3406cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54002/0 (socket says 172.21.15.73:54002) 2024-03-29T04:09:09.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.067+0000 7f7b2affd640 1 -- 172.21.15.73:0/662665902 learned_addr learned my addr 172.21.15.73:0/662665902 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:09:09.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.067+0000 7f7b337fe640 1 --2- 172.21.15.73:0/662665902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b3415e930 0x7f7b340cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:09.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.067+0000 7f7b33fff640 1 -- 172.21.15.73:0/662665902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b3415e930 msgr2=0x7f7b340cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:09.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.067+0000 7f7b33fff640 1 --2- 172.21.15.73:0/662665902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b3415e930 0x7f7b340cf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:09.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.067+0000 7f7b33fff640 1 -- 172.21.15.73:0/662665902 >> v1:172.21.15.73:6789/0 conn(0x7f7b340cf670 legacy=0x7f7b340d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:09.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.067+0000 7f7b33fff640 1 -- 172.21.15.73:0/662665902 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b340d00f0 con 0x7f7b340d3310 2024-03-29T04:09:09.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.067+0000 7f7b32ffd640 1 -- 172.21.15.73:0/662665902 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1493937729 0 0) 0x7f7b340cfb30 con 0x7f7b340cf670 2024-03-29T04:09:09.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.068+0000 7f7b33fff640 1 --2- 172.21.15.73:0/662665902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b340d3310 0x7f7b3406cc10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c009d90 tx=0x7f7b2c02be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e1f0850963a3af7 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:09.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.068+0000 7f7b32ffd640 1 -- 172.21.15.73:0/662665902 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b2c039070 con 0x7f7b340d3310 2024-03-29T04:09:09.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.068+0000 7f7b32ffd640 1 -- 172.21.15.73:0/662665902 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b2c02cbc0 con 0x7f7b340d3310 2024-03-29T04:09:09.050 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.068+0000 7f7b32ffd640 1 -- 172.21.15.73:0/662665902 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b2c034440 con 0x7f7b340d3310 2024-03-29T04:09:09.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.069+0000 7f7b39ee4640 1 -- 172.21.15.73:0/662665902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b340d3310 msgr2=0x7f7b3406cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:09.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.069+0000 7f7b39ee4640 1 --2- 172.21.15.73:0/662665902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b340d3310 0x7f7b3406cc10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c009d90 tx=0x7f7b2c02be10 comp rx=0 tx=0).stop 2024-03-29T04:09:09.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.069+0000 7f7b39ee4640 1 -- 172.21.15.73:0/662665902 shutdown_connections 2024-03-29T04:09:09.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.069+0000 7f7b39ee4640 1 --2- 172.21.15.73:0/662665902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b340d3310 0x7f7b3406cc10 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:09.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.069+0000 7f7b39ee4640 1 --2- 172.21.15.73:0/662665902 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b3415e930 0x7f7b340cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:09.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.069+0000 7f7b39ee4640 1 -- 172.21.15.73:0/662665902 >> 172.21.15.73:0/662665902 conn(0x7f7b3408bfc0 msgr2=0x7f7b340d4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:09.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.069+0000 7f7b39ee4640 1 -- 172.21.15.73:0/662665902 shutdown_connections 2024-03-29T04:09:09.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.069+0000 7f7b39ee4640 1 -- 172.21.15.73:0/662665902 wait complete. 2024-03-29T04:09:09.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.070+0000 7f7b39ee4640 1 Processor -- start 2024-03-29T04:09:09.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.070+0000 7f7b39ee4640 1 -- start start 2024-03-29T04:09:09.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.071+0000 7f7b39ee4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b340cf670 0x7f7b341608e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:09.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.071+0000 7f7b39ee4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b340d3310 0x7f7b3415fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:09.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.071+0000 7f7b39ee4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b3415e930 0x7f7b34154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:09.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.071+0000 7f7b39ee4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7b3415ee90 con 0x7f7b340d3310 2024-03-29T04:09:09.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.071+0000 7f7b39ee4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7b3415ed10 con 0x7f7b3415e930 2024-03-29T04:09:09.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.071+0000 7f7b39ee4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7b340b3c50 con 0x7f7b340cf670 2024-03-29T04:09:09.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.071+0000 7f7b2affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b340d3310 0x7f7b3415fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:09.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.071+0000 7f7b2affd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b340d3310 0x7f7b3415fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54014/0 (socket says 172.21.15.73:54014) 2024-03-29T04:09:09.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.071+0000 7f7b2affd640 1 -- 172.21.15.73:0/3934875297 learned_addr learned my addr 172.21.15.73:0/3934875297 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:09.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.071+0000 7f7b337fe640 1 --2- 172.21.15.73:0/3934875297 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b340cf670 0x7f7b341608e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:09.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.071+0000 7f7b33fff640 1 --2- 172.21.15.73:0/3934875297 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b3415e930 0x7f7b34154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:09.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.071+0000 7f7b2affd640 1 -- 172.21.15.73:0/3934875297 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b340cf670 msgr2=0x7f7b341608e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:09.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.071+0000 7f7b2affd640 1 --2- 172.21.15.73:0/3934875297 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b340cf670 0x7f7b341608e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:09.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.071+0000 7f7b2affd640 1 -- 172.21.15.73:0/3934875297 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b3415e930 msgr2=0x7f7b34154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:09.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.071+0000 7f7b2affd640 1 --2- 172.21.15.73:0/3934875297 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b3415e930 0x7f7b34154620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:09.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.071+0000 7f7b2affd640 1 -- 172.21.15.73:0/3934875297 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b340cb940 con 0x7f7b340d3310 2024-03-29T04:09:09.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.071+0000 7f7b2affd640 1 --2- 172.21.15.73:0/3934875297 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b340d3310 0x7f7b3415fa80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c00c4d0 tx=0x7f7b1c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:09.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.072+0000 7f7b30ff9640 1 -- 172.21.15.73:0/3934875297 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c018070 con 0x7f7b340d3310 2024-03-29T04:09:09.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.072+0000 7f7b30ff9640 1 -- 172.21.15.73:0/3934875297 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b1c007500 con 0x7f7b340d3310 2024-03-29T04:09:09.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.072+0000 7f7b39ee4640 1 -- 172.21.15.73:0/3934875297 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b340cbc20 con 0x7f7b340d3310 2024-03-29T04:09:09.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.072+0000 7f7b30ff9640 1 -- 172.21.15.73:0/3934875297 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c004a20 con 0x7f7b340d3310 2024-03-29T04:09:09.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.072+0000 7f7b39ee4640 1 -- 172.21.15.73:0/3934875297 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b340cc1e0 con 0x7f7b340d3310 2024-03-29T04:09:09.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.073+0000 7f7b39ee4640 1 -- 172.21.15.73:0/3934875297 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b34068640 con 0x7f7b340d3310 2024-03-29T04:09:09.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.073+0000 7f7b30ff9640 1 -- 172.21.15.73:0/3934875297 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f7b1c01b070 con 0x7f7b340d3310 2024-03-29T04:09:09.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.074+0000 7f7b30ff9640 1 --2- 172.21.15.73:0/3934875297 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7b1406c530 0x7f7b1406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:09.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.074+0000 7f7b337fe640 1 --2- 172.21.15.73:0/3934875297 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7b1406c530 0x7f7b1406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:09.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.074+0000 7f7b30ff9640 1 -- 172.21.15.73:0/3934875297 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f7b1c08aa40 con 0x7f7b340d3310 2024-03-29T04:09:09.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.074+0000 7f7b337fe640 1 --2- 172.21.15.73:0/3934875297 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7b1406c530 0x7f7b1406e9f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7b24009a30 tx=0x7f7b24008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:09.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.078+0000 7f7b30ff9640 1 -- 172.21.15.73:0/3934875297 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f7b1c059060 con 0x7f7b340d3310 2024-03-29T04:09:09.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.297+0000 7f7b39ee4640 1 -- 172.21.15.73:0/3934875297 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7b340caf30 con 0x7f7b340d3310 2024-03-29T04:09:09.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.298+0000 7f7b30ff9640 1 -- 172.21.15.73:0/3934875297 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) ==== 53+0+73 (secure 0 0 0) 0x7f7b1c08ae20 con 0x7f7b340d3310 2024-03-29T04:09:09.278 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-29T04:09:09.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.300+0000 7f7b39ee4640 1 -- 172.21.15.73:0/3934875297 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7b1406c530 msgr2=0x7f7b1406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:09.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.300+0000 7f7b39ee4640 1 --2- 172.21.15.73:0/3934875297 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7b1406c530 0x7f7b1406e9f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7b24009a30 tx=0x7f7b24008040 comp rx=0 tx=0).stop 2024-03-29T04:09:09.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.300+0000 7f7b39ee4640 1 -- 172.21.15.73:0/3934875297 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b340d3310 msgr2=0x7f7b3415fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:09.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.300+0000 7f7b39ee4640 1 --2- 172.21.15.73:0/3934875297 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b340d3310 0x7f7b3415fa80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c00c4d0 tx=0x7f7b1c00c990 comp rx=0 tx=0).stop 2024-03-29T04:09:09.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.300+0000 7f7b39ee4640 1 -- 172.21.15.73:0/3934875297 shutdown_connections 2024-03-29T04:09:09.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.300+0000 7f7b39ee4640 1 --2- 172.21.15.73:0/3934875297 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7b1406c530 0x7f7b1406e9f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:09.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.300+0000 7f7b39ee4640 1 --2- 172.21.15.73:0/3934875297 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b3415e930 0x7f7b34154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:09.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.300+0000 7f7b39ee4640 1 --2- 172.21.15.73:0/3934875297 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b340d3310 0x7f7b3415fa80 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:09.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.300+0000 7f7b39ee4640 1 --2- 172.21.15.73:0/3934875297 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7b340cf670 0x7f7b341608e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:09.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.300+0000 7f7b39ee4640 1 -- 172.21.15.73:0/3934875297 >> 172.21.15.73:0/3934875297 conn(0x7f7b3408bfc0 msgr2=0x7f7b340d2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:09.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.300+0000 7f7b39ee4640 1 -- 172.21.15.73:0/3934875297 shutdown_connections 2024-03-29T04:09:09.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09.300+0000 7f7b39ee4640 1 -- 172.21.15.73:0/3934875297 wait complete. 2024-03-29T04:09:09.290 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-03-29T04:09:09.290 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-29T04:09:09.290 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2024-03-29T04:09:09.290 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-29T04:09:09.290 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-29T04:09:09.291 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-03-29T04:09:09.291 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-03-29T04:09:09.291 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-29T04:09:09.291 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-29T04:09:09.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:09:09.291 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2024-03-29T04:09:09.306 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-29T04:09:09.306 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-29T04:09:09.307 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2024-03-29T04:09:09.307 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:09:09.307 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2024-03-29T04:09:09.307 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:09:09.307 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-29T04:09:09.307 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2024-03-29T04:09:09.307 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2024-03-29T04:09:09.307 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-29T04:09:09.307 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2024-03-29T04:09:09.307 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2024-03-29T04:09:09.307 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-29T04:09:09.307 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2024-03-29T04:09:09.307 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-29T04:09:09.308 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2024-03-29T04:09:09.308 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-29T04:09:09.308 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42685sec preferred_lft 42685sec 2024-03-29T04:09:09.308 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link 2024-03-29T04:09:09.308 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:09:09.308 INFO:teuthology.orchestra.run.smithi073.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-29T04:09:09.308 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether be:37:bf:05:ec:d3 brd ff:ff:ff:ff:ff:ff 2024-03-29T04:09:09.308 INFO:teuthology.orchestra.run.smithi073.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-29T04:09:09.308 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:09:09.308 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::c80a:b7ff:feb5:8e8e/64 scope link 2024-03-29T04:09:09.308 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:09:09.309 INFO:teuthology.orchestra.run.smithi073.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-29T04:09:09.309 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether da:3c:54:9c:c9:61 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-29T04:09:09.309 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::d83c:54ff:fe9c:c961/64 scope link 2024-03-29T04:09:09.309 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:09:09.309 INFO:teuthology.orchestra.run.smithi073.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-29T04:09:09.309 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether be:37:bf:05:ec:d3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-29T04:09:09.309 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::bc37:bfff:fe05:ecd3/64 scope link 2024-03-29T04:09:09.309 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:09:09.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:09:09.309 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-29T04:09:09.372 INFO:teuthology.orchestra.run.smithi073.stdout:1 2024-03-29T04:09:09.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:09:09.373 DEBUG:teuthology.orchestra.run.smithi073:> route 2024-03-29T04:09:09.428 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2024-03-29T04:09:09.429 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-29T04:09:09.429 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-29T04:09:09.429 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-29T04:09:09.429 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-29T04:09:09.429 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-29T04:09:09.429 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-03-29T04:09:09.429 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-29T04:09:09.429 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-29T04:09:09.429 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-29T04:09:09.430 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-03-29T04:09:09.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-29T04:09:09.558 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-29T04:09:09.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:09:09.564 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-03-29T04:09:09.579 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-29T04:09:09.579 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-29T04:09:09.579 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-29T04:09:09.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:09:09.580 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.0 up 2024-03-29T04:09:09.647 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-29T04:09:09.647 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-29T04:09:09.701 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-29T04:09:09.702 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-29T04:09:09.702 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-29T04:09:09.758 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-29T04:09:09.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:09:09.758 DEBUG:teuthology.orchestra.run.smithi073:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-29T04:09:09.846 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-29T04:09:09.847 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-29T04:09:09.847 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2024-03-29T04:09:09.855 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-29T04:09:09.855 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-29T04:09:09.855 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2024-03-29T04:09:09.855 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.142:3300,172.21.15.142:3301" 2024-03-29T04:09:09.855 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-29T04:09:09.860 INFO:teuthology.orchestra.run.smithi073.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-03-29T04:09:09.860 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-03-29T04:09:09.860 INFO:teuthology.orchestra.run.smithi073.stdout:invalid new device string format 2024-03-29T04:09:09.861 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.142:3300,172.21.15.142:3301" 2024-03-29T04:09:09.861 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-29T04:09:09.861 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: resolved to: "172.21.15.73:6789,172.21.15.142:6789,172.21.15.142:6790" 2024-03-29T04:09:09.861 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.73:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2024-03-29T04:09:09.861 INFO:teuthology.orchestra.run.smithi073.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=6bff1617-b138-4517-acca-3ecaae3f2bb3" will pass to kernel 2024-03-29T04:09:09.861 INFO:teuthology.orchestra.run.smithi073.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-03-29T04:09:09.861 INFO:teuthology.orchestra.run.smithi073.stdout: You just mounted a file system that supports labels which does not 2024-03-29T04:09:09.861 INFO:teuthology.orchestra.run.smithi073.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-29T04:09:09.862 INFO:teuthology.orchestra.run.smithi073.stdout: applications will generate AVC messages and not be allowed access to 2024-03-29T04:09:09.862 INFO:teuthology.orchestra.run.smithi073.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-29T04:09:09.863 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-29T04:09:09.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:09:09.863 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-29T04:09:09.890 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-29T04:09:09.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-29T04:09:09.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-29T04:09:09.989 INFO:teuthology.orchestra.run.smithi073.stdout:client4850 2024-03-29T04:09:09.990 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-29T04:09:09.990 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-29T04:09:10.005 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-29T04:09:10.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.169+0000 7f78176d9640 1 Processor -- start 2024-03-29T04:09:10.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.169+0000 7f78176d9640 1 -- start start 2024-03-29T04:09:10.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.170+0000 7f78176d9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f78100d1080 0x7f7810160210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:10.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.170+0000 7f78176d9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7810160750 0x7f7810166540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:10.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.170+0000 7f78176d9640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f781015cb20 con 0x7f781015c740 2024-03-29T04:09:10.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.170+0000 7f78176d9640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f7810160ba0 con 0x7f78100d1080 2024-03-29T04:09:10.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.170+0000 7f78176d9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f78100d0000 con 0x7f7810160750 2024-03-29T04:09:10.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.170+0000 7f7814c74640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f78100d1080 0x7f7810160210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:10.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.170+0000 7f7814c74640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f78100d1080 0x7f7810160210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54030/0 (socket says 172.21.15.73:54030) 2024-03-29T04:09:10.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.170+0000 7f7814c74640 1 -- 172.21.15.73:0/14277248 learned_addr learned my addr 172.21.15.73:0/14277248 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:10.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.170+0000 7f7815475640 1 --1- 172.21.15.73:0/14277248 >> v1:172.21.15.73:6789/0 conn(0x7f781015c740 0x7f78100cda20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:48108/0 (socket says 172.21.15.73:48108) 2024-03-29T04:09:10.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.170+0000 7f7815c76640 1 --2- 172.21.15.73:0/14277248 >> v2:172.21.15.142:3300/0 conn(0x7f7810160750 0x7f7810166540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:10.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.171+0000 7f7814c74640 1 -- 172.21.15.73:0/14277248 >> v2:172.21.15.142:3300/0 conn(0x7f7810160750 msgr2=0x7f7810166540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:10.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.171+0000 7f7814c74640 1 --2- 172.21.15.73:0/14277248 >> v2:172.21.15.142:3300/0 conn(0x7f7810160750 0x7f7810166540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:10.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.171+0000 7f7814c74640 1 -- 172.21.15.73:0/14277248 >> v1:172.21.15.73:6789/0 conn(0x7f781015c740 legacy=0x7f78100cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:10.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.171+0000 7f7814c74640 1 -- 172.21.15.73:0/14277248 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78100d02c0 con 0x7f78100d1080 2024-03-29T04:09:10.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.171+0000 7f7807fff640 1 -- 172.21.15.73:0/14277248 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 325943246 0 0) 0x7f781015cb20 con 0x7f781015c740 2024-03-29T04:09:10.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.172+0000 7f7814c74640 1 --2- 172.21.15.73:0/14277248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78100d1080 0x7f7810160210 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f781006bfd0 tx=0x7f780c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1972faad31b5dd9 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:10.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.172+0000 7f7807fff640 1 -- 172.21.15.73:0/14277248 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f780c034070 con 0x7f78100d1080 2024-03-29T04:09:10.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.172+0000 7f7807fff640 1 -- 172.21.15.73:0/14277248 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f780c030860 con 0x7f78100d1080 2024-03-29T04:09:10.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.172+0000 7f7807fff640 1 -- 172.21.15.73:0/14277248 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f780c030c30 con 0x7f78100d1080 2024-03-29T04:09:10.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.172+0000 7f78176d9640 1 -- 172.21.15.73:0/14277248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78100d1080 msgr2=0x7f7810160210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:10.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.172+0000 7f78176d9640 1 --2- 172.21.15.73:0/14277248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78100d1080 0x7f7810160210 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f781006bfd0 tx=0x7f780c02b9a0 comp rx=0 tx=0).stop 2024-03-29T04:09:10.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.172+0000 7f78176d9640 1 -- 172.21.15.73:0/14277248 shutdown_connections 2024-03-29T04:09:10.153 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.172+0000 7f78176d9640 1 --2- 172.21.15.73:0/14277248 >> v2:172.21.15.142:3300/0 conn(0x7f7810160750 0x7f7810166540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:10.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.172+0000 7f78176d9640 1 --2- 172.21.15.73:0/14277248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78100d1080 0x7f7810160210 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:10.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.172+0000 7f78176d9640 1 -- 172.21.15.73:0/14277248 >> 172.21.15.73:0/14277248 conn(0x7f78100d2430 msgr2=0x7f78100d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:10.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.173+0000 7f78176d9640 1 -- 172.21.15.73:0/14277248 shutdown_connections 2024-03-29T04:09:10.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.173+0000 7f78176d9640 1 -- 172.21.15.73:0/14277248 wait complete. 2024-03-29T04:09:10.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.174+0000 7f78176d9640 1 Processor -- start 2024-03-29T04:09:10.154 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.174+0000 7f78176d9640 1 -- start start 2024-03-29T04:09:10.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.174+0000 7f78176d9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78100d1080 0x7f78100c5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:10.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.174+0000 7f78176d9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f781015c740 0x7f7810157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:10.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.174+0000 7f78176d9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7810160750 0x7f78100c9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:10.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.174+0000 7f78176d9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f78100d0b60 con 0x7f7810160750 2024-03-29T04:09:10.157 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.174+0000 7f78176d9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f78100d0880 con 0x7f78100d1080 2024-03-29T04:09:10.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.174+0000 7f78176d9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7810160f70 con 0x7f781015c740 2024-03-29T04:09:10.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.174+0000 7f7815c76640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7810160750 0x7f78100c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:10.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.175+0000 7f7815c76640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7810160750 0x7f78100c9500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54038/0 (socket says 172.21.15.73:54038) 2024-03-29T04:09:10.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.175+0000 7f7815c76640 1 -- 172.21.15.73:0/3859182268 learned_addr learned my addr 172.21.15.73:0/3859182268 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:10.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.175+0000 7f7815475640 1 --2- 172.21.15.73:0/3859182268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78100d1080 0x7f78100c5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:10.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.175+0000 7f7814c74640 1 --2- 172.21.15.73:0/3859182268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f781015c740 0x7f7810157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:10.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.175+0000 7f7815c76640 1 -- 172.21.15.73:0/3859182268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f781015c740 msgr2=0x7f7810157680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:10.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.175+0000 7f7815c76640 1 --2- 172.21.15.73:0/3859182268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f781015c740 0x7f7810157680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:10.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.175+0000 7f7815c76640 1 -- 172.21.15.73:0/3859182268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78100d1080 msgr2=0x7f78100c5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:10.158 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.175+0000 7f7815c76640 1 --2- 172.21.15.73:0/3859182268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78100d1080 0x7f78100c5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:10.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.175+0000 7f7815c76640 1 -- 172.21.15.73:0/3859182268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78100c9c70 con 0x7f7810160750 2024-03-29T04:09:10.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.175+0000 7f7814c74640 1 --2- 172.21.15.73:0/3859182268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f781015c740 0x7f7810157680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:09:10.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.175+0000 7f7815c76640 1 --2- 172.21.15.73:0/3859182268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7810160750 0x7f78100c9500 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7808007e60 tx=0x7f780800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:10.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.175+0000 7f7805ffb640 1 -- 172.21.15.73:0/3859182268 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7808014420 con 0x7f7810160750 2024-03-29T04:09:10.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.175+0000 7f7805ffb640 1 -- 172.21.15.73:0/3859182268 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7808019070 con 0x7f7810160750 2024-03-29T04:09:10.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.175+0000 7f7805ffb640 1 -- 172.21.15.73:0/3859182268 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7808014820 con 0x7f7810160750 2024-03-29T04:09:10.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.175+0000 7f78176d9640 1 -- 172.21.15.73:0/3859182268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78100c9f50 con 0x7f7810160750 2024-03-29T04:09:10.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.175+0000 7f78176d9640 1 -- 172.21.15.73:0/3859182268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78100ca510 con 0x7f7810160750 2024-03-29T04:09:10.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.177+0000 7f78176d9640 1 -- 172.21.15.73:0/3859182268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78100d2210 con 0x7f7810160750 2024-03-29T04:09:10.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.177+0000 7f7805ffb640 1 -- 172.21.15.73:0/3859182268 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f78080149c0 con 0x7f7810160750 2024-03-29T04:09:10.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.177+0000 7f7805ffb640 1 --2- 172.21.15.73:0/3859182268 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f77f406c530 0x7f77f406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:10.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.177+0000 7f7805ffb640 1 -- 172.21.15.73:0/3859182268 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f780808bea0 con 0x7f7810160750 2024-03-29T04:09:10.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.177+0000 7f7815475640 1 --2- 172.21.15.73:0/3859182268 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f77f406c530 0x7f77f406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:10.159 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.178+0000 7f7815475640 1 --2- 172.21.15.73:0/3859182268 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f77f406c530 0x7f77f406e9f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7800007fd0 tx=0x7f7800007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:10.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.186+0000 7f7805ffb640 1 -- 172.21.15.73:0/3859182268 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f78100d2210 con 0x7f7810160750 2024-03-29T04:09:10.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.405+0000 7f78176d9640 1 -- 172.21.15.73:0/3859182268 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7810068640 con 0x7f7810160750 2024-03-29T04:09:10.385 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.405+0000 7f7805ffb640 1 -- 172.21.15.73:0/3859182268 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) ==== 53+0+73 (secure 0 0 0) 0x7f780805a4c0 con 0x7f7810160750 2024-03-29T04:09:10.385 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-29T04:09:10.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.408+0000 7f78176d9640 1 -- 172.21.15.73:0/3859182268 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f77f406c530 msgr2=0x7f77f406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:10.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.408+0000 7f78176d9640 1 --2- 172.21.15.73:0/3859182268 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f77f406c530 0x7f77f406e9f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7800007fd0 tx=0x7f7800007de0 comp rx=0 tx=0).stop 2024-03-29T04:09:10.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.408+0000 7f78176d9640 1 -- 172.21.15.73:0/3859182268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7810160750 msgr2=0x7f78100c9500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:10.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.408+0000 7f78176d9640 1 --2- 172.21.15.73:0/3859182268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7810160750 0x7f78100c9500 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7808007e60 tx=0x7f780800e4b0 comp rx=0 tx=0).stop 2024-03-29T04:09:10.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.408+0000 7f78176d9640 1 -- 172.21.15.73:0/3859182268 shutdown_connections 2024-03-29T04:09:10.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.408+0000 7f78176d9640 1 --2- 172.21.15.73:0/3859182268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7810160750 0x7f78100c9500 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:10.388 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.408+0000 7f78176d9640 1 --2- 172.21.15.73:0/3859182268 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f781015c740 0x7f7810157680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:10.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.408+0000 7f78176d9640 1 --2- 172.21.15.73:0/3859182268 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f77f406c530 0x7f77f406e9f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:10.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.408+0000 7f78176d9640 1 --2- 172.21.15.73:0/3859182268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f78100d1080 0x7f78100c5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:10.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.408+0000 7f78176d9640 1 -- 172.21.15.73:0/3859182268 >> 172.21.15.73:0/3859182268 conn(0x7f78100d2430 msgr2=0x7f78100ceb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:10.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.408+0000 7f78176d9640 1 -- 172.21.15.73:0/3859182268 shutdown_connections 2024-03-29T04:09:10.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:10.408+0000 7f78176d9640 1 -- 172.21.15.73:0/3859182268 wait complete. 2024-03-29T04:09:10.399 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-03-29T04:09:10.399 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-29T04:09:10.400 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2024-03-29T04:09:10.400 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-03-29T04:09:10.400 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-29T04:09:10.400 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-03-29T04:09:10.400 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-03-29T04:09:10.400 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-29T04:09:10.401 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-29T04:09:10.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:09:10.401 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2024-03-29T04:09:10.421 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-29T04:09:10.421 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-29T04:09:10.422 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2024-03-29T04:09:10.422 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:09:10.422 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2024-03-29T04:09:10.422 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:09:10.422 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-29T04:09:10.423 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2024-03-29T04:09:10.423 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2024-03-29T04:09:10.423 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-29T04:09:10.423 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2024-03-29T04:09:10.423 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2024-03-29T04:09:10.423 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-29T04:09:10.424 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2024-03-29T04:09:10.424 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-29T04:09:10.424 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2024-03-29T04:09:10.424 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-29T04:09:10.424 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 42689sec preferred_lft 42689sec 2024-03-29T04:09:10.424 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::ec4:7aff:fe88:6e0d/64 scope link 2024-03-29T04:09:10.425 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:09:10.425 INFO:teuthology.orchestra.run.smithi142.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-29T04:09:10.425 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 8e:c4:44:76:40:6b brd ff:ff:ff:ff:ff:ff 2024-03-29T04:09:10.425 INFO:teuthology.orchestra.run.smithi142.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-29T04:09:10.425 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:09:10.425 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::9c88:7cff:fe6e:2370/64 scope link 2024-03-29T04:09:10.426 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:09:10.426 INFO:teuthology.orchestra.run.smithi142.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-29T04:09:10.426 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether f6:59:ef:56:aa:24 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-29T04:09:10.426 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::f459:efff:fe56:aa24/64 scope link 2024-03-29T04:09:10.426 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:09:10.427 INFO:teuthology.orchestra.run.smithi142.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-29T04:09:10.427 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 8e:c4:44:76:40:6b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-29T04:09:10.427 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::8cc4:44ff:fe76:406b/64 scope link 2024-03-29T04:09:10.427 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2024-03-29T04:09:10.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:09:10.428 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-29T04:09:10.492 INFO:teuthology.orchestra.run.smithi142.stdout:1 2024-03-29T04:09:10.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:09:10.494 DEBUG:teuthology.orchestra.run.smithi142:> route 2024-03-29T04:09:10.553 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2024-03-29T04:09:10.553 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-29T04:09:10.553 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-29T04:09:10.553 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-29T04:09:10.553 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-29T04:09:10.553 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-29T04:09:10.554 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2024-03-29T04:09:10.554 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-29T04:09:10.554 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-29T04:09:10.554 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-29T04:09:10.554 DEBUG:teuthology.orchestra.run.smithi142:> ') 2024-03-29T04:09:10.646 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:09:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-29T04:09:10.690 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:09:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-29T04:09:10.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:09:10.697 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-03-29T04:09:10.714 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-03-29T04:09:10.714 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-29T04:09:10.714 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-29T04:09:10.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:09:10.714 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2024-03-29T04:09:10.782 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-29T04:09:10.783 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-03-29T04:09:10.837 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-03-29T04:09:10.837 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-29T04:09:10.837 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-03-29T04:09:10.892 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-29T04:09:10.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:09:10.892 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-29T04:09:10.977 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-29T04:09:10.977 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-03-29T04:09:10.977 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2024-03-29T04:09:10.985 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-29T04:09:10.985 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-03-29T04:09:10.985 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2024-03-29T04:09:10.985 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.142:3300,172.21.15.142:3301" 2024-03-29T04:09:10.985 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-29T04:09:11.002 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-03-29T04:09:11.003 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-03-29T04:09:11.003 INFO:teuthology.orchestra.run.smithi142.stdout:invalid new device string format 2024-03-29T04:09:11.003 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.73:3300,172.21.15.142:3300,172.21.15.142:3301" 2024-03-29T04:09:11.003 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-29T04:09:11.003 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.73:6789,172.21.15.142:6789,172.21.15.142:6790" 2024-03-29T04:09:11.003 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.73:6789,172.21.15.142:6789,172.21.15.142:6790:/ 2024-03-29T04:09:11.003 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=6bff1617-b138-4517-acca-3ecaae3f2bb3" will pass to kernel 2024-03-29T04:09:11.003 INFO:teuthology.orchestra.run.smithi142.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-03-29T04:09:11.004 INFO:teuthology.orchestra.run.smithi142.stdout: You just mounted a file system that supports labels which does not 2024-03-29T04:09:11.004 INFO:teuthology.orchestra.run.smithi142.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-29T04:09:11.004 INFO:teuthology.orchestra.run.smithi142.stdout: applications will generate AVC messages and not be allowed access to 2024-03-29T04:09:11.004 INFO:teuthology.orchestra.run.smithi142.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-29T04:09:11.005 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-29T04:09:11.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:09:11.005 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-03-29T04:09:11.072 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-29T04:09:11.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:09:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-29T04:09:11.162 INFO:teuthology.orchestra.run.smithi142.stderr:2024-03-29T04:09:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-29T04:09:11.167 INFO:teuthology.orchestra.run.smithi142.stdout:client5283 2024-03-29T04:09:11.168 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-03-29T04:09:11.168 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-29T04:09:11.183 DEBUG:tasks.cephfs.test_uninlining:setting inline_data:1 2024-03-29T04:09:11.183 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs inline_data 1 --yes-i-really-really-mean-it 2024-03-29T04:09:11.301 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.309+0000 7feba87bd640 1 Processor -- start 2024-03-29T04:09:11.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.309+0000 7feba87bd640 1 -- start start 2024-03-29T04:09:11.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.310+0000 7feba87bd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7feba015e780 0x7feba0162ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:11.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.310+0000 7feba87bd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feba00d4f20 0x7feba00b1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:11.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.310+0000 7feba87bd640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feba00b37c0 con 0x7feba015eb60 2024-03-29T04:09:11.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.310+0000 7feba87bd640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7feba0163430 con 0x7feba015e780 2024-03-29T04:09:11.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.310+0000 7feba87bd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7feba00cfde0 con 0x7feba00d4f20 2024-03-29T04:09:11.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.310+0000 7feba6559640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7feba015e780 0x7feba0162ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:11.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.310+0000 7feba6559640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7feba015e780 0x7feba0162ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54054/0 (socket says 172.21.15.73:54054) 2024-03-29T04:09:11.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.310+0000 7feba6559640 1 -- 172.21.15.73:0/2590741878 learned_addr learned my addr 172.21.15.73:0/2590741878 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:11.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.310+0000 7feba5d58640 1 --2- 172.21.15.73:0/2590741878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feba00d4f20 0x7feba00b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:11.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.311+0000 7feba6559640 1 -- 172.21.15.73:0/2590741878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feba00d4f20 msgr2=0x7feba00b1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:11.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.311+0000 7feba6559640 1 --2- 172.21.15.73:0/2590741878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feba00d4f20 0x7feba00b1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:11.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.311+0000 7feba6559640 1 -- 172.21.15.73:0/2590741878 >> v1:172.21.15.142:6789/0 conn(0x7feba015eb60 legacy=0x7feba00d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:11.410 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.311+0000 7feba6559640 1 -- 172.21.15.73:0/2590741878 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feba00d53e0 con 0x7feba015e780 2024-03-29T04:09:11.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.311+0000 7feba5557640 1 -- 172.21.15.73:0/2590741878 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1180509989 0 0) 0x7feba00b37c0 con 0x7feba015eb60 2024-03-29T04:09:11.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.312+0000 7feba6559640 1 --2- 172.21.15.73:0/2590741878 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feba015e780 0x7feba0162ef0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7feb9c009870 tx=0x7feb9c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=630d3b0ee70d2b89 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:11.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.312+0000 7feba5557640 1 -- 172.21.15.73:0/2590741878 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9c034070 con 0x7feba015e780 2024-03-29T04:09:11.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.312+0000 7feba5557640 1 -- 172.21.15.73:0/2590741878 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb9c030840 con 0x7feba015e780 2024-03-29T04:09:11.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.312+0000 7feba5557640 1 -- 172.21.15.73:0/2590741878 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9c030c10 con 0x7feba015e780 2024-03-29T04:09:11.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.312+0000 7feba87bd640 1 -- 172.21.15.73:0/2590741878 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feba015e780 msgr2=0x7feba0162ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:11.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.312+0000 7feba87bd640 1 --2- 172.21.15.73:0/2590741878 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feba015e780 0x7feba0162ef0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7feb9c009870 tx=0x7feb9c02b980 comp rx=0 tx=0).stop 2024-03-29T04:09:11.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.312+0000 7feba87bd640 1 -- 172.21.15.73:0/2590741878 shutdown_connections 2024-03-29T04:09:11.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.312+0000 7feba87bd640 1 --2- 172.21.15.73:0/2590741878 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feba00d4f20 0x7feba00b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:11.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.312+0000 7feba87bd640 1 --2- 172.21.15.73:0/2590741878 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feba015e780 0x7feba0162ef0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:11.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.312+0000 7feba87bd640 1 -- 172.21.15.73:0/2590741878 >> 172.21.15.73:0/2590741878 conn(0x7feba008bfc0 msgr2=0x7feba00d4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:11.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.313+0000 7feba87bd640 1 -- 172.21.15.73:0/2590741878 shutdown_connections 2024-03-29T04:09:11.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.313+0000 7feba87bd640 1 -- 172.21.15.73:0/2590741878 wait complete. 2024-03-29T04:09:11.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.314+0000 7feba87bd640 1 Processor -- start 2024-03-29T04:09:11.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.314+0000 7feba87bd640 1 -- start start 2024-03-29T04:09:11.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.314+0000 7feba87bd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feba00d4f20 0x7feba00c6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:11.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.314+0000 7feba87bd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feba015e780 0x7feba006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:11.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.314+0000 7feba87bd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feba015eb60 0x7feba006df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:11.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.314+0000 7feba87bd640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7feba00cf440 con 0x7feba00d4f20 2024-03-29T04:09:11.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.314+0000 7feba87bd640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7feba00cfa70 con 0x7feba015eb60 2024-03-29T04:09:11.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.314+0000 7feba87bd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7feba00d0980 con 0x7feba015e780 2024-03-29T04:09:11.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.314+0000 7feba6559640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feba00d4f20 0x7feba00c6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:11.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.314+0000 7feba6559640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feba00d4f20 0x7feba00c6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54070/0 (socket says 172.21.15.73:54070) 2024-03-29T04:09:11.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.315+0000 7feba6559640 1 -- 172.21.15.73:0/3136839001 learned_addr learned my addr 172.21.15.73:0/3136839001 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:11.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.315+0000 7feba6d5a640 1 --2- 172.21.15.73:0/3136839001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feba015eb60 0x7feba006df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:11.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.315+0000 7feba5d58640 1 --2- 172.21.15.73:0/3136839001 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feba015e780 0x7feba006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:11.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.315+0000 7feba6559640 1 -- 172.21.15.73:0/3136839001 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feba015e780 msgr2=0x7feba006d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:11.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.315+0000 7feba6559640 1 --2- 172.21.15.73:0/3136839001 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feba015e780 0x7feba006d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:11.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.315+0000 7feba6559640 1 -- 172.21.15.73:0/3136839001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feba015eb60 msgr2=0x7feba006df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:11.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.315+0000 7feba6559640 1 --2- 172.21.15.73:0/3136839001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feba015eb60 0x7feba006df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:11.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.315+0000 7feba6559640 1 -- 172.21.15.73:0/3136839001 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feba015f160 con 0x7feba00d4f20 2024-03-29T04:09:11.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.315+0000 7feba6559640 1 --2- 172.21.15.73:0/3136839001 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feba00d4f20 0x7feba00c6be0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7feb9c009870 tx=0x7feb9c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:11.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.315+0000 7feb96ffd640 1 -- 172.21.15.73:0/3136839001 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9c048070 con 0x7feba00d4f20 2024-03-29T04:09:11.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.315+0000 7feb96ffd640 1 -- 172.21.15.73:0/3136839001 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb9c030640 con 0x7feba00d4f20 2024-03-29T04:09:11.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.315+0000 7feb96ffd640 1 -- 172.21.15.73:0/3136839001 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9c034040 con 0x7feba00d4f20 2024-03-29T04:09:11.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.315+0000 7feba87bd640 1 -- 172.21.15.73:0/3136839001 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feba015f440 con 0x7feba00d4f20 2024-03-29T04:09:11.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.315+0000 7feba87bd640 1 -- 172.21.15.73:0/3136839001 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feba015fa00 con 0x7feba00d4f20 2024-03-29T04:09:11.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.316+0000 7feba87bd640 1 -- 172.21.15.73:0/3136839001 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feba0068640 con 0x7feba00d4f20 2024-03-29T04:09:11.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.317+0000 7feb96ffd640 1 -- 172.21.15.73:0/3136839001 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7feb9c04b070 con 0x7feba00d4f20 2024-03-29T04:09:11.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.317+0000 7feb96ffd640 1 --2- 172.21.15.73:0/3136839001 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7feb8406c530 0x7feb8406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:11.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.317+0000 7feb96ffd640 1 -- 172.21.15.73:0/3136839001 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7feb9c0ad550 con 0x7feba00d4f20 2024-03-29T04:09:11.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.317+0000 7feba5d58640 1 --2- 172.21.15.73:0/3136839001 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7feb8406c530 0x7feb8406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:11.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.318+0000 7feba5d58640 1 --2- 172.21.15.73:0/3136839001 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7feb8406c530 0x7feb8406e9f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7feba0156b10 tx=0x7feb90009110 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:11.414 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.322+0000 7feb96ffd640 1 -- 172.21.15.73:0/3136839001 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7feb9c07b520 con 0x7feba00d4f20 2024-03-29T04:09:11.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.541+0000 7feba87bd640 1 -- 172.21.15.73:0/3136839001 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "1", "yes_i_really_really_mean_it": true} v 0) -- 0x7feba0162f80 con 0x7feba00d4f20 2024-03-29T04:09:11.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.763+0000 7feb96ffd640 1 -- 172.21.15.73:0/3136839001 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "1", "yes_i_really_really_mean_it": true}]=0 inline data enabled v14) ==== 165+0+0 (secure 0 0 0) 0x7feb9c07f820 con 0x7feba00d4f20 2024-03-29T04:09:11.743 INFO:teuthology.orchestra.run.smithi073.stderr:inline data enabled 2024-03-29T04:09:11.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.765+0000 7feba87bd640 1 -- 172.21.15.73:0/3136839001 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7feb8406c530 msgr2=0x7feb8406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:11.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.765+0000 7feba87bd640 1 --2- 172.21.15.73:0/3136839001 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7feb8406c530 0x7feb8406e9f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7feba0156b10 tx=0x7feb90009110 comp rx=0 tx=0).stop 2024-03-29T04:09:11.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.765+0000 7feba87bd640 1 -- 172.21.15.73:0/3136839001 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feba00d4f20 msgr2=0x7feba00c6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:11.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.765+0000 7feba87bd640 1 --2- 172.21.15.73:0/3136839001 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feba00d4f20 0x7feba00c6be0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7feb9c009870 tx=0x7feb9c004730 comp rx=0 tx=0).stop 2024-03-29T04:09:11.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.766+0000 7feba87bd640 1 -- 172.21.15.73:0/3136839001 shutdown_connections 2024-03-29T04:09:11.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.766+0000 7feba87bd640 1 --2- 172.21.15.73:0/3136839001 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7feb8406c530 0x7feb8406e9f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:11.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.766+0000 7feba87bd640 1 --2- 172.21.15.73:0/3136839001 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feba015eb60 0x7feba006df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:11.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.766+0000 7feba87bd640 1 --2- 172.21.15.73:0/3136839001 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7feba015e780 0x7feba006d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:11.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.766+0000 7feba87bd640 1 --2- 172.21.15.73:0/3136839001 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feba00d4f20 0x7feba00c6be0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:11.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.766+0000 7feba87bd640 1 -- 172.21.15.73:0/3136839001 >> 172.21.15.73:0/3136839001 conn(0x7feba008bfc0 msgr2=0x7feba015d770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:11.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.766+0000 7feba87bd640 1 -- 172.21.15.73:0/3136839001 shutdown_connections 2024-03-29T04:09:11.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:11.766+0000 7feba87bd640 1 -- 172.21.15.73:0/3136839001 wait complete. 2024-03-29T04:09:11.759 DEBUG:tasks.cephfs.test_uninlining:fetching tarball 2024-03-29T04:09:11.759 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/mnt.0 && wget http://download.ceph.com/qa/linux-5.4.tar.gz 2024-03-29T04:09:11.850 INFO:teuthology.orchestra.run.smithi073.stderr:--2024-03-29 04:09:11-- http://download.ceph.com/qa/linux-5.4.tar.gz 2024-03-29T04:09:11.850 INFO:teuthology.orchestra.run.smithi073.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-03-29T04:09:11.887 INFO:teuthology.orchestra.run.smithi073.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-03-29T04:09:11.923 INFO:teuthology.orchestra.run.smithi073.stderr:HTTP request sent, awaiting response... 200 OK 2024-03-29T04:09:11.923 INFO:teuthology.orchestra.run.smithi073.stderr:Length: 172616875 (165M) [application/octet-stream] 2024-03-29T04:09:11.925 INFO:teuthology.orchestra.run.smithi073.stderr:Saving to: ‘linux-5.4.tar.gz’ 2024-03-29T04:09:11.927 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-03-29T04:09:11.995 INFO:teuthology.orchestra.run.smithi073.stderr: 0K .......... .......... .......... .......... .......... 0% 730K 3m51s 2024-03-29T04:09:12.034 INFO:teuthology.orchestra.run.smithi073.stderr: 50K .......... .......... .......... .......... .......... 0% 1.38M 2m55s 2024-03-29T04:09:12.034 INFO:teuthology.orchestra.run.smithi073.stderr: 100K .......... .......... .......... .......... .......... 0% 111M 1m57s 2024-03-29T04:09:12.034 INFO:teuthology.orchestra.run.smithi073.stderr: 150K .......... .......... .......... .......... .......... 0% 113M 88s 2024-03-29T04:09:12.074 INFO:teuthology.orchestra.run.smithi073.stderr: 200K .......... .......... .......... .......... .......... 0% 1.39M 94s 2024-03-29T04:09:12.074 INFO:teuthology.orchestra.run.smithi073.stderr: 250K .......... .......... .......... .......... .......... 0% 111M 79s 2024-03-29T04:09:12.074 INFO:teuthology.orchestra.run.smithi073.stderr: 300K .......... .......... .......... .......... .......... 0% 115M 68s 2024-03-29T04:09:12.074 INFO:teuthology.orchestra.run.smithi073.stderr: 350K .......... .......... .......... .......... .......... 0% 107M 59s 2024-03-29T04:09:12.118 INFO:teuthology.orchestra.run.smithi073.stderr: 400K .......... .......... .......... .......... .......... 0% 1.44M 65s 2024-03-29T04:09:12.118 INFO:teuthology.orchestra.run.smithi073.stderr: 450K .......... .......... .......... .......... .......... 0% 112M 59s 2024-03-29T04:09:12.118 INFO:teuthology.orchestra.run.smithi073.stderr: 500K .......... .......... .......... .......... .......... 0% 110M 54s 2024-03-29T04:09:12.118 INFO:teuthology.orchestra.run.smithi073.stderr: 550K .......... .......... .......... .......... .......... 0% 111M 49s 2024-03-29T04:09:12.118 INFO:teuthology.orchestra.run.smithi073.stderr: 600K .......... .......... .......... .......... .......... 0% 108M 46s 2024-03-29T04:09:12.118 INFO:teuthology.orchestra.run.smithi073.stderr: 650K .......... .......... .......... .......... .......... 0% 109M 43s 2024-03-29T04:09:12.118 INFO:teuthology.orchestra.run.smithi073.stderr: 700K .......... .......... .......... .......... .......... 0% 91.7M 40s 2024-03-29T04:09:12.118 INFO:teuthology.orchestra.run.smithi073.stderr: 750K .......... .......... .......... .......... .......... 0% 75.3M 37s 2024-03-29T04:09:12.118 INFO:teuthology.orchestra.run.smithi073.stderr: 800K .......... .......... .......... .......... .......... 0% 50.7M 35s 2024-03-29T04:09:12.169 INFO:teuthology.orchestra.run.smithi073.stderr: 850K .......... .......... .......... .......... .......... 0% 1.56M 39s 2024-03-29T04:09:12.170 INFO:teuthology.orchestra.run.smithi073.stderr: 900K .......... .......... .......... .......... .......... 0% 110M 37s 2024-03-29T04:09:12.170 INFO:teuthology.orchestra.run.smithi073.stderr: 950K .......... .......... .......... .......... .......... 0% 109M 35s 2024-03-29T04:09:12.170 INFO:teuthology.orchestra.run.smithi073.stderr: 1000K .......... .......... .......... .......... .......... 0% 112M 34s 2024-03-29T04:09:12.170 INFO:teuthology.orchestra.run.smithi073.stderr: 1050K .......... .......... .......... .......... .......... 0% 104M 32s 2024-03-29T04:09:12.170 INFO:teuthology.orchestra.run.smithi073.stderr: 1100K .......... .......... .......... .......... .......... 0% 121M 31s 2024-03-29T04:09:12.170 INFO:teuthology.orchestra.run.smithi073.stderr: 1150K .......... .......... .......... .......... .......... 0% 107M 30s 2024-03-29T04:09:12.170 INFO:teuthology.orchestra.run.smithi073.stderr: 1200K .......... .......... .......... .......... .......... 0% 55.1M 29s 2024-03-29T04:09:12.170 INFO:teuthology.orchestra.run.smithi073.stderr: 1250K .......... .......... .......... .......... .......... 0% 31.7M 28s 2024-03-29T04:09:12.170 INFO:teuthology.orchestra.run.smithi073.stderr: 1300K .......... .......... .......... .......... .......... 0% 32.3M 27s 2024-03-29T04:09:12.170 INFO:teuthology.orchestra.run.smithi073.stderr: 1350K .......... .......... .......... .......... .......... 0% 25.3M 26s 2024-03-29T04:09:12.170 INFO:teuthology.orchestra.run.smithi073.stderr: 1400K .......... .......... .......... .......... .......... 0% 29.7M 25s 2024-03-29T04:09:12.171 INFO:teuthology.orchestra.run.smithi073.stderr: 1450K .......... .......... .......... .......... .......... 0% 35.0M 25s 2024-03-29T04:09:12.171 INFO:teuthology.orchestra.run.smithi073.stderr: 1500K .......... .......... .......... .......... .......... 0% 23.6M 24s 2024-03-29T04:09:12.171 INFO:teuthology.orchestra.run.smithi073.stderr: 1550K .......... .......... .......... .......... .......... 0% 38.0M 24s 2024-03-29T04:09:12.171 INFO:teuthology.orchestra.run.smithi073.stderr: 1600K .......... .......... .......... .......... .......... 0% 27.2M 23s 2024-03-29T04:09:12.171 INFO:teuthology.orchestra.run.smithi073.stderr: 1650K .......... .......... .......... .......... .......... 1% 24.6M 23s 2024-03-29T04:09:19.130 INFO:teuthology.orchestra.run.smithi073.stderr: 1700K .......... .......... .......... .......... .......... 1% 2.94M 23s 2024-03-29T04:09:19.130 INFO:teuthology.orchestra.run.smithi073.stderr: 1750K .......... .......... .......... .......... .......... 1% 113M 23s 2024-03-29T04:09:19.130 INFO:teuthology.orchestra.run.smithi073.stderr: 1800K .......... .......... .......... .......... .......... 1% 110M 22s 2024-03-29T04:09:19.131 INFO:teuthology.orchestra.run.smithi073.stderr: 1850K .......... .......... .......... .......... .......... 1% 115M 22s 2024-03-29T04:09:19.131 INFO:teuthology.orchestra.run.smithi073.stderr: 1900K .......... .......... .......... .......... .......... 1% 107M 21s 2024-03-29T04:09:19.131 INFO:teuthology.orchestra.run.smithi073.stderr: 1950K .......... .......... .......... .......... .......... 1% 108M 21s 2024-03-29T04:09:19.131 INFO:teuthology.orchestra.run.smithi073.stderr: 2000K .......... .......... .......... .......... .......... 1% 107M 20s 2024-03-29T04:09:19.131 INFO:teuthology.orchestra.run.smithi073.stderr: 2050K .......... .......... .......... .......... .......... 1% 108M 20s 2024-03-29T04:09:19.131 INFO:teuthology.orchestra.run.smithi073.stderr: 2100K .......... .......... .......... .......... .......... 1% 28.4M 19s 2024-03-29T04:09:19.131 INFO:teuthology.orchestra.run.smithi073.stderr: 2150K .......... .......... .......... .......... .......... 1% 35.2M 19s 2024-03-29T04:09:19.131 INFO:teuthology.orchestra.run.smithi073.stderr: 2200K .......... .......... .......... .......... .......... 1% 24.6M 19s 2024-03-29T04:09:19.131 INFO:teuthology.orchestra.run.smithi073.stderr: 2250K .......... .......... .......... .......... .......... 1% 23.7M 19s 2024-03-29T04:09:19.131 INFO:teuthology.orchestra.run.smithi073.stderr: 2300K .......... .......... .......... .......... .......... 1% 53.1M 18s 2024-03-29T04:09:19.131 INFO:teuthology.orchestra.run.smithi073.stderr: 2350K .......... .......... .......... .......... .......... 1% 24.6M 18s 2024-03-29T04:09:19.131 INFO:teuthology.orchestra.run.smithi073.stderr: 2400K .......... .......... .......... .......... .......... 1% 31.8M 18s 2024-03-29T04:09:19.132 INFO:teuthology.orchestra.run.smithi073.stderr: 2450K .......... .......... .......... .......... .......... 1% 24.4M 17s 2024-03-29T04:09:19.132 INFO:teuthology.orchestra.run.smithi073.stderr: 2500K .......... .......... .......... .......... .......... 1% 23.8M 17s 2024-03-29T04:09:19.132 INFO:teuthology.orchestra.run.smithi073.stderr: 2550K .......... .......... .......... .......... .......... 1% 61.5M 17s 2024-03-29T04:09:19.132 INFO:teuthology.orchestra.run.smithi073.stderr: 2600K .......... .......... .......... .......... .......... 1% 24.4M 17s 2024-03-29T04:09:19.132 INFO:teuthology.orchestra.run.smithi073.stderr: 2650K .......... .......... .......... .......... .......... 1% 23.6M 17s 2024-03-29T04:09:19.132 INFO:teuthology.orchestra.run.smithi073.stderr: 2700K .......... .......... .......... .......... .......... 1% 37.7M 16s 2024-03-29T04:09:19.132 INFO:teuthology.orchestra.run.smithi073.stderr: 2750K .......... .......... .......... .......... .......... 1% 23.7M 16s 2024-03-29T04:09:19.132 INFO:teuthology.orchestra.run.smithi073.stderr: 2800K .......... .......... .......... .......... .......... 1% 48.7M 16s 2024-03-29T04:09:19.132 INFO:teuthology.orchestra.run.smithi073.stderr: 2850K .......... .......... .......... .......... .......... 1% 24.4M 16s 2024-03-29T04:09:19.132 INFO:teuthology.orchestra.run.smithi073.stderr: 2900K .......... .......... .......... .......... .......... 1% 28.2M 16s 2024-03-29T04:09:19.132 INFO:teuthology.orchestra.run.smithi073.stderr: 2950K .......... .......... .......... .......... .......... 1% 31.8M 15s 2024-03-29T04:09:19.132 INFO:teuthology.orchestra.run.smithi073.stderr: 3000K .......... .......... .......... .......... .......... 1% 25.2M 15s 2024-03-29T04:09:19.133 INFO:teuthology.orchestra.run.smithi073.stderr: 3050K .......... .......... .......... .......... .......... 1% 43.2M 15s 2024-03-29T04:09:19.133 INFO:teuthology.orchestra.run.smithi073.stderr: 3100K .......... .......... .......... .......... .......... 1% 24.8M 15s 2024-03-29T04:09:19.133 INFO:teuthology.orchestra.run.smithi073.stderr: 3150K .......... .......... .......... .......... .......... 1% 28.2M 15s 2024-03-29T04:09:19.133 INFO:teuthology.orchestra.run.smithi073.stderr: 3200K .......... .......... .......... .......... .......... 1% 24.7M 15s 2024-03-29T04:09:19.133 INFO:teuthology.orchestra.run.smithi073.stderr: 3250K .......... .......... .......... .......... .......... 1% 24.4M 15s 2024-03-29T04:09:19.133 INFO:teuthology.orchestra.run.smithi073.stderr: 3300K .......... .......... .......... .......... .......... 1% 70.8M 14s 2024-03-29T04:09:19.133 INFO:teuthology.orchestra.run.smithi073.stderr: 3350K .......... .......... .......... .......... .......... 2% 24.4M 14s 2024-03-29T04:09:19.133 INFO:teuthology.orchestra.run.smithi073.stderr: 3400K .......... .......... .......... .......... .......... 2% 28.3M 14s 2024-03-29T04:09:19.133 INFO:teuthology.orchestra.run.smithi073.stderr: 3450K .......... .......... .......... .......... .......... 2% 25.6M 14s 2024-03-29T04:09:19.133 INFO:teuthology.orchestra.run.smithi073.stderr: 3500K .......... .......... .......... .......... .......... 2% 40.9M 14s 2024-03-29T04:09:19.133 INFO:teuthology.orchestra.run.smithi073.stderr: 3550K .......... .......... .......... .......... .......... 2% 25.8M 14s 2024-03-29T04:09:19.133 INFO:teuthology.orchestra.run.smithi073.stderr: 3600K .......... .......... .......... .......... .......... 2% 31.5M 14s 2024-03-29T04:09:19.133 INFO:teuthology.orchestra.run.smithi073.stderr: 3650K .......... .......... .......... .......... .......... 2% 23.3M 14s 2024-03-29T04:09:19.134 INFO:teuthology.orchestra.run.smithi073.stderr: 3700K .......... .......... .......... .......... .......... 2% 25.5M 13s 2024-03-29T04:09:19.134 INFO:teuthology.orchestra.run.smithi073.stderr: 3750K .......... .......... .......... .......... .......... 2% 44.9M 13s 2024-03-29T04:09:19.134 INFO:teuthology.orchestra.run.smithi073.stderr: 3800K .......... .......... .......... .......... .......... 2% 23.4M 13s 2024-03-29T04:09:19.134 INFO:teuthology.orchestra.run.smithi073.stderr: 3850K .......... .......... .......... .......... .......... 2% 36.9M 13s 2024-03-29T04:09:19.134 INFO:teuthology.orchestra.run.smithi073.stderr: 3900K .......... .......... .......... .......... .......... 2% 23.2M 13s 2024-03-29T04:09:19.134 INFO:teuthology.orchestra.run.smithi073.stderr: 3950K .......... .......... .......... .......... .......... 2% 41.8M 13s 2024-03-29T04:09:19.134 INFO:teuthology.orchestra.run.smithi073.stderr: 4000K .......... .......... .......... .......... .......... 2% 24.5M 13s 2024-03-29T04:09:19.134 INFO:teuthology.orchestra.run.smithi073.stderr: 4050K .......... .......... .......... .......... .......... 2% 27.5M 13s 2024-03-29T04:09:19.134 INFO:teuthology.orchestra.run.smithi073.stderr: 4100K .......... .......... .......... .......... .......... 2% 38.9M 13s 2024-03-29T04:09:19.134 INFO:teuthology.orchestra.run.smithi073.stderr: 4150K .......... .......... .......... .......... .......... 2% 30.6M 13s 2024-03-29T04:09:19.134 INFO:teuthology.orchestra.run.smithi073.stderr: 4200K .......... .......... .......... .......... .......... 2% 28.3M 12s 2024-03-29T04:09:19.134 INFO:teuthology.orchestra.run.smithi073.stderr: 4250K .......... .......... .......... .......... .......... 2% 24.8M 12s 2024-03-29T04:09:19.135 INFO:teuthology.orchestra.run.smithi073.stderr: 4300K .......... .......... .......... .......... .......... 2% 24.4M 12s 2024-03-29T04:09:19.135 INFO:teuthology.orchestra.run.smithi073.stderr: 4350K .......... .......... .......... .......... .......... 2% 47.6M 12s 2024-03-29T04:09:19.135 INFO:teuthology.orchestra.run.smithi073.stderr: 4400K .......... .......... .......... .......... .......... 2% 26.6M 12s 2024-03-29T04:09:19.135 INFO:teuthology.orchestra.run.smithi073.stderr: 4450K .......... .......... .......... .......... .......... 2% 29.2M 12s 2024-03-29T04:09:19.135 INFO:teuthology.orchestra.run.smithi073.stderr: 4500K .......... .......... .......... .......... .......... 2% 22.1M 12s 2024-03-29T04:09:19.135 INFO:teuthology.orchestra.run.smithi073.stderr: 4550K .......... .......... .......... .......... .......... 2% 25.0M 12s 2024-03-29T04:09:19.135 INFO:teuthology.orchestra.run.smithi073.stderr: 4600K .......... .......... .......... .......... .......... 2% 62.4M 12s 2024-03-29T04:09:19.135 INFO:teuthology.orchestra.run.smithi073.stderr: 4650K .......... .......... .......... .......... .......... 2% 30.5M 12s 2024-03-29T04:09:19.135 INFO:teuthology.orchestra.run.smithi073.stderr: 4700K .......... .......... .......... .......... .......... 2% 23.9M 12s 2024-03-29T04:09:19.135 INFO:teuthology.orchestra.run.smithi073.stderr: 4750K .......... .......... .......... .......... .......... 2% 24.4M 12s 2024-03-29T04:09:19.135 INFO:teuthology.orchestra.run.smithi073.stderr: 4800K .......... .......... .......... .......... .......... 2% 58.0M 12s 2024-03-29T04:09:19.135 INFO:teuthology.orchestra.run.smithi073.stderr: 4850K .......... .......... .......... .......... .......... 2% 26.8M 11s 2024-03-29T04:09:19.135 INFO:teuthology.orchestra.run.smithi073.stderr: 4900K .......... .......... .......... .......... .......... 2% 25.4M 11s 2024-03-29T04:09:19.136 INFO:teuthology.orchestra.run.smithi073.stderr: 4950K .......... .......... .......... .......... .......... 2% 34.9M 11s 2024-03-29T04:09:19.136 INFO:teuthology.orchestra.run.smithi073.stderr: 5000K .......... .......... .......... .......... .......... 2% 22.8M 11s 2024-03-29T04:09:19.136 INFO:teuthology.orchestra.run.smithi073.stderr: 5050K .......... .......... .......... .......... .......... 3% 24.3M 11s 2024-03-29T04:09:19.136 INFO:teuthology.orchestra.run.smithi073.stderr: 5100K .......... .......... .......... .......... .......... 3% 56.6M 11s 2024-03-29T04:09:19.136 INFO:teuthology.orchestra.run.smithi073.stderr: 5150K .......... .......... .......... .......... .......... 3% 30.7M 11s 2024-03-29T04:09:19.136 INFO:teuthology.orchestra.run.smithi073.stderr: 5200K .......... .......... .......... .......... .......... 3% 26.7M 11s 2024-03-29T04:09:19.136 INFO:teuthology.orchestra.run.smithi073.stderr: 5250K .......... .......... .......... .......... .......... 3% 23.4M 11s 2024-03-29T04:09:19.136 INFO:teuthology.orchestra.run.smithi073.stderr: 5300K .......... .......... .......... .......... .......... 3% 24.5M 11s 2024-03-29T04:09:19.136 INFO:teuthology.orchestra.run.smithi073.stderr: 5350K .......... .......... .......... .......... .......... 3% 50.1M 11s 2024-03-29T04:09:19.136 INFO:teuthology.orchestra.run.smithi073.stderr: 5400K .......... .......... .......... .......... .......... 3% 24.9M 11s 2024-03-29T04:09:19.136 INFO:teuthology.orchestra.run.smithi073.stderr: 5450K .......... .......... .......... .......... .......... 3% 33.4M 11s 2024-03-29T04:09:19.137 INFO:teuthology.orchestra.run.smithi073.stderr: 5500K .......... .......... .......... .......... .......... 3% 24.7M 11s 2024-03-29T04:09:19.137 INFO:teuthology.orchestra.run.smithi073.stderr: 5550K .......... .......... .......... .......... .......... 3% 29.4M 11s 2024-03-29T04:09:19.137 INFO:teuthology.orchestra.run.smithi073.stderr: 5600K .......... .......... .......... .......... .......... 3% 40.0M 11s 2024-03-29T04:09:19.137 INFO:teuthology.orchestra.run.smithi073.stderr: 5650K .......... .......... .......... .......... .......... 3% 26.8M 11s 2024-03-29T04:09:19.137 INFO:teuthology.orchestra.run.smithi073.stderr: 5700K .......... .......... .......... .......... .......... 3% 28.2M 11s 2024-03-29T04:09:19.137 INFO:teuthology.orchestra.run.smithi073.stderr: 5750K .......... .......... .......... .......... .......... 3% 24.9M 10s 2024-03-29T04:09:19.137 INFO:teuthology.orchestra.run.smithi073.stderr: 5800K .......... .......... .......... .......... .......... 3% 24.5M 10s 2024-03-29T04:09:19.137 INFO:teuthology.orchestra.run.smithi073.stderr: 5850K .......... .......... .......... .......... .......... 3% 52.2M 10s 2024-03-29T04:09:19.137 INFO:teuthology.orchestra.run.smithi073.stderr: 5900K .......... .......... .......... .......... .......... 3% 24.8M 10s 2024-03-29T04:09:19.137 INFO:teuthology.orchestra.run.smithi073.stderr: 5950K .......... .......... .......... .......... .......... 3% 33.2M 10s 2024-03-29T04:09:19.137 INFO:teuthology.orchestra.run.smithi073.stderr: 6000K .......... .......... .......... .......... .......... 3% 23.7M 10s 2024-03-29T04:09:19.137 INFO:teuthology.orchestra.run.smithi073.stderr: 6050K .......... .......... .......... .......... .......... 3% 24.0M 10s 2024-03-29T04:09:19.137 INFO:teuthology.orchestra.run.smithi073.stderr: 6100K .......... .......... .......... .......... .......... 3% 63.2M 10s 2024-03-29T04:09:19.138 INFO:teuthology.orchestra.run.smithi073.stderr: 6150K .......... .......... .......... .......... .......... 3% 27.1M 10s 2024-03-29T04:09:19.138 INFO:teuthology.orchestra.run.smithi073.stderr: 6200K .......... .......... .......... .......... .......... 3% 22.7M 10s 2024-03-29T04:09:19.138 INFO:teuthology.orchestra.run.smithi073.stderr: 6250K .......... .......... .......... .......... .......... 3% 41.5M 10s 2024-03-29T04:09:19.138 INFO:teuthology.orchestra.run.smithi073.stderr: 6300K .......... .......... .......... .......... .......... 3% 23.5M 10s 2024-03-29T04:09:19.138 INFO:teuthology.orchestra.run.smithi073.stderr: 6350K .......... .......... .......... .......... .......... 3% 37.8M 10s 2024-03-29T04:09:19.138 INFO:teuthology.orchestra.run.smithi073.stderr: 6400K .......... .......... .......... .......... .......... 3% 25.3M 10s 2024-03-29T04:09:19.138 INFO:teuthology.orchestra.run.smithi073.stderr: 6450K .......... .......... .......... .......... .......... 3% 26.1M 10s 2024-03-29T04:09:19.138 INFO:teuthology.orchestra.run.smithi073.stderr: 6500K .......... .......... .......... .......... .......... 3% 37.8M 10s 2024-03-29T04:09:19.138 INFO:teuthology.orchestra.run.smithi073.stderr: 6550K .......... .......... .......... .......... .......... 3% 23.6M 10s 2024-03-29T04:09:19.138 INFO:teuthology.orchestra.run.smithi073.stderr: 6600K .......... .......... .......... .......... .......... 3% 41.0M 10s 2024-03-29T04:09:19.138 INFO:teuthology.orchestra.run.smithi073.stderr: 6650K .......... .......... .......... .......... .......... 3% 25.1M 10s 2024-03-29T04:09:19.138 INFO:teuthology.orchestra.run.smithi073.stderr: 6700K .......... .......... .......... .......... .......... 4% 34.1M 10s 2024-03-29T04:09:19.139 INFO:teuthology.orchestra.run.smithi073.stderr: 6750K .......... .......... .......... .......... .......... 4% 24.9M 10s 2024-03-29T04:09:19.139 INFO:teuthology.orchestra.run.smithi073.stderr: 6800K .......... .......... .......... .......... .......... 4% 24.5M 10s 2024-03-29T04:09:19.139 INFO:teuthology.orchestra.run.smithi073.stderr: 6850K .......... .......... .......... .......... .......... 4% 53.7M 10s 2024-03-29T04:09:19.139 INFO:teuthology.orchestra.run.smithi073.stderr: 6900K .......... .......... .......... .......... .......... 4% 23.8M 10s 2024-03-29T04:09:19.139 INFO:teuthology.orchestra.run.smithi073.stderr: 6950K .......... .......... .......... .......... .......... 4% 27.9M 10s 2024-03-29T04:09:19.139 INFO:teuthology.orchestra.run.smithi073.stderr: 7000K .......... .......... .......... .......... .......... 4% 12.1M 10s 2024-03-29T04:09:19.139 INFO:teuthology.orchestra.run.smithi073.stderr: 7050K .......... .......... .......... .......... .......... 4% 55.0M 10s 2024-03-29T04:09:19.139 INFO:teuthology.orchestra.run.smithi073.stderr: 7100K .......... .......... .......... .......... .......... 4% 120M 9s 2024-03-29T04:09:19.139 INFO:teuthology.orchestra.run.smithi073.stderr: 7150K .......... .......... .......... .......... .......... 4% 39.1M 9s 2024-03-29T04:09:19.139 INFO:teuthology.orchestra.run.smithi073.stderr: 7200K .......... .......... .......... .......... .......... 4% 32.7M 9s 2024-03-29T04:09:19.139 INFO:teuthology.orchestra.run.smithi073.stderr: 7250K .......... .......... .......... .......... .......... 4% 24.4M 9s 2024-03-29T04:09:19.139 INFO:teuthology.orchestra.run.smithi073.stderr: 7300K .......... .......... .......... .......... .......... 4% 20.0M 9s 2024-03-29T04:09:19.140 INFO:teuthology.orchestra.run.smithi073.stderr: 7350K .......... .......... .......... .......... .......... 4% 105M 9s 2024-03-29T04:09:19.140 INFO:teuthology.orchestra.run.smithi073.stderr: 7400K .......... .......... .......... .......... .......... 4% 24.8M 9s 2024-03-29T04:09:19.140 INFO:teuthology.orchestra.run.smithi073.stderr: 7450K .......... .......... .......... .......... .......... 4% 26.7M 9s 2024-03-29T04:09:19.140 INFO:teuthology.orchestra.run.smithi073.stderr: 7500K .......... .......... .......... .......... .......... 4% 24.1M 9s 2024-03-29T04:09:19.140 INFO:teuthology.orchestra.run.smithi073.stderr: 7550K .......... .......... .......... .......... .......... 4% 44.4M 9s 2024-03-29T04:09:19.140 INFO:teuthology.orchestra.run.smithi073.stderr: 7600K .......... .......... .......... .......... .......... 4% 33.5M 9s 2024-03-29T04:09:19.140 INFO:teuthology.orchestra.run.smithi073.stderr: 7650K .......... .......... .......... .......... .......... 4% 23.0M 9s 2024-03-29T04:09:19.140 INFO:teuthology.orchestra.run.smithi073.stderr: 7700K .......... .......... .......... .......... .......... 4% 37.0M 9s 2024-03-29T04:09:19.140 INFO:teuthology.orchestra.run.smithi073.stderr: 7750K .......... .......... .......... .......... .......... 4% 24.1M 9s 2024-03-29T04:09:19.140 INFO:teuthology.orchestra.run.smithi073.stderr: 7800K .......... .......... .......... .......... .......... 4% 24.8M 9s 2024-03-29T04:09:19.140 INFO:teuthology.orchestra.run.smithi073.stderr: 7850K .......... .......... .......... .......... .......... 4% 58.3M 9s 2024-03-29T04:09:19.140 INFO:teuthology.orchestra.run.smithi073.stderr: 7900K .......... .......... .......... .......... .......... 4% 22.7M 9s 2024-03-29T04:09:19.140 INFO:teuthology.orchestra.run.smithi073.stderr: 7950K .......... .......... .......... .......... .......... 4% 24.2M 9s 2024-03-29T04:09:19.141 INFO:teuthology.orchestra.run.smithi073.stderr: 8000K .......... .......... .......... .......... .......... 4% 34.4M 9s 2024-03-29T04:09:19.141 INFO:teuthology.orchestra.run.smithi073.stderr: 8050K .......... .......... .......... .......... .......... 4% 24.8M 9s 2024-03-29T04:09:19.141 INFO:teuthology.orchestra.run.smithi073.stderr: 8100K .......... .......... .......... .......... .......... 4% 60.1M 9s 2024-03-29T04:09:19.141 INFO:teuthology.orchestra.run.smithi073.stderr: 8150K .......... .......... .......... .......... .......... 4% 26.2M 9s 2024-03-29T04:09:19.141 INFO:teuthology.orchestra.run.smithi073.stderr: 8200K .......... .......... .......... .......... .......... 4% 22.9M 9s 2024-03-29T04:09:19.141 INFO:teuthology.orchestra.run.smithi073.stderr: 8250K .......... .......... .......... .......... .......... 4% 31.3M 9s 2024-03-29T04:09:19.141 INFO:teuthology.orchestra.run.smithi073.stderr: 8300K .......... .......... .......... .......... .......... 4% 24.7M 9s 2024-03-29T04:09:19.141 INFO:teuthology.orchestra.run.smithi073.stderr: 8350K .......... .......... .......... .......... .......... 4% 56.0M 9s 2024-03-29T04:09:19.141 INFO:teuthology.orchestra.run.smithi073.stderr: 8400K .......... .......... .......... .......... .......... 5% 21.9M 9s 2024-03-29T04:09:19.141 INFO:teuthology.orchestra.run.smithi073.stderr: 8450K .......... .......... .......... .......... .......... 5% 25.1M 9s 2024-03-29T04:09:19.141 INFO:teuthology.orchestra.run.smithi073.stderr: 8500K .......... .......... .......... .......... .......... 5% 32.8M 9s 2024-03-29T04:09:19.141 INFO:teuthology.orchestra.run.smithi073.stderr: 8550K .......... .......... .......... .......... .......... 5% 39.1M 9s 2024-03-29T04:09:19.142 INFO:teuthology.orchestra.run.smithi073.stderr: 8600K .......... .......... .......... .......... .......... 5% 32.0M 9s 2024-03-29T04:09:19.142 INFO:teuthology.orchestra.run.smithi073.stderr: 8650K .......... .......... .......... .......... .......... 5% 22.6M 9s 2024-03-29T04:09:19.142 INFO:teuthology.orchestra.run.smithi073.stderr: 8700K .......... .......... .......... .......... .......... 5% 24.9M 9s 2024-03-29T04:09:19.142 INFO:teuthology.orchestra.run.smithi073.stderr: 8750K .......... .......... .......... .......... .......... 5% 35.5M 9s 2024-03-29T04:09:19.142 INFO:teuthology.orchestra.run.smithi073.stderr: 8800K .......... .......... .......... .......... .......... 5% 20.9M 9s 2024-03-29T04:09:19.142 INFO:teuthology.orchestra.run.smithi073.stderr: 8850K .......... .......... .......... .......... .......... 5% 47.1M 9s 2024-03-29T04:09:19.142 INFO:teuthology.orchestra.run.smithi073.stderr: 8900K .......... .......... .......... .......... .......... 5% 33.9M 9s 2024-03-29T04:09:19.142 INFO:teuthology.orchestra.run.smithi073.stderr: 8950K .......... .......... .......... .......... .......... 5% 22.3M 9s 2024-03-29T04:09:19.142 INFO:teuthology.orchestra.run.smithi073.stderr: 9000K .......... .......... .......... .......... .......... 5% 45.6M 8s 2024-03-29T04:09:19.142 INFO:teuthology.orchestra.run.smithi073.stderr: 9050K .......... .......... .......... .......... .......... 5% 21.2M 8s 2024-03-29T04:09:19.142 INFO:teuthology.orchestra.run.smithi073.stderr: 9100K .......... .......... .......... .......... .......... 5% 24.7M 8s 2024-03-29T04:09:19.142 INFO:teuthology.orchestra.run.smithi073.stderr: 9150K .......... .......... .......... .......... .......... 5% 51.1M 8s 2024-03-29T04:09:19.142 INFO:teuthology.orchestra.run.smithi073.stderr: 9200K .......... .......... .......... .......... .......... 5% 29.8M 8s 2024-03-29T04:09:19.143 INFO:teuthology.orchestra.run.smithi073.stderr: 9250K .......... .......... .......... .......... .......... 5% 26.7M 8s 2024-03-29T04:09:19.143 INFO:teuthology.orchestra.run.smithi073.stderr: 9300K .......... .......... .......... .......... .......... 5% 24.9M 8s 2024-03-29T04:09:19.143 INFO:teuthology.orchestra.run.smithi073.stderr: 9350K .......... .......... .......... .......... .......... 5% 24.3M 8s 2024-03-29T04:09:19.143 INFO:teuthology.orchestra.run.smithi073.stderr: 9400K .......... .......... .......... .......... .......... 5% 57.5M 8s 2024-03-29T04:09:19.143 INFO:teuthology.orchestra.run.smithi073.stderr: 9450K .......... .......... .......... .......... .......... 5% 31.1M 8s 2024-03-29T04:09:19.143 INFO:teuthology.orchestra.run.smithi073.stderr: 9500K .......... .......... .......... .......... .......... 5% 24.9M 8s 2024-03-29T04:09:19.143 INFO:teuthology.orchestra.run.smithi073.stderr: 9550K .......... .......... .......... .......... .......... 5% 24.4M 8s 2024-03-29T04:09:19.143 INFO:teuthology.orchestra.run.smithi073.stderr: 9600K .......... .......... .......... .......... .......... 5% 24.3M 8s 2024-03-29T04:09:19.143 INFO:teuthology.orchestra.run.smithi073.stderr: 9650K .......... .......... .......... .......... .......... 5% 73.5M 8s 2024-03-29T04:09:19.143 INFO:teuthology.orchestra.run.smithi073.stderr: 9700K .......... .......... .......... .......... .......... 5% 24.0M 8s 2024-03-29T04:09:19.143 INFO:teuthology.orchestra.run.smithi073.stderr: 9750K .......... .......... .......... .......... .......... 5% 29.2M 8s 2024-03-29T04:09:19.143 INFO:teuthology.orchestra.run.smithi073.stderr: 9800K .......... .......... .......... .......... .......... 5% 20.6M 8s 2024-03-29T04:09:19.143 INFO:teuthology.orchestra.run.smithi073.stderr: 9850K .......... .......... .......... .......... .......... 5% 51.5M 8s 2024-03-29T04:09:19.144 INFO:teuthology.orchestra.run.smithi073.stderr: 9900K .......... .......... .......... .......... .......... 5% 32.1M 8s 2024-03-29T04:09:19.144 INFO:teuthology.orchestra.run.smithi073.stderr: 9950K .......... .......... .......... .......... .......... 5% 28.8M 8s 2024-03-29T04:09:19.144 INFO:teuthology.orchestra.run.smithi073.stderr: 10000K .......... .......... .......... .......... .......... 5% 24.9M 8s 2024-03-29T04:09:19.144 INFO:teuthology.orchestra.run.smithi073.stderr: 10050K .......... .......... .......... .......... .......... 5% 23.3M 8s 2024-03-29T04:09:19.144 INFO:teuthology.orchestra.run.smithi073.stderr: 10100K .......... .......... .......... .......... .......... 6% 50.7M 8s 2024-03-29T04:09:19.144 INFO:teuthology.orchestra.run.smithi073.stderr: 10150K .......... .......... .......... .......... .......... 6% 29.9M 8s 2024-03-29T04:09:19.144 INFO:teuthology.orchestra.run.smithi073.stderr: 10200K .......... .......... .......... .......... .......... 6% 25.3M 8s 2024-03-29T04:09:19.144 INFO:teuthology.orchestra.run.smithi073.stderr: 10250K .......... .......... .......... .......... .......... 6% 31.5M 8s 2024-03-29T04:09:19.144 INFO:teuthology.orchestra.run.smithi073.stderr: 10300K .......... .......... .......... .......... .......... 6% 28.4M 8s 2024-03-29T04:09:19.144 INFO:teuthology.orchestra.run.smithi073.stderr: 10350K .......... .......... .......... .......... .......... 6% 26.0M 8s 2024-03-29T04:09:19.144 INFO:teuthology.orchestra.run.smithi073.stderr: 10400K .......... .......... .......... .......... .......... 6% 33.7M 8s 2024-03-29T04:09:19.144 INFO:teuthology.orchestra.run.smithi073.stderr: 10450K .......... .......... .......... .......... .......... 6% 24.5M 8s 2024-03-29T04:09:19.145 INFO:teuthology.orchestra.run.smithi073.stderr: 10500K .......... .......... .......... .......... .......... 6% 36.6M 8s 2024-03-29T04:09:19.145 INFO:teuthology.orchestra.run.smithi073.stderr: 10550K .......... .......... .......... .......... .......... 6% 24.0M 8s 2024-03-29T04:09:19.145 INFO:teuthology.orchestra.run.smithi073.stderr: 10600K .......... .......... .......... .......... .......... 6% 24.7M 8s 2024-03-29T04:09:19.145 INFO:teuthology.orchestra.run.smithi073.stderr: 10650K .......... .......... .......... .......... .......... 6% 49.3M 8s 2024-03-29T04:09:19.145 INFO:teuthology.orchestra.run.smithi073.stderr: 10700K .......... .......... .......... .......... .......... 6% 24.8M 8s 2024-03-29T04:09:19.145 INFO:teuthology.orchestra.run.smithi073.stderr: 10750K .......... .......... .......... .......... .......... 6% 30.0M 8s 2024-03-29T04:09:19.145 INFO:teuthology.orchestra.run.smithi073.stderr: 10800K .......... .......... .......... .......... .......... 6% 27.1M 8s 2024-03-29T04:09:19.145 INFO:teuthology.orchestra.run.smithi073.stderr: 10850K .......... .......... .......... .......... .......... 6% 24.2M 8s 2024-03-29T04:09:19.145 INFO:teuthology.orchestra.run.smithi073.stderr: 10900K .......... .......... .......... .......... .......... 6% 59.3M 8s 2024-03-29T04:09:19.145 INFO:teuthology.orchestra.run.smithi073.stderr: 10950K .......... .......... .......... .......... .......... 6% 25.7M 8s 2024-03-29T04:09:19.145 INFO:teuthology.orchestra.run.smithi073.stderr: 11000K .......... .......... .......... .......... .......... 6% 28.3M 8s 2024-03-29T04:09:19.145 INFO:teuthology.orchestra.run.smithi073.stderr: 11050K .......... .......... .......... .......... .......... 6% 24.4M 8s 2024-03-29T04:09:19.145 INFO:teuthology.orchestra.run.smithi073.stderr: 11100K .......... .......... .......... .......... .......... 6% 24.6M 8s 2024-03-29T04:09:19.146 INFO:teuthology.orchestra.run.smithi073.stderr: 11150K .......... .......... .......... .......... .......... 6% 50.8M 8s 2024-03-29T04:09:19.146 INFO:teuthology.orchestra.run.smithi073.stderr: 11200K .......... .......... .......... .......... .......... 6% 24.7M 8s 2024-03-29T04:09:19.146 INFO:teuthology.orchestra.run.smithi073.stderr: 11250K .......... .......... .......... .......... .......... 6% 31.3M 8s 2024-03-29T04:09:19.146 INFO:teuthology.orchestra.run.smithi073.stderr: 11300K .......... .......... .......... .......... .......... 6% 24.2M 8s 2024-03-29T04:09:19.146 INFO:teuthology.orchestra.run.smithi073.stderr: 11350K .......... .......... .......... .......... .......... 6% 48.6M 8s 2024-03-29T04:09:19.146 INFO:teuthology.orchestra.run.smithi073.stderr: 11400K .......... .......... .......... .......... .......... 6% 28.7M 8s 2024-03-29T04:09:19.146 INFO:teuthology.orchestra.run.smithi073.stderr: 11450K .......... .......... .......... .......... .......... 6% 25.6M 8s 2024-03-29T04:09:19.146 INFO:teuthology.orchestra.run.smithi073.stderr: 11500K .......... .......... .......... .......... .......... 6% 24.3M 8s 2024-03-29T04:09:19.146 INFO:teuthology.orchestra.run.smithi073.stderr: 11550K .......... .......... .......... .......... .......... 6% 28.7M 8s 2024-03-29T04:09:19.146 INFO:teuthology.orchestra.run.smithi073.stderr: 11600K .......... .......... .......... .......... .......... 6% 23.5M 8s 2024-03-29T04:09:19.146 INFO:teuthology.orchestra.run.smithi073.stderr: 11650K .......... .......... .......... .......... .......... 6% 51.1M 8s 2024-03-29T04:09:19.146 INFO:teuthology.orchestra.run.smithi073.stderr: 11700K .......... .......... .......... .......... .......... 6% 22.9M 8s 2024-03-29T04:09:19.146 INFO:teuthology.orchestra.run.smithi073.stderr: 11750K .......... .......... .......... .......... .......... 7% 35.3M 8s 2024-03-29T04:09:19.147 INFO:teuthology.orchestra.run.smithi073.stderr: 11800K .......... .......... .......... .......... .......... 7% 24.9M 8s 2024-03-29T04:09:19.147 INFO:teuthology.orchestra.run.smithi073.stderr: 11850K .......... .......... .......... .......... .......... 7% 24.4M 8s 2024-03-29T04:09:19.147 INFO:teuthology.orchestra.run.smithi073.stderr: 11900K .......... .......... .......... .......... .......... 7% 56.6M 8s 2024-03-29T04:09:19.147 INFO:teuthology.orchestra.run.smithi073.stderr: 11950K .......... .......... .......... .......... .......... 7% 27.4M 8s 2024-03-29T04:09:19.147 INFO:teuthology.orchestra.run.smithi073.stderr: 12000K .......... .......... .......... .......... .......... 7% 27.9M 8s 2024-03-29T04:09:19.147 INFO:teuthology.orchestra.run.smithi073.stderr: 12050K .......... .......... .......... .......... .......... 7% 24.8M 8s 2024-03-29T04:09:19.147 INFO:teuthology.orchestra.run.smithi073.stderr: 12100K .......... .......... .......... .......... .......... 7% 28.9M 8s 2024-03-29T04:09:19.147 INFO:teuthology.orchestra.run.smithi073.stderr: 12150K .......... .......... .......... .......... .......... 7% 35.6M 8s 2024-03-29T04:09:19.147 INFO:teuthology.orchestra.run.smithi073.stderr: 12200K .......... .......... .......... .......... .......... 7% 30.0M 8s 2024-03-29T04:09:19.147 INFO:teuthology.orchestra.run.smithi073.stderr: 12250K .......... .......... .......... .......... .......... 7% 29.2M 8s 2024-03-29T04:09:19.147 INFO:teuthology.orchestra.run.smithi073.stderr: 12300K .......... .......... .......... .......... .......... 7% 24.1M 8s 2024-03-29T04:09:19.147 INFO:teuthology.orchestra.run.smithi073.stderr: 12350K .......... .......... .......... .......... .......... 7% 24.7M 8s 2024-03-29T04:09:19.148 INFO:teuthology.orchestra.run.smithi073.stderr: 12400K .......... .......... .......... .......... .......... 7% 52.0M 7s 2024-03-29T04:09:19.148 INFO:teuthology.orchestra.run.smithi073.stderr: 12450K .......... .......... .......... .......... .......... 7% 24.0M 7s 2024-03-29T04:09:19.148 INFO:teuthology.orchestra.run.smithi073.stderr: 12500K .......... .......... .......... .......... .......... 7% 34.3M 7s 2024-03-29T04:09:19.148 INFO:teuthology.orchestra.run.smithi073.stderr: 12550K .......... .......... .......... .......... .......... 7% 21.0M 7s 2024-03-29T04:09:19.148 INFO:teuthology.orchestra.run.smithi073.stderr: 12600K .......... .......... .......... .......... .......... 7% 26.8M 7s 2024-03-29T04:09:19.148 INFO:teuthology.orchestra.run.smithi073.stderr: 12650K .......... .......... .......... .......... .......... 7% 65.2M 7s 2024-03-29T04:09:19.148 INFO:teuthology.orchestra.run.smithi073.stderr: 12700K .......... .......... .......... .......... .......... 7% 25.0M 7s 2024-03-29T04:09:19.148 INFO:teuthology.orchestra.run.smithi073.stderr: 12750K .......... .......... .......... .......... .......... 7% 26.0M 7s 2024-03-29T04:09:19.148 INFO:teuthology.orchestra.run.smithi073.stderr: 12800K .......... .......... .......... .......... .......... 7% 41.9M 7s 2024-03-29T04:09:19.148 INFO:teuthology.orchestra.run.smithi073.stderr: 12850K .......... .......... .......... .......... .......... 7% 25.2M 7s 2024-03-29T04:09:19.148 INFO:teuthology.orchestra.run.smithi073.stderr: 12900K .......... .......... .......... .......... .......... 7% 32.8M 7s 2024-03-29T04:09:19.148 INFO:teuthology.orchestra.run.smithi073.stderr: 12950K .......... .......... .......... .......... .......... 7% 24.9M 7s 2024-03-29T04:09:19.149 INFO:teuthology.orchestra.run.smithi073.stderr: 13000K .......... .......... .......... .......... .......... 7% 23.9M 7s 2024-03-29T04:09:19.149 INFO:teuthology.orchestra.run.smithi073.stderr: 13050K .......... .......... .......... .......... .......... 7% 39.2M 7s 2024-03-29T04:09:19.149 INFO:teuthology.orchestra.run.smithi073.stderr: 13100K .......... .......... .......... .......... .......... 7% 23.0M 7s 2024-03-29T04:09:19.149 INFO:teuthology.orchestra.run.smithi073.stderr: 13150K .......... .......... .......... .......... .......... 7% 48.9M 7s 2024-03-29T04:09:19.149 INFO:teuthology.orchestra.run.smithi073.stderr: 13200K .......... .......... .......... .......... .......... 7% 31.9M 7s 2024-03-29T04:09:19.149 INFO:teuthology.orchestra.run.smithi073.stderr: 13250K .......... .......... .......... .......... .......... 7% 25.5M 7s 2024-03-29T04:09:19.149 INFO:teuthology.orchestra.run.smithi073.stderr: 13300K .......... .......... .......... .......... .......... 7% 25.1M 7s 2024-03-29T04:09:19.149 INFO:teuthology.orchestra.run.smithi073.stderr: 13350K .......... .......... .......... .......... .......... 7% 24.4M 7s 2024-03-29T04:09:19.149 INFO:teuthology.orchestra.run.smithi073.stderr: 13400K .......... .......... .......... .......... .......... 7% 51.8M 7s 2024-03-29T04:09:19.149 INFO:teuthology.orchestra.run.smithi073.stderr: 13450K .......... .......... .......... .......... .......... 8% 25.3M 7s 2024-03-29T04:09:19.149 INFO:teuthology.orchestra.run.smithi073.stderr: 13500K .......... .......... .......... .......... .......... 8% 32.4M 7s 2024-03-29T04:09:19.149 INFO:teuthology.orchestra.run.smithi073.stderr: 13550K .......... .......... .......... .......... .......... 8% 20.7M 7s 2024-03-29T04:09:19.150 INFO:teuthology.orchestra.run.smithi073.stderr: 13600K .......... .......... .......... .......... .......... 8% 30.1M 7s 2024-03-29T04:09:19.150 INFO:teuthology.orchestra.run.smithi073.stderr: 13650K .......... .......... .......... .......... .......... 8% 59.5M 7s 2024-03-29T04:09:19.150 INFO:teuthology.orchestra.run.smithi073.stderr: 13700K .......... .......... .......... .......... .......... 8% 22.7M 7s 2024-03-29T04:09:19.150 INFO:teuthology.orchestra.run.smithi073.stderr: 13750K .......... .......... .......... .......... .......... 8% 24.8M 7s 2024-03-29T04:09:19.150 INFO:teuthology.orchestra.run.smithi073.stderr: 13800K .......... .......... .......... .......... .......... 8% 33.2M 7s 2024-03-29T04:09:19.150 INFO:teuthology.orchestra.run.smithi073.stderr: 13850K .......... .......... .......... .......... .......... 8% 24.8M 7s 2024-03-29T04:09:19.150 INFO:teuthology.orchestra.run.smithi073.stderr: 13900K .......... .......... .......... .......... .......... 8% 51.3M 7s 2024-03-29T04:09:19.150 INFO:teuthology.orchestra.run.smithi073.stderr: 13950K .......... .......... .......... .......... .......... 8% 25.9M 7s 2024-03-29T04:09:19.150 INFO:teuthology.orchestra.run.smithi073.stderr: 14000K .......... .......... .......... .......... .......... 8% 23.5M 7s 2024-03-29T04:09:19.150 INFO:teuthology.orchestra.run.smithi073.stderr: 14050K .......... .......... .......... .......... .......... 8% 24.4M 7s 2024-03-29T04:09:19.150 INFO:teuthology.orchestra.run.smithi073.stderr: 14100K .......... .......... .......... .......... .......... 8% 65.9M 7s 2024-03-29T04:09:19.150 INFO:teuthology.orchestra.run.smithi073.stderr: 14150K .......... .......... .......... .......... .......... 8% 18.7M 7s 2024-03-29T04:09:19.151 INFO:teuthology.orchestra.run.smithi073.stderr: 14200K .......... .......... .......... .......... .......... 8% 46.6M 7s 2024-03-29T04:09:19.151 INFO:teuthology.orchestra.run.smithi073.stderr: 14250K .......... .......... .......... .......... .......... 8% 24.4M 7s 2024-03-29T04:09:19.151 INFO:teuthology.orchestra.run.smithi073.stderr: 14300K .......... .......... .......... .......... .......... 8% 23.8M 7s 2024-03-29T04:09:19.151 INFO:teuthology.orchestra.run.smithi073.stderr: 14350K .......... .......... .......... .......... .......... 8% 45.1M 7s 2024-03-29T04:09:19.151 INFO:teuthology.orchestra.run.smithi073.stderr: 14400K .......... .......... .......... .......... .......... 8% 23.4M 7s 2024-03-29T04:09:19.151 INFO:teuthology.orchestra.run.smithi073.stderr: 14450K .......... .......... .......... .......... .......... 8% 44.4M 7s 2024-03-29T04:09:19.151 INFO:teuthology.orchestra.run.smithi073.stderr: 14500K .......... .......... .......... .......... .......... 8% 32.4M 7s 2024-03-29T04:09:19.151 INFO:teuthology.orchestra.run.smithi073.stderr: 14550K .......... .......... .......... .......... .......... 8% 24.7M 7s 2024-03-29T04:09:19.151 INFO:teuthology.orchestra.run.smithi073.stderr: 14600K .......... .......... .......... .......... .......... 8% 24.3M 7s 2024-03-29T04:09:19.151 INFO:teuthology.orchestra.run.smithi073.stderr: 14650K .......... .......... .......... .......... .......... 8% 24.9M 7s 2024-03-29T04:09:19.151 INFO:teuthology.orchestra.run.smithi073.stderr: 14700K .......... .......... .......... .......... .......... 8% 49.6M 7s 2024-03-29T04:09:19.151 INFO:teuthology.orchestra.run.smithi073.stderr: 14750K .......... .......... .......... .......... .......... 8% 29.8M 7s 2024-03-29T04:09:19.152 INFO:teuthology.orchestra.run.smithi073.stderr: 14800K .......... .......... .......... .......... .......... 8% 24.9M 7s 2024-03-29T04:09:19.152 INFO:teuthology.orchestra.run.smithi073.stderr: 14850K .......... .......... .......... .......... .......... 8% 24.1M 7s 2024-03-29T04:09:19.152 INFO:teuthology.orchestra.run.smithi073.stderr: 14900K .......... .......... .......... .......... .......... 8% 40.7M 7s 2024-03-29T04:09:19.152 INFO:teuthology.orchestra.run.smithi073.stderr: 14950K .......... .......... .......... .......... .......... 8% 34.1M 7s 2024-03-29T04:09:19.152 INFO:teuthology.orchestra.run.smithi073.stderr: 15000K .......... .......... .......... .......... .......... 8% 24.3M 7s 2024-03-29T04:09:19.152 INFO:teuthology.orchestra.run.smithi073.stderr: 15050K .......... .......... .......... .......... .......... 8% 32.1M 7s 2024-03-29T04:09:19.152 INFO:teuthology.orchestra.run.smithi073.stderr: 15100K .......... .......... .......... .......... .......... 8% 24.6M 7s 2024-03-29T04:09:19.152 INFO:teuthology.orchestra.run.smithi073.stderr: 15150K .......... .......... .......... .......... .......... 9% 47.1M 7s 2024-03-29T04:09:19.152 INFO:teuthology.orchestra.run.smithi073.stderr: 15200K .......... .......... .......... .......... .......... 9% 26.3M 7s 2024-03-29T04:09:19.152 INFO:teuthology.orchestra.run.smithi073.stderr: 15250K .......... .......... .......... .......... .......... 9% 29.8M 7s 2024-03-29T04:09:19.152 INFO:teuthology.orchestra.run.smithi073.stderr: 15300K .......... .......... .......... .......... .......... 9% 23.3M 7s 2024-03-29T04:09:19.152 INFO:teuthology.orchestra.run.smithi073.stderr: 15350K .......... .......... .......... .......... .......... 9% 23.6M 7s 2024-03-29T04:09:19.153 INFO:teuthology.orchestra.run.smithi073.stderr: 15400K .......... .......... .......... .......... .......... 9% 46.6M 7s 2024-03-29T04:09:19.153 INFO:teuthology.orchestra.run.smithi073.stderr: 15450K .......... .......... .......... .......... .......... 9% 32.8M 7s 2024-03-29T04:09:19.153 INFO:teuthology.orchestra.run.smithi073.stderr: 15500K .......... .......... .......... .......... .......... 9% 22.6M 7s 2024-03-29T04:09:19.153 INFO:teuthology.orchestra.run.smithi073.stderr: 15550K .......... .......... .......... .......... .......... 9% 24.2M 7s 2024-03-29T04:09:19.153 INFO:teuthology.orchestra.run.smithi073.stderr: 15600K .......... .......... .......... .......... .......... 9% 47.6M 7s 2024-03-29T04:09:19.153 INFO:teuthology.orchestra.run.smithi073.stderr: 15650K .......... .......... .......... .......... .......... 9% 24.2M 7s 2024-03-29T04:09:19.153 INFO:teuthology.orchestra.run.smithi073.stderr: 15700K .......... .......... .......... .......... .......... 9% 33.8M 7s 2024-03-29T04:09:19.153 INFO:teuthology.orchestra.run.smithi073.stderr: 15750K .......... .......... .......... .......... .......... 9% 25.4M 7s 2024-03-29T04:09:19.153 INFO:teuthology.orchestra.run.smithi073.stderr: 15800K .......... .......... .......... .......... .......... 9% 34.3M 7s 2024-03-29T04:09:19.153 INFO:teuthology.orchestra.run.smithi073.stderr: 15850K .......... .......... .......... .......... .......... 9% 24.9M 7s 2024-03-29T04:09:19.153 INFO:teuthology.orchestra.run.smithi073.stderr: 15900K .......... .......... .......... .......... .......... 9% 24.3M 7s 2024-03-29T04:09:19.153 INFO:teuthology.orchestra.run.smithi073.stderr: 15950K .......... .......... .......... .......... .......... 9% 53.3M 7s 2024-03-29T04:09:19.153 INFO:teuthology.orchestra.run.smithi073.stderr: 16000K .......... .......... .......... .......... .......... 9% 23.8M 7s 2024-03-29T04:09:19.154 INFO:teuthology.orchestra.run.smithi073.stderr: 16050K .......... .......... .......... .......... .......... 9% 30.6M 7s 2024-03-29T04:09:19.154 INFO:teuthology.orchestra.run.smithi073.stderr: 16100K .......... .......... .......... .......... .......... 9% 27.4M 7s 2024-03-29T04:09:19.154 INFO:teuthology.orchestra.run.smithi073.stderr: 16150K .......... .......... .......... .......... .......... 9% 24.6M 7s 2024-03-29T04:09:19.154 INFO:teuthology.orchestra.run.smithi073.stderr: 16200K .......... .......... .......... .......... .......... 9% 48.3M 7s 2024-03-29T04:09:19.154 INFO:teuthology.orchestra.run.smithi073.stderr: 16250K .......... .......... .......... .......... .......... 9% 27.1M 7s 2024-03-29T04:09:19.154 INFO:teuthology.orchestra.run.smithi073.stderr: 16300K .......... .......... .......... .......... .......... 9% 23.4M 7s 2024-03-29T04:09:19.154 INFO:teuthology.orchestra.run.smithi073.stderr: 16350K .......... .......... .......... .......... .......... 9% 40.8M 7s 2024-03-29T04:09:19.154 INFO:teuthology.orchestra.run.smithi073.stderr: 16400K .......... .......... .......... .......... .......... 9% 20.9M 7s 2024-03-29T04:09:19.154 INFO:teuthology.orchestra.run.smithi073.stderr: 16450K .......... .......... .......... .......... .......... 9% 52.7M 7s 2024-03-29T04:09:19.154 INFO:teuthology.orchestra.run.smithi073.stderr: 16500K .......... .......... .......... .......... .......... 9% 25.1M 7s 2024-03-29T04:09:19.154 INFO:teuthology.orchestra.run.smithi073.stderr: 16550K .......... .......... .......... .......... .......... 9% 29.2M 7s 2024-03-29T04:09:19.154 INFO:teuthology.orchestra.run.smithi073.stderr: 16600K .......... .......... .......... .......... .......... 9% 23.2M 7s 2024-03-29T04:09:19.155 INFO:teuthology.orchestra.run.smithi073.stderr: 16650K .......... .......... .......... .......... .......... 9% 53.2M 7s 2024-03-29T04:09:19.155 INFO:teuthology.orchestra.run.smithi073.stderr: 16700K .......... .......... .......... .......... .......... 9% 29.2M 7s 2024-03-29T04:09:19.155 INFO:teuthology.orchestra.run.smithi073.stderr: 16750K .......... .......... .......... .......... .......... 9% 22.5M 7s 2024-03-29T04:09:19.155 INFO:teuthology.orchestra.run.smithi073.stderr: 16800K .......... .......... .......... .......... .......... 9% 24.0M 7s 2024-03-29T04:09:19.155 INFO:teuthology.orchestra.run.smithi073.stderr: 16850K .......... .......... .......... .......... .......... 10% 43.4M 7s 2024-03-29T04:09:19.155 INFO:teuthology.orchestra.run.smithi073.stderr: 16900K .......... .......... .......... .......... .......... 10% 26.5M 7s 2024-03-29T04:09:19.155 INFO:teuthology.orchestra.run.smithi073.stderr: 16950K .......... .......... .......... .......... .......... 10% 39.8M 7s 2024-03-29T04:09:19.155 INFO:teuthology.orchestra.run.smithi073.stderr: 17000K .......... .......... .......... .......... .......... 10% 22.6M 7s 2024-03-29T04:09:19.155 INFO:teuthology.orchestra.run.smithi073.stderr: 17050K .......... .......... .......... .......... .......... 10% 25.4M 7s 2024-03-29T04:09:19.155 INFO:teuthology.orchestra.run.smithi073.stderr: 17100K .......... .......... .......... .......... .......... 10% 36.7M 7s 2024-03-29T04:09:19.155 INFO:teuthology.orchestra.run.smithi073.stderr: 17150K .......... .......... .......... .......... .......... 10% 23.9M 7s 2024-03-29T04:09:19.155 INFO:teuthology.orchestra.run.smithi073.stderr: 17200K .......... .......... .......... .......... .......... 10% 53.2M 7s 2024-03-29T04:09:19.156 INFO:teuthology.orchestra.run.smithi073.stderr: 17250K .......... .......... .......... .......... .......... 10% 32.5M 7s 2024-03-29T04:09:19.156 INFO:teuthology.orchestra.run.smithi073.stderr: 17300K .......... .......... .......... .......... .......... 10% 24.3M 7s 2024-03-29T04:09:19.156 INFO:teuthology.orchestra.run.smithi073.stderr: 17350K .......... .......... .......... .......... .......... 10% 24.5M 7s 2024-03-29T04:09:19.156 INFO:teuthology.orchestra.run.smithi073.stderr: 17400K .......... .......... .......... .......... .......... 10% 24.9M 7s 2024-03-29T04:09:19.156 INFO:teuthology.orchestra.run.smithi073.stderr: 17450K .......... .......... .......... .......... .......... 10% 49.0M 7s 2024-03-29T04:09:19.156 INFO:teuthology.orchestra.run.smithi073.stderr: 17500K .......... .......... .......... .......... .......... 10% 30.8M 7s 2024-03-29T04:09:19.156 INFO:teuthology.orchestra.run.smithi073.stderr: 17550K .......... .......... .......... .......... .......... 10% 27.1M 7s 2024-03-29T04:09:19.156 INFO:teuthology.orchestra.run.smithi073.stderr: 17600K .......... .......... .......... .......... .......... 10% 20.1M 7s 2024-03-29T04:09:19.156 INFO:teuthology.orchestra.run.smithi073.stderr: 17650K .......... .......... .......... .......... .......... 10% 44.1M 7s 2024-03-29T04:09:19.156 INFO:teuthology.orchestra.run.smithi073.stderr: 17700K .......... .......... .......... .......... .......... 10% 33.0M 7s 2024-03-29T04:09:19.156 INFO:teuthology.orchestra.run.smithi073.stderr: 17750K .......... .......... .......... .......... .......... 10% 23.7M 7s 2024-03-29T04:09:19.157 INFO:teuthology.orchestra.run.smithi073.stderr: 17800K .......... .......... .......... .......... .......... 10% 23.4M 7s 2024-03-29T04:09:19.157 INFO:teuthology.orchestra.run.smithi073.stderr: 17850K .......... .......... .......... .......... .......... 10% 31.4M 7s 2024-03-29T04:09:19.157 INFO:teuthology.orchestra.run.smithi073.stderr: 17900K .......... .......... .......... .......... .......... 10% 58.7M 7s 2024-03-29T04:09:19.157 INFO:teuthology.orchestra.run.smithi073.stderr: 17950K .......... .......... .......... .......... .......... 10% 27.0M 7s 2024-03-29T04:09:19.157 INFO:teuthology.orchestra.run.smithi073.stderr: 18000K .......... .......... .......... .......... .......... 10% 26.4M 7s 2024-03-29T04:09:19.157 INFO:teuthology.orchestra.run.smithi073.stderr: 18050K .......... .......... .......... .......... .......... 10% 23.3M 7s 2024-03-29T04:09:19.157 INFO:teuthology.orchestra.run.smithi073.stderr: 18100K .......... .......... .......... .......... .......... 10% 39.2M 7s 2024-03-29T04:09:19.157 INFO:teuthology.orchestra.run.smithi073.stderr: 18150K .......... .......... .......... .......... .......... 10% 25.6M 7s 2024-03-29T04:09:19.157 INFO:teuthology.orchestra.run.smithi073.stderr: 18200K .......... .......... .......... .......... .......... 10% 34.9M 7s 2024-03-29T04:09:19.157 INFO:teuthology.orchestra.run.smithi073.stderr: 18250K .......... .......... .......... .......... .......... 10% 24.3M 7s 2024-03-29T04:09:19.157 INFO:teuthology.orchestra.run.smithi073.stderr: 18300K .......... .......... .......... .......... .......... 10% 35.6M 7s 2024-03-29T04:09:19.157 INFO:teuthology.orchestra.run.smithi073.stderr: 18350K .......... .......... .......... .......... .......... 10% 23.4M 7s 2024-03-29T04:09:19.158 INFO:teuthology.orchestra.run.smithi073.stderr: 18400K .......... .......... .......... .......... .......... 10% 26.0M 6s 2024-03-29T04:09:19.158 INFO:teuthology.orchestra.run.smithi073.stderr: 18450K .......... .......... .......... .......... .......... 10% 50.0M 6s 2024-03-29T04:09:19.158 INFO:teuthology.orchestra.run.smithi073.stderr: 18500K .......... .......... .......... .......... .......... 11% 24.6M 6s 2024-03-29T04:09:19.158 INFO:teuthology.orchestra.run.smithi073.stderr: 18550K .......... .......... .......... .......... .......... 11% 34.1M 6s 2024-03-29T04:09:19.158 INFO:teuthology.orchestra.run.smithi073.stderr: 18600K .......... .......... .......... .......... .......... 11% 24.4M 6s 2024-03-29T04:09:19.158 INFO:teuthology.orchestra.run.smithi073.stderr: 18650K .......... .......... .......... .......... .......... 11% 24.4M 6s 2024-03-29T04:09:19.158 INFO:teuthology.orchestra.run.smithi073.stderr: 18700K .......... .......... .......... .......... .......... 11% 59.5M 6s 2024-03-29T04:09:19.158 INFO:teuthology.orchestra.run.smithi073.stderr: 18750K .......... .......... .......... .......... .......... 11% 23.1M 6s 2024-03-29T04:09:19.158 INFO:teuthology.orchestra.run.smithi073.stderr: 18800K .......... .......... .......... .......... .......... 11% 34.2M 6s 2024-03-29T04:09:19.158 INFO:teuthology.orchestra.run.smithi073.stderr: 18850K .......... .......... .......... .......... .......... 11% 19.9M 6s 2024-03-29T04:09:19.158 INFO:teuthology.orchestra.run.smithi073.stderr: 18900K .......... .......... .......... .......... .......... 11% 45.8M 6s 2024-03-29T04:09:19.158 INFO:teuthology.orchestra.run.smithi073.stderr: 18950K .......... .......... .......... .......... .......... 11% 33.5M 6s 2024-03-29T04:09:19.159 INFO:teuthology.orchestra.run.smithi073.stderr: 19000K .......... .......... .......... .......... .......... 11% 24.8M 6s 2024-03-29T04:09:19.159 INFO:teuthology.orchestra.run.smithi073.stderr: 19050K .......... .......... .......... .......... .......... 11% 24.7M 6s 2024-03-29T04:09:19.159 INFO:teuthology.orchestra.run.smithi073.stderr: 19100K .......... .......... .......... .......... .......... 11% 38.4M 6s 2024-03-29T04:09:19.159 INFO:teuthology.orchestra.run.smithi073.stderr: 19150K .......... .......... .......... .......... .......... 11% 22.7M 6s 2024-03-29T04:09:19.159 INFO:teuthology.orchestra.run.smithi073.stderr: 19200K .......... .......... .......... .......... .......... 11% 50.0M 6s 2024-03-29T04:09:19.159 INFO:teuthology.orchestra.run.smithi073.stderr: 19250K .......... .......... .......... .......... .......... 11% 26.6M 6s 2024-03-29T04:09:19.159 INFO:teuthology.orchestra.run.smithi073.stderr: 19300K .......... .......... .......... .......... .......... 11% 25.5M 6s 2024-03-29T04:09:19.159 INFO:teuthology.orchestra.run.smithi073.stderr: 19350K .......... .......... .......... .......... .......... 11% 23.4M 6s 2024-03-29T04:09:19.159 INFO:teuthology.orchestra.run.smithi073.stderr: 19400K .......... .......... .......... .......... .......... 11% 48.6M 6s 2024-03-29T04:09:19.159 INFO:teuthology.orchestra.run.smithi073.stderr: 19450K .......... .......... .......... .......... .......... 11% 23.6M 6s 2024-03-29T04:09:19.159 INFO:teuthology.orchestra.run.smithi073.stderr: 19500K .......... .......... .......... .......... .......... 11% 33.6M 6s 2024-03-29T04:09:19.159 INFO:teuthology.orchestra.run.smithi073.stderr: 19550K .......... .......... .......... .......... .......... 11% 23.3M 6s 2024-03-29T04:09:19.160 INFO:teuthology.orchestra.run.smithi073.stderr: 19600K .......... .......... .......... .......... .......... 11% 37.8M 6s 2024-03-29T04:09:19.160 INFO:teuthology.orchestra.run.smithi073.stderr: 19650K .......... .......... .......... .......... .......... 11% 25.0M 6s 2024-03-29T04:09:19.160 INFO:teuthology.orchestra.run.smithi073.stderr: 19700K .......... .......... .......... .......... .......... 11% 23.8M 6s 2024-03-29T04:09:19.160 INFO:teuthology.orchestra.run.smithi073.stderr: 19750K .......... .......... .......... .......... .......... 11% 71.9M 6s 2024-03-29T04:09:19.160 INFO:teuthology.orchestra.run.smithi073.stderr: 19800K .......... .......... .......... .......... .......... 11% 22.2M 6s 2024-03-29T04:09:19.160 INFO:teuthology.orchestra.run.smithi073.stderr: 19850K .......... .......... .......... .......... .......... 11% 31.5M 6s 2024-03-29T04:09:19.160 INFO:teuthology.orchestra.run.smithi073.stderr: 19900K .......... .......... .......... .......... .......... 11% 21.9M 6s 2024-03-29T04:09:19.160 INFO:teuthology.orchestra.run.smithi073.stderr: 19950K .......... .......... .......... .......... .......... 11% 39.9M 6s 2024-03-29T04:09:19.160 INFO:teuthology.orchestra.run.smithi073.stderr: 20000K .......... .......... .......... .......... .......... 11% 37.6M 6s 2024-03-29T04:09:19.160 INFO:teuthology.orchestra.run.smithi073.stderr: 20050K .......... .......... .......... .......... .......... 11% 22.3M 6s 2024-03-29T04:09:19.160 INFO:teuthology.orchestra.run.smithi073.stderr: 20100K .......... .......... .......... .......... .......... 11% 33.5M 6s 2024-03-29T04:09:19.160 INFO:teuthology.orchestra.run.smithi073.stderr: 20150K .......... .......... .......... .......... .......... 11% 23.1M 6s 2024-03-29T04:09:19.161 INFO:teuthology.orchestra.run.smithi073.stderr: 20200K .......... .......... .......... .......... .......... 12% 48.6M 6s 2024-03-29T04:09:19.161 INFO:teuthology.orchestra.run.smithi073.stderr: 20250K .......... .......... .......... .......... .......... 12% 27.3M 6s 2024-03-29T04:09:19.161 INFO:teuthology.orchestra.run.smithi073.stderr: 20300K .......... .......... .......... .......... .......... 12% 23.3M 6s 2024-03-29T04:09:19.161 INFO:teuthology.orchestra.run.smithi073.stderr: 20350K .......... .......... .......... .......... .......... 12% 23.8M 6s 2024-03-29T04:09:19.161 INFO:teuthology.orchestra.run.smithi073.stderr: 20400K .......... .......... .......... .......... .......... 12% 42.6M 6s 2024-03-29T04:09:19.161 INFO:teuthology.orchestra.run.smithi073.stderr: 20450K .......... .......... .......... .......... .......... 12% 40.8M 6s 2024-03-29T04:09:19.161 INFO:teuthology.orchestra.run.smithi073.stderr: 20500K .......... .......... .......... .......... .......... 12% 26.1M 6s 2024-03-29T04:09:19.161 INFO:teuthology.orchestra.run.smithi073.stderr: 20550K .......... .......... .......... .......... .......... 12% 28.0M 6s 2024-03-29T04:09:19.161 INFO:teuthology.orchestra.run.smithi073.stderr: 20600K .......... .......... .......... .......... .......... 12% 23.5M 6s 2024-03-29T04:09:19.161 INFO:teuthology.orchestra.run.smithi073.stderr: 20650K .......... .......... .......... .......... .......... 12% 24.3M 6s 2024-03-29T04:09:19.161 INFO:teuthology.orchestra.run.smithi073.stderr: 20700K .......... .......... .......... .......... .......... 12% 44.2M 6s 2024-03-29T04:09:19.161 INFO:teuthology.orchestra.run.smithi073.stderr: 20750K .......... .......... .......... .......... .......... 12% 32.5M 6s 2024-03-29T04:09:19.161 INFO:teuthology.orchestra.run.smithi073.stderr: 20800K .......... .......... .......... .......... .......... 12% 23.1M 6s 2024-03-29T04:09:19.162 INFO:teuthology.orchestra.run.smithi073.stderr: 20850K .......... .......... .......... .......... .......... 12% 24.5M 6s 2024-03-29T04:09:19.162 INFO:teuthology.orchestra.run.smithi073.stderr: 20900K .......... .......... .......... .......... .......... 12% 42.5M 6s 2024-03-29T04:09:19.162 INFO:teuthology.orchestra.run.smithi073.stderr: 20950K .......... .......... .......... .......... .......... 12% 24.3M 6s 2024-03-29T04:09:19.162 INFO:teuthology.orchestra.run.smithi073.stderr: 21000K .......... .......... .......... .......... .......... 12% 40.1M 6s 2024-03-29T04:09:19.162 INFO:teuthology.orchestra.run.smithi073.stderr: 21050K .......... .......... .......... .......... .......... 12% 32.1M 6s 2024-03-29T04:09:19.162 INFO:teuthology.orchestra.run.smithi073.stderr: 21100K .......... .......... .......... .......... .......... 12% 26.9M 6s 2024-03-29T04:09:19.162 INFO:teuthology.orchestra.run.smithi073.stderr: 21150K .......... .......... .......... .......... .......... 12% 24.3M 6s 2024-03-29T04:09:19.162 INFO:teuthology.orchestra.run.smithi073.stderr: 21200K .......... .......... .......... .......... .......... 12% 24.8M 6s 2024-03-29T04:09:19.162 INFO:teuthology.orchestra.run.smithi073.stderr: 21250K .......... .......... .......... .......... .......... 12% 52.9M 6s 2024-03-29T04:09:19.162 INFO:teuthology.orchestra.run.smithi073.stderr: 21300K .......... .......... .......... .......... .......... 12% 24.0M 6s 2024-03-29T04:09:19.162 INFO:teuthology.orchestra.run.smithi073.stderr: 21350K .......... .......... .......... .......... .......... 12% 28.3M 6s 2024-03-29T04:09:19.162 INFO:teuthology.orchestra.run.smithi073.stderr: 21400K .......... .......... .......... .......... .......... 12% 28.2M 6s 2024-03-29T04:09:19.162 INFO:teuthology.orchestra.run.smithi073.stderr: 21450K .......... .......... .......... .......... .......... 12% 44.9M 6s 2024-03-29T04:09:19.163 INFO:teuthology.orchestra.run.smithi073.stderr: 21500K .......... .......... .......... .......... .......... 12% 28.0M 6s 2024-03-29T04:09:19.163 INFO:teuthology.orchestra.run.smithi073.stderr: 21550K .......... .......... .......... .......... .......... 12% 28.7M 6s 2024-03-29T04:09:19.163 INFO:teuthology.orchestra.run.smithi073.stderr: 21600K .......... .......... .......... .......... .......... 12% 22.2M 6s 2024-03-29T04:09:19.163 INFO:teuthology.orchestra.run.smithi073.stderr: 21650K .......... .......... .......... .......... .......... 12% 45.4M 6s 2024-03-29T04:09:19.163 INFO:teuthology.orchestra.run.smithi073.stderr: 21700K .......... .......... .......... .......... .......... 12% 20.5M 6s 2024-03-29T04:09:19.163 INFO:teuthology.orchestra.run.smithi073.stderr: 21750K .......... .......... .......... .......... .......... 12% 39.7M 6s 2024-03-29T04:09:19.163 INFO:teuthology.orchestra.run.smithi073.stderr: 21800K .......... .......... .......... .......... .......... 12% 25.1M 6s 2024-03-29T04:09:19.163 INFO:teuthology.orchestra.run.smithi073.stderr: 21850K .......... .......... .......... .......... .......... 12% 25.6M 6s 2024-03-29T04:09:19.163 INFO:teuthology.orchestra.run.smithi073.stderr: 21900K .......... .......... .......... .......... .......... 13% 27.1M 6s 2024-03-29T04:09:19.163 INFO:teuthology.orchestra.run.smithi073.stderr: 21950K .......... .......... .......... .......... .......... 13% 45.7M 6s 2024-03-29T04:09:19.165 INFO:teuthology.orchestra.run.smithi073.stderr: 22000K .......... .......... .......... .......... .......... 13% 30.7M 6s 2024-03-29T04:09:19.165 INFO:teuthology.orchestra.run.smithi073.stderr: 22050K .......... .......... .......... .......... .......... 13% 24.6M 6s 2024-03-29T04:09:19.165 INFO:teuthology.orchestra.run.smithi073.stderr: 22100K .......... .......... .......... .......... .......... 13% 23.6M 6s 2024-03-29T04:09:19.165 INFO:teuthology.orchestra.run.smithi073.stderr: 22150K .......... .......... .......... .......... .......... 13% 37.8M 6s 2024-03-29T04:09:19.165 INFO:teuthology.orchestra.run.smithi073.stderr: 22200K .......... .......... .......... .......... .......... 13% 25.4M 6s 2024-03-29T04:09:19.165 INFO:teuthology.orchestra.run.smithi073.stderr: 22250K .......... .......... .......... .......... .......... 13% 40.2M 6s 2024-03-29T04:09:19.166 INFO:teuthology.orchestra.run.smithi073.stderr: 22300K .......... .......... .......... .......... .......... 13% 24.2M 6s 2024-03-29T04:09:19.166 INFO:teuthology.orchestra.run.smithi073.stderr: 22350K .......... .......... .......... .......... .......... 13% 41.5M 6s 2024-03-29T04:09:19.166 INFO:teuthology.orchestra.run.smithi073.stderr: 22400K .......... .......... .......... .......... .......... 13% 22.6M 6s 2024-03-29T04:09:19.166 INFO:teuthology.orchestra.run.smithi073.stderr: 22450K .......... .......... .......... .......... .......... 13% 24.1M 6s 2024-03-29T04:09:19.166 INFO:teuthology.orchestra.run.smithi073.stderr: 22500K .......... .......... .......... .......... .......... 13% 59.5M 6s 2024-03-29T04:09:19.166 INFO:teuthology.orchestra.run.smithi073.stderr: 22550K .......... .......... .......... .......... .......... 13% 23.0M 6s 2024-03-29T04:09:19.166 INFO:teuthology.orchestra.run.smithi073.stderr: 22600K .......... .......... .......... .......... .......... 13% 25.5M 6s 2024-03-29T04:09:19.166 INFO:teuthology.orchestra.run.smithi073.stderr: 22650K .......... .......... .......... .......... .......... 13% 33.0M 6s 2024-03-29T04:09:19.166 INFO:teuthology.orchestra.run.smithi073.stderr: 22700K .......... .......... .......... .......... .......... 13% 24.3M 6s 2024-03-29T04:09:19.166 INFO:teuthology.orchestra.run.smithi073.stderr: 22750K .......... .......... .......... .......... .......... 13% 51.4M 6s 2024-03-29T04:09:19.166 INFO:teuthology.orchestra.run.smithi073.stderr: 22800K .......... .......... .......... .......... .......... 13% 23.7M 6s 2024-03-29T04:09:19.166 INFO:teuthology.orchestra.run.smithi073.stderr: 22850K .......... .......... .......... .......... .......... 13% 31.8M 6s 2024-03-29T04:09:19.166 INFO:teuthology.orchestra.run.smithi073.stderr: 22900K .......... .......... .......... .......... .......... 13% 23.1M 6s 2024-03-29T04:09:19.167 INFO:teuthology.orchestra.run.smithi073.stderr: 22950K .......... .......... .......... .......... .......... 13% 49.3M 6s 2024-03-29T04:09:19.167 INFO:teuthology.orchestra.run.smithi073.stderr: 23000K .......... .......... .......... .......... .......... 13% 31.3M 6s 2024-03-29T04:09:19.167 INFO:teuthology.orchestra.run.smithi073.stderr: 23050K .......... .......... .......... .......... .......... 13% 22.0M 6s 2024-03-29T04:09:19.167 INFO:teuthology.orchestra.run.smithi073.stderr: 23100K .......... .......... .......... .......... .......... 13% 25.3M 6s 2024-03-29T04:09:19.167 INFO:teuthology.orchestra.run.smithi073.stderr: 23150K .......... .......... .......... .......... .......... 13% 34.6M 6s 2024-03-29T04:09:19.167 INFO:teuthology.orchestra.run.smithi073.stderr: 23200K .......... .......... .......... .......... .......... 13% 24.9M 6s 2024-03-29T04:09:19.167 INFO:teuthology.orchestra.run.smithi073.stderr: 23250K .......... .......... .......... .......... .......... 13% 59.2M 6s 2024-03-29T04:09:19.167 INFO:teuthology.orchestra.run.smithi073.stderr: 23300K .......... .......... .......... .......... .......... 13% 22.1M 6s 2024-03-29T04:09:19.167 INFO:teuthology.orchestra.run.smithi073.stderr: 23350K .......... .......... .......... .......... .......... 13% 23.6M 6s 2024-03-29T04:09:19.167 INFO:teuthology.orchestra.run.smithi073.stderr: 23400K .......... .......... .......... .......... .......... 13% 25.5M 6s 2024-03-29T04:09:19.167 INFO:teuthology.orchestra.run.smithi073.stderr: 23450K .......... .......... .......... .......... .......... 13% 46.7M 6s 2024-03-29T04:09:19.167 INFO:teuthology.orchestra.run.smithi073.stderr: 23500K .......... .......... .......... .......... .......... 13% 34.0M 6s 2024-03-29T04:09:19.168 INFO:teuthology.orchestra.run.smithi073.stderr: 23550K .......... .......... .......... .......... .......... 14% 24.9M 6s 2024-03-29T04:09:19.168 INFO:teuthology.orchestra.run.smithi073.stderr: 23600K .......... .......... .......... .......... .......... 14% 24.8M 6s 2024-03-29T04:09:19.168 INFO:teuthology.orchestra.run.smithi073.stderr: 23650K .......... .......... .......... .......... .......... 14% 37.0M 6s 2024-03-29T04:09:19.168 INFO:teuthology.orchestra.run.smithi073.stderr: 23700K .......... .......... .......... .......... .......... 14% 23.5M 6s 2024-03-29T04:09:19.168 INFO:teuthology.orchestra.run.smithi073.stderr: 23750K .......... .......... .......... .......... .......... 14% 50.4M 6s 2024-03-29T04:09:19.168 INFO:teuthology.orchestra.run.smithi073.stderr: 23800K .......... .......... .......... .......... .......... 14% 29.8M 6s 2024-03-29T04:09:19.168 INFO:teuthology.orchestra.run.smithi073.stderr: 23850K .......... .......... .......... .......... .......... 14% 27.5M 6s 2024-03-29T04:09:19.168 INFO:teuthology.orchestra.run.smithi073.stderr: 23900K .......... .......... .......... .......... .......... 14% 24.1M 6s 2024-03-29T04:09:19.168 INFO:teuthology.orchestra.run.smithi073.stderr: 23950K .......... .......... .......... .......... .......... 14% 24.9M 6s 2024-03-29T04:09:19.168 INFO:teuthology.orchestra.run.smithi073.stderr: 24000K .......... .......... .......... .......... .......... 14% 50.5M 6s 2024-03-29T04:09:19.168 INFO:teuthology.orchestra.run.smithi073.stderr: 24050K .......... .......... .......... .......... .......... 14% 26.9M 6s 2024-03-29T04:09:19.168 INFO:teuthology.orchestra.run.smithi073.stderr: 24100K .......... .......... .......... .......... .......... 14% 30.3M 6s 2024-03-29T04:09:19.169 INFO:teuthology.orchestra.run.smithi073.stderr: 24150K .......... .......... .......... .......... .......... 14% 24.6M 6s 2024-03-29T04:09:19.169 INFO:teuthology.orchestra.run.smithi073.stderr: 24200K .......... .......... .......... .......... .......... 14% 38.1M 6s 2024-03-29T04:09:19.169 INFO:teuthology.orchestra.run.smithi073.stderr: 24250K .......... .......... .......... .......... .......... 14% 30.7M 6s 2024-03-29T04:09:19.169 INFO:teuthology.orchestra.run.smithi073.stderr: 24300K .......... .......... .......... .......... .......... 14% 26.4M 6s 2024-03-29T04:09:19.169 INFO:teuthology.orchestra.run.smithi073.stderr: 24350K .......... .......... .......... .......... .......... 14% 22.6M 6s 2024-03-29T04:09:19.169 INFO:teuthology.orchestra.run.smithi073.stderr: 24400K .......... .......... .......... .......... .......... 14% 37.0M 6s 2024-03-29T04:09:19.169 INFO:teuthology.orchestra.run.smithi073.stderr: 24450K .......... .......... .......... .......... .......... 14% 23.1M 6s 2024-03-29T04:09:19.169 INFO:teuthology.orchestra.run.smithi073.stderr: 24500K .......... .......... .......... .......... .......... 14% 35.7M 6s 2024-03-29T04:09:19.169 INFO:teuthology.orchestra.run.smithi073.stderr: 24550K .......... .......... .......... .......... .......... 14% 32.3M 6s 2024-03-29T04:09:19.169 INFO:teuthology.orchestra.run.smithi073.stderr: 24600K .......... .......... .......... .......... .......... 14% 25.4M 6s 2024-03-29T04:09:19.169 INFO:teuthology.orchestra.run.smithi073.stderr: 24650K .......... .......... .......... .......... .......... 14% 34.1M 6s 2024-03-29T04:09:19.169 INFO:teuthology.orchestra.run.smithi073.stderr: 24700K .......... .......... .......... .......... .......... 14% 24.3M 6s 2024-03-29T04:09:19.170 INFO:teuthology.orchestra.run.smithi073.stderr: 24750K .......... .......... .......... .......... .......... 14% 27.2M 6s 2024-03-29T04:09:19.170 INFO:teuthology.orchestra.run.smithi073.stderr: 24800K .......... .......... .......... .......... .......... 14% 34.0M 6s 2024-03-29T04:09:19.170 INFO:teuthology.orchestra.run.smithi073.stderr: 24850K .......... .......... .......... .......... .......... 14% 24.6M 6s 2024-03-29T04:09:19.170 INFO:teuthology.orchestra.run.smithi073.stderr: 24900K .......... .......... .......... .......... .......... 14% 40.3M 6s 2024-03-29T04:09:19.170 INFO:teuthology.orchestra.run.smithi073.stderr: 24950K .......... .......... .......... .......... .......... 14% 23.1M 6s 2024-03-29T04:09:19.170 INFO:teuthology.orchestra.run.smithi073.stderr: 25000K .......... .......... .......... .......... .......... 14% 23.0M 6s 2024-03-29T04:09:19.170 INFO:teuthology.orchestra.run.smithi073.stderr: 25050K .......... .......... .......... .......... .......... 14% 50.6M 6s 2024-03-29T04:09:19.170 INFO:teuthology.orchestra.run.smithi073.stderr: 25100K .......... .......... .......... .......... .......... 14% 33.2M 6s 2024-03-29T04:09:19.170 INFO:teuthology.orchestra.run.smithi073.stderr: 25150K .......... .......... .......... .......... .......... 14% 24.9M 6s 2024-03-29T04:09:19.170 INFO:teuthology.orchestra.run.smithi073.stderr: 25200K .......... .......... .......... .......... .......... 14% 24.2M 6s 2024-03-29T04:09:19.170 INFO:teuthology.orchestra.run.smithi073.stderr: 25250K .......... .......... .......... .......... .......... 15% 24.4M 6s 2024-03-29T04:09:19.170 INFO:teuthology.orchestra.run.smithi073.stderr: 25300K .......... .......... .......... .......... .......... 15% 54.4M 6s 2024-03-29T04:09:19.171 INFO:teuthology.orchestra.run.smithi073.stderr: 25350K .......... .......... .......... .......... .......... 15% 24.2M 6s 2024-03-29T04:09:19.171 INFO:teuthology.orchestra.run.smithi073.stderr: 25400K .......... .......... .......... .......... .......... 15% 29.6M 6s 2024-03-29T04:09:19.171 INFO:teuthology.orchestra.run.smithi073.stderr: 25450K .......... .......... .......... .......... .......... 15% 39.5M 6s 2024-03-29T04:09:19.171 INFO:teuthology.orchestra.run.smithi073.stderr: 25500K .......... .......... .......... .......... .......... 15% 19.4M 6s 2024-03-29T04:09:19.171 INFO:teuthology.orchestra.run.smithi073.stderr: 25550K .......... .......... .......... .......... .......... 15% 49.1M 6s 2024-03-29T04:09:19.171 INFO:teuthology.orchestra.run.smithi073.stderr: 25600K .......... .......... .......... .......... .......... 15% 24.9M 6s 2024-03-29T04:09:19.171 INFO:teuthology.orchestra.run.smithi073.stderr: 25650K .......... .......... .......... .......... .......... 15% 32.1M 6s 2024-03-29T04:09:19.171 INFO:teuthology.orchestra.run.smithi073.stderr: 25700K .......... .......... .......... .......... .......... 15% 23.8M 6s 2024-03-29T04:09:19.171 INFO:teuthology.orchestra.run.smithi073.stderr: 25750K .......... .......... .......... .......... .......... 15% 26.2M 6s 2024-03-29T04:09:19.171 INFO:teuthology.orchestra.run.smithi073.stderr: 25800K .......... .......... .......... .......... .......... 15% 51.2M 6s 2024-03-29T04:09:19.171 INFO:teuthology.orchestra.run.smithi073.stderr: 25850K .......... .......... .......... .......... .......... 15% 24.3M 6s 2024-03-29T04:09:19.171 INFO:teuthology.orchestra.run.smithi073.stderr: 25900K .......... .......... .......... .......... .......... 15% 34.8M 6s 2024-03-29T04:09:19.171 INFO:teuthology.orchestra.run.smithi073.stderr: 25950K .......... .......... .......... .......... .......... 15% 26.1M 6s 2024-03-29T04:09:19.172 INFO:teuthology.orchestra.run.smithi073.stderr: 26000K .......... .......... .......... .......... .......... 15% 29.2M 6s 2024-03-29T04:09:19.172 INFO:teuthology.orchestra.run.smithi073.stderr: 26050K .......... .......... .......... .......... .......... 15% 33.1M 6s 2024-03-29T04:09:19.172 INFO:teuthology.orchestra.run.smithi073.stderr: 26100K .......... .......... .......... .......... .......... 15% 23.8M 6s 2024-03-29T04:09:19.172 INFO:teuthology.orchestra.run.smithi073.stderr: 26150K .......... .......... .......... .......... .......... 15% 44.0M 6s 2024-03-29T04:09:19.172 INFO:teuthology.orchestra.run.smithi073.stderr: 26200K .......... .......... .......... .......... .......... 15% 23.8M 6s 2024-03-29T04:09:19.172 INFO:teuthology.orchestra.run.smithi073.stderr: 26250K .......... .......... .......... .......... .......... 15% 22.8M 6s 2024-03-29T04:09:19.172 INFO:teuthology.orchestra.run.smithi073.stderr: 26300K .......... .......... .......... .......... .......... 15% 50.0M 6s 2024-03-29T04:09:19.172 INFO:teuthology.orchestra.run.smithi073.stderr: 26350K .......... .......... .......... .......... .......... 15% 24.5M 6s 2024-03-29T04:09:19.172 INFO:teuthology.orchestra.run.smithi073.stderr: 26400K .......... .......... .......... .......... .......... 15% 27.3M 6s 2024-03-29T04:09:19.172 INFO:teuthology.orchestra.run.smithi073.stderr: 26450K .......... .......... .......... .......... .......... 15% 29.7M 6s 2024-03-29T04:09:19.172 INFO:teuthology.orchestra.run.smithi073.stderr: 26500K .......... .......... .......... .......... .......... 15% 25.0M 6s 2024-03-29T04:09:19.172 INFO:teuthology.orchestra.run.smithi073.stderr: 26550K .......... .......... .......... .......... .......... 15% 53.8M 6s 2024-03-29T04:09:19.172 INFO:teuthology.orchestra.run.smithi073.stderr: 26600K .......... .......... .......... .......... .......... 15% 28.8M 6s 2024-03-29T04:09:19.173 INFO:teuthology.orchestra.run.smithi073.stderr: 26650K .......... .......... .......... .......... .......... 15% 26.8M 6s 2024-03-29T04:09:19.173 INFO:teuthology.orchestra.run.smithi073.stderr: 26700K .......... .......... .......... .......... .......... 15% 22.1M 6s 2024-03-29T04:09:19.173 INFO:teuthology.orchestra.run.smithi073.stderr: 26750K .......... .......... .......... .......... .......... 15% 65.8M 6s 2024-03-29T04:09:19.173 INFO:teuthology.orchestra.run.smithi073.stderr: 26800K .......... .......... .......... .......... .......... 15% 25.8M 6s 2024-03-29T04:09:19.173 INFO:teuthology.orchestra.run.smithi073.stderr: 26850K .......... .......... .......... .......... .......... 15% 25.3M 6s 2024-03-29T04:09:19.173 INFO:teuthology.orchestra.run.smithi073.stderr: 26900K .......... .......... .......... .......... .......... 15% 34.9M 6s 2024-03-29T04:09:19.173 INFO:teuthology.orchestra.run.smithi073.stderr: 26950K .......... .......... .......... .......... .......... 16% 21.1M 6s 2024-03-29T04:09:19.173 INFO:teuthology.orchestra.run.smithi073.stderr: 27000K .......... .......... .......... .......... .......... 16% 36.5M 6s 2024-03-29T04:09:19.173 INFO:teuthology.orchestra.run.smithi073.stderr: 27050K .......... .......... .......... .......... .......... 16% 33.3M 6s 2024-03-29T04:09:19.173 INFO:teuthology.orchestra.run.smithi073.stderr: 27100K .......... .......... .......... .......... .......... 16% 24.4M 6s 2024-03-29T04:09:19.173 INFO:teuthology.orchestra.run.smithi073.stderr: 27150K .......... .......... .......... .......... .......... 16% 25.4M 6s 2024-03-29T04:09:19.173 INFO:teuthology.orchestra.run.smithi073.stderr: 27200K .......... .......... .......... .......... .......... 16% 26.4M 6s 2024-03-29T04:09:19.174 INFO:teuthology.orchestra.run.smithi073.stderr: 27250K .......... .......... .......... .......... .......... 16% 37.8M 6s 2024-03-29T04:09:19.174 INFO:teuthology.orchestra.run.smithi073.stderr: 27300K .......... .......... .......... .......... .......... 16% 33.7M 6s 2024-03-29T04:09:19.174 INFO:teuthology.orchestra.run.smithi073.stderr: 27350K .......... .......... .......... .......... .......... 16% 27.9M 6s 2024-03-29T04:09:19.174 INFO:teuthology.orchestra.run.smithi073.stderr: 27400K .......... .......... .......... .......... .......... 16% 31.0M 6s 2024-03-29T04:09:19.174 INFO:teuthology.orchestra.run.smithi073.stderr: 27450K .......... .......... .......... .......... .......... 16% 28.7M 6s 2024-03-29T04:09:19.174 INFO:teuthology.orchestra.run.smithi073.stderr: 27500K .......... .......... .......... .......... .......... 16% 23.1M 6s 2024-03-29T04:09:19.174 INFO:teuthology.orchestra.run.smithi073.stderr: 27550K .......... .......... .......... .......... .......... 16% 41.6M 6s 2024-03-29T04:09:19.174 INFO:teuthology.orchestra.run.smithi073.stderr: 27600K .......... .......... .......... .......... .......... 16% 23.7M 6s 2024-03-29T04:09:19.174 INFO:teuthology.orchestra.run.smithi073.stderr: 27650K .......... .......... .......... .......... .......... 16% 34.8M 6s 2024-03-29T04:09:19.174 INFO:teuthology.orchestra.run.smithi073.stderr: 27700K .......... .......... .......... .......... .......... 16% 24.1M 6s 2024-03-29T04:09:19.174 INFO:teuthology.orchestra.run.smithi073.stderr: 27750K .......... .......... .......... .......... .......... 16% 22.7M 6s 2024-03-29T04:09:19.174 INFO:teuthology.orchestra.run.smithi073.stderr: 27800K .......... .......... .......... .......... .......... 16% 53.8M 6s 2024-03-29T04:09:19.175 INFO:teuthology.orchestra.run.smithi073.stderr: 27850K .......... .......... .......... .......... .......... 16% 32.7M 6s 2024-03-29T04:09:19.175 INFO:teuthology.orchestra.run.smithi073.stderr: 27900K .......... .......... .......... .......... .......... 16% 24.5M 6s 2024-03-29T04:09:19.175 INFO:teuthology.orchestra.run.smithi073.stderr: 27950K .......... .......... .......... .......... .......... 16% 23.3M 6s 2024-03-29T04:09:19.175 INFO:teuthology.orchestra.run.smithi073.stderr: 28000K .......... .......... .......... .......... .......... 16% 42.7M 6s 2024-03-29T04:09:19.175 INFO:teuthology.orchestra.run.smithi073.stderr: 28050K .......... .......... .......... .......... .......... 16% 31.6M 6s 2024-03-29T04:09:19.175 INFO:teuthology.orchestra.run.smithi073.stderr: 28100K .......... .......... .......... .......... .......... 16% 23.5M 6s 2024-03-29T04:09:19.175 INFO:teuthology.orchestra.run.smithi073.stderr: 28150K .......... .......... .......... .......... .......... 16% 32.3M 6s 2024-03-29T04:09:19.175 INFO:teuthology.orchestra.run.smithi073.stderr: 28200K .......... .......... .......... .......... .......... 16% 23.2M 6s 2024-03-29T04:09:19.175 INFO:teuthology.orchestra.run.smithi073.stderr: 28250K .......... .......... .......... .......... .......... 16% 49.3M 6s 2024-03-29T04:09:19.175 INFO:teuthology.orchestra.run.smithi073.stderr: 28300K .......... .......... .......... .......... .......... 16% 27.6M 6s 2024-03-29T04:09:19.175 INFO:teuthology.orchestra.run.smithi073.stderr: 28350K .......... .......... .......... .......... .......... 16% 23.8M 6s 2024-03-29T04:09:19.175 INFO:teuthology.orchestra.run.smithi073.stderr: 28400K .......... .......... .......... .......... .......... 16% 28.6M 6s 2024-03-29T04:09:19.175 INFO:teuthology.orchestra.run.smithi073.stderr: 28450K .......... .......... .......... .......... .......... 16% 24.0M 6s 2024-03-29T04:09:19.176 INFO:teuthology.orchestra.run.smithi073.stderr: 28500K .......... .......... .......... .......... .......... 16% 46.5M 6s 2024-03-29T04:09:19.176 INFO:teuthology.orchestra.run.smithi073.stderr: 28550K .......... .......... .......... .......... .......... 16% 32.8M 6s 2024-03-29T04:09:19.176 INFO:teuthology.orchestra.run.smithi073.stderr: 28600K .......... .......... .......... .......... .......... 16% 24.2M 6s 2024-03-29T04:09:19.176 INFO:teuthology.orchestra.run.smithi073.stderr: 28650K .......... .......... .......... .......... .......... 17% 32.3M 6s 2024-03-29T04:09:19.176 INFO:teuthology.orchestra.run.smithi073.stderr: 28700K .......... .......... .......... .......... .......... 17% 24.4M 6s 2024-03-29T04:09:19.176 INFO:teuthology.orchestra.run.smithi073.stderr: 28750K .......... .......... .......... .......... .......... 17% 26.1M 6s 2024-03-29T04:09:19.176 INFO:teuthology.orchestra.run.smithi073.stderr: 28800K .......... .......... .......... .......... .......... 17% 44.8M 6s 2024-03-29T04:09:19.176 INFO:teuthology.orchestra.run.smithi073.stderr: 28850K .......... .......... .......... .......... .......... 17% 24.0M 6s 2024-03-29T04:09:19.176 INFO:teuthology.orchestra.run.smithi073.stderr: 28900K .......... .......... .......... .......... .......... 17% 25.0M 6s 2024-03-29T04:09:19.176 INFO:teuthology.orchestra.run.smithi073.stderr: 28950K .......... .......... .......... .......... .......... 17% 29.8M 6s 2024-03-29T04:09:19.176 INFO:teuthology.orchestra.run.smithi073.stderr: 29000K .......... .......... .......... .......... .......... 17% 27.7M 6s 2024-03-29T04:09:19.177 INFO:teuthology.orchestra.run.smithi073.stderr: 29050K .......... .......... .......... .......... .......... 17% 51.5M 6s 2024-03-29T04:09:19.177 INFO:teuthology.orchestra.run.smithi073.stderr: 29100K .......... .......... .......... .......... .......... 17% 25.2M 6s 2024-03-29T04:09:19.177 INFO:teuthology.orchestra.run.smithi073.stderr: 29150K .......... .......... .......... .......... .......... 17% 30.1M 6s 2024-03-29T04:09:19.177 INFO:teuthology.orchestra.run.smithi073.stderr: 29200K .......... .......... .......... .......... .......... 17% 31.5M 6s 2024-03-29T04:09:19.177 INFO:teuthology.orchestra.run.smithi073.stderr: 29250K .......... .......... .......... .......... .......... 17% 23.4M 6s 2024-03-29T04:09:19.177 INFO:teuthology.orchestra.run.smithi073.stderr: 29300K .......... .......... .......... .......... .......... 17% 36.2M 6s 2024-03-29T04:09:19.177 INFO:teuthology.orchestra.run.smithi073.stderr: 29350K .......... .......... .......... .......... .......... 17% 23.4M 6s 2024-03-29T04:09:19.177 INFO:teuthology.orchestra.run.smithi073.stderr: 29400K .......... .......... .......... .......... .......... 17% 24.7M 6s 2024-03-29T04:09:19.177 INFO:teuthology.orchestra.run.smithi073.stderr: 29450K .......... .......... .......... .......... .......... 17% 55.4M 6s 2024-03-29T04:09:19.177 INFO:teuthology.orchestra.run.smithi073.stderr: 29500K .......... .......... .......... .......... .......... 17% 23.2M 6s 2024-03-29T04:09:19.177 INFO:teuthology.orchestra.run.smithi073.stderr: 29550K .......... .......... .......... .......... .......... 17% 35.7M 6s 2024-03-29T04:09:19.177 INFO:teuthology.orchestra.run.smithi073.stderr: 29600K .......... .......... .......... .......... .......... 17% 23.9M 6s 2024-03-29T04:09:19.178 INFO:teuthology.orchestra.run.smithi073.stderr: 29650K .......... .......... .......... .......... .......... 17% 24.8M 6s 2024-03-29T04:09:19.178 INFO:teuthology.orchestra.run.smithi073.stderr: 29700K .......... .......... .......... .......... .......... 17% 53.1M 5s 2024-03-29T04:09:19.178 INFO:teuthology.orchestra.run.smithi073.stderr: 29750K .......... .......... .......... .......... .......... 17% 23.5M 5s 2024-03-29T04:09:19.178 INFO:teuthology.orchestra.run.smithi073.stderr: 29800K .......... .......... .......... .......... .......... 17% 33.3M 5s 2024-03-29T04:09:19.178 INFO:teuthology.orchestra.run.smithi073.stderr: 29850K .......... .......... .......... .......... .......... 17% 22.0M 5s 2024-03-29T04:09:19.178 INFO:teuthology.orchestra.run.smithi073.stderr: 29900K .......... .......... .......... .......... .......... 17% 41.8M 5s 2024-03-29T04:09:19.178 INFO:teuthology.orchestra.run.smithi073.stderr: 29950K .......... .......... .......... .......... .......... 17% 32.6M 5s 2024-03-29T04:09:19.178 INFO:teuthology.orchestra.run.smithi073.stderr: 30000K .......... .......... .......... .......... .......... 17% 24.3M 5s 2024-03-29T04:09:19.178 INFO:teuthology.orchestra.run.smithi073.stderr: 30050K .......... .......... .......... .......... .......... 17% 31.1M 5s 2024-03-29T04:09:19.178 INFO:teuthology.orchestra.run.smithi073.stderr: 30100K .......... .......... .......... .......... .......... 17% 26.8M 5s 2024-03-29T04:09:19.178 INFO:teuthology.orchestra.run.smithi073.stderr: 30150K .......... .......... .......... .......... .......... 17% 28.1M 5s 2024-03-29T04:09:19.178 INFO:teuthology.orchestra.run.smithi073.stderr: 30200K .......... .......... .......... .......... .......... 17% 33.7M 5s 2024-03-29T04:09:19.179 INFO:teuthology.orchestra.run.smithi073.stderr: 30250K .......... .......... .......... .......... .......... 17% 25.8M 5s 2024-03-29T04:09:19.179 INFO:teuthology.orchestra.run.smithi073.stderr: 30300K .......... .......... .......... .......... .......... 18% 28.9M 5s 2024-03-29T04:09:19.179 INFO:teuthology.orchestra.run.smithi073.stderr: 30350K .......... .......... .......... .......... .......... 18% 22.6M 5s 2024-03-29T04:09:19.179 INFO:teuthology.orchestra.run.smithi073.stderr: 30400K .......... .......... .......... .......... .......... 18% 47.8M 5s 2024-03-29T04:09:19.179 INFO:teuthology.orchestra.run.smithi073.stderr: 30450K .......... .......... .......... .......... .......... 18% 32.4M 5s 2024-03-29T04:09:19.179 INFO:teuthology.orchestra.run.smithi073.stderr: 30500K .......... .......... .......... .......... .......... 18% 24.3M 5s 2024-03-29T04:09:19.179 INFO:teuthology.orchestra.run.smithi073.stderr: 30550K .......... .......... .......... .......... .......... 18% 32.4M 5s 2024-03-29T04:09:19.179 INFO:teuthology.orchestra.run.smithi073.stderr: 30600K .......... .......... .......... .......... .......... 18% 36.0M 5s 2024-03-29T04:09:19.179 INFO:teuthology.orchestra.run.smithi073.stderr: 30650K .......... .......... .......... .......... .......... 18% 23.5M 5s 2024-03-29T04:09:19.179 INFO:teuthology.orchestra.run.smithi073.stderr: 30700K .......... .......... .......... .......... .......... 18% 24.5M 5s 2024-03-29T04:09:19.179 INFO:teuthology.orchestra.run.smithi073.stderr: 30750K .......... .......... .......... .......... .......... 18% 26.7M 5s 2024-03-29T04:09:19.179 INFO:teuthology.orchestra.run.smithi073.stderr: 30800K .......... .......... .......... .......... .......... 18% 23.2M 5s 2024-03-29T04:09:19.179 INFO:teuthology.orchestra.run.smithi073.stderr: 30850K .......... .......... .......... .......... .......... 18% 47.8M 5s 2024-03-29T04:09:19.180 INFO:teuthology.orchestra.run.smithi073.stderr: 30900K .......... .......... .......... .......... .......... 18% 32.5M 5s 2024-03-29T04:09:19.180 INFO:teuthology.orchestra.run.smithi073.stderr: 30950K .......... .......... .......... .......... .......... 18% 23.5M 5s 2024-03-29T04:09:19.180 INFO:teuthology.orchestra.run.smithi073.stderr: 31000K .......... .......... .......... .......... .......... 18% 24.0M 5s 2024-03-29T04:09:19.180 INFO:teuthology.orchestra.run.smithi073.stderr: 31050K .......... .......... .......... .......... .......... 18% 38.7M 5s 2024-03-29T04:09:19.180 INFO:teuthology.orchestra.run.smithi073.stderr: 31100K .......... .......... .......... .......... .......... 18% 23.5M 5s 2024-03-29T04:09:19.180 INFO:teuthology.orchestra.run.smithi073.stderr: 31150K .......... .......... .......... .......... .......... 18% 52.0M 5s 2024-03-29T04:09:19.180 INFO:teuthology.orchestra.run.smithi073.stderr: 31200K .......... .......... .......... .......... .......... 18% 30.3M 5s 2024-03-29T04:09:19.180 INFO:teuthology.orchestra.run.smithi073.stderr: 31250K .......... .......... .......... .......... .......... 18% 28.5M 5s 2024-03-29T04:09:19.180 INFO:teuthology.orchestra.run.smithi073.stderr: 31300K .......... .......... .......... .......... .......... 18% 23.7M 5s 2024-03-29T04:09:19.180 INFO:teuthology.orchestra.run.smithi073.stderr: 31350K .......... .......... .......... .......... .......... 18% 19.7M 5s 2024-03-29T04:09:19.180 INFO:teuthology.orchestra.run.smithi073.stderr: 31400K .......... .......... .......... .......... .......... 18% 105M 5s 2024-03-29T04:09:19.180 INFO:teuthology.orchestra.run.smithi073.stderr: 31450K .......... .......... .......... .......... .......... 18% 32.6M 5s 2024-03-29T04:09:19.181 INFO:teuthology.orchestra.run.smithi073.stderr: 31500K .......... .......... .......... .......... .......... 18% 24.7M 5s 2024-03-29T04:09:19.181 INFO:teuthology.orchestra.run.smithi073.stderr: 31550K .......... .......... .......... .......... .......... 18% 26.6M 5s 2024-03-29T04:09:19.181 INFO:teuthology.orchestra.run.smithi073.stderr: 31600K .......... .......... .......... .......... .......... 18% 22.7M 5s 2024-03-29T04:09:19.181 INFO:teuthology.orchestra.run.smithi073.stderr: 31650K .......... .......... .......... .......... .......... 18% 65.1M 5s 2024-03-29T04:09:19.181 INFO:teuthology.orchestra.run.smithi073.stderr: 31700K .......... .......... .......... .......... .......... 18% 24.7M 5s 2024-03-29T04:09:19.181 INFO:teuthology.orchestra.run.smithi073.stderr: 31750K .......... .......... .......... .......... .......... 18% 30.2M 5s 2024-03-29T04:09:19.181 INFO:teuthology.orchestra.run.smithi073.stderr: 31800K .......... .......... .......... .......... .......... 18% 24.6M 5s 2024-03-29T04:09:19.181 INFO:teuthology.orchestra.run.smithi073.stderr: 31850K .......... .......... .......... .......... .......... 18% 24.3M 5s 2024-03-29T04:09:19.181 INFO:teuthology.orchestra.run.smithi073.stderr: 31900K .......... .......... .......... .......... .......... 18% 55.6M 5s 2024-03-29T04:09:19.181 INFO:teuthology.orchestra.run.smithi073.stderr: 31950K .......... .......... .......... .......... .......... 18% 20.0M 5s 2024-03-29T04:09:19.181 INFO:teuthology.orchestra.run.smithi073.stderr: 32000K .......... .......... .......... .......... .......... 19% 35.6M 5s 2024-03-29T04:09:19.181 INFO:teuthology.orchestra.run.smithi073.stderr: 32050K .......... .......... .......... .......... .......... 19% 36.7M 5s 2024-03-29T04:09:19.181 INFO:teuthology.orchestra.run.smithi073.stderr: 32100K .......... .......... .......... .......... .......... 19% 24.7M 5s 2024-03-29T04:09:19.182 INFO:teuthology.orchestra.run.smithi073.stderr: 32150K .......... .......... .......... .......... .......... 19% 24.5M 5s 2024-03-29T04:09:19.182 INFO:teuthology.orchestra.run.smithi073.stderr: 32200K .......... .......... .......... .......... .......... 19% 55.9M 5s 2024-03-29T04:09:19.182 INFO:teuthology.orchestra.run.smithi073.stderr: 32250K .......... .......... .......... .......... .......... 19% 23.6M 5s 2024-03-29T04:09:19.182 INFO:teuthology.orchestra.run.smithi073.stderr: 32300K .......... .......... .......... .......... .......... 19% 34.1M 5s 2024-03-29T04:09:19.182 INFO:teuthology.orchestra.run.smithi073.stderr: 32350K .......... .......... .......... .......... .......... 19% 23.9M 5s 2024-03-29T04:09:19.182 INFO:teuthology.orchestra.run.smithi073.stderr: 32400K .......... .......... .......... .......... .......... 19% 23.2M 5s 2024-03-29T04:09:19.182 INFO:teuthology.orchestra.run.smithi073.stderr: 32450K .......... .......... .......... .......... .......... 19% 65.1M 5s 2024-03-29T04:09:19.182 INFO:teuthology.orchestra.run.smithi073.stderr: 32500K .......... .......... .......... .......... .......... 19% 26.0M 5s 2024-03-29T04:09:19.182 INFO:teuthology.orchestra.run.smithi073.stderr: 32550K .......... .......... .......... .......... .......... 19% 23.0M 5s 2024-03-29T04:09:19.182 INFO:teuthology.orchestra.run.smithi073.stderr: 32600K .......... .......... .......... .......... .......... 19% 42.1M 5s 2024-03-29T04:09:19.182 INFO:teuthology.orchestra.run.smithi073.stderr: 32650K .......... .......... .......... .......... .......... 19% 20.3M 5s 2024-03-29T04:09:19.182 INFO:teuthology.orchestra.run.smithi073.stderr: 32700K .......... .......... .......... .......... .......... 19% 50.5M 5s 2024-03-29T04:09:19.182 INFO:teuthology.orchestra.run.smithi073.stderr: 32750K .......... .......... .......... .......... .......... 19% 23.9M 5s 2024-03-29T04:09:19.183 INFO:teuthology.orchestra.run.smithi073.stderr: 32800K .......... .......... .......... .......... .......... 19% 24.0M 5s 2024-03-29T04:09:19.183 INFO:teuthology.orchestra.run.smithi073.stderr: 32850K .......... .......... .......... .......... .......... 19% 46.4M 5s 2024-03-29T04:09:19.183 INFO:teuthology.orchestra.run.smithi073.stderr: 32900K .......... .......... .......... .......... .......... 19% 21.1M 5s 2024-03-29T04:09:19.183 INFO:teuthology.orchestra.run.smithi073.stderr: 32950K .......... .......... .......... .......... .......... 19% 63.4M 5s 2024-03-29T04:09:19.183 INFO:teuthology.orchestra.run.smithi073.stderr: 33000K .......... .......... .......... .......... .......... 19% 23.6M 5s 2024-03-29T04:09:19.183 INFO:teuthology.orchestra.run.smithi073.stderr: 33050K .......... .......... .......... .......... .......... 19% 32.3M 5s 2024-03-29T04:09:19.183 INFO:teuthology.orchestra.run.smithi073.stderr: 33100K .......... .......... .......... .......... .......... 19% 24.8M 5s 2024-03-29T04:09:19.183 INFO:teuthology.orchestra.run.smithi073.stderr: 33150K .......... .......... .......... .......... .......... 19% 25.3M 5s 2024-03-29T04:09:19.183 INFO:teuthology.orchestra.run.smithi073.stderr: 33200K .......... .......... .......... .......... .......... 19% 46.5M 5s 2024-03-29T04:09:19.183 INFO:teuthology.orchestra.run.smithi073.stderr: 33250K .......... .......... .......... .......... .......... 19% 24.3M 5s 2024-03-29T04:09:19.183 INFO:teuthology.orchestra.run.smithi073.stderr: 33300K .......... .......... .......... .......... .......... 19% 33.0M 5s 2024-03-29T04:09:19.183 INFO:teuthology.orchestra.run.smithi073.stderr: 33350K .......... .......... .......... .......... .......... 19% 24.4M 5s 2024-03-29T04:09:19.184 INFO:teuthology.orchestra.run.smithi073.stderr: 33400K .......... .......... .......... .......... .......... 19% 22.2M 5s 2024-03-29T04:09:19.184 INFO:teuthology.orchestra.run.smithi073.stderr: 33450K .......... .......... .......... .......... .......... 19% 51.6M 5s 2024-03-29T04:09:19.184 INFO:teuthology.orchestra.run.smithi073.stderr: 33500K .......... .......... .......... .......... .......... 19% 24.2M 5s 2024-03-29T04:09:19.184 INFO:teuthology.orchestra.run.smithi073.stderr: 33550K .......... .......... .......... .......... .......... 19% 24.3M 5s 2024-03-29T04:09:19.184 INFO:teuthology.orchestra.run.smithi073.stderr: 33600K .......... .......... .......... .......... .......... 19% 39.3M 5s 2024-03-29T04:09:19.184 INFO:teuthology.orchestra.run.smithi073.stderr: 33650K .......... .......... .......... .......... .......... 19% 22.6M 5s 2024-03-29T04:09:19.184 INFO:teuthology.orchestra.run.smithi073.stderr: 33700K .......... .......... .......... .......... .......... 20% 50.6M 5s 2024-03-29T04:09:19.184 INFO:teuthology.orchestra.run.smithi073.stderr: 33750K .......... .......... .......... .......... .......... 20% 25.3M 5s 2024-03-29T04:09:19.184 INFO:teuthology.orchestra.run.smithi073.stderr: 33800K .......... .......... .......... .......... .......... 20% 23.6M 5s 2024-03-29T04:09:19.184 INFO:teuthology.orchestra.run.smithi073.stderr: 33850K .......... .......... .......... .......... .......... 20% 32.2M 5s 2024-03-29T04:09:19.184 INFO:teuthology.orchestra.run.smithi073.stderr: 33900K .......... .......... .......... .......... .......... 20% 28.4M 5s 2024-03-29T04:09:19.184 INFO:teuthology.orchestra.run.smithi073.stderr: 33950K .......... .......... .......... .......... .......... 20% 36.9M 5s 2024-03-29T04:09:19.185 INFO:teuthology.orchestra.run.smithi073.stderr: 34000K .......... .......... .......... .......... .......... 20% 24.9M 5s 2024-03-29T04:09:19.185 INFO:teuthology.orchestra.run.smithi073.stderr: 34050K .......... .......... .......... .......... .......... 20% 35.6M 5s 2024-03-29T04:09:19.185 INFO:teuthology.orchestra.run.smithi073.stderr: 34100K .......... .......... .......... .......... .......... 20% 482K 6s 2024-03-29T04:09:19.185 INFO:teuthology.orchestra.run.smithi073.stderr: 34150K .......... .......... .......... .......... .......... 20% 202M 6s 2024-03-29T04:09:19.185 INFO:teuthology.orchestra.run.smithi073.stderr: 34200K .......... .......... .......... .......... .......... 20% 678M 6s 2024-03-29T04:09:19.185 INFO:teuthology.orchestra.run.smithi073.stderr: 34250K .......... .......... .......... .......... .......... 20% 694M 6s 2024-03-29T04:09:19.185 INFO:teuthology.orchestra.run.smithi073.stderr: 34300K .......... .......... .......... .......... .......... 20% 602M 6s 2024-03-29T04:09:19.185 INFO:teuthology.orchestra.run.smithi073.stderr: 34350K .......... .......... .......... .......... .......... 20% 673M 6s 2024-03-29T04:09:19.185 INFO:teuthology.orchestra.run.smithi073.stderr: 34400K .......... .......... .......... .......... .......... 20% 688M 6s 2024-03-29T04:09:19.185 INFO:teuthology.orchestra.run.smithi073.stderr: 34450K .......... .......... .......... .......... .......... 20% 701M 6s 2024-03-29T04:09:19.185 INFO:teuthology.orchestra.run.smithi073.stderr: 34500K .......... .......... .......... .......... .......... 20% 627M 6s 2024-03-29T04:09:19.185 INFO:teuthology.orchestra.run.smithi073.stderr: 34550K .......... .......... .......... .......... .......... 20% 693M 6s 2024-03-29T04:09:19.185 INFO:teuthology.orchestra.run.smithi073.stderr: 34600K .......... .......... .......... .......... .......... 20% 665M 6s 2024-03-29T04:09:19.186 INFO:teuthology.orchestra.run.smithi073.stderr: 34650K .......... .......... .......... .......... .......... 20% 698M 6s 2024-03-29T04:09:19.186 INFO:teuthology.orchestra.run.smithi073.stderr: 34700K .......... .......... .......... .......... .......... 20% 603M 6s 2024-03-29T04:09:19.186 INFO:teuthology.orchestra.run.smithi073.stderr: 34750K .......... .......... .......... .......... .......... 20% 632M 5s 2024-03-29T04:09:19.186 INFO:teuthology.orchestra.run.smithi073.stderr: 34800K .......... .......... .......... .......... .......... 20% 696M 5s 2024-03-29T04:09:19.186 INFO:teuthology.orchestra.run.smithi073.stderr: 34850K .......... .......... .......... .......... .......... 20% 699M 5s 2024-03-29T04:09:19.186 INFO:teuthology.orchestra.run.smithi073.stderr: 34900K .......... .......... .......... .......... .......... 20% 630M 5s 2024-03-29T04:09:19.186 INFO:teuthology.orchestra.run.smithi073.stderr: 34950K .......... .......... .......... .......... .......... 20% 11.1M 5s 2024-03-29T04:09:19.186 INFO:teuthology.orchestra.run.smithi073.stderr: 35000K .......... .......... .......... .......... .......... 20% 590M 5s 2024-03-29T04:09:19.186 INFO:teuthology.orchestra.run.smithi073.stderr: 35050K .......... .......... .......... .......... .......... 20% 684M 5s 2024-03-29T04:09:19.186 INFO:teuthology.orchestra.run.smithi073.stderr: 35100K .......... .......... .......... .......... .......... 20% 687M 5s 2024-03-29T04:09:19.186 INFO:teuthology.orchestra.run.smithi073.stderr: 35150K .......... .......... .......... .......... .......... 20% 720M 5s 2024-03-29T04:09:19.186 INFO:teuthology.orchestra.run.smithi073.stderr: 35200K .......... .......... .......... .......... .......... 20% 561M 5s 2024-03-29T04:09:19.187 INFO:teuthology.orchestra.run.smithi073.stderr: 35250K .......... .......... .......... .......... .......... 20% 697M 5s 2024-03-29T04:09:19.187 INFO:teuthology.orchestra.run.smithi073.stderr: 35300K .......... .......... .......... .......... .......... 20% 693M 5s 2024-03-29T04:09:19.187 INFO:teuthology.orchestra.run.smithi073.stderr: 35350K .......... .......... .......... .......... .......... 21% 668M 5s 2024-03-29T04:09:19.187 INFO:teuthology.orchestra.run.smithi073.stderr: 35400K .......... .......... .......... .......... .......... 21% 625M 5s 2024-03-29T04:09:19.187 INFO:teuthology.orchestra.run.smithi073.stderr: 35450K .......... .......... .......... .......... .......... 21% 692M 5s 2024-03-29T04:09:19.187 INFO:teuthology.orchestra.run.smithi073.stderr: 35500K .......... .......... .......... .......... .......... 21% 703M 5s 2024-03-29T04:09:19.187 INFO:teuthology.orchestra.run.smithi073.stderr: 35550K .......... .......... .......... .......... .......... 21% 697M 5s 2024-03-29T04:09:19.187 INFO:teuthology.orchestra.run.smithi073.stderr: 35600K .......... .......... .......... .......... .......... 21% 523M 5s 2024-03-29T04:09:19.187 INFO:teuthology.orchestra.run.smithi073.stderr: 35650K .......... .......... .......... .......... .......... 21% 572M 5s 2024-03-29T04:09:19.187 INFO:teuthology.orchestra.run.smithi073.stderr: 35700K .......... .......... .......... .......... .......... 21% 670M 5s 2024-03-29T04:09:19.187 INFO:teuthology.orchestra.run.smithi073.stderr: 35750K .......... .......... .......... .......... .......... 21% 655M 5s 2024-03-29T04:09:19.187 INFO:teuthology.orchestra.run.smithi073.stderr: 35800K .......... .......... .......... .......... .......... 21% 612M 5s 2024-03-29T04:09:19.187 INFO:teuthology.orchestra.run.smithi073.stderr: 35850K .......... .......... .......... .......... .......... 21% 653M 5s 2024-03-29T04:09:19.187 INFO:teuthology.orchestra.run.smithi073.stderr: 35900K .......... .......... .......... .......... .......... 21% 693M 5s 2024-03-29T04:09:19.188 INFO:teuthology.orchestra.run.smithi073.stderr: 35950K .......... .......... .......... .......... .......... 21% 699M 5s 2024-03-29T04:09:19.188 INFO:teuthology.orchestra.run.smithi073.stderr: 36000K .......... .......... .......... .......... .......... 21% 619M 5s 2024-03-29T04:09:19.188 INFO:teuthology.orchestra.run.smithi073.stderr: 36050K .......... .......... .......... .......... .......... 21% 695M 5s 2024-03-29T04:09:19.188 INFO:teuthology.orchestra.run.smithi073.stderr: 36100K .......... .......... .......... .......... .......... 21% 670M 5s 2024-03-29T04:09:19.188 INFO:teuthology.orchestra.run.smithi073.stderr: 36150K .......... .......... .......... .......... .......... 21% 688M 5s 2024-03-29T04:09:19.188 INFO:teuthology.orchestra.run.smithi073.stderr: 36200K .......... .......... .......... .......... .......... 21% 604M 5s 2024-03-29T04:09:19.188 INFO:teuthology.orchestra.run.smithi073.stderr: 36250K .......... .......... .......... .......... .......... 21% 701M 5s 2024-03-29T04:09:19.188 INFO:teuthology.orchestra.run.smithi073.stderr: 36300K .......... .......... .......... .......... .......... 21% 727M 5s 2024-03-29T04:09:19.188 INFO:teuthology.orchestra.run.smithi073.stderr: 36350K .......... .......... .......... .......... .......... 21% 5.66M 5s 2024-03-29T04:09:19.188 INFO:teuthology.orchestra.run.smithi073.stderr: 36400K .......... .......... .......... .......... .......... 21% 181M 5s 2024-03-29T04:09:19.188 INFO:teuthology.orchestra.run.smithi073.stderr: 36450K .......... .......... .......... .......... .......... 21% 586M 5s 2024-03-29T04:09:19.188 INFO:teuthology.orchestra.run.smithi073.stderr: 36500K .......... .......... .......... .......... .......... 21% 701M 5s 2024-03-29T04:09:19.189 INFO:teuthology.orchestra.run.smithi073.stderr: 36550K .......... .......... .......... .......... .......... 21% 637M 5s 2024-03-29T04:09:19.189 INFO:teuthology.orchestra.run.smithi073.stderr: 36600K .......... .......... .......... .......... .......... 21% 691M 5s 2024-03-29T04:09:19.189 INFO:teuthology.orchestra.run.smithi073.stderr: 36650K .......... .......... .......... .......... .......... 21% 624M 5s 2024-03-29T04:09:19.189 INFO:teuthology.orchestra.run.smithi073.stderr: 36700K .......... .......... .......... .......... .......... 21% 661M 5s 2024-03-29T04:09:19.189 INFO:teuthology.orchestra.run.smithi073.stderr: 36750K .......... .......... .......... .......... .......... 21% 716M 5s 2024-03-29T04:09:19.189 INFO:teuthology.orchestra.run.smithi073.stderr: 36800K .......... .......... .......... .......... .......... 21% 727M 5s 2024-03-29T04:09:19.189 INFO:teuthology.orchestra.run.smithi073.stderr: 36850K .......... .......... .......... .......... .......... 21% 462M 5s 2024-03-29T04:09:19.189 INFO:teuthology.orchestra.run.smithi073.stderr: 36900K .......... .......... .......... .......... .......... 21% 571M 5s 2024-03-29T04:09:19.189 INFO:teuthology.orchestra.run.smithi073.stderr: 36950K .......... .......... .......... .......... .......... 21% 458M 5s 2024-03-29T04:09:19.189 INFO:teuthology.orchestra.run.smithi073.stderr: 37000K .......... .......... .......... .......... .......... 21% 446M 5s 2024-03-29T04:09:19.189 INFO:teuthology.orchestra.run.smithi073.stderr: 37050K .......... .......... .......... .......... .......... 22% 423M 5s 2024-03-29T04:09:19.189 INFO:teuthology.orchestra.run.smithi073.stderr: 37100K .......... .......... .......... .......... .......... 22% 685M 5s 2024-03-29T04:09:19.189 INFO:teuthology.orchestra.run.smithi073.stderr: 37150K .......... .......... .......... .......... .......... 22% 643M 5s 2024-03-29T04:09:19.190 INFO:teuthology.orchestra.run.smithi073.stderr: 37200K .......... .......... .......... .......... .......... 22% 445M 5s 2024-03-29T04:09:19.190 INFO:teuthology.orchestra.run.smithi073.stderr: 37250K .......... .......... .......... .......... .......... 22% 368M 5s 2024-03-29T04:09:19.190 INFO:teuthology.orchestra.run.smithi073.stderr: 37300K .......... .......... .......... .......... .......... 22% 2.12M 5s 2024-03-29T04:09:19.190 INFO:teuthology.orchestra.run.smithi073.stderr: 37350K .......... .......... .......... .......... .......... 22% 312M 5s 2024-03-29T04:09:19.190 INFO:teuthology.orchestra.run.smithi073.stderr: 37400K .......... .......... .......... .......... .......... 22% 385M 5s 2024-03-29T04:09:19.190 INFO:teuthology.orchestra.run.smithi073.stderr: 37450K .......... .......... .......... .......... .......... 22% 364M 5s 2024-03-29T04:09:19.190 INFO:teuthology.orchestra.run.smithi073.stderr: 37500K .......... .......... .......... .......... .......... 22% 401M 5s 2024-03-29T04:09:19.190 INFO:teuthology.orchestra.run.smithi073.stderr: 37550K .......... .......... .......... .......... .......... 22% 334M 5s 2024-03-29T04:09:19.190 INFO:teuthology.orchestra.run.smithi073.stderr: 37600K .......... .......... .......... .......... .......... 22% 358M 5s 2024-03-29T04:09:19.190 INFO:teuthology.orchestra.run.smithi073.stderr: 37650K .......... .......... .......... .......... .......... 22% 365M 5s 2024-03-29T04:09:19.190 INFO:teuthology.orchestra.run.smithi073.stderr: 37700K .......... .......... .......... .......... .......... 22% 105M 5s 2024-03-29T04:09:19.190 INFO:teuthology.orchestra.run.smithi073.stderr: 37750K .......... .......... .......... .......... .......... 22% 118M 5s 2024-03-29T04:09:19.191 INFO:teuthology.orchestra.run.smithi073.stderr: 37800K .......... .......... .......... .......... .......... 22% 105M 5s 2024-03-29T04:09:19.191 INFO:teuthology.orchestra.run.smithi073.stderr: 37850K .......... .......... .......... .......... .......... 22% 43.8M 5s 2024-03-29T04:09:19.191 INFO:teuthology.orchestra.run.smithi073.stderr: 37900K .......... .......... .......... .......... .......... 22% 44.2M 5s 2024-03-29T04:09:19.191 INFO:teuthology.orchestra.run.smithi073.stderr: 37950K .......... .......... .......... .......... .......... 22% 23.0M 5s 2024-03-29T04:09:19.191 INFO:teuthology.orchestra.run.smithi073.stderr: 38000K .......... .......... .......... .......... .......... 22% 26.9M 5s 2024-03-29T04:09:19.191 INFO:teuthology.orchestra.run.smithi073.stderr: 38050K .......... .......... .......... .......... .......... 22% 32.1M 5s 2024-03-29T04:09:19.191 INFO:teuthology.orchestra.run.smithi073.stderr: 38100K .......... .......... .......... .......... .......... 22% 50.8M 5s 2024-03-29T04:09:19.191 INFO:teuthology.orchestra.run.smithi073.stderr: 38150K .......... .......... .......... .......... .......... 22% 23.8M 5s 2024-03-29T04:09:19.191 INFO:teuthology.orchestra.run.smithi073.stderr: 38200K .......... .......... .......... .......... .......... 22% 25.3M 5s 2024-03-29T04:09:19.191 INFO:teuthology.orchestra.run.smithi073.stderr: 38250K .......... .......... .......... .......... .......... 22% 31.6M 5s 2024-03-29T04:09:19.191 INFO:teuthology.orchestra.run.smithi073.stderr: 38300K .......... .......... .......... .......... .......... 22% 25.2M 5s 2024-03-29T04:09:19.191 INFO:teuthology.orchestra.run.smithi073.stderr: 38350K .......... .......... .......... .......... .......... 22% 24.4M 5s 2024-03-29T04:09:19.191 INFO:teuthology.orchestra.run.smithi073.stderr: 38400K .......... .......... .......... .......... .......... 22% 57.3M 5s 2024-03-29T04:09:19.192 INFO:teuthology.orchestra.run.smithi073.stderr: 38450K .......... .......... .......... .......... .......... 22% 30.7M 5s 2024-03-29T04:09:19.192 INFO:teuthology.orchestra.run.smithi073.stderr: 38500K .......... .......... .......... .......... .......... 22% 24.9M 5s 2024-03-29T04:09:19.192 INFO:teuthology.orchestra.run.smithi073.stderr: 38550K .......... .......... .......... .......... .......... 22% 24.5M 5s 2024-03-29T04:09:19.192 INFO:teuthology.orchestra.run.smithi073.stderr: 38600K .......... .......... .......... .......... .......... 22% 24.8M 5s 2024-03-29T04:09:19.192 INFO:teuthology.orchestra.run.smithi073.stderr: 38650K .......... .......... .......... .......... .......... 22% 60.1M 5s 2024-03-29T04:09:19.192 INFO:teuthology.orchestra.run.smithi073.stderr: 38700K .......... .......... .......... .......... .......... 22% 24.5M 5s 2024-03-29T04:09:19.192 INFO:teuthology.orchestra.run.smithi073.stderr: 38750K .......... .......... .......... .......... .......... 23% 21.4M 5s 2024-03-29T04:09:19.192 INFO:teuthology.orchestra.run.smithi073.stderr: 38800K .......... .......... .......... .......... .......... 23% 24.5M 5s 2024-03-29T04:09:19.192 INFO:teuthology.orchestra.run.smithi073.stderr: 38850K .......... .......... .......... .......... .......... 23% 24.7M 5s 2024-03-29T04:09:19.192 INFO:teuthology.orchestra.run.smithi073.stderr: 38900K .......... .......... .......... .......... .......... 23% 113M 5s 2024-03-29T04:09:19.192 INFO:teuthology.orchestra.run.smithi073.stderr: 38950K .......... .......... .......... .......... .......... 23% 22.8M 5s 2024-03-29T04:09:19.192 INFO:teuthology.orchestra.run.smithi073.stderr: 39000K .......... .......... .......... .......... .......... 23% 29.8M 5s 2024-03-29T04:09:19.192 INFO:teuthology.orchestra.run.smithi073.stderr: 39050K .......... .......... .......... .......... .......... 23% 24.9M 5s 2024-03-29T04:09:19.193 INFO:teuthology.orchestra.run.smithi073.stderr: 39100K .......... .......... .......... .......... .......... 23% 24.5M 5s 2024-03-29T04:09:19.193 INFO:teuthology.orchestra.run.smithi073.stderr: 39150K .......... .......... .......... .......... .......... 23% 111M 5s 2024-03-29T04:09:19.193 INFO:teuthology.orchestra.run.smithi073.stderr: 39200K .......... .......... .......... .......... .......... 23% 28.8M 5s 2024-03-29T04:09:19.193 INFO:teuthology.orchestra.run.smithi073.stderr: 39250K .......... .......... .......... .......... .......... 23% 16.9M 5s 2024-03-29T04:09:19.193 INFO:teuthology.orchestra.run.smithi073.stderr: 39300K .......... .......... .......... .......... .......... 23% 32.4M 5s 2024-03-29T04:09:19.193 INFO:teuthology.orchestra.run.smithi073.stderr: 39350K .......... .......... .......... .......... .......... 23% 25.4M 5s 2024-03-29T04:09:19.193 INFO:teuthology.orchestra.run.smithi073.stderr: 39400K .......... .......... .......... .......... .......... 23% 108M 5s 2024-03-29T04:09:19.193 INFO:teuthology.orchestra.run.smithi073.stderr: 39450K .......... .......... .......... .......... .......... 23% 25.5M 5s 2024-03-29T04:09:19.193 INFO:teuthology.orchestra.run.smithi073.stderr: 39500K .......... .......... .......... .......... .......... 23% 25.4M 5s 2024-03-29T04:09:19.193 INFO:teuthology.orchestra.run.smithi073.stderr: 39550K .......... .......... .......... .......... .......... 23% 25.0M 5s 2024-03-29T04:09:19.193 INFO:teuthology.orchestra.run.smithi073.stderr: 39600K .......... .......... .......... .......... .......... 23% 41.4M 5s 2024-03-29T04:09:19.193 INFO:teuthology.orchestra.run.smithi073.stderr: 39650K .......... .......... .......... .......... .......... 23% 36.4M 5s 2024-03-29T04:09:19.193 INFO:teuthology.orchestra.run.smithi073.stderr: 39700K .......... .......... .......... .......... .......... 23% 28.2M 5s 2024-03-29T04:09:19.194 INFO:teuthology.orchestra.run.smithi073.stderr: 39750K .......... .......... .......... .......... .......... 23% 21.4M 5s 2024-03-29T04:09:19.194 INFO:teuthology.orchestra.run.smithi073.stderr: 39800K .......... .......... .......... .......... .......... 23% 36.9M 5s 2024-03-29T04:09:19.194 INFO:teuthology.orchestra.run.smithi073.stderr: 39850K .......... .......... .......... .......... .......... 23% 21.8M 5s 2024-03-29T04:09:19.194 INFO:teuthology.orchestra.run.smithi073.stderr: 39900K .......... .......... .......... .......... .......... 23% 56.1M 5s 2024-03-29T04:09:19.194 INFO:teuthology.orchestra.run.smithi073.stderr: 39950K .......... .......... .......... .......... .......... 23% 24.5M 5s 2024-03-29T04:09:19.194 INFO:teuthology.orchestra.run.smithi073.stderr: 40000K .......... .......... .......... .......... .......... 23% 24.4M 5s 2024-03-29T04:09:19.194 INFO:teuthology.orchestra.run.smithi073.stderr: 40050K .......... .......... .......... .......... .......... 23% 40.2M 5s 2024-03-29T04:09:19.194 INFO:teuthology.orchestra.run.smithi073.stderr: 40100K .......... .......... .......... .......... .......... 23% 25.6M 5s 2024-03-29T04:09:19.194 INFO:teuthology.orchestra.run.smithi073.stderr: 40150K .......... .......... .......... .......... .......... 23% 38.6M 5s 2024-03-29T04:09:19.194 INFO:teuthology.orchestra.run.smithi073.stderr: 40200K .......... .......... .......... .......... .......... 23% 24.5M 5s 2024-03-29T04:09:19.194 INFO:teuthology.orchestra.run.smithi073.stderr: 40250K .......... .......... .......... .......... .......... 23% 24.9M 5s 2024-03-29T04:09:19.194 INFO:teuthology.orchestra.run.smithi073.stderr: 40300K .......... .......... .......... .......... .......... 23% 39.8M 5s 2024-03-29T04:09:19.195 INFO:teuthology.orchestra.run.smithi073.stderr: 40350K .......... .......... .......... .......... .......... 23% 24.4M 5s 2024-03-29T04:09:19.195 INFO:teuthology.orchestra.run.smithi073.stderr: 40400K .......... .......... .......... .......... .......... 23% 41.9M 5s 2024-03-29T04:09:19.195 INFO:teuthology.orchestra.run.smithi073.stderr: 40450K .......... .......... .......... .......... .......... 24% 24.6M 5s 2024-03-29T04:09:19.195 INFO:teuthology.orchestra.run.smithi073.stderr: 40500K .......... .......... .......... .......... .......... 24% 24.3M 5s 2024-03-29T04:09:19.195 INFO:teuthology.orchestra.run.smithi073.stderr: 40550K .......... .......... .......... .......... .......... 24% 38.4M 5s 2024-03-29T04:09:19.195 INFO:teuthology.orchestra.run.smithi073.stderr: 40600K .......... .......... .......... .......... .......... 24% 25.4M 5s 2024-03-29T04:09:19.195 INFO:teuthology.orchestra.run.smithi073.stderr: 40650K .......... .......... .......... .......... .......... 24% 42.4M 5s 2024-03-29T04:09:19.195 INFO:teuthology.orchestra.run.smithi073.stderr: 40700K .......... .......... .......... .......... .......... 24% 23.8M 5s 2024-03-29T04:09:19.195 INFO:teuthology.orchestra.run.smithi073.stderr: 40750K .......... .......... .......... .......... .......... 24% 38.1M 5s 2024-03-29T04:09:19.195 INFO:teuthology.orchestra.run.smithi073.stderr: 40800K .......... .......... .......... .......... .......... 24% 24.2M 5s 2024-03-29T04:09:19.195 INFO:teuthology.orchestra.run.smithi073.stderr: 40850K .......... .......... .......... .......... .......... 24% 20.8M 5s 2024-03-29T04:09:19.195 INFO:teuthology.orchestra.run.smithi073.stderr: 40900K .......... .......... .......... .......... .......... 24% 60.7M 5s 2024-03-29T04:09:19.195 INFO:teuthology.orchestra.run.smithi073.stderr: 40950K .......... .......... .......... .......... .......... 24% 30.4M 5s 2024-03-29T04:09:19.196 INFO:teuthology.orchestra.run.smithi073.stderr: 41000K .......... .......... .......... .......... .......... 24% 23.4M 5s 2024-03-29T04:09:19.196 INFO:teuthology.orchestra.run.smithi073.stderr: 41050K .......... .......... .......... .......... .......... 24% 28.2M 5s 2024-03-29T04:09:19.196 INFO:teuthology.orchestra.run.smithi073.stderr: 41100K .......... .......... .......... .......... .......... 24% 25.3M 5s 2024-03-29T04:09:19.196 INFO:teuthology.orchestra.run.smithi073.stderr: 41150K .......... .......... .......... .......... .......... 24% 50.5M 5s 2024-03-29T04:09:19.196 INFO:teuthology.orchestra.run.smithi073.stderr: 41200K .......... .......... .......... .......... .......... 24% 24.7M 5s 2024-03-29T04:09:19.196 INFO:teuthology.orchestra.run.smithi073.stderr: 41250K .......... .......... .......... .......... .......... 24% 34.3M 5s 2024-03-29T04:09:19.196 INFO:teuthology.orchestra.run.smithi073.stderr: 41300K .......... .......... .......... .......... .......... 24% 24.7M 5s 2024-03-29T04:09:19.196 INFO:teuthology.orchestra.run.smithi073.stderr: 41350K .......... .......... .......... .......... .......... 24% 21.5M 5s 2024-03-29T04:09:19.196 INFO:teuthology.orchestra.run.smithi073.stderr: 41400K .......... .......... .......... .......... .......... 24% 63.2M 5s 2024-03-29T04:09:19.196 INFO:teuthology.orchestra.run.smithi073.stderr: 41450K .......... .......... .......... .......... .......... 24% 25.1M 5s 2024-03-29T04:09:19.196 INFO:teuthology.orchestra.run.smithi073.stderr: 41500K .......... .......... .......... .......... .......... 24% 30.8M 5s 2024-03-29T04:09:19.196 INFO:teuthology.orchestra.run.smithi073.stderr: 41550K .......... .......... .......... .......... .......... 24% 27.2M 5s 2024-03-29T04:09:19.196 INFO:teuthology.orchestra.run.smithi073.stderr: 41600K .......... .......... .......... .......... .......... 24% 24.6M 5s 2024-03-29T04:09:19.197 INFO:teuthology.orchestra.run.smithi073.stderr: 41650K .......... .......... .......... .......... .......... 24% 47.8M 5s 2024-03-29T04:09:19.197 INFO:teuthology.orchestra.run.smithi073.stderr: 41700K .......... .......... .......... .......... .......... 24% 25.8M 5s 2024-03-29T04:09:19.197 INFO:teuthology.orchestra.run.smithi073.stderr: 41750K .......... .......... .......... .......... .......... 24% 22.9M 5s 2024-03-29T04:09:19.197 INFO:teuthology.orchestra.run.smithi073.stderr: 41800K .......... .......... .......... .......... .......... 24% 39.2M 5s 2024-03-29T04:09:19.197 INFO:teuthology.orchestra.run.smithi073.stderr: 41850K .......... .......... .......... .......... .......... 24% 33.3M 5s 2024-03-29T04:09:19.197 INFO:teuthology.orchestra.run.smithi073.stderr: 41900K .......... .......... .......... .......... .......... 24% 31.9M 5s 2024-03-29T04:09:19.197 INFO:teuthology.orchestra.run.smithi073.stderr: 41950K .......... .......... .......... .......... .......... 24% 23.0M 5s 2024-03-29T04:09:19.197 INFO:teuthology.orchestra.run.smithi073.stderr: 42000K .......... .......... .......... .......... .......... 24% 29.6M 5s 2024-03-29T04:09:19.197 INFO:teuthology.orchestra.run.smithi073.stderr: 42050K .......... .......... .......... .......... .......... 24% 32.1M 5s 2024-03-29T04:09:19.197 INFO:teuthology.orchestra.run.smithi073.stderr: 42100K .......... .......... .......... .......... .......... 25% 24.0M 5s 2024-03-29T04:09:19.197 INFO:teuthology.orchestra.run.smithi073.stderr: 42150K .......... .......... .......... .......... .......... 25% 41.9M 5s 2024-03-29T04:09:19.197 INFO:teuthology.orchestra.run.smithi073.stderr: 42200K .......... .......... .......... .......... .......... 25% 25.7M 5s 2024-03-29T04:09:19.197 INFO:teuthology.orchestra.run.smithi073.stderr: 42250K .......... .......... .......... .......... .......... 25% 28.0M 5s 2024-03-29T04:09:19.198 INFO:teuthology.orchestra.run.smithi073.stderr: 42300K .......... .......... .......... .......... .......... 25% 31.9M 5s 2024-03-29T04:09:19.198 INFO:teuthology.orchestra.run.smithi073.stderr: 42350K .......... .......... .......... .......... .......... 25% 22.4M 5s 2024-03-29T04:09:19.198 INFO:teuthology.orchestra.run.smithi073.stderr: 42400K .......... .......... .......... .......... .......... 25% 55.0M 5s 2024-03-29T04:09:19.198 INFO:teuthology.orchestra.run.smithi073.stderr: 42450K .......... .......... .......... .......... .......... 25% 26.0M 5s 2024-03-29T04:09:19.198 INFO:teuthology.orchestra.run.smithi073.stderr: 42500K .......... .......... .......... .......... .......... 25% 25.1M 5s 2024-03-29T04:09:19.198 INFO:teuthology.orchestra.run.smithi073.stderr: 42550K .......... .......... .......... .......... .......... 25% 35.1M 5s 2024-03-29T04:09:19.198 INFO:teuthology.orchestra.run.smithi073.stderr: 42600K .......... .......... .......... .......... .......... 25% 21.7M 5s 2024-03-29T04:09:19.198 INFO:teuthology.orchestra.run.smithi073.stderr: 42650K .......... .......... .......... .......... .......... 25% 24.2M 5s 2024-03-29T04:09:19.198 INFO:teuthology.orchestra.run.smithi073.stderr: 42700K .......... .......... .......... .......... .......... 25% 70.7M 5s 2024-03-29T04:09:19.198 INFO:teuthology.orchestra.run.smithi073.stderr: 42750K .......... .......... .......... .......... .......... 25% 23.5M 5s 2024-03-29T04:09:19.198 INFO:teuthology.orchestra.run.smithi073.stderr: 42800K .......... .......... .......... .......... .......... 25% 30.4M 5s 2024-03-29T04:09:19.198 INFO:teuthology.orchestra.run.smithi073.stderr: 42850K .......... .......... .......... .......... .......... 25% 24.9M 5s 2024-03-29T04:09:19.198 INFO:teuthology.orchestra.run.smithi073.stderr: 42900K .......... .......... .......... .......... .......... 25% 24.1M 5s 2024-03-29T04:09:19.199 INFO:teuthology.orchestra.run.smithi073.stderr: 42950K .......... .......... .......... .......... .......... 25% 60.1M 5s 2024-03-29T04:09:19.199 INFO:teuthology.orchestra.run.smithi073.stderr: 43000K .......... .......... .......... .......... .......... 25% 24.9M 5s 2024-03-29T04:09:19.199 INFO:teuthology.orchestra.run.smithi073.stderr: 43050K .......... .......... .......... .......... .......... 25% 30.6M 5s 2024-03-29T04:09:19.199 INFO:teuthology.orchestra.run.smithi073.stderr: 43100K .......... .......... .......... .......... .......... 25% 21.9M 5s 2024-03-29T04:09:19.199 INFO:teuthology.orchestra.run.smithi073.stderr: 43150K .......... .......... .......... .......... .......... 25% 25.9M 5s 2024-03-29T04:09:19.199 INFO:teuthology.orchestra.run.smithi073.stderr: 43200K .......... .......... .......... .......... .......... 25% 48.5M 5s 2024-03-29T04:09:19.199 INFO:teuthology.orchestra.run.smithi073.stderr: 43250K .......... .......... .......... .......... .......... 25% 33.4M 5s 2024-03-29T04:09:19.199 INFO:teuthology.orchestra.run.smithi073.stderr: 43300K .......... .......... .......... .......... .......... 25% 25.6M 5s 2024-03-29T04:09:19.199 INFO:teuthology.orchestra.run.smithi073.stderr: 43350K .......... .......... .......... .......... .......... 25% 24.1M 5s 2024-03-29T04:09:19.199 INFO:teuthology.orchestra.run.smithi073.stderr: 43400K .......... .......... .......... .......... .......... 25% 27.2M 5s 2024-03-29T04:09:19.199 INFO:teuthology.orchestra.run.smithi073.stderr: 43450K .......... .......... .......... .......... .......... 25% 45.4M 5s 2024-03-29T04:09:19.199 INFO:teuthology.orchestra.run.smithi073.stderr: 43500K .......... .......... .......... .......... .......... 25% 22.6M 5s 2024-03-29T04:09:19.199 INFO:teuthology.orchestra.run.smithi073.stderr: 43550K .......... .......... .......... .......... .......... 25% 40.2M 5s 2024-03-29T04:09:19.200 INFO:teuthology.orchestra.run.smithi073.stderr: 43600K .......... .......... .......... .......... .......... 25% 19.6M 5s 2024-03-29T04:09:19.200 INFO:teuthology.orchestra.run.smithi073.stderr: 43650K .......... .......... .......... .......... .......... 25% 28.9M 5s 2024-03-29T04:09:19.200 INFO:teuthology.orchestra.run.smithi073.stderr: 43700K .......... .......... .......... .......... .......... 25% 46.0M 5s 2024-03-29T04:09:19.200 INFO:teuthology.orchestra.run.smithi073.stderr: 43750K .......... .......... .......... .......... .......... 25% 26.8M 5s 2024-03-29T04:09:19.200 INFO:teuthology.orchestra.run.smithi073.stderr: 43800K .......... .......... .......... .......... .......... 26% 33.1M 5s 2024-03-29T04:09:19.200 INFO:teuthology.orchestra.run.smithi073.stderr: 43850K .......... .......... .......... .......... .......... 26% 24.6M 5s 2024-03-29T04:09:19.200 INFO:teuthology.orchestra.run.smithi073.stderr: 43900K .......... .......... .......... .......... .......... 26% 24.4M 5s 2024-03-29T04:09:19.200 INFO:teuthology.orchestra.run.smithi073.stderr: 43950K .......... .......... .......... .......... .......... 26% 46.4M 5s 2024-03-29T04:09:19.200 INFO:teuthology.orchestra.run.smithi073.stderr: 44000K .......... .......... .......... .......... .......... 26% 24.6M 5s 2024-03-29T04:09:19.200 INFO:teuthology.orchestra.run.smithi073.stderr: 44050K .......... .......... .......... .......... .......... 26% 36.4M 5s 2024-03-29T04:09:19.200 INFO:teuthology.orchestra.run.smithi073.stderr: 44100K .......... .......... .......... .......... .......... 26% 22.2M 5s 2024-03-29T04:09:19.200 INFO:teuthology.orchestra.run.smithi073.stderr: 44150K .......... .......... .......... .......... .......... 26% 32.2M 5s 2024-03-29T04:09:19.200 INFO:teuthology.orchestra.run.smithi073.stderr: 44200K .......... .......... .......... .......... .......... 26% 34.2M 5s 2024-03-29T04:09:19.201 INFO:teuthology.orchestra.run.smithi073.stderr: 44250K .......... .......... .......... .......... .......... 26% 24.6M 5s 2024-03-29T04:09:19.201 INFO:teuthology.orchestra.run.smithi073.stderr: 44300K .......... .......... .......... .......... .......... 26% 37.3M 5s 2024-03-29T04:09:19.201 INFO:teuthology.orchestra.run.smithi073.stderr: 44350K .......... .......... .......... .......... .......... 26% 22.8M 5s 2024-03-29T04:09:19.201 INFO:teuthology.orchestra.run.smithi073.stderr: 44400K .......... .......... .......... .......... .......... 26% 50.3M 5s 2024-03-29T04:09:19.201 INFO:teuthology.orchestra.run.smithi073.stderr: 44450K .......... .......... .......... .......... .......... 26% 25.9M 5s 2024-03-29T04:09:19.201 INFO:teuthology.orchestra.run.smithi073.stderr: 44500K .......... .......... .......... .......... .......... 26% 24.6M 5s 2024-03-29T04:09:19.201 INFO:teuthology.orchestra.run.smithi073.stderr: 44550K .......... .......... .......... .......... .......... 26% 29.2M 5s 2024-03-29T04:09:19.201 INFO:teuthology.orchestra.run.smithi073.stderr: 44600K .......... .......... .......... .......... .......... 26% 24.1M 5s 2024-03-29T04:09:19.201 INFO:teuthology.orchestra.run.smithi073.stderr: 44650K .......... .......... .......... .......... .......... 26% 65.5M 5s 2024-03-29T04:09:19.201 INFO:teuthology.orchestra.run.smithi073.stderr: 44700K .......... .......... .......... .......... .......... 26% 25.4M 5s 2024-03-29T04:09:19.201 INFO:teuthology.orchestra.run.smithi073.stderr: 44750K .......... .......... .......... .......... .......... 26% 28.9M 5s 2024-03-29T04:09:19.201 INFO:teuthology.orchestra.run.smithi073.stderr: 44800K .......... .......... .......... .......... .......... 26% 23.5M 5s 2024-03-29T04:09:19.202 INFO:teuthology.orchestra.run.smithi073.stderr: 44850K .......... .......... .......... .......... .......... 26% 44.6M 5s 2024-03-29T04:09:19.202 INFO:teuthology.orchestra.run.smithi073.stderr: 44900K .......... .......... .......... .......... .......... 26% 28.6M 5s 2024-03-29T04:09:19.202 INFO:teuthology.orchestra.run.smithi073.stderr: 44950K .......... .......... .......... .......... .......... 26% 27.3M 5s 2024-03-29T04:09:19.202 INFO:teuthology.orchestra.run.smithi073.stderr: 45000K .......... .......... .......... .......... .......... 26% 26.7M 5s 2024-03-29T04:09:19.202 INFO:teuthology.orchestra.run.smithi073.stderr: 45050K .......... .......... .......... .......... .......... 26% 24.5M 5s 2024-03-29T04:09:19.202 INFO:teuthology.orchestra.run.smithi073.stderr: 45100K .......... .......... .......... .......... .......... 26% 26.2M 5s 2024-03-29T04:09:19.202 INFO:teuthology.orchestra.run.smithi073.stderr: 45150K .......... .......... .......... .......... .......... 26% 27.4M 5s 2024-03-29T04:09:19.202 INFO:teuthology.orchestra.run.smithi073.stderr: 45200K .......... .......... .......... .......... .......... 26% 45.6M 5s 2024-03-29T04:09:19.202 INFO:teuthology.orchestra.run.smithi073.stderr: 45250K .......... .......... .......... .......... .......... 26% 25.6M 5s 2024-03-29T04:09:19.202 INFO:teuthology.orchestra.run.smithi073.stderr: 45300K .......... .......... .......... .......... .......... 26% 27.2M 5s 2024-03-29T04:09:19.202 INFO:teuthology.orchestra.run.smithi073.stderr: 45350K .......... .......... .......... .......... .......... 26% 35.3M 5s 2024-03-29T04:09:19.202 INFO:teuthology.orchestra.run.smithi073.stderr: 45400K .......... .......... .......... .......... .......... 26% 26.3M 5s 2024-03-29T04:09:19.203 INFO:teuthology.orchestra.run.smithi073.stderr: 45450K .......... .......... .......... .......... .......... 26% 39.5M 5s 2024-03-29T04:09:19.203 INFO:teuthology.orchestra.run.smithi073.stderr: 45500K .......... .......... .......... .......... .......... 27% 22.8M 5s 2024-03-29T04:09:19.203 INFO:teuthology.orchestra.run.smithi073.stderr: 45550K .......... .......... .......... .......... .......... 27% 27.0M 5s 2024-03-29T04:09:19.203 INFO:teuthology.orchestra.run.smithi073.stderr: 45600K .......... .......... .......... .......... .......... 27% 24.9M 5s 2024-03-29T04:09:19.203 INFO:teuthology.orchestra.run.smithi073.stderr: 45650K .......... .......... .......... .......... .......... 27% 50.6M 5s 2024-03-29T04:09:19.203 INFO:teuthology.orchestra.run.smithi073.stderr: 45700K .......... .......... .......... .......... .......... 27% 32.8M 5s 2024-03-29T04:09:19.203 INFO:teuthology.orchestra.run.smithi073.stderr: 45750K .......... .......... .......... .......... .......... 27% 24.7M 5s 2024-03-29T04:09:19.203 INFO:teuthology.orchestra.run.smithi073.stderr: 45800K .......... .......... .......... .......... .......... 27% 23.9M 5s 2024-03-29T04:09:19.203 INFO:teuthology.orchestra.run.smithi073.stderr: 45850K .......... .......... .......... .......... .......... 27% 39.0M 5s 2024-03-29T04:09:19.203 INFO:teuthology.orchestra.run.smithi073.stderr: 45900K .......... .......... .......... .......... .......... 27% 21.6M 5s 2024-03-29T04:09:19.203 INFO:teuthology.orchestra.run.smithi073.stderr: 45950K .......... .......... .......... .......... .......... 27% 51.3M 5s 2024-03-29T04:09:19.203 INFO:teuthology.orchestra.run.smithi073.stderr: 46000K .......... .......... .......... .......... .......... 27% 24.9M 5s 2024-03-29T04:09:19.204 INFO:teuthology.orchestra.run.smithi073.stderr: 46050K .......... .......... .......... .......... .......... 27% 26.4M 5s 2024-03-29T04:09:19.204 INFO:teuthology.orchestra.run.smithi073.stderr: 46100K .......... .......... .......... .......... .......... 27% 34.5M 5s 2024-03-29T04:09:19.204 INFO:teuthology.orchestra.run.smithi073.stderr: 46150K .......... .......... .......... .......... .......... 27% 24.7M 5s 2024-03-29T04:09:19.204 INFO:teuthology.orchestra.run.smithi073.stderr: 46200K .......... .......... .......... .......... .......... 27% 37.4M 5s 2024-03-29T04:09:19.204 INFO:teuthology.orchestra.run.smithi073.stderr: 46250K .......... .......... .......... .......... .......... 27% 24.2M 5s 2024-03-29T04:09:19.204 INFO:teuthology.orchestra.run.smithi073.stderr: 46300K .......... .......... .......... .......... .......... 27% 24.9M 5s 2024-03-29T04:09:19.204 INFO:teuthology.orchestra.run.smithi073.stderr: 46350K .......... .......... .......... .......... .......... 27% 37.8M 5s 2024-03-29T04:09:19.204 INFO:teuthology.orchestra.run.smithi073.stderr: 46400K .......... .......... .......... .......... .......... 27% 26.0M 5s 2024-03-29T04:09:19.204 INFO:teuthology.orchestra.run.smithi073.stderr: 46450K .......... .......... .......... .......... .......... 27% 40.7M 5s 2024-03-29T04:09:19.204 INFO:teuthology.orchestra.run.smithi073.stderr: 46500K .......... .......... .......... .......... .......... 27% 24.6M 5s 2024-03-29T04:09:19.204 INFO:teuthology.orchestra.run.smithi073.stderr: 46550K .......... .......... .......... .......... .......... 27% 34.9M 5s 2024-03-29T04:09:19.204 INFO:teuthology.orchestra.run.smithi073.stderr: 46600K .......... .......... .......... .......... .......... 27% 24.7M 5s 2024-03-29T04:09:19.204 INFO:teuthology.orchestra.run.smithi073.stderr: 46650K .......... .......... .......... .......... .......... 27% 24.1M 5s 2024-03-29T04:09:19.205 INFO:teuthology.orchestra.run.smithi073.stderr: 46700K .......... .......... .......... .......... .......... 27% 48.7M 5s 2024-03-29T04:09:19.205 INFO:teuthology.orchestra.run.smithi073.stderr: 46750K .......... .......... .......... .......... .......... 27% 25.4M 5s 2024-03-29T04:09:19.205 INFO:teuthology.orchestra.run.smithi073.stderr: 46800K .......... .......... .......... .......... .......... 27% 32.0M 5s 2024-03-29T04:09:19.205 INFO:teuthology.orchestra.run.smithi073.stderr: 46850K .......... .......... .......... .......... .......... 27% 25.2M 5s 2024-03-29T04:09:19.205 INFO:teuthology.orchestra.run.smithi073.stderr: 46900K .......... .......... .......... .......... .......... 27% 27.0M 5s 2024-03-29T04:09:19.205 INFO:teuthology.orchestra.run.smithi073.stderr: 46950K .......... .......... .......... .......... .......... 27% 37.5M 5s 2024-03-29T04:09:19.205 INFO:teuthology.orchestra.run.smithi073.stderr: 47000K .......... .......... .......... .......... .......... 27% 31.7M 5s 2024-03-29T04:09:19.205 INFO:teuthology.orchestra.run.smithi073.stderr: 47050K .......... .......... .......... .......... .......... 27% 23.5M 5s 2024-03-29T04:09:19.205 INFO:teuthology.orchestra.run.smithi073.stderr: 47100K .......... .......... .......... .......... .......... 27% 31.2M 5s 2024-03-29T04:09:19.205 INFO:teuthology.orchestra.run.smithi073.stderr: 47150K .......... .......... .......... .......... .......... 28% 22.2M 5s 2024-03-29T04:09:19.205 INFO:teuthology.orchestra.run.smithi073.stderr: 47200K .......... .......... .......... .......... .......... 28% 48.5M 5s 2024-03-29T04:09:19.205 INFO:teuthology.orchestra.run.smithi073.stderr: 47250K .......... .......... .......... .......... .......... 28% 24.1M 5s 2024-03-29T04:09:19.205 INFO:teuthology.orchestra.run.smithi073.stderr: 47300K .......... .......... .......... .......... .......... 28% 33.6M 5s 2024-03-29T04:09:19.205 INFO:teuthology.orchestra.run.smithi073.stderr: 47350K .......... .......... .......... .......... .......... 28% 27.4M 5s 2024-03-29T04:09:19.206 INFO:teuthology.orchestra.run.smithi073.stderr: 47400K .......... .......... .......... .......... .......... 28% 16.4M 5s 2024-03-29T04:09:19.206 INFO:teuthology.orchestra.run.smithi073.stderr: 47450K .......... .......... .......... .......... .......... 28% 49.7M 5s 2024-03-29T04:09:19.206 INFO:teuthology.orchestra.run.smithi073.stderr: 47500K .......... .......... .......... .......... .......... 28% 36.1M 5s 2024-03-29T04:09:19.206 INFO:teuthology.orchestra.run.smithi073.stderr: 47550K .......... .......... .......... .......... .......... 28% 33.7M 5s 2024-03-29T04:09:19.206 INFO:teuthology.orchestra.run.smithi073.stderr: 47600K .......... .......... .......... .......... .......... 28% 29.0M 5s 2024-03-29T04:09:19.206 INFO:teuthology.orchestra.run.smithi073.stderr: 47650K .......... .......... .......... .......... .......... 28% 24.5M 5s 2024-03-29T04:09:19.206 INFO:teuthology.orchestra.run.smithi073.stderr: 47700K .......... .......... .......... .......... .......... 28% 47.0M 5s 2024-03-29T04:09:19.206 INFO:teuthology.orchestra.run.smithi073.stderr: 47750K .......... .......... .......... .......... .......... 28% 26.5M 5s 2024-03-29T04:09:19.206 INFO:teuthology.orchestra.run.smithi073.stderr: 47800K .......... .......... .......... .......... .......... 28% 22.8M 5s 2024-03-29T04:09:19.206 INFO:teuthology.orchestra.run.smithi073.stderr: 47850K .......... .......... .......... .......... .......... 28% 33.8M 5s 2024-03-29T04:09:19.206 INFO:teuthology.orchestra.run.smithi073.stderr: 47900K .......... .......... .......... .......... .......... 28% 33.1M 5s 2024-03-29T04:09:19.206 INFO:teuthology.orchestra.run.smithi073.stderr: 47950K .......... .......... .......... .......... .......... 28% 22.8M 5s 2024-03-29T04:09:19.206 INFO:teuthology.orchestra.run.smithi073.stderr: 48000K .......... .......... .......... .......... .......... 28% 34.6M 5s 2024-03-29T04:09:19.207 INFO:teuthology.orchestra.run.smithi073.stderr: 48050K .......... .......... .......... .......... .......... 28% 25.4M 5s 2024-03-29T04:09:19.207 INFO:teuthology.orchestra.run.smithi073.stderr: 48100K .......... .......... .......... .......... .......... 28% 43.2M 5s 2024-03-29T04:09:19.207 INFO:teuthology.orchestra.run.smithi073.stderr: 48150K .......... .......... .......... .......... .......... 28% 21.0M 5s 2024-03-29T04:09:19.207 INFO:teuthology.orchestra.run.smithi073.stderr: 48200K .......... .......... .......... .......... .......... 28% 24.2M 5s 2024-03-29T04:09:19.207 INFO:teuthology.orchestra.run.smithi073.stderr: 48250K .......... .......... .......... .......... .......... 28% 60.1M 5s 2024-03-29T04:09:19.207 INFO:teuthology.orchestra.run.smithi073.stderr: 48300K .......... .......... .......... .......... .......... 28% 29.5M 5s 2024-03-29T04:09:19.207 INFO:teuthology.orchestra.run.smithi073.stderr: 48350K .......... .......... .......... .......... .......... 28% 25.7M 5s 2024-03-29T04:09:19.207 INFO:teuthology.orchestra.run.smithi073.stderr: 48400K .......... .......... .......... .......... .......... 28% 24.6M 5s 2024-03-29T04:09:19.207 INFO:teuthology.orchestra.run.smithi073.stderr: 48450K .......... .......... .......... .......... .......... 28% 24.3M 5s 2024-03-29T04:09:19.207 INFO:teuthology.orchestra.run.smithi073.stderr: 48500K .......... .......... .......... .......... .......... 28% 75.2M 5s 2024-03-29T04:09:19.207 INFO:teuthology.orchestra.run.smithi073.stderr: 48550K .......... .......... .......... .......... .......... 28% 27.6M 5s 2024-03-29T04:09:19.207 INFO:teuthology.orchestra.run.smithi073.stderr: 48600K .......... .......... .......... .......... .......... 28% 19.2M 5s 2024-03-29T04:09:19.207 INFO:teuthology.orchestra.run.smithi073.stderr: 48650K .......... .......... .......... .......... .......... 28% 36.5M 5s 2024-03-29T04:09:19.208 INFO:teuthology.orchestra.run.smithi073.stderr: 48700K .......... .......... .......... .......... .......... 28% 37.4M 5s 2024-03-29T04:09:19.208 INFO:teuthology.orchestra.run.smithi073.stderr: 48750K .......... .......... .......... .......... .......... 28% 29.6M 5s 2024-03-29T04:09:19.208 INFO:teuthology.orchestra.run.smithi073.stderr: 48800K .......... .......... .......... .......... .......... 28% 25.5M 5s 2024-03-29T04:09:19.208 INFO:teuthology.orchestra.run.smithi073.stderr: 48850K .......... .......... .......... .......... .......... 29% 32.4M 5s 2024-03-29T04:09:19.208 INFO:teuthology.orchestra.run.smithi073.stderr: 48900K .......... .......... .......... .......... .......... 29% 26.8M 5s 2024-03-29T04:09:19.208 INFO:teuthology.orchestra.run.smithi073.stderr: 48950K .......... .......... .......... .......... .......... 29% 22.6M 5s 2024-03-29T04:09:19.208 INFO:teuthology.orchestra.run.smithi073.stderr: 49000K .......... .......... .......... .......... .......... 29% 42.1M 5s 2024-03-29T04:09:19.208 INFO:teuthology.orchestra.run.smithi073.stderr: 49050K .......... .......... .......... .......... .......... 29% 28.9M 4s 2024-03-29T04:09:19.208 INFO:teuthology.orchestra.run.smithi073.stderr: 49100K .......... .......... .......... .......... .......... 29% 32.2M 4s 2024-03-29T04:09:19.208 INFO:teuthology.orchestra.run.smithi073.stderr: 49150K .......... .......... .......... .......... .......... 29% 33.4M 4s 2024-03-29T04:09:19.208 INFO:teuthology.orchestra.run.smithi073.stderr: 49200K .......... .......... .......... .......... .......... 29% 19.5M 4s 2024-03-29T04:09:19.208 INFO:teuthology.orchestra.run.smithi073.stderr: 49250K .......... .......... .......... .......... .......... 29% 46.2M 4s 2024-03-29T04:09:19.208 INFO:teuthology.orchestra.run.smithi073.stderr: 49300K .......... .......... .......... .......... .......... 29% 24.3M 4s 2024-03-29T04:09:19.209 INFO:teuthology.orchestra.run.smithi073.stderr: 49350K .......... .......... .......... .......... .......... 29% 36.1M 4s 2024-03-29T04:09:19.209 INFO:teuthology.orchestra.run.smithi073.stderr: 49400K .......... .......... .......... .......... .......... 29% 24.3M 4s 2024-03-29T04:09:19.209 INFO:teuthology.orchestra.run.smithi073.stderr: 49450K .......... .......... .......... .......... .......... 29% 25.3M 4s 2024-03-29T04:09:19.209 INFO:teuthology.orchestra.run.smithi073.stderr: 49500K .......... .......... .......... .......... .......... 29% 53.8M 4s 2024-03-29T04:09:19.209 INFO:teuthology.orchestra.run.smithi073.stderr: 49550K .......... .......... .......... .......... .......... 29% 27.9M 4s 2024-03-29T04:09:19.209 INFO:teuthology.orchestra.run.smithi073.stderr: 49600K .......... .......... .......... .......... .......... 29% 27.7M 4s 2024-03-29T04:09:19.209 INFO:teuthology.orchestra.run.smithi073.stderr: 49650K .......... .......... .......... .......... .......... 29% 24.8M 4s 2024-03-29T04:09:19.209 INFO:teuthology.orchestra.run.smithi073.stderr: 49700K .......... .......... .......... .......... .......... 29% 36.0M 4s 2024-03-29T04:09:19.209 INFO:teuthology.orchestra.run.smithi073.stderr: 49750K .......... .......... .......... .......... .......... 29% 32.1M 4s 2024-03-29T04:09:19.209 INFO:teuthology.orchestra.run.smithi073.stderr: 49800K .......... .......... .......... .......... .......... 29% 25.1M 4s 2024-03-29T04:09:19.209 INFO:teuthology.orchestra.run.smithi073.stderr: 49850K .......... .......... .......... .......... .......... 29% 24.3M 4s 2024-03-29T04:09:19.209 INFO:teuthology.orchestra.run.smithi073.stderr: 49900K .......... .......... .......... .......... .......... 29% 31.7M 4s 2024-03-29T04:09:19.209 INFO:teuthology.orchestra.run.smithi073.stderr: 49950K .......... .......... .......... .......... .......... 29% 25.4M 4s 2024-03-29T04:09:19.209 INFO:teuthology.orchestra.run.smithi073.stderr: 50000K .......... .......... .......... .......... .......... 29% 49.4M 4s 2024-03-29T04:09:19.210 INFO:teuthology.orchestra.run.smithi073.stderr: 50050K .......... .......... .......... .......... .......... 29% 24.8M 4s 2024-03-29T04:09:19.210 INFO:teuthology.orchestra.run.smithi073.stderr: 50100K .......... .......... .......... .......... .......... 29% 30.8M 4s 2024-03-29T04:09:19.210 INFO:teuthology.orchestra.run.smithi073.stderr: 50150K .......... .......... .......... .......... .......... 29% 24.8M 4s 2024-03-29T04:09:19.210 INFO:teuthology.orchestra.run.smithi073.stderr: 50200K .......... .......... .......... .......... .......... 29% 24.6M 4s 2024-03-29T04:09:19.210 INFO:teuthology.orchestra.run.smithi073.stderr: 50250K .......... .......... .......... .......... .......... 29% 49.9M 4s 2024-03-29T04:09:19.210 INFO:teuthology.orchestra.run.smithi073.stderr: 50300K .......... .......... .......... .......... .......... 29% 25.9M 4s 2024-03-29T04:09:19.210 INFO:teuthology.orchestra.run.smithi073.stderr: 50350K .......... .......... .......... .......... .......... 29% 31.7M 4s 2024-03-29T04:09:19.210 INFO:teuthology.orchestra.run.smithi073.stderr: 50400K .......... .......... .......... .......... .......... 29% 25.3M 4s 2024-03-29T04:09:19.210 INFO:teuthology.orchestra.run.smithi073.stderr: 50450K .......... .......... .......... .......... .......... 29% 24.7M 4s 2024-03-29T04:09:19.210 INFO:teuthology.orchestra.run.smithi073.stderr: 50500K .......... .......... .......... .......... .......... 29% 44.7M 4s 2024-03-29T04:09:19.210 INFO:teuthology.orchestra.run.smithi073.stderr: 50550K .......... .......... .......... .......... .......... 30% 24.2M 4s 2024-03-29T04:09:19.211 INFO:teuthology.orchestra.run.smithi073.stderr: 50600K .......... .......... .......... .......... .......... 30% 36.0M 4s 2024-03-29T04:09:19.211 INFO:teuthology.orchestra.run.smithi073.stderr: 50650K .......... .......... .......... .......... .......... 30% 24.7M 4s 2024-03-29T04:09:19.211 INFO:teuthology.orchestra.run.smithi073.stderr: 50700K .......... .......... .......... .......... .......... 30% 24.3M 4s 2024-03-29T04:09:19.211 INFO:teuthology.orchestra.run.smithi073.stderr: 50750K .......... .......... .......... .......... .......... 30% 48.6M 4s 2024-03-29T04:09:19.211 INFO:teuthology.orchestra.run.smithi073.stderr: 50800K .......... .......... .......... .......... .......... 30% 24.6M 4s 2024-03-29T04:09:19.211 INFO:teuthology.orchestra.run.smithi073.stderr: 50850K .......... .......... .......... .......... .......... 30% 34.6M 4s 2024-03-29T04:09:19.211 INFO:teuthology.orchestra.run.smithi073.stderr: 50900K .......... .......... .......... .......... .......... 30% 23.4M 4s 2024-03-29T04:09:19.211 INFO:teuthology.orchestra.run.smithi073.stderr: 50950K .......... .......... .......... .......... .......... 30% 29.2M 4s 2024-03-29T04:09:19.211 INFO:teuthology.orchestra.run.smithi073.stderr: 51000K .......... .......... .......... .......... .......... 30% 37.8M 4s 2024-03-29T04:09:19.211 INFO:teuthology.orchestra.run.smithi073.stderr: 51050K .......... .......... .......... .......... .......... 30% 26.0M 4s 2024-03-29T04:09:19.211 INFO:teuthology.orchestra.run.smithi073.stderr: 51100K .......... .......... .......... .......... .......... 30% 23.7M 4s 2024-03-29T04:09:19.211 INFO:teuthology.orchestra.run.smithi073.stderr: 51150K .......... .......... .......... .......... .......... 30% 31.5M 4s 2024-03-29T04:09:19.211 INFO:teuthology.orchestra.run.smithi073.stderr: 51200K .......... .......... .......... .......... .......... 30% 54.0M 4s 2024-03-29T04:09:19.211 INFO:teuthology.orchestra.run.smithi073.stderr: 51250K .......... .......... .......... .......... .......... 30% 27.1M 4s 2024-03-29T04:09:19.212 INFO:teuthology.orchestra.run.smithi073.stderr: 51300K .......... .......... .......... .......... .......... 30% 23.9M 4s 2024-03-29T04:09:19.212 INFO:teuthology.orchestra.run.smithi073.stderr: 51350K .......... .......... .......... .......... .......... 30% 31.5M 4s 2024-03-29T04:09:19.212 INFO:teuthology.orchestra.run.smithi073.stderr: 51400K .......... .......... .......... .......... .......... 30% 24.7M 4s 2024-03-29T04:09:19.212 INFO:teuthology.orchestra.run.smithi073.stderr: 51450K .......... .......... .......... .......... .......... 30% 48.4M 4s 2024-03-29T04:09:19.212 INFO:teuthology.orchestra.run.smithi073.stderr: 51500K .......... .......... .......... .......... .......... 30% 26.3M 4s 2024-03-29T04:09:19.212 INFO:teuthology.orchestra.run.smithi073.stderr: 51550K .......... .......... .......... .......... .......... 30% 23.0M 4s 2024-03-29T04:09:19.212 INFO:teuthology.orchestra.run.smithi073.stderr: 51600K .......... .......... .......... .......... .......... 30% 25.3M 4s 2024-03-29T04:09:19.212 INFO:teuthology.orchestra.run.smithi073.stderr: 51650K .......... .......... .......... .......... .......... 30% 48.0M 4s 2024-03-29T04:09:19.212 INFO:teuthology.orchestra.run.smithi073.stderr: 51700K .......... .......... .......... .......... .......... 30% 19.4M 4s 2024-03-29T04:09:19.212 INFO:teuthology.orchestra.run.smithi073.stderr: 51750K .......... .......... .......... .......... .......... 30% 67.4M 4s 2024-03-29T04:09:19.212 INFO:teuthology.orchestra.run.smithi073.stderr: 51800K .......... .......... .......... .......... .......... 30% 27.7M 4s 2024-03-29T04:09:19.212 INFO:teuthology.orchestra.run.smithi073.stderr: 51850K .......... .......... .......... .......... .......... 30% 24.9M 4s 2024-03-29T04:09:19.212 INFO:teuthology.orchestra.run.smithi073.stderr: 51900K .......... .......... .......... .......... .......... 30% 23.8M 4s 2024-03-29T04:09:19.213 INFO:teuthology.orchestra.run.smithi073.stderr: 51950K .......... .......... .......... .......... .......... 30% 58.3M 4s 2024-03-29T04:09:19.213 INFO:teuthology.orchestra.run.smithi073.stderr: 52000K .......... .......... .......... .......... .......... 30% 28.1M 4s 2024-03-29T04:09:19.213 INFO:teuthology.orchestra.run.smithi073.stderr: 52050K .......... .......... .......... .......... .......... 30% 25.5M 4s 2024-03-29T04:09:19.213 INFO:teuthology.orchestra.run.smithi073.stderr: 52100K .......... .......... .......... .......... .......... 30% 25.0M 4s 2024-03-29T04:09:19.213 INFO:teuthology.orchestra.run.smithi073.stderr: 52150K .......... .......... .......... .......... .......... 30% 25.0M 4s 2024-03-29T04:09:19.213 INFO:teuthology.orchestra.run.smithi073.stderr: 52200K .......... .......... .......... .......... .......... 30% 50.7M 4s 2024-03-29T04:09:19.213 INFO:teuthology.orchestra.run.smithi073.stderr: 52250K .......... .......... .......... .......... .......... 31% 30.3M 4s 2024-03-29T04:09:19.213 INFO:teuthology.orchestra.run.smithi073.stderr: 52300K .......... .......... .......... .......... .......... 31% 26.3M 4s 2024-03-29T04:09:19.213 INFO:teuthology.orchestra.run.smithi073.stderr: 52350K .......... .......... .......... .......... .......... 31% 28.9M 4s 2024-03-29T04:09:19.213 INFO:teuthology.orchestra.run.smithi073.stderr: 52400K .......... .......... .......... .......... .......... 31% 21.2M 4s 2024-03-29T04:09:19.213 INFO:teuthology.orchestra.run.smithi073.stderr: 52450K .......... .......... .......... .......... .......... 31% 41.2M 4s 2024-03-29T04:09:19.213 INFO:teuthology.orchestra.run.smithi073.stderr: 52500K .......... .......... .......... .......... .......... 31% 34.8M 4s 2024-03-29T04:09:19.213 INFO:teuthology.orchestra.run.smithi073.stderr: 52550K .......... .......... .......... .......... .......... 31% 25.4M 4s 2024-03-29T04:09:19.214 INFO:teuthology.orchestra.run.smithi073.stderr: 52600K .......... .......... .......... .......... .......... 31% 25.1M 4s 2024-03-29T04:09:19.214 INFO:teuthology.orchestra.run.smithi073.stderr: 52650K .......... .......... .......... .......... .......... 31% 24.3M 4s 2024-03-29T04:09:19.214 INFO:teuthology.orchestra.run.smithi073.stderr: 52700K .......... .......... .......... .......... .......... 31% 52.1M 4s 2024-03-29T04:09:19.214 INFO:teuthology.orchestra.run.smithi073.stderr: 52750K .......... .......... .......... .......... .......... 31% 33.1M 4s 2024-03-29T04:09:19.214 INFO:teuthology.orchestra.run.smithi073.stderr: 52800K .......... .......... .......... .......... .......... 31% 20.0M 4s 2024-03-29T04:09:19.214 INFO:teuthology.orchestra.run.smithi073.stderr: 52850K .......... .......... .......... .......... .......... 31% 29.3M 4s 2024-03-29T04:09:19.214 INFO:teuthology.orchestra.run.smithi073.stderr: 52900K .......... .......... .......... .......... .......... 31% 24.6M 4s 2024-03-29T04:09:19.214 INFO:teuthology.orchestra.run.smithi073.stderr: 52950K .......... .......... .......... .......... .......... 31% 44.2M 4s 2024-03-29T04:09:19.214 INFO:teuthology.orchestra.run.smithi073.stderr: 53000K .......... .......... .......... .......... .......... 31% 35.7M 4s 2024-03-29T04:09:19.214 INFO:teuthology.orchestra.run.smithi073.stderr: 53050K .......... .......... .......... .......... .......... 31% 24.8M 4s 2024-03-29T04:09:19.214 INFO:teuthology.orchestra.run.smithi073.stderr: 53100K .......... .......... .......... .......... .......... 31% 23.8M 4s 2024-03-29T04:09:19.214 INFO:teuthology.orchestra.run.smithi073.stderr: 53150K .......... .......... .......... .......... .......... 31% 48.6M 4s 2024-03-29T04:09:19.214 INFO:teuthology.orchestra.run.smithi073.stderr: 53200K .......... .......... .......... .......... .......... 31% 23.5M 4s 2024-03-29T04:09:19.215 INFO:teuthology.orchestra.run.smithi073.stderr: 53250K .......... .......... .......... .......... .......... 31% 22.4M 4s 2024-03-29T04:09:19.215 INFO:teuthology.orchestra.run.smithi073.stderr: 53300K .......... .......... .......... .......... .......... 31% 48.4M 4s 2024-03-29T04:09:19.215 INFO:teuthology.orchestra.run.smithi073.stderr: 53350K .......... .......... .......... .......... .......... 31% 25.0M 4s 2024-03-29T04:09:19.215 INFO:teuthology.orchestra.run.smithi073.stderr: 53400K .......... .......... .......... .......... .......... 31% 33.9M 4s 2024-03-29T04:09:19.215 INFO:teuthology.orchestra.run.smithi073.stderr: 53450K .......... .......... .......... .......... .......... 31% 25.0M 4s 2024-03-29T04:09:19.215 INFO:teuthology.orchestra.run.smithi073.stderr: 53500K .......... .......... .......... .......... .......... 31% 24.3M 4s 2024-03-29T04:09:19.215 INFO:teuthology.orchestra.run.smithi073.stderr: 53550K .......... .......... .......... .......... .......... 31% 47.7M 4s 2024-03-29T04:09:19.215 INFO:teuthology.orchestra.run.smithi073.stderr: 53600K .......... .......... .......... .......... .......... 31% 13.5M 4s 2024-03-29T04:09:19.215 INFO:teuthology.orchestra.run.smithi073.stderr: 53650K .......... .......... .......... .......... .......... 31% 113M 4s 2024-03-29T04:09:19.215 INFO:teuthology.orchestra.run.smithi073.stderr: 53700K .......... .......... .......... .......... .......... 31% 38.5M 4s 2024-03-29T04:09:19.215 INFO:teuthology.orchestra.run.smithi073.stderr: 53750K .......... .......... .......... .......... .......... 31% 23.8M 4s 2024-03-29T04:09:19.215 INFO:teuthology.orchestra.run.smithi073.stderr: 53800K .......... .......... .......... .......... .......... 31% 52.3M 4s 2024-03-29T04:09:19.215 INFO:teuthology.orchestra.run.smithi073.stderr: 53850K .......... .......... .......... .......... .......... 31% 31.2M 4s 2024-03-29T04:09:19.216 INFO:teuthology.orchestra.run.smithi073.stderr: 53900K .......... .......... .......... .......... .......... 32% 25.5M 4s 2024-03-29T04:09:19.216 INFO:teuthology.orchestra.run.smithi073.stderr: 53950K .......... .......... .......... .......... .......... 32% 24.0M 4s 2024-03-29T04:09:19.216 INFO:teuthology.orchestra.run.smithi073.stderr: 54000K .......... .......... .......... .......... .......... 32% 25.2M 4s 2024-03-29T04:09:19.216 INFO:teuthology.orchestra.run.smithi073.stderr: 54050K .......... .......... .......... .......... .......... 32% 54.1M 4s 2024-03-29T04:09:19.216 INFO:teuthology.orchestra.run.smithi073.stderr: 54100K .......... .......... .......... .......... .......... 32% 32.1M 4s 2024-03-29T04:09:19.216 INFO:teuthology.orchestra.run.smithi073.stderr: 54150K .......... .......... .......... .......... .......... 32% 25.3M 4s 2024-03-29T04:09:19.216 INFO:teuthology.orchestra.run.smithi073.stderr: 54200K .......... .......... .......... .......... .......... 32% 24.4M 4s 2024-03-29T04:09:19.216 INFO:teuthology.orchestra.run.smithi073.stderr: 54250K .......... .......... .......... .......... .......... 32% 22.5M 4s 2024-03-29T04:09:19.216 INFO:teuthology.orchestra.run.smithi073.stderr: 54300K .......... .......... .......... .......... .......... 32% 53.2M 4s 2024-03-29T04:09:19.216 INFO:teuthology.orchestra.run.smithi073.stderr: 54350K .......... .......... .......... .......... .......... 32% 25.1M 4s 2024-03-29T04:09:19.216 INFO:teuthology.orchestra.run.smithi073.stderr: 54400K .......... .......... .......... .......... .......... 32% 31.7M 4s 2024-03-29T04:09:19.216 INFO:teuthology.orchestra.run.smithi073.stderr: 54450K .......... .......... .......... .......... .......... 32% 24.7M 4s 2024-03-29T04:09:19.216 INFO:teuthology.orchestra.run.smithi073.stderr: 54500K .......... .......... .......... .......... .......... 32% 24.5M 4s 2024-03-29T04:09:19.217 INFO:teuthology.orchestra.run.smithi073.stderr: 54550K .......... .......... .......... .......... .......... 32% 58.3M 4s 2024-03-29T04:09:19.217 INFO:teuthology.orchestra.run.smithi073.stderr: 54600K .......... .......... .......... .......... .......... 32% 22.4M 4s 2024-03-29T04:09:19.217 INFO:teuthology.orchestra.run.smithi073.stderr: 54650K .......... .......... .......... .......... .......... 32% 27.0M 4s 2024-03-29T04:09:19.217 INFO:teuthology.orchestra.run.smithi073.stderr: 54700K .......... .......... .......... .......... .......... 32% 30.9M 4s 2024-03-29T04:09:19.217 INFO:teuthology.orchestra.run.smithi073.stderr: 54750K .......... .......... .......... .......... .......... 32% 24.9M 4s 2024-03-29T04:09:19.217 INFO:teuthology.orchestra.run.smithi073.stderr: 54800K .......... .......... .......... .......... .......... 32% 36.9M 4s 2024-03-29T04:09:19.217 INFO:teuthology.orchestra.run.smithi073.stderr: 54850K .......... .......... .......... .......... .......... 32% 20.0M 4s 2024-03-29T04:09:19.217 INFO:teuthology.orchestra.run.smithi073.stderr: 54900K .......... .......... .......... .......... .......... 32% 34.5M 4s 2024-03-29T04:09:19.217 INFO:teuthology.orchestra.run.smithi073.stderr: 54950K .......... .......... .......... .......... .......... 32% 32.5M 4s 2024-03-29T04:09:19.217 INFO:teuthology.orchestra.run.smithi073.stderr: 55000K .......... .......... .......... .......... .......... 32% 65.7M 4s 2024-03-29T04:09:19.217 INFO:teuthology.orchestra.run.smithi073.stderr: 55050K .......... .......... .......... .......... .......... 32% 24.2M 4s 2024-03-29T04:09:19.217 INFO:teuthology.orchestra.run.smithi073.stderr: 55100K .......... .......... .......... .......... .......... 32% 24.5M 4s 2024-03-29T04:09:19.217 INFO:teuthology.orchestra.run.smithi073.stderr: 55150K .......... .......... .......... .......... .......... 32% 35.5M 4s 2024-03-29T04:09:19.218 INFO:teuthology.orchestra.run.smithi073.stderr: 55200K .......... .......... .......... .......... .......... 32% 24.3M 4s 2024-03-29T04:09:19.218 INFO:teuthology.orchestra.run.smithi073.stderr: 55250K .......... .......... .......... .......... .......... 32% 24.4M 4s 2024-03-29T04:09:19.218 INFO:teuthology.orchestra.run.smithi073.stderr: 55300K .......... .......... .......... .......... .......... 32% 51.9M 4s 2024-03-29T04:09:19.218 INFO:teuthology.orchestra.run.smithi073.stderr: 55350K .......... .......... .......... .......... .......... 32% 32.3M 4s 2024-03-29T04:09:19.218 INFO:teuthology.orchestra.run.smithi073.stderr: 55400K .......... .......... .......... .......... .......... 32% 25.8M 4s 2024-03-29T04:09:19.218 INFO:teuthology.orchestra.run.smithi073.stderr: 55450K .......... .......... .......... .......... .......... 32% 32.1M 4s 2024-03-29T04:09:19.218 INFO:teuthology.orchestra.run.smithi073.stderr: 55500K .......... .......... .......... .......... .......... 32% 20.2M 4s 2024-03-29T04:09:19.218 INFO:teuthology.orchestra.run.smithi073.stderr: 55550K .......... .......... .......... .......... .......... 32% 45.2M 4s 2024-03-29T04:09:19.218 INFO:teuthology.orchestra.run.smithi073.stderr: 55600K .......... .......... .......... .......... .......... 33% 17.1M 4s 2024-03-29T04:09:19.218 INFO:teuthology.orchestra.run.smithi073.stderr: 55650K .......... .......... .......... .......... .......... 33% 26.1M 4s 2024-03-29T04:09:19.218 INFO:teuthology.orchestra.run.smithi073.stderr: 55700K .......... .......... .......... .......... .......... 33% 77.1M 4s 2024-03-29T04:09:19.219 INFO:teuthology.orchestra.run.smithi073.stderr: 55750K .......... .......... .......... .......... .......... 33% 24.5M 4s 2024-03-29T04:09:19.219 INFO:teuthology.orchestra.run.smithi073.stderr: 55800K .......... .......... .......... .......... .......... 33% 52.7M 4s 2024-03-29T04:09:19.219 INFO:teuthology.orchestra.run.smithi073.stderr: 55850K .......... .......... .......... .......... .......... 33% 32.0M 4s 2024-03-29T04:09:19.219 INFO:teuthology.orchestra.run.smithi073.stderr: 55900K .......... .......... .......... .......... .......... 33% 25.4M 4s 2024-03-29T04:09:19.219 INFO:teuthology.orchestra.run.smithi073.stderr: 55950K .......... .......... .......... .......... .......... 33% 24.6M 4s 2024-03-29T04:09:19.219 INFO:teuthology.orchestra.run.smithi073.stderr: 56000K .......... .......... .......... .......... .......... 33% 24.4M 4s 2024-03-29T04:09:19.219 INFO:teuthology.orchestra.run.smithi073.stderr: 56050K .......... .......... .......... .......... .......... 33% 53.8M 4s 2024-03-29T04:09:19.219 INFO:teuthology.orchestra.run.smithi073.stderr: 56100K .......... .......... .......... .......... .......... 33% 25.0M 4s 2024-03-29T04:09:19.219 INFO:teuthology.orchestra.run.smithi073.stderr: 56150K .......... .......... .......... .......... .......... 33% 31.7M 4s 2024-03-29T04:09:19.219 INFO:teuthology.orchestra.run.smithi073.stderr: 56200K .......... .......... .......... .......... .......... 33% 25.1M 4s 2024-03-29T04:09:19.219 INFO:teuthology.orchestra.run.smithi073.stderr: 56250K .......... .......... .......... .......... .......... 33% 23.3M 4s 2024-03-29T04:09:19.219 INFO:teuthology.orchestra.run.smithi073.stderr: 56300K .......... .......... .......... .......... .......... 33% 53.5M 4s 2024-03-29T04:09:19.219 INFO:teuthology.orchestra.run.smithi073.stderr: 56350K .......... .......... .......... .......... .......... 33% 28.7M 4s 2024-03-29T04:09:19.219 INFO:teuthology.orchestra.run.smithi073.stderr: 56400K .......... .......... .......... .......... .......... 33% 27.1M 4s 2024-03-29T04:09:19.220 INFO:teuthology.orchestra.run.smithi073.stderr: 56450K .......... .......... .......... .......... .......... 33% 24.7M 4s 2024-03-29T04:09:19.220 INFO:teuthology.orchestra.run.smithi073.stderr: 56500K .......... .......... .......... .......... .......... 33% 22.8M 4s 2024-03-29T04:09:19.220 INFO:teuthology.orchestra.run.smithi073.stderr: 56550K .......... .......... .......... .......... .......... 33% 65.9M 4s 2024-03-29T04:09:19.220 INFO:teuthology.orchestra.run.smithi073.stderr: 56600K .......... .......... .......... .......... .......... 33% 27.3M 4s 2024-03-29T04:09:19.220 INFO:teuthology.orchestra.run.smithi073.stderr: 56650K .......... .......... .......... .......... .......... 33% 24.1M 4s 2024-03-29T04:09:19.220 INFO:teuthology.orchestra.run.smithi073.stderr: 56700K .......... .......... .......... .......... .......... 33% 29.4M 4s 2024-03-29T04:09:19.220 INFO:teuthology.orchestra.run.smithi073.stderr: 56750K .......... .......... .......... .......... .......... 33% 25.0M 4s 2024-03-29T04:09:19.220 INFO:teuthology.orchestra.run.smithi073.stderr: 56800K .......... .......... .......... .......... .......... 33% 36.5M 4s 2024-03-29T04:09:19.220 INFO:teuthology.orchestra.run.smithi073.stderr: 56850K .......... .......... .......... .......... .......... 33% 14.2M 4s 2024-03-29T04:09:19.220 INFO:teuthology.orchestra.run.smithi073.stderr: 56900K .......... .......... .......... .......... .......... 33% 56.9M 4s 2024-03-29T04:09:19.220 INFO:teuthology.orchestra.run.smithi073.stderr: 56950K .......... .......... .......... .......... .......... 33% 71.1M 4s 2024-03-29T04:09:19.220 INFO:teuthology.orchestra.run.smithi073.stderr: 57000K .......... .......... .......... .......... .......... 33% 23.5M 4s 2024-03-29T04:09:19.221 INFO:teuthology.orchestra.run.smithi073.stderr: 57050K .......... .......... .......... .......... .......... 33% 55.2M 4s 2024-03-29T04:09:19.221 INFO:teuthology.orchestra.run.smithi073.stderr: 57100K .......... .......... .......... .......... .......... 33% 24.4M 4s 2024-03-29T04:09:19.221 INFO:teuthology.orchestra.run.smithi073.stderr: 57150K .......... .......... .......... .......... .......... 33% 32.1M 4s 2024-03-29T04:09:19.221 INFO:teuthology.orchestra.run.smithi073.stderr: 57200K .......... .......... .......... .......... .......... 33% 25.1M 4s 2024-03-29T04:09:19.221 INFO:teuthology.orchestra.run.smithi073.stderr: 57250K .......... .......... .......... .......... .......... 33% 24.2M 4s 2024-03-29T04:09:19.221 INFO:teuthology.orchestra.run.smithi073.stderr: 57300K .......... .......... .......... .......... .......... 34% 53.3M 4s 2024-03-29T04:09:19.221 INFO:teuthology.orchestra.run.smithi073.stderr: 57350K .......... .......... .......... .......... .......... 34% 25.1M 4s 2024-03-29T04:09:19.221 INFO:teuthology.orchestra.run.smithi073.stderr: 57400K .......... .......... .......... .......... .......... 34% 22.7M 4s 2024-03-29T04:09:19.221 INFO:teuthology.orchestra.run.smithi073.stderr: 57450K .......... .......... .......... .......... .......... 34% 36.9M 4s 2024-03-29T04:09:19.221 INFO:teuthology.orchestra.run.smithi073.stderr: 57500K .......... .......... .......... .......... .......... 34% 24.6M 4s 2024-03-29T04:09:19.221 INFO:teuthology.orchestra.run.smithi073.stderr: 57550K .......... .......... .......... .......... .......... 34% 44.7M 4s 2024-03-29T04:09:19.221 INFO:teuthology.orchestra.run.smithi073.stderr: 57600K .......... .......... .......... .......... .......... 34% 13.3M 4s 2024-03-29T04:09:19.221 INFO:teuthology.orchestra.run.smithi073.stderr: 57650K .......... .......... .......... .......... .......... 34% 14.2M 4s 2024-03-29T04:09:19.222 INFO:teuthology.orchestra.run.smithi073.stderr: 57700K .......... .......... .......... .......... .......... 34% 16.9M 4s 2024-03-29T04:09:19.222 INFO:teuthology.orchestra.run.smithi073.stderr: 57750K .......... .......... .......... .......... .......... 34% 35.4M 4s 2024-03-29T04:09:19.222 INFO:teuthology.orchestra.run.smithi073.stderr: 57800K .......... .......... .......... .......... .......... 34% 75.2M 4s 2024-03-29T04:09:19.222 INFO:teuthology.orchestra.run.smithi073.stderr: 57850K .......... .......... .......... .......... .......... 34% 106M 4s 2024-03-29T04:09:19.222 INFO:teuthology.orchestra.run.smithi073.stderr: 57900K .......... .......... .......... .......... .......... 34% 98.0M 4s 2024-03-29T04:09:19.222 INFO:teuthology.orchestra.run.smithi073.stderr: 57950K .......... .......... .......... .......... .......... 34% 65.2M 4s 2024-03-29T04:09:19.222 INFO:teuthology.orchestra.run.smithi073.stderr: 58000K .......... .......... .......... .......... .......... 34% 23.6M 4s 2024-03-29T04:09:19.222 INFO:teuthology.orchestra.run.smithi073.stderr: 58050K .......... .......... .......... .......... .......... 34% 56.2M 4s 2024-03-29T04:09:19.222 INFO:teuthology.orchestra.run.smithi073.stderr: 58100K .......... .......... .......... .......... .......... 34% 24.5M 4s 2024-03-29T04:09:19.222 INFO:teuthology.orchestra.run.smithi073.stderr: 58150K .......... .......... .......... .......... .......... 34% 30.1M 4s 2024-03-29T04:09:19.222 INFO:teuthology.orchestra.run.smithi073.stderr: 58200K .......... .......... .......... .......... .......... 34% 24.8M 4s 2024-03-29T04:09:19.222 INFO:teuthology.orchestra.run.smithi073.stderr: 58250K .......... .......... .......... .......... .......... 34% 24.2M 4s 2024-03-29T04:09:19.223 INFO:teuthology.orchestra.run.smithi073.stderr: 58300K .......... .......... .......... .......... .......... 34% 60.4M 4s 2024-03-29T04:09:19.223 INFO:teuthology.orchestra.run.smithi073.stderr: 58350K .......... .......... .......... .......... .......... 34% 24.9M 4s 2024-03-29T04:09:19.223 INFO:teuthology.orchestra.run.smithi073.stderr: 58400K .......... .......... .......... .......... .......... 34% 28.0M 4s 2024-03-29T04:09:19.223 INFO:teuthology.orchestra.run.smithi073.stderr: 58450K .......... .......... .......... .......... .......... 34% 27.0M 4s 2024-03-29T04:09:19.223 INFO:teuthology.orchestra.run.smithi073.stderr: 58500K .......... .......... .......... .......... .......... 34% 40.0M 4s 2024-03-29T04:09:19.223 INFO:teuthology.orchestra.run.smithi073.stderr: 58550K .......... .......... .......... .......... .......... 34% 27.8M 4s 2024-03-29T04:09:19.223 INFO:teuthology.orchestra.run.smithi073.stderr: 58600K .......... .......... .......... .......... .......... 34% 25.4M 4s 2024-03-29T04:09:19.223 INFO:teuthology.orchestra.run.smithi073.stderr: 58650K .......... .......... .......... .......... .......... 34% 16.9M 4s 2024-03-29T04:09:19.223 INFO:teuthology.orchestra.run.smithi073.stderr: 58700K .......... .......... .......... .......... .......... 34% 21.4M 4s 2024-03-29T04:09:19.223 INFO:teuthology.orchestra.run.smithi073.stderr: 58750K .......... .......... .......... .......... .......... 34% 74.0M 4s 2024-03-29T04:09:19.223 INFO:teuthology.orchestra.run.smithi073.stderr: 58800K .......... .......... .......... .......... .......... 34% 23.8M 4s 2024-03-29T04:09:19.223 INFO:teuthology.orchestra.run.smithi073.stderr: 58850K .......... .......... .......... .......... .......... 34% 24.4M 4s 2024-03-29T04:09:19.223 INFO:teuthology.orchestra.run.smithi073.stderr: 58900K .......... .......... .......... .......... .......... 34% 14.9M 4s 2024-03-29T04:09:19.224 INFO:teuthology.orchestra.run.smithi073.stderr: 58950K .......... .......... .......... .......... .......... 35% 17.8M 4s 2024-03-29T04:09:19.224 INFO:teuthology.orchestra.run.smithi073.stderr: 59000K .......... .......... .......... .......... .......... 35% 34.7M 4s 2024-03-29T04:09:19.224 INFO:teuthology.orchestra.run.smithi073.stderr: 59050K .......... .......... .......... .......... .......... 35% 80.9M 4s 2024-03-29T04:09:19.224 INFO:teuthology.orchestra.run.smithi073.stderr: 59100K .......... .......... .......... .......... .......... 35% 80.5M 4s 2024-03-29T04:09:19.224 INFO:teuthology.orchestra.run.smithi073.stderr: 59150K .......... .......... .......... .......... .......... 35% 92.2M 4s 2024-03-29T04:09:19.224 INFO:teuthology.orchestra.run.smithi073.stderr: 59200K .......... .......... .......... .......... .......... 35% 48.9M 4s 2024-03-29T04:09:19.224 INFO:teuthology.orchestra.run.smithi073.stderr: 59250K .......... .......... .......... .......... .......... 35% 34.3M 4s 2024-03-29T04:09:19.224 INFO:teuthology.orchestra.run.smithi073.stderr: 59300K .......... .......... .......... .......... .......... 35% 24.5M 4s 2024-03-29T04:09:19.224 INFO:teuthology.orchestra.run.smithi073.stderr: 59350K .......... .......... .......... .......... .......... 35% 30.5M 4s 2024-03-29T04:09:19.224 INFO:teuthology.orchestra.run.smithi073.stderr: 59400K .......... .......... .......... .......... .......... 35% 26.6M 4s 2024-03-29T04:09:19.224 INFO:teuthology.orchestra.run.smithi073.stderr: 59450K .......... .......... .......... .......... .......... 35% 25.0M 4s 2024-03-29T04:09:19.224 INFO:teuthology.orchestra.run.smithi073.stderr: 59500K .......... .......... .......... .......... .......... 35% 45.6M 4s 2024-03-29T04:09:19.224 INFO:teuthology.orchestra.run.smithi073.stderr: 59550K .......... .......... .......... .......... .......... 35% 24.8M 4s 2024-03-29T04:09:19.225 INFO:teuthology.orchestra.run.smithi073.stderr: 59600K .......... .......... .......... .......... .......... 35% 23.4M 4s 2024-03-29T04:09:19.225 INFO:teuthology.orchestra.run.smithi073.stderr: 59650K .......... .......... .......... .......... .......... 35% 11.1M 4s 2024-03-29T04:09:19.225 INFO:teuthology.orchestra.run.smithi073.stderr: 59700K .......... .......... .......... .......... .......... 35% 18.1M 4s 2024-03-29T04:09:19.225 INFO:teuthology.orchestra.run.smithi073.stderr: 59750K .......... .......... .......... .......... .......... 35% 11.5M 4s 2024-03-29T04:09:19.225 INFO:teuthology.orchestra.run.smithi073.stderr: 59800K .......... .......... .......... .......... .......... 35% 13.6M 4s 2024-03-29T04:09:19.225 INFO:teuthology.orchestra.run.smithi073.stderr: 59850K .......... .......... .......... .......... .......... 35% 25.1M 4s 2024-03-29T04:09:19.225 INFO:teuthology.orchestra.run.smithi073.stderr: 59900K .......... .......... .......... .......... .......... 35% 68.1M 4s 2024-03-29T04:09:19.225 INFO:teuthology.orchestra.run.smithi073.stderr: 59950K .......... .......... .......... .......... .......... 35% 109M 4s 2024-03-29T04:09:19.225 INFO:teuthology.orchestra.run.smithi073.stderr: 60000K .......... .......... .......... .......... .......... 35% 106M 4s 2024-03-29T04:09:19.225 INFO:teuthology.orchestra.run.smithi073.stderr: 60050K .......... .......... .......... .......... .......... 35% 70.8M 4s 2024-03-29T04:09:19.225 INFO:teuthology.orchestra.run.smithi073.stderr: 60100K .......... .......... .......... .......... .......... 35% 103M 4s 2024-03-29T04:09:19.225 INFO:teuthology.orchestra.run.smithi073.stderr: 60150K .......... .......... .......... .......... .......... 35% 99.8M 4s 2024-03-29T04:09:19.225 INFO:teuthology.orchestra.run.smithi073.stderr: 60200K .......... .......... .......... .......... .......... 35% 81.6M 4s 2024-03-29T04:09:19.226 INFO:teuthology.orchestra.run.smithi073.stderr: 60250K .......... .......... .......... .......... .......... 35% 53.2M 4s 2024-03-29T04:09:19.226 INFO:teuthology.orchestra.run.smithi073.stderr: 60300K .......... .......... .......... .......... .......... 35% 25.2M 4s 2024-03-29T04:09:19.226 INFO:teuthology.orchestra.run.smithi073.stderr: 60350K .......... .......... .......... .......... .......... 35% 44.3M 4s 2024-03-29T04:09:19.226 INFO:teuthology.orchestra.run.smithi073.stderr: 60400K .......... .......... .......... .......... .......... 35% 25.1M 4s 2024-03-29T04:09:19.226 INFO:teuthology.orchestra.run.smithi073.stderr: 60450K .......... .......... .......... .......... .......... 35% 38.1M 4s 2024-03-29T04:09:19.226 INFO:teuthology.orchestra.run.smithi073.stderr: 60500K .......... .......... .......... .......... .......... 35% 28.7M 4s 2024-03-29T04:09:19.226 INFO:teuthology.orchestra.run.smithi073.stderr: 60550K .......... .......... .......... .......... .......... 35% 32.2M 4s 2024-03-29T04:09:19.226 INFO:teuthology.orchestra.run.smithi073.stderr: 60600K .......... .......... .......... .......... .......... 35% 27.0M 4s 2024-03-29T04:09:19.226 INFO:teuthology.orchestra.run.smithi073.stderr: 60650K .......... .......... .......... .......... .......... 36% 14.7M 4s 2024-03-29T04:09:19.226 INFO:teuthology.orchestra.run.smithi073.stderr: 60700K .......... .......... .......... .......... .......... 36% 14.6M 4s 2024-03-29T04:09:19.226 INFO:teuthology.orchestra.run.smithi073.stderr: 60750K .......... .......... .......... .......... .......... 36% 16.4M 4s 2024-03-29T04:09:19.226 INFO:teuthology.orchestra.run.smithi073.stderr: 60800K .......... .......... .......... .......... .......... 36% 42.7M 4s 2024-03-29T04:09:19.226 INFO:teuthology.orchestra.run.smithi073.stderr: 60850K .......... .......... .......... .......... .......... 36% 15.1M 4s 2024-03-29T04:09:19.227 INFO:teuthology.orchestra.run.smithi073.stderr: 60900K .......... .......... .......... .......... .......... 36% 12.1M 4s 2024-03-29T04:09:19.227 INFO:teuthology.orchestra.run.smithi073.stderr: 60950K .......... .......... .......... .......... .......... 36% 20.0M 4s 2024-03-29T04:09:19.227 INFO:teuthology.orchestra.run.smithi073.stderr: 61000K .......... .......... .......... .......... .......... 36% 11.2M 4s 2024-03-29T04:09:19.227 INFO:teuthology.orchestra.run.smithi073.stderr: 61050K .......... .......... .......... .......... .......... 36% 15.2M 4s 2024-03-29T04:09:19.227 INFO:teuthology.orchestra.run.smithi073.stderr: 61100K .......... .......... .......... .......... .......... 36% 109M 4s 2024-03-29T04:09:19.227 INFO:teuthology.orchestra.run.smithi073.stderr: 61150K .......... .......... .......... .......... .......... 36% 103M 4s 2024-03-29T04:09:19.227 INFO:teuthology.orchestra.run.smithi073.stderr: 61200K .......... .......... .......... .......... .......... 36% 98.4M 4s 2024-03-29T04:09:19.227 INFO:teuthology.orchestra.run.smithi073.stderr: 61250K .......... .......... .......... .......... .......... 36% 106M 4s 2024-03-29T04:09:19.227 INFO:teuthology.orchestra.run.smithi073.stderr: 61300K .......... .......... .......... .......... .......... 36% 107M 4s 2024-03-29T04:09:19.227 INFO:teuthology.orchestra.run.smithi073.stderr: 61350K .......... .......... .......... .......... .......... 36% 111M 4s 2024-03-29T04:09:19.227 INFO:teuthology.orchestra.run.smithi073.stderr: 61400K .......... .......... .......... .......... .......... 36% 77.2M 4s 2024-03-29T04:09:19.227 INFO:teuthology.orchestra.run.smithi073.stderr: 61450K .......... .......... .......... .......... .......... 36% 76.6M 4s 2024-03-29T04:09:19.228 INFO:teuthology.orchestra.run.smithi073.stderr: 61500K .......... .......... .......... .......... .......... 36% 70.8M 4s 2024-03-29T04:09:19.228 INFO:teuthology.orchestra.run.smithi073.stderr: 61550K .......... .......... .......... .......... .......... 36% 54.8M 4s 2024-03-29T04:09:19.228 INFO:teuthology.orchestra.run.smithi073.stderr: 61600K .......... .......... .......... .......... .......... 36% 107M 4s 2024-03-29T04:09:19.228 INFO:teuthology.orchestra.run.smithi073.stderr: 61650K .......... .......... .......... .......... .......... 36% 24.1M 4s 2024-03-29T04:09:19.228 INFO:teuthology.orchestra.run.smithi073.stderr: 61700K .......... .......... .......... .......... .......... 36% 14.3M 4s 2024-03-29T04:09:19.228 INFO:teuthology.orchestra.run.smithi073.stderr: 61750K .......... .......... .......... .......... .......... 36% 20.0M 4s 2024-03-29T04:09:19.228 INFO:teuthology.orchestra.run.smithi073.stderr: 61800K .......... .......... .......... .......... .......... 36% 21.2M 4s 2024-03-29T04:09:19.228 INFO:teuthology.orchestra.run.smithi073.stderr: 61850K .......... .......... .......... .......... .......... 36% 64.9M 4s 2024-03-29T04:09:19.228 INFO:teuthology.orchestra.run.smithi073.stderr: 61900K .......... .......... .......... .......... .......... 36% 26.8M 4s 2024-03-29T04:09:19.228 INFO:teuthology.orchestra.run.smithi073.stderr: 61950K .......... .......... .......... .......... .......... 36% 17.7M 4s 2024-03-29T04:09:19.228 INFO:teuthology.orchestra.run.smithi073.stderr: 62000K .......... .......... .......... .......... .......... 36% 19.8M 4s 2024-03-29T04:09:19.228 INFO:teuthology.orchestra.run.smithi073.stderr: 62050K .......... .......... .......... .......... .......... 36% 17.8M 4s 2024-03-29T04:09:19.228 INFO:teuthology.orchestra.run.smithi073.stderr: 62100K .......... .......... .......... .......... .......... 36% 23.5M 4s 2024-03-29T04:09:19.229 INFO:teuthology.orchestra.run.smithi073.stderr: 62150K .......... .......... .......... .......... .......... 36% 16.6M 4s 2024-03-29T04:09:19.229 INFO:teuthology.orchestra.run.smithi073.stderr: 62200K .......... .......... .......... .......... .......... 36% 46.3M 4s 2024-03-29T04:09:19.229 INFO:teuthology.orchestra.run.smithi073.stderr: 62250K .......... .......... .......... .......... .......... 36% 91.2M 4s 2024-03-29T04:09:19.229 INFO:teuthology.orchestra.run.smithi073.stderr: 62300K .......... .......... .......... .......... .......... 36% 107M 4s 2024-03-29T04:09:19.229 INFO:teuthology.orchestra.run.smithi073.stderr: 62350K .......... .......... .......... .......... .......... 37% 75.7M 4s 2024-03-29T04:09:19.229 INFO:teuthology.orchestra.run.smithi073.stderr: 62400K .......... .......... .......... .......... .......... 37% 75.5M 4s 2024-03-29T04:09:19.229 INFO:teuthology.orchestra.run.smithi073.stderr: 62450K .......... .......... .......... .......... .......... 37% 73.2M 4s 2024-03-29T04:09:19.229 INFO:teuthology.orchestra.run.smithi073.stderr: 62500K .......... .......... .......... .......... .......... 37% 106M 4s 2024-03-29T04:09:19.229 INFO:teuthology.orchestra.run.smithi073.stderr: 62550K .......... .......... .......... .......... .......... 37% 49.7M 4s 2024-03-29T04:09:19.229 INFO:teuthology.orchestra.run.smithi073.stderr: 62600K .......... .......... .......... .......... .......... 37% 29.7M 4s 2024-03-29T04:09:19.229 INFO:teuthology.orchestra.run.smithi073.stderr: 62650K .......... .......... .......... .......... .......... 37% 17.8M 4s 2024-03-29T04:09:19.229 INFO:teuthology.orchestra.run.smithi073.stderr: 62700K .......... .......... .......... .......... .......... 37% 12.7M 4s 2024-03-29T04:09:19.230 INFO:teuthology.orchestra.run.smithi073.stderr: 62750K .......... .......... .......... .......... .......... 37% 27.7M 4s 2024-03-29T04:09:19.230 INFO:teuthology.orchestra.run.smithi073.stderr: 62800K .......... .......... .......... .......... .......... 37% 101M 4s 2024-03-29T04:09:19.230 INFO:teuthology.orchestra.run.smithi073.stderr: 62850K .......... .......... .......... .......... .......... 37% 72.0M 4s 2024-03-29T04:09:19.230 INFO:teuthology.orchestra.run.smithi073.stderr: 62900K .......... .......... .......... .......... .......... 37% 59.2M 4s 2024-03-29T04:09:19.230 INFO:teuthology.orchestra.run.smithi073.stderr: 62950K .......... .......... .......... .......... .......... 37% 28.3M 4s 2024-03-29T04:09:19.230 INFO:teuthology.orchestra.run.smithi073.stderr: 63000K .......... .......... .......... .......... .......... 37% 31.2M 4s 2024-03-29T04:09:19.230 INFO:teuthology.orchestra.run.smithi073.stderr: 63050K .......... .......... .......... .......... .......... 37% 19.4M 4s 2024-03-29T04:09:19.230 INFO:teuthology.orchestra.run.smithi073.stderr: 63100K .......... .......... .......... .......... .......... 37% 16.7M 4s 2024-03-29T04:09:19.230 INFO:teuthology.orchestra.run.smithi073.stderr: 63150K .......... .......... .......... .......... .......... 37% 22.6M 4s 2024-03-29T04:09:19.230 INFO:teuthology.orchestra.run.smithi073.stderr: 63200K .......... .......... .......... .......... .......... 37% 26.5M 4s 2024-03-29T04:09:19.230 INFO:teuthology.orchestra.run.smithi073.stderr: 63250K .......... .......... .......... .......... .......... 37% 39.0M 4s 2024-03-29T04:09:19.230 INFO:teuthology.orchestra.run.smithi073.stderr: 63300K .......... .......... .......... .......... .......... 37% 16.1M 4s 2024-03-29T04:09:19.231 INFO:teuthology.orchestra.run.smithi073.stderr: 63350K .......... .......... .......... .......... .......... 37% 34.4M 4s 2024-03-29T04:09:19.231 INFO:teuthology.orchestra.run.smithi073.stderr: 63400K .......... .......... .......... .......... .......... 37% 23.3M 4s 2024-03-29T04:09:19.231 INFO:teuthology.orchestra.run.smithi073.stderr: 63450K .......... .......... .......... .......... .......... 37% 34.1M 4s 2024-03-29T04:09:19.231 INFO:teuthology.orchestra.run.smithi073.stderr: 63500K .......... .......... .......... .......... .......... 37% 57.0M 4s 2024-03-29T04:09:19.231 INFO:teuthology.orchestra.run.smithi073.stderr: 63550K .......... .......... .......... .......... .......... 37% 40.6M 4s 2024-03-29T04:09:19.231 INFO:teuthology.orchestra.run.smithi073.stderr: 63600K .......... .......... .......... .......... .......... 37% 47.0M 4s 2024-03-29T04:09:19.231 INFO:teuthology.orchestra.run.smithi073.stderr: 63650K .......... .......... .......... .......... .......... 37% 60.3M 4s 2024-03-29T04:09:19.231 INFO:teuthology.orchestra.run.smithi073.stderr: 63700K .......... .......... .......... .......... .......... 37% 44.3M 4s 2024-03-29T04:09:19.231 INFO:teuthology.orchestra.run.smithi073.stderr: 63750K .......... .......... .......... .......... .......... 37% 14.8M 4s 2024-03-29T04:09:19.231 INFO:teuthology.orchestra.run.smithi073.stderr: 63800K .......... .......... .......... .......... .......... 37% 17.6M 4s 2024-03-29T04:09:19.231 INFO:teuthology.orchestra.run.smithi073.stderr: 63850K .......... .......... .......... .......... .......... 37% 30.4M 4s 2024-03-29T04:09:19.231 INFO:teuthology.orchestra.run.smithi073.stderr: 63900K .......... .......... .......... .......... .......... 37% 42.5M 4s 2024-03-29T04:09:19.232 INFO:teuthology.orchestra.run.smithi073.stderr: 63950K .......... .......... .......... .......... .......... 37% 25.7M 4s 2024-03-29T04:09:19.232 INFO:teuthology.orchestra.run.smithi073.stderr: 64000K .......... .......... .......... .......... .......... 37% 22.3M 4s 2024-03-29T04:09:19.232 INFO:teuthology.orchestra.run.smithi073.stderr: 64050K .......... .......... .......... .......... .......... 38% 33.4M 4s 2024-03-29T04:09:19.232 INFO:teuthology.orchestra.run.smithi073.stderr: 64100K .......... .......... .......... .......... .......... 38% 16.0M 4s 2024-03-29T04:09:19.232 INFO:teuthology.orchestra.run.smithi073.stderr: 64150K .......... .......... .......... .......... .......... 38% 26.4M 4s 2024-03-29T04:09:19.232 INFO:teuthology.orchestra.run.smithi073.stderr: 64200K .......... .......... .......... .......... .......... 38% 11.1M 4s 2024-03-29T04:09:19.232 INFO:teuthology.orchestra.run.smithi073.stderr: 64250K .......... .......... .......... .......... .......... 38% 18.9M 4s 2024-03-29T04:09:19.232 INFO:teuthology.orchestra.run.smithi073.stderr: 64300K .......... .......... .......... .......... .......... 38% 20.3M 4s 2024-03-29T04:09:19.232 INFO:teuthology.orchestra.run.smithi073.stderr: 64350K .......... .......... .......... .......... .......... 38% 9.48M 4s 2024-03-29T04:09:19.232 INFO:teuthology.orchestra.run.smithi073.stderr: 64400K .......... .......... .......... .......... .......... 38% 44.0M 4s 2024-03-29T04:09:19.232 INFO:teuthology.orchestra.run.smithi073.stderr: 64450K .......... .......... .......... .......... .......... 38% 81.9M 4s 2024-03-29T04:09:19.232 INFO:teuthology.orchestra.run.smithi073.stderr: 64500K .......... .......... .......... .......... .......... 38% 106M 4s 2024-03-29T04:09:19.232 INFO:teuthology.orchestra.run.smithi073.stderr: 64550K .......... .......... .......... .......... .......... 38% 95.7M 4s 2024-03-29T04:09:19.232 INFO:teuthology.orchestra.run.smithi073.stderr: 64600K .......... .......... .......... .......... .......... 38% 107M 4s 2024-03-29T04:09:19.233 INFO:teuthology.orchestra.run.smithi073.stderr: 64650K .......... .......... .......... .......... .......... 38% 108M 4s 2024-03-29T04:09:19.233 INFO:teuthology.orchestra.run.smithi073.stderr: 64700K .......... .......... .......... .......... .......... 38% 102M 4s 2024-03-29T04:09:19.233 INFO:teuthology.orchestra.run.smithi073.stderr: 64750K .......... .......... .......... .......... .......... 38% 82.3M 4s 2024-03-29T04:09:19.233 INFO:teuthology.orchestra.run.smithi073.stderr: 64800K .......... .......... .......... .......... .......... 38% 53.8M 4s 2024-03-29T04:09:19.233 INFO:teuthology.orchestra.run.smithi073.stderr: 64850K .......... .......... .......... .......... .......... 38% 62.4M 4s 2024-03-29T04:09:19.233 INFO:teuthology.orchestra.run.smithi073.stderr: 64900K .......... .......... .......... .......... .......... 38% 52.6M 4s 2024-03-29T04:09:19.233 INFO:teuthology.orchestra.run.smithi073.stderr: 64950K .......... .......... .......... .......... .......... 38% 42.3M 4s 2024-03-29T04:09:19.233 INFO:teuthology.orchestra.run.smithi073.stderr: 65000K .......... .......... .......... .......... .......... 38% 41.0M 4s 2024-03-29T04:09:19.233 INFO:teuthology.orchestra.run.smithi073.stderr: 65050K .......... .......... .......... .......... .......... 38% 22.1M 4s 2024-03-29T04:09:19.233 INFO:teuthology.orchestra.run.smithi073.stderr: 65100K .......... .......... .......... .......... .......... 38% 20.4M 4s 2024-03-29T04:09:19.233 INFO:teuthology.orchestra.run.smithi073.stderr: 65150K .......... .......... .......... .......... .......... 38% 21.1M 4s 2024-03-29T04:09:19.233 INFO:teuthology.orchestra.run.smithi073.stderr: 65200K .......... .......... .......... .......... .......... 38% 16.5M 4s 2024-03-29T04:09:19.233 INFO:teuthology.orchestra.run.smithi073.stderr: 65250K .......... .......... .......... .......... .......... 38% 31.4M 4s 2024-03-29T04:09:19.234 INFO:teuthology.orchestra.run.smithi073.stderr: 65300K .......... .......... .......... .......... .......... 38% 30.7M 4s 2024-03-29T04:09:19.234 INFO:teuthology.orchestra.run.smithi073.stderr: 65350K .......... .......... .......... .......... .......... 38% 23.1M 4s 2024-03-29T04:09:19.234 INFO:teuthology.orchestra.run.smithi073.stderr: 65400K .......... .......... .......... .......... .......... 38% 38.5M 4s 2024-03-29T04:09:19.234 INFO:teuthology.orchestra.run.smithi073.stderr: 65450K .......... .......... .......... .......... .......... 38% 17.8M 4s 2024-03-29T04:09:19.234 INFO:teuthology.orchestra.run.smithi073.stderr: 65500K .......... .......... .......... .......... .......... 38% 24.2M 4s 2024-03-29T04:09:19.234 INFO:teuthology.orchestra.run.smithi073.stderr: 65550K .......... .......... .......... .......... .......... 38% 40.7M 4s 2024-03-29T04:09:19.234 INFO:teuthology.orchestra.run.smithi073.stderr: 65600K .......... .......... .......... .......... .......... 38% 50.1M 4s 2024-03-29T04:09:19.234 INFO:teuthology.orchestra.run.smithi073.stderr: 65650K .......... .......... .......... .......... .......... 38% 109M 4s 2024-03-29T04:09:19.234 INFO:teuthology.orchestra.run.smithi073.stderr: 65700K .......... .......... .......... .......... .......... 39% 102M 4s 2024-03-29T04:09:19.234 INFO:teuthology.orchestra.run.smithi073.stderr: 65750K .......... .......... .......... .......... .......... 39% 41.7M 4s 2024-03-29T04:09:19.234 INFO:teuthology.orchestra.run.smithi073.stderr: 65800K .......... .......... .......... .......... .......... 39% 11.6M 4s 2024-03-29T04:09:19.234 INFO:teuthology.orchestra.run.smithi073.stderr: 65850K .......... .......... .......... .......... .......... 39% 9.96M 4s 2024-03-29T04:09:19.235 INFO:teuthology.orchestra.run.smithi073.stderr: 65900K .......... .......... .......... .......... .......... 39% 143M 4s 2024-03-29T04:09:19.235 INFO:teuthology.orchestra.run.smithi073.stderr: 65950K .......... .......... .......... .......... .......... 39% 115M 4s 2024-03-29T04:09:19.235 INFO:teuthology.orchestra.run.smithi073.stderr: 66000K .......... .......... .......... .......... .......... 39% 31.4M 4s 2024-03-29T04:09:19.235 INFO:teuthology.orchestra.run.smithi073.stderr: 66050K .......... .......... .......... .......... .......... 39% 25.5M 4s 2024-03-29T04:09:19.235 INFO:teuthology.orchestra.run.smithi073.stderr: 66100K .......... .......... .......... .......... .......... 39% 28.5M 4s 2024-03-29T04:09:19.235 INFO:teuthology.orchestra.run.smithi073.stderr: 66150K .......... .......... .......... .......... .......... 39% 20.4M 4s 2024-03-29T04:09:19.235 INFO:teuthology.orchestra.run.smithi073.stderr: 66200K .......... .......... .......... .......... .......... 39% 11.8M 4s 2024-03-29T04:09:19.235 INFO:teuthology.orchestra.run.smithi073.stderr: 66250K .......... .......... .......... .......... .......... 39% 16.1M 4s 2024-03-29T04:09:19.235 INFO:teuthology.orchestra.run.smithi073.stderr: 66300K .......... .......... .......... .......... .......... 39% 18.7M 4s 2024-03-29T04:09:19.235 INFO:teuthology.orchestra.run.smithi073.stderr: 66350K .......... .......... .......... .......... .......... 39% 21.7M 4s 2024-03-29T04:09:19.235 INFO:teuthology.orchestra.run.smithi073.stderr: 66400K .......... .......... .......... .......... .......... 39% 29.9M 4s 2024-03-29T04:09:19.235 INFO:teuthology.orchestra.run.smithi073.stderr: 66450K .......... .......... .......... .......... .......... 39% 17.5M 4s 2024-03-29T04:09:19.236 INFO:teuthology.orchestra.run.smithi073.stderr: 66500K .......... .......... .......... .......... .......... 39% 13.2M 4s 2024-03-29T04:09:19.236 INFO:teuthology.orchestra.run.smithi073.stderr: 66550K .......... .......... .......... .......... .......... 39% 24.6M 4s 2024-03-29T04:09:19.236 INFO:teuthology.orchestra.run.smithi073.stderr: 66600K .......... .......... .......... .......... .......... 39% 17.4M 4s 2024-03-29T04:09:19.236 INFO:teuthology.orchestra.run.smithi073.stderr: 66650K .......... .......... .......... .......... .......... 39% 109M 4s 2024-03-29T04:09:19.236 INFO:teuthology.orchestra.run.smithi073.stderr: 66700K .......... .......... .......... .......... .......... 39% 75.8M 4s 2024-03-29T04:09:19.236 INFO:teuthology.orchestra.run.smithi073.stderr: 66750K .......... .......... .......... .......... .......... 39% 99.5M 4s 2024-03-29T04:09:19.236 INFO:teuthology.orchestra.run.smithi073.stderr: 66800K .......... .......... .......... .......... .......... 39% 51.6M 4s 2024-03-29T04:09:19.236 INFO:teuthology.orchestra.run.smithi073.stderr: 66850K .......... .......... .......... .......... .......... 39% 52.0M 4s 2024-03-29T04:09:19.236 INFO:teuthology.orchestra.run.smithi073.stderr: 66900K .......... .......... .......... .......... .......... 39% 76.7M 4s 2024-03-29T04:09:19.236 INFO:teuthology.orchestra.run.smithi073.stderr: 66950K .......... .......... .......... .......... .......... 39% 55.2M 4s 2024-03-29T04:09:19.236 INFO:teuthology.orchestra.run.smithi073.stderr: 67000K .......... .......... .......... .......... .......... 39% 47.3M 4s 2024-03-29T04:09:19.236 INFO:teuthology.orchestra.run.smithi073.stderr: 67050K .......... .......... .......... .......... .......... 39% 50.4M 4s 2024-03-29T04:09:19.237 INFO:teuthology.orchestra.run.smithi073.stderr: 67100K .......... .......... .......... .......... .......... 39% 108M 4s 2024-03-29T04:09:19.237 INFO:teuthology.orchestra.run.smithi073.stderr: 67150K .......... .......... .......... .......... .......... 39% 106M 4s 2024-03-29T04:09:19.237 INFO:teuthology.orchestra.run.smithi073.stderr: 67200K .......... .......... .......... .......... .......... 39% 14.9M 4s 2024-03-29T04:09:19.237 INFO:teuthology.orchestra.run.smithi073.stderr: 67250K .......... .......... .......... .......... .......... 39% 23.4M 4s 2024-03-29T04:09:19.237 INFO:teuthology.orchestra.run.smithi073.stderr: 67300K .......... .......... .......... .......... .......... 39% 23.2M 4s 2024-03-29T04:09:19.237 INFO:teuthology.orchestra.run.smithi073.stderr: 67350K .......... .......... .......... .......... .......... 39% 30.7M 4s 2024-03-29T04:09:19.237 INFO:teuthology.orchestra.run.smithi073.stderr: 67400K .......... .......... .......... .......... .......... 40% 30.7M 4s 2024-03-29T04:09:19.237 INFO:teuthology.orchestra.run.smithi073.stderr: 67450K .......... .......... .......... .......... .......... 40% 23.9M 4s 2024-03-29T04:09:19.237 INFO:teuthology.orchestra.run.smithi073.stderr: 67500K .......... .......... .......... .......... .......... 40% 29.6M 4s 2024-03-29T04:09:19.237 INFO:teuthology.orchestra.run.smithi073.stderr: 67550K .......... .......... .......... .......... .......... 40% 44.7M 4s 2024-03-29T04:09:19.237 INFO:teuthology.orchestra.run.smithi073.stderr: 67600K .......... .......... .......... .......... .......... 40% 50.4M 4s 2024-03-29T04:09:19.237 INFO:teuthology.orchestra.run.smithi073.stderr: 67650K .......... .......... .......... .......... .......... 40% 64.3M 4s 2024-03-29T04:09:19.237 INFO:teuthology.orchestra.run.smithi073.stderr: 67700K .......... .......... .......... .......... .......... 40% 32.7M 4s 2024-03-29T04:09:19.238 INFO:teuthology.orchestra.run.smithi073.stderr: 67750K .......... .......... .......... .......... .......... 40% 36.6M 4s 2024-03-29T04:09:19.238 INFO:teuthology.orchestra.run.smithi073.stderr: 67800K .......... .......... .......... .......... .......... 40% 41.5M 4s 2024-03-29T04:09:19.238 INFO:teuthology.orchestra.run.smithi073.stderr: 67850K .......... .......... .......... .......... .......... 40% 12.1M 4s 2024-03-29T04:09:19.238 INFO:teuthology.orchestra.run.smithi073.stderr: 67900K .......... .......... .......... .......... .......... 40% 30.4M 4s 2024-03-29T04:09:19.238 INFO:teuthology.orchestra.run.smithi073.stderr: 67950K .......... .......... .......... .......... .......... 40% 46.0M 4s 2024-03-29T04:09:19.238 INFO:teuthology.orchestra.run.smithi073.stderr: 68000K .......... .......... .......... .......... .......... 40% 50.0M 4s 2024-03-29T04:09:19.238 INFO:teuthology.orchestra.run.smithi073.stderr: 68050K .......... .......... .......... .......... .......... 40% 75.1M 4s 2024-03-29T04:09:19.238 INFO:teuthology.orchestra.run.smithi073.stderr: 68100K .......... .......... .......... .......... .......... 40% 15.2M 4s 2024-03-29T04:09:19.238 INFO:teuthology.orchestra.run.smithi073.stderr: 68150K .......... .......... .......... .......... .......... 40% 35.1M 4s 2024-03-29T04:09:19.238 INFO:teuthology.orchestra.run.smithi073.stderr: 68200K .......... .......... .......... .......... .......... 40% 21.6M 4s 2024-03-29T04:09:19.238 INFO:teuthology.orchestra.run.smithi073.stderr: 68250K .......... .......... .......... .......... .......... 40% 31.9M 4s 2024-03-29T04:09:19.238 INFO:teuthology.orchestra.run.smithi073.stderr: 68300K .......... .......... .......... .......... .......... 40% 85.2M 4s 2024-03-29T04:09:19.239 INFO:teuthology.orchestra.run.smithi073.stderr: 68350K .......... .......... .......... .......... .......... 40% 36.3M 4s 2024-03-29T04:09:19.239 INFO:teuthology.orchestra.run.smithi073.stderr: 68400K .......... .......... .......... .......... .......... 40% 55.2M 4s 2024-03-29T04:09:19.239 INFO:teuthology.orchestra.run.smithi073.stderr: 68450K .......... .......... .......... .......... .......... 40% 29.9M 4s 2024-03-29T04:09:19.239 INFO:teuthology.orchestra.run.smithi073.stderr: 68500K .......... .......... .......... .......... .......... 40% 50.5M 4s 2024-03-29T04:09:19.239 INFO:teuthology.orchestra.run.smithi073.stderr: 68550K .......... .......... .......... .......... .......... 40% 110M 4s 2024-03-29T04:09:19.239 INFO:teuthology.orchestra.run.smithi073.stderr: 68600K .......... .......... .......... .......... .......... 40% 25.9M 4s 2024-03-29T04:09:19.239 INFO:teuthology.orchestra.run.smithi073.stderr: 68650K .......... .......... .......... .......... .......... 40% 40.7M 4s 2024-03-29T04:09:19.239 INFO:teuthology.orchestra.run.smithi073.stderr: 68700K .......... .......... .......... .......... .......... 40% 24.4M 4s 2024-03-29T04:09:19.239 INFO:teuthology.orchestra.run.smithi073.stderr: 68750K .......... .......... .......... .......... .......... 40% 24.8M 4s 2024-03-29T04:09:19.239 INFO:teuthology.orchestra.run.smithi073.stderr: 68800K .......... .......... .......... .......... .......... 40% 40.3M 4s 2024-03-29T04:09:19.239 INFO:teuthology.orchestra.run.smithi073.stderr: 68850K .......... .......... .......... .......... .......... 40% 24.7M 4s 2024-03-29T04:09:19.239 INFO:teuthology.orchestra.run.smithi073.stderr: 68900K .......... .......... .......... .......... .......... 40% 24.3M 4s 2024-03-29T04:09:19.239 INFO:teuthology.orchestra.run.smithi073.stderr: 68950K .......... .......... .......... .......... .......... 40% 39.8M 4s 2024-03-29T04:09:19.239 INFO:teuthology.orchestra.run.smithi073.stderr: 69000K .......... .......... .......... .......... .......... 40% 23.1M 4s 2024-03-29T04:09:19.240 INFO:teuthology.orchestra.run.smithi073.stderr: 69050K .......... .......... .......... .......... .......... 40% 42.8M 4s 2024-03-29T04:09:19.240 INFO:teuthology.orchestra.run.smithi073.stderr: 69100K .......... .......... .......... .......... .......... 41% 24.5M 4s 2024-03-29T04:09:19.240 INFO:teuthology.orchestra.run.smithi073.stderr: 69150K .......... .......... .......... .......... .......... 41% 24.9M 4s 2024-03-29T04:09:19.240 INFO:teuthology.orchestra.run.smithi073.stderr: 69200K .......... .......... .......... .......... .......... 41% 46.3M 4s 2024-03-29T04:09:19.240 INFO:teuthology.orchestra.run.smithi073.stderr: 69250K .......... .......... .......... .......... .......... 41% 33.2M 4s 2024-03-29T04:09:19.240 INFO:teuthology.orchestra.run.smithi073.stderr: 69300K .......... .......... .......... .......... .......... 41% 26.6M 4s 2024-03-29T04:09:19.240 INFO:teuthology.orchestra.run.smithi073.stderr: 69350K .......... .......... .......... .......... .......... 41% 24.0M 4s 2024-03-29T04:09:19.240 INFO:teuthology.orchestra.run.smithi073.stderr: 69400K .......... .......... .......... .......... .......... 41% 24.6M 4s 2024-03-29T04:09:19.240 INFO:teuthology.orchestra.run.smithi073.stderr: 69450K .......... .......... .......... .......... .......... 41% 46.5M 4s 2024-03-29T04:09:19.240 INFO:teuthology.orchestra.run.smithi073.stderr: 69500K .......... .......... .......... .......... .......... 41% 24.0M 4s 2024-03-29T04:09:19.240 INFO:teuthology.orchestra.run.smithi073.stderr: 69550K .......... .......... .......... .......... .......... 41% 37.6M 4s 2024-03-29T04:09:19.241 INFO:teuthology.orchestra.run.smithi073.stderr: 69600K .......... .......... .......... .......... .......... 41% 24.8M 4s 2024-03-29T04:09:19.241 INFO:teuthology.orchestra.run.smithi073.stderr: 69650K .......... .......... .......... .......... .......... 41% 24.9M 4s 2024-03-29T04:09:19.241 INFO:teuthology.orchestra.run.smithi073.stderr: 69700K .......... .......... .......... .......... .......... 41% 41.2M 4s 2024-03-29T04:09:19.241 INFO:teuthology.orchestra.run.smithi073.stderr: 69750K .......... .......... .......... .......... .......... 41% 25.3M 4s 2024-03-29T04:09:19.241 INFO:teuthology.orchestra.run.smithi073.stderr: 69800K .......... .......... .......... .......... .......... 41% 32.9M 4s 2024-03-29T04:09:19.241 INFO:teuthology.orchestra.run.smithi073.stderr: 69850K .......... .......... .......... .......... .......... 41% 21.7M 4s 2024-03-29T04:09:19.241 INFO:teuthology.orchestra.run.smithi073.stderr: 69900K .......... .......... .......... .......... .......... 41% 30.8M 4s 2024-03-29T04:09:19.241 INFO:teuthology.orchestra.run.smithi073.stderr: 69950K .......... .......... .......... .......... .......... 41% 45.0M 4s 2024-03-29T04:09:19.241 INFO:teuthology.orchestra.run.smithi073.stderr: 70000K .......... .......... .......... .......... .......... 41% 24.8M 4s 2024-03-29T04:09:19.241 INFO:teuthology.orchestra.run.smithi073.stderr: 70050K .......... .......... .......... .......... .......... 41% 28.4M 4s 2024-03-29T04:09:19.241 INFO:teuthology.orchestra.run.smithi073.stderr: 70100K .......... .......... .......... .......... .......... 41% 39.5M 4s 2024-03-29T04:09:19.241 INFO:teuthology.orchestra.run.smithi073.stderr: 70150K .......... .......... .......... .......... .......... 41% 31.8M 4s 2024-03-29T04:09:19.241 INFO:teuthology.orchestra.run.smithi073.stderr: 70200K .......... .......... .......... .......... .......... 41% 14.4M 4s 2024-03-29T04:09:19.242 INFO:teuthology.orchestra.run.smithi073.stderr: 70250K .......... .......... .......... .......... .......... 41% 7.74M 4s 2024-03-29T04:09:19.242 INFO:teuthology.orchestra.run.smithi073.stderr: 70300K .......... .......... .......... .......... .......... 41% 22.5M 4s 2024-03-29T04:09:19.242 INFO:teuthology.orchestra.run.smithi073.stderr: 70350K .......... .......... .......... .......... .......... 41% 107M 4s 2024-03-29T04:09:19.242 INFO:teuthology.orchestra.run.smithi073.stderr: 70400K .......... .......... .......... .......... .......... 41% 103M 4s 2024-03-29T04:09:19.242 INFO:teuthology.orchestra.run.smithi073.stderr: 70450K .......... .......... .......... .......... .......... 41% 106M 4s 2024-03-29T04:09:19.242 INFO:teuthology.orchestra.run.smithi073.stderr: 70500K .......... .......... .......... .......... .......... 41% 110M 4s 2024-03-29T04:09:19.242 INFO:teuthology.orchestra.run.smithi073.stderr: 70550K .......... .......... .......... .......... .......... 41% 107M 4s 2024-03-29T04:09:19.242 INFO:teuthology.orchestra.run.smithi073.stderr: 70600K .......... .......... .......... .......... .......... 41% 20.9M 4s 2024-03-29T04:09:19.242 INFO:teuthology.orchestra.run.smithi073.stderr: 70650K .......... .......... .......... .......... .......... 41% 38.3M 4s 2024-03-29T04:09:19.242 INFO:teuthology.orchestra.run.smithi073.stderr: 70700K .......... .......... .......... .......... .......... 41% 43.1M 4s 2024-03-29T04:09:19.242 INFO:teuthology.orchestra.run.smithi073.stderr: 70750K .......... .......... .......... .......... .......... 42% 14.1M 4s 2024-03-29T04:09:19.242 INFO:teuthology.orchestra.run.smithi073.stderr: 70800K .......... .......... .......... .......... .......... 42% 7.92M 4s 2024-03-29T04:09:19.242 INFO:teuthology.orchestra.run.smithi073.stderr: 70850K .......... .......... .......... .......... .......... 42% 16.6M 4s 2024-03-29T04:09:19.243 INFO:teuthology.orchestra.run.smithi073.stderr: 70900K .......... .......... .......... .......... .......... 42% 47.3M 4s 2024-03-29T04:09:19.243 INFO:teuthology.orchestra.run.smithi073.stderr: 70950K .......... .......... .......... .......... .......... 42% 110M 4s 2024-03-29T04:09:19.243 INFO:teuthology.orchestra.run.smithi073.stderr: 71000K .......... .......... .......... .......... .......... 42% 84.4M 4s 2024-03-29T04:09:19.243 INFO:teuthology.orchestra.run.smithi073.stderr: 71050K .......... .......... .......... .......... .......... 42% 40.9M 4s 2024-03-29T04:09:19.243 INFO:teuthology.orchestra.run.smithi073.stderr: 71100K .......... .......... .......... .......... .......... 42% 71.2M 4s 2024-03-29T04:09:19.243 INFO:teuthology.orchestra.run.smithi073.stderr: 71150K .......... .......... .......... .......... .......... 42% 102M 4s 2024-03-29T04:09:19.243 INFO:teuthology.orchestra.run.smithi073.stderr: 71200K .......... .......... .......... .......... .......... 42% 105M 4s 2024-03-29T04:09:19.243 INFO:teuthology.orchestra.run.smithi073.stderr: 71250K .......... .......... .......... .......... .......... 42% 48.8M 4s 2024-03-29T04:09:19.243 INFO:teuthology.orchestra.run.smithi073.stderr: 71300K .......... .......... .......... .......... .......... 42% 28.8M 4s 2024-03-29T04:09:19.243 INFO:teuthology.orchestra.run.smithi073.stderr: 71350K .......... .......... .......... .......... .......... 42% 24.7M 4s 2024-03-29T04:09:19.243 INFO:teuthology.orchestra.run.smithi073.stderr: 71400K .......... .......... .......... .......... .......... 42% 24.3M 4s 2024-03-29T04:09:19.243 INFO:teuthology.orchestra.run.smithi073.stderr: 71450K .......... .......... .......... .......... .......... 42% 66.4M 4s 2024-03-29T04:09:19.244 INFO:teuthology.orchestra.run.smithi073.stderr: 71500K .......... .......... .......... .......... .......... 42% 25.3M 4s 2024-03-29T04:09:19.244 INFO:teuthology.orchestra.run.smithi073.stderr: 71550K .......... .......... .......... .......... .......... 42% 28.7M 4s 2024-03-29T04:09:19.244 INFO:teuthology.orchestra.run.smithi073.stderr: 71600K .......... .......... .......... .......... .......... 42% 25.0M 4s 2024-03-29T04:09:19.244 INFO:teuthology.orchestra.run.smithi073.stderr: 71650K .......... .......... .......... .......... .......... 42% 27.0M 4s 2024-03-29T04:09:19.244 INFO:teuthology.orchestra.run.smithi073.stderr: 71700K .......... .......... .......... .......... .......... 42% 44.2M 4s 2024-03-29T04:09:19.244 INFO:teuthology.orchestra.run.smithi073.stderr: 71750K .......... .......... .......... .......... .......... 42% 23.9M 4s 2024-03-29T04:09:19.244 INFO:teuthology.orchestra.run.smithi073.stderr: 71800K .......... .......... .......... .......... .......... 42% 28.6M 4s 2024-03-29T04:09:19.244 INFO:teuthology.orchestra.run.smithi073.stderr: 71850K .......... .......... .......... .......... .......... 42% 24.7M 4s 2024-03-29T04:09:19.244 INFO:teuthology.orchestra.run.smithi073.stderr: 71900K .......... .......... .......... .......... .......... 42% 28.4M 4s 2024-03-29T04:09:19.244 INFO:teuthology.orchestra.run.smithi073.stderr: 71950K .......... .......... .......... .......... .......... 42% 58.2M 4s 2024-03-29T04:09:19.244 INFO:teuthology.orchestra.run.smithi073.stderr: 72000K .......... .......... .......... .......... .......... 42% 22.7M 4s 2024-03-29T04:09:19.244 INFO:teuthology.orchestra.run.smithi073.stderr: 72050K .......... .......... .......... .......... .......... 42% 35.3M 4s 2024-03-29T04:09:19.245 INFO:teuthology.orchestra.run.smithi073.stderr: 72100K .......... .......... .......... .......... .......... 42% 25.0M 4s 2024-03-29T04:09:19.245 INFO:teuthology.orchestra.run.smithi073.stderr: 72150K .......... .......... .......... .......... .......... 42% 17.6M 4s 2024-03-29T04:09:19.245 INFO:teuthology.orchestra.run.smithi073.stderr: 72200K .......... .......... .......... .......... .......... 42% 26.3M 4s 2024-03-29T04:09:19.245 INFO:teuthology.orchestra.run.smithi073.stderr: 72250K .......... .......... .......... .......... .......... 42% 10.5M 4s 2024-03-29T04:09:19.245 INFO:teuthology.orchestra.run.smithi073.stderr: 72300K .......... .......... .......... .......... .......... 42% 13.2M 4s 2024-03-29T04:09:19.245 INFO:teuthology.orchestra.run.smithi073.stderr: 72350K .......... .......... .......... .......... .......... 42% 24.2M 4s 2024-03-29T04:09:19.245 INFO:teuthology.orchestra.run.smithi073.stderr: 72400K .......... .......... .......... .......... .......... 42% 39.2M 4s 2024-03-29T04:09:19.245 INFO:teuthology.orchestra.run.smithi073.stderr: 72450K .......... .......... .......... .......... .......... 43% 18.5M 4s 2024-03-29T04:09:19.245 INFO:teuthology.orchestra.run.smithi073.stderr: 72500K .......... .......... .......... .......... .......... 43% 16.6M 4s 2024-03-29T04:09:19.245 INFO:teuthology.orchestra.run.smithi073.stderr: 72550K .......... .......... .......... .......... .......... 43% 79.0M 3s 2024-03-29T04:09:19.245 INFO:teuthology.orchestra.run.smithi073.stderr: 72600K .......... .......... .......... .......... .......... 43% 41.9M 3s 2024-03-29T04:09:19.245 INFO:teuthology.orchestra.run.smithi073.stderr: 72650K .......... .......... .......... .......... .......... 43% 26.7M 3s 2024-03-29T04:09:19.245 INFO:teuthology.orchestra.run.smithi073.stderr: 72700K .......... .......... .......... .......... .......... 43% 106M 3s 2024-03-29T04:09:19.246 INFO:teuthology.orchestra.run.smithi073.stderr: 72750K .......... .......... .......... .......... .......... 43% 29.1M 3s 2024-03-29T04:09:19.246 INFO:teuthology.orchestra.run.smithi073.stderr: 72800K .......... .......... .......... .......... .......... 43% 17.4M 3s 2024-03-29T04:09:19.246 INFO:teuthology.orchestra.run.smithi073.stderr: 72850K .......... .......... .......... .......... .......... 43% 26.4M 3s 2024-03-29T04:09:19.246 INFO:teuthology.orchestra.run.smithi073.stderr: 72900K .......... .......... .......... .......... .......... 43% 23.0M 3s 2024-03-29T04:09:19.246 INFO:teuthology.orchestra.run.smithi073.stderr: 72950K .......... .......... .......... .......... .......... 43% 47.8M 3s 2024-03-29T04:09:19.246 INFO:teuthology.orchestra.run.smithi073.stderr: 73000K .......... .......... .......... .......... .......... 43% 76.1M 3s 2024-03-29T04:09:19.246 INFO:teuthology.orchestra.run.smithi073.stderr: 73050K .......... .......... .......... .......... .......... 43% 11.1M 3s 2024-03-29T04:09:19.246 INFO:teuthology.orchestra.run.smithi073.stderr: 73100K .......... .......... .......... .......... .......... 43% 26.4M 3s 2024-03-29T04:09:19.246 INFO:teuthology.orchestra.run.smithi073.stderr: 73150K .......... .......... .......... .......... .......... 43% 33.2M 3s 2024-03-29T04:09:19.246 INFO:teuthology.orchestra.run.smithi073.stderr: 73200K .......... .......... .......... .......... .......... 43% 111M 3s 2024-03-29T04:09:19.246 INFO:teuthology.orchestra.run.smithi073.stderr: 73250K .......... .......... .......... .......... .......... 43% 69.7M 3s 2024-03-29T04:09:19.246 INFO:teuthology.orchestra.run.smithi073.stderr: 73300K .......... .......... .......... .......... .......... 43% 65.9M 3s 2024-03-29T04:09:19.246 INFO:teuthology.orchestra.run.smithi073.stderr: 73350K .......... .......... .......... .......... .......... 43% 65.7M 3s 2024-03-29T04:09:19.247 INFO:teuthology.orchestra.run.smithi073.stderr: 73400K .......... .......... .......... .......... .......... 43% 73.5M 3s 2024-03-29T04:09:19.247 INFO:teuthology.orchestra.run.smithi073.stderr: 73450K .......... .......... .......... .......... .......... 43% 111M 3s 2024-03-29T04:09:19.247 INFO:teuthology.orchestra.run.smithi073.stderr: 73500K .......... .......... .......... .......... .......... 43% 84.4M 3s 2024-03-29T04:09:19.247 INFO:teuthology.orchestra.run.smithi073.stderr: 73550K .......... .......... .......... .......... .......... 43% 62.4M 3s 2024-03-29T04:09:19.247 INFO:teuthology.orchestra.run.smithi073.stderr: 73600K .......... .......... .......... .......... .......... 43% 26.2M 3s 2024-03-29T04:09:19.247 INFO:teuthology.orchestra.run.smithi073.stderr: 73650K .......... .......... .......... .......... .......... 43% 23.7M 3s 2024-03-29T04:09:19.247 INFO:teuthology.orchestra.run.smithi073.stderr: 73700K .......... .......... .......... .......... .......... 43% 71.5M 3s 2024-03-29T04:09:19.247 INFO:teuthology.orchestra.run.smithi073.stderr: 73750K .......... .......... .......... .......... .......... 43% 23.9M 3s 2024-03-29T04:09:19.247 INFO:teuthology.orchestra.run.smithi073.stderr: 73800K .......... .......... .......... .......... .......... 43% 25.1M 3s 2024-03-29T04:09:19.247 INFO:teuthology.orchestra.run.smithi073.stderr: 73850K .......... .......... .......... .......... .......... 43% 24.6M 3s 2024-03-29T04:09:19.247 INFO:teuthology.orchestra.run.smithi073.stderr: 73900K .......... .......... .......... .......... .......... 43% 27.8M 3s 2024-03-29T04:09:19.247 INFO:teuthology.orchestra.run.smithi073.stderr: 73950K .......... .......... .......... .......... .......... 43% 66.2M 3s 2024-03-29T04:09:19.247 INFO:teuthology.orchestra.run.smithi073.stderr: 74000K .......... .......... .......... .......... .......... 43% 24.8M 3s 2024-03-29T04:09:19.248 INFO:teuthology.orchestra.run.smithi073.stderr: 74050K .......... .......... .......... .......... .......... 43% 27.1M 3s 2024-03-29T04:09:19.248 INFO:teuthology.orchestra.run.smithi073.stderr: 74100K .......... .......... .......... .......... .......... 43% 24.3M 3s 2024-03-29T04:09:19.248 INFO:teuthology.orchestra.run.smithi073.stderr: 74150K .......... .......... .......... .......... .......... 44% 43.4M 3s 2024-03-29T04:09:19.248 INFO:teuthology.orchestra.run.smithi073.stderr: 74200K .......... .......... .......... .......... .......... 44% 24.7M 3s 2024-03-29T04:09:19.248 INFO:teuthology.orchestra.run.smithi073.stderr: 74250K .......... .......... .......... .......... .......... 44% 27.6M 3s 2024-03-29T04:09:19.248 INFO:teuthology.orchestra.run.smithi073.stderr: 74300K .......... .......... .......... .......... .......... 44% 19.3M 3s 2024-03-29T04:09:19.248 INFO:teuthology.orchestra.run.smithi073.stderr: 74350K .......... .......... .......... .......... .......... 44% 23.8M 3s 2024-03-29T04:09:19.248 INFO:teuthology.orchestra.run.smithi073.stderr: 74400K .......... .......... .......... .......... .......... 44% 21.4M 3s 2024-03-29T04:09:19.248 INFO:teuthology.orchestra.run.smithi073.stderr: 74450K .......... .......... .......... .......... .......... 44% 27.1M 3s 2024-03-29T04:09:19.248 INFO:teuthology.orchestra.run.smithi073.stderr: 74500K .......... .......... .......... .......... .......... 44% 37.2M 3s 2024-03-29T04:09:19.248 INFO:teuthology.orchestra.run.smithi073.stderr: 74550K .......... .......... .......... .......... .......... 44% 33.1M 3s 2024-03-29T04:09:19.248 INFO:teuthology.orchestra.run.smithi073.stderr: 74600K .......... .......... .......... .......... .......... 44% 39.0M 3s 2024-03-29T04:09:19.248 INFO:teuthology.orchestra.run.smithi073.stderr: 74650K .......... .......... .......... .......... .......... 44% 20.8M 3s 2024-03-29T04:09:19.249 INFO:teuthology.orchestra.run.smithi073.stderr: 74700K .......... .......... .......... .......... .......... 44% 11.3M 3s 2024-03-29T04:09:19.249 INFO:teuthology.orchestra.run.smithi073.stderr: 74750K .......... .......... .......... .......... .......... 44% 45.7M 3s 2024-03-29T04:09:19.249 INFO:teuthology.orchestra.run.smithi073.stderr: 74800K .......... .......... .......... .......... .......... 44% 41.8M 3s 2024-03-29T04:09:19.249 INFO:teuthology.orchestra.run.smithi073.stderr: 74850K .......... .......... .......... .......... .......... 44% 25.4M 3s 2024-03-29T04:09:19.249 INFO:teuthology.orchestra.run.smithi073.stderr: 74900K .......... .......... .......... .......... .......... 44% 49.6M 3s 2024-03-29T04:09:19.249 INFO:teuthology.orchestra.run.smithi073.stderr: 74950K .......... .......... .......... .......... .......... 44% 18.1M 3s 2024-03-29T04:09:19.249 INFO:teuthology.orchestra.run.smithi073.stderr: 75000K .......... .......... .......... .......... .......... 44% 27.5M 3s 2024-03-29T04:09:19.249 INFO:teuthology.orchestra.run.smithi073.stderr: 75050K .......... .......... .......... .......... .......... 44% 29.1M 3s 2024-03-29T04:09:19.249 INFO:teuthology.orchestra.run.smithi073.stderr: 75100K .......... .......... .......... .......... .......... 44% 27.8M 3s 2024-03-29T04:09:19.249 INFO:teuthology.orchestra.run.smithi073.stderr: 75150K .......... .......... .......... .......... .......... 44% 43.2M 3s 2024-03-29T04:09:19.249 INFO:teuthology.orchestra.run.smithi073.stderr: 75200K .......... .......... .......... .......... .......... 44% 29.6M 3s 2024-03-29T04:09:19.249 INFO:teuthology.orchestra.run.smithi073.stderr: 75250K .......... .......... .......... .......... .......... 44% 32.2M 3s 2024-03-29T04:09:19.249 INFO:teuthology.orchestra.run.smithi073.stderr: 75300K .......... .......... .......... .......... .......... 44% 10.4M 3s 2024-03-29T04:09:19.250 INFO:teuthology.orchestra.run.smithi073.stderr: 75350K .......... .......... .......... .......... .......... 44% 32.0M 3s 2024-03-29T04:09:19.250 INFO:teuthology.orchestra.run.smithi073.stderr: 75400K .......... .......... .......... .......... .......... 44% 76.0M 3s 2024-03-29T04:09:19.250 INFO:teuthology.orchestra.run.smithi073.stderr: 75450K .......... .......... .......... .......... .......... 44% 104M 3s 2024-03-29T04:09:19.250 INFO:teuthology.orchestra.run.smithi073.stderr: 75500K .......... .......... .......... .......... .......... 44% 72.2M 3s 2024-03-29T04:09:19.250 INFO:teuthology.orchestra.run.smithi073.stderr: 75550K .......... .......... .......... .......... .......... 44% 60.0M 3s 2024-03-29T04:09:19.250 INFO:teuthology.orchestra.run.smithi073.stderr: 75600K .......... .......... .......... .......... .......... 44% 59.9M 3s 2024-03-29T04:09:19.250 INFO:teuthology.orchestra.run.smithi073.stderr: 75650K .......... .......... .......... .......... .......... 44% 72.3M 3s 2024-03-29T04:09:19.250 INFO:teuthology.orchestra.run.smithi073.stderr: 75700K .......... .......... .......... .......... .......... 44% 24.9M 3s 2024-03-29T04:09:19.250 INFO:teuthology.orchestra.run.smithi073.stderr: 75750K .......... .......... .......... .......... .......... 44% 36.3M 3s 2024-03-29T04:09:19.250 INFO:teuthology.orchestra.run.smithi073.stderr: 75800K .......... .......... .......... .......... .......... 44% 37.1M 3s 2024-03-29T04:09:19.250 INFO:teuthology.orchestra.run.smithi073.stderr: 75850K .......... .......... .......... .......... .......... 45% 27.3M 3s 2024-03-29T04:09:19.250 INFO:teuthology.orchestra.run.smithi073.stderr: 75900K .......... .......... .......... .......... .......... 45% 24.8M 3s 2024-03-29T04:09:19.250 INFO:teuthology.orchestra.run.smithi073.stderr: 75950K .......... .......... .......... .......... .......... 45% 24.8M 3s 2024-03-29T04:09:19.251 INFO:teuthology.orchestra.run.smithi073.stderr: 76000K .......... .......... .......... .......... .......... 45% 50.6M 3s 2024-03-29T04:09:19.251 INFO:teuthology.orchestra.run.smithi073.stderr: 76050K .......... .......... .......... .......... .......... 45% 29.7M 3s 2024-03-29T04:09:19.251 INFO:teuthology.orchestra.run.smithi073.stderr: 76100K .......... .......... .......... .......... .......... 45% 27.0M 3s 2024-03-29T04:09:19.251 INFO:teuthology.orchestra.run.smithi073.stderr: 76150K .......... .......... .......... .......... .......... 45% 24.7M 3s 2024-03-29T04:09:19.251 INFO:teuthology.orchestra.run.smithi073.stderr: 76200K .......... .......... .......... .......... .......... 45% 23.7M 3s 2024-03-29T04:09:19.251 INFO:teuthology.orchestra.run.smithi073.stderr: 76250K .......... .......... .......... .......... .......... 45% 29.7M 3s 2024-03-29T04:09:19.251 INFO:teuthology.orchestra.run.smithi073.stderr: 76300K .......... .......... .......... .......... .......... 45% 39.7M 3s 2024-03-29T04:09:19.251 INFO:teuthology.orchestra.run.smithi073.stderr: 76350K .......... .......... .......... .......... .......... 45% 32.1M 3s 2024-03-29T04:09:19.251 INFO:teuthology.orchestra.run.smithi073.stderr: 76400K .......... .......... .......... .......... .......... 45% 20.4M 3s 2024-03-29T04:09:19.251 INFO:teuthology.orchestra.run.smithi073.stderr: 76450K .......... .......... .......... .......... .......... 45% 18.2M 3s 2024-03-29T04:09:19.251 INFO:teuthology.orchestra.run.smithi073.stderr: 76500K .......... .......... .......... .......... .......... 45% 24.7M 3s 2024-03-29T04:09:19.251 INFO:teuthology.orchestra.run.smithi073.stderr: 76550K .......... .......... .......... .......... .......... 45% 26.7M 3s 2024-03-29T04:09:19.252 INFO:teuthology.orchestra.run.smithi073.stderr: 76600K .......... .......... .......... .......... .......... 45% 111M 3s 2024-03-29T04:09:19.252 INFO:teuthology.orchestra.run.smithi073.stderr: 76650K .......... .......... .......... .......... .......... 45% 45.3M 3s 2024-03-29T04:09:19.252 INFO:teuthology.orchestra.run.smithi073.stderr: 76700K .......... .......... .......... .......... .......... 45% 24.2M 3s 2024-03-29T04:09:19.252 INFO:teuthology.orchestra.run.smithi073.stderr: 76750K .......... .......... .......... .......... .......... 45% 30.1M 3s 2024-03-29T04:09:19.252 INFO:teuthology.orchestra.run.smithi073.stderr: 76800K .......... .......... .......... .......... .......... 45% 9.82M 3s 2024-03-29T04:09:19.252 INFO:teuthology.orchestra.run.smithi073.stderr: 76850K .......... .......... .......... .......... .......... 45% 50.1M 3s 2024-03-29T04:09:19.252 INFO:teuthology.orchestra.run.smithi073.stderr: 76900K .......... .......... .......... .......... .......... 45% 25.9M 3s 2024-03-29T04:09:19.252 INFO:teuthology.orchestra.run.smithi073.stderr: 76950K .......... .......... .......... .......... .......... 45% 24.6M 3s 2024-03-29T04:09:19.252 INFO:teuthology.orchestra.run.smithi073.stderr: 77000K .......... .......... .......... .......... .......... 45% 37.3M 3s 2024-03-29T04:09:19.252 INFO:teuthology.orchestra.run.smithi073.stderr: 77050K .......... .......... .......... .......... .......... 45% 22.4M 3s 2024-03-29T04:09:19.252 INFO:teuthology.orchestra.run.smithi073.stderr: 77100K .......... .......... .......... .......... .......... 45% 22.8M 3s 2024-03-29T04:09:19.252 INFO:teuthology.orchestra.run.smithi073.stderr: 77150K .......... .......... .......... .......... .......... 45% 20.6M 3s 2024-03-29T04:09:19.252 INFO:teuthology.orchestra.run.smithi073.stderr: 77200K .......... .......... .......... .......... .......... 45% 26.5M 3s 2024-03-29T04:09:19.253 INFO:teuthology.orchestra.run.smithi073.stderr: 77250K .......... .......... .......... .......... .......... 45% 56.1M 3s 2024-03-29T04:09:19.253 INFO:teuthology.orchestra.run.smithi073.stderr: 77300K .......... .......... .......... .......... .......... 45% 84.0M 3s 2024-03-29T04:09:19.253 INFO:teuthology.orchestra.run.smithi073.stderr: 77350K .......... .......... .......... .......... .......... 45% 71.7M 3s 2024-03-29T04:09:19.253 INFO:teuthology.orchestra.run.smithi073.stderr: 77400K .......... .......... .......... .......... .......... 45% 67.9M 3s 2024-03-29T04:09:19.253 INFO:teuthology.orchestra.run.smithi073.stderr: 77450K .......... .......... .......... .......... .......... 45% 10.6M 3s 2024-03-29T04:09:19.253 INFO:teuthology.orchestra.run.smithi073.stderr: 77500K .......... .......... .......... .......... .......... 46% 24.1M 3s 2024-03-29T04:09:19.253 INFO:teuthology.orchestra.run.smithi073.stderr: 77550K .......... .......... .......... .......... .......... 46% 29.0M 3s 2024-03-29T04:09:19.253 INFO:teuthology.orchestra.run.smithi073.stderr: 77600K .......... .......... .......... .......... .......... 46% 62.5M 3s 2024-03-29T04:09:19.253 INFO:teuthology.orchestra.run.smithi073.stderr: 77650K .......... .......... .......... .......... .......... 46% 67.2M 3s 2024-03-29T04:09:19.253 INFO:teuthology.orchestra.run.smithi073.stderr: 77700K .......... .......... .......... .......... .......... 46% 39.8M 3s 2024-03-29T04:09:19.253 INFO:teuthology.orchestra.run.smithi073.stderr: 77750K .......... .......... .......... .......... .......... 46% 64.9M 3s 2024-03-29T04:09:19.253 INFO:teuthology.orchestra.run.smithi073.stderr: 77800K .......... .......... .......... .......... .......... 46% 49.2M 3s 2024-03-29T04:09:19.253 INFO:teuthology.orchestra.run.smithi073.stderr: 77850K .......... .......... .......... .......... .......... 46% 47.4M 3s 2024-03-29T04:09:19.254 INFO:teuthology.orchestra.run.smithi073.stderr: 77900K .......... .......... .......... .......... .......... 46% 25.7M 3s 2024-03-29T04:09:19.254 INFO:teuthology.orchestra.run.smithi073.stderr: 77950K .......... .......... .......... .......... .......... 46% 24.6M 3s 2024-03-29T04:09:19.254 INFO:teuthology.orchestra.run.smithi073.stderr: 78000K .......... .......... .......... .......... .......... 46% 49.1M 3s 2024-03-29T04:09:19.254 INFO:teuthology.orchestra.run.smithi073.stderr: 78050K .......... .......... .......... .......... .......... 46% 25.2M 3s 2024-03-29T04:09:19.254 INFO:teuthology.orchestra.run.smithi073.stderr: 78100K .......... .......... .......... .......... .......... 46% 33.7M 3s 2024-03-29T04:09:19.254 INFO:teuthology.orchestra.run.smithi073.stderr: 78150K .......... .......... .......... .......... .......... 46% 24.7M 3s 2024-03-29T04:09:19.254 INFO:teuthology.orchestra.run.smithi073.stderr: 78200K .......... .......... .......... .......... .......... 46% 25.8M 3s 2024-03-29T04:09:19.254 INFO:teuthology.orchestra.run.smithi073.stderr: 78250K .......... .......... .......... .......... .......... 46% 41.2M 3s 2024-03-29T04:09:19.254 INFO:teuthology.orchestra.run.smithi073.stderr: 78300K .......... .......... .......... .......... .......... 46% 18.9M 3s 2024-03-29T04:09:19.254 INFO:teuthology.orchestra.run.smithi073.stderr: 78350K .......... .......... .......... .......... .......... 46% 29.4M 3s 2024-03-29T04:09:19.254 INFO:teuthology.orchestra.run.smithi073.stderr: 78400K .......... .......... .......... .......... .......... 46% 18.5M 3s 2024-03-29T04:09:19.254 INFO:teuthology.orchestra.run.smithi073.stderr: 78450K .......... .......... .......... .......... .......... 46% 63.1M 3s 2024-03-29T04:09:19.254 INFO:teuthology.orchestra.run.smithi073.stderr: 78500K .......... .......... .......... .......... .......... 46% 47.5M 3s 2024-03-29T04:09:19.255 INFO:teuthology.orchestra.run.smithi073.stderr: 78550K .......... .......... .......... .......... .......... 46% 36.4M 3s 2024-03-29T04:09:19.255 INFO:teuthology.orchestra.run.smithi073.stderr: 78600K .......... .......... .......... .......... .......... 46% 21.6M 3s 2024-03-29T04:09:19.255 INFO:teuthology.orchestra.run.smithi073.stderr: 78650K .......... .......... .......... .......... .......... 46% 34.9M 3s 2024-03-29T04:09:19.255 INFO:teuthology.orchestra.run.smithi073.stderr: 78700K .......... .......... .......... .......... .......... 46% 24.1M 3s 2024-03-29T04:09:19.255 INFO:teuthology.orchestra.run.smithi073.stderr: 78750K .......... .......... .......... .......... .......... 46% 60.5M 3s 2024-03-29T04:09:19.255 INFO:teuthology.orchestra.run.smithi073.stderr: 78800K .......... .......... .......... .......... .......... 46% 23.0M 3s 2024-03-29T04:09:19.255 INFO:teuthology.orchestra.run.smithi073.stderr: 78850K .......... .......... .......... .......... .......... 46% 23.5M 3s 2024-03-29T04:09:19.255 INFO:teuthology.orchestra.run.smithi073.stderr: 78900K .......... .......... .......... .......... .......... 46% 49.4M 3s 2024-03-29T04:09:19.255 INFO:teuthology.orchestra.run.smithi073.stderr: 78950K .......... .......... .......... .......... .......... 46% 22.4M 3s 2024-03-29T04:09:19.255 INFO:teuthology.orchestra.run.smithi073.stderr: 79000K .......... .......... .......... .......... .......... 46% 48.4M 3s 2024-03-29T04:09:19.255 INFO:teuthology.orchestra.run.smithi073.stderr: 79050K .......... .......... .......... .......... .......... 46% 22.4M 3s 2024-03-29T04:09:19.255 INFO:teuthology.orchestra.run.smithi073.stderr: 79100K .......... .......... .......... .......... .......... 46% 27.9M 3s 2024-03-29T04:09:19.256 INFO:teuthology.orchestra.run.smithi073.stderr: 79150K .......... .......... .......... .......... .......... 46% 30.5M 3s 2024-03-29T04:09:19.256 INFO:teuthology.orchestra.run.smithi073.stderr: 79200K .......... .......... .......... .......... .......... 47% 24.7M 3s 2024-03-29T04:09:19.256 INFO:teuthology.orchestra.run.smithi073.stderr: 79250K .......... .......... .......... .......... .......... 47% 43.7M 3s 2024-03-29T04:09:19.256 INFO:teuthology.orchestra.run.smithi073.stderr: 79300K .......... .......... .......... .......... .......... 47% 23.0M 3s 2024-03-29T04:09:19.256 INFO:teuthology.orchestra.run.smithi073.stderr: 79350K .......... .......... .......... .......... .......... 47% 27.0M 3s 2024-03-29T04:09:19.256 INFO:teuthology.orchestra.run.smithi073.stderr: 79400K .......... .......... .......... .......... .......... 47% 33.5M 3s 2024-03-29T04:09:19.256 INFO:teuthology.orchestra.run.smithi073.stderr: 79450K .......... .......... .......... .......... .......... 47% 30.2M 3s 2024-03-29T04:09:19.256 INFO:teuthology.orchestra.run.smithi073.stderr: 79500K .......... .......... .......... .......... .......... 47% 23.6M 3s 2024-03-29T04:09:19.256 INFO:teuthology.orchestra.run.smithi073.stderr: 79550K .......... .......... .......... .......... .......... 47% 35.7M 3s 2024-03-29T04:09:19.256 INFO:teuthology.orchestra.run.smithi073.stderr: 79600K .......... .......... .......... .......... .......... 47% 25.8M 3s 2024-03-29T04:09:19.256 INFO:teuthology.orchestra.run.smithi073.stderr: 79650K .......... .......... .......... .......... .......... 47% 32.7M 3s 2024-03-29T04:09:19.257 INFO:teuthology.orchestra.run.smithi073.stderr: 79700K .......... .......... .......... .......... .......... 47% 27.3M 3s 2024-03-29T04:09:19.257 INFO:teuthology.orchestra.run.smithi073.stderr: 79750K .......... .......... .......... .......... .......... 47% 24.2M 3s 2024-03-29T04:09:19.257 INFO:teuthology.orchestra.run.smithi073.stderr: 79800K .......... .......... .......... .......... .......... 47% 43.3M 3s 2024-03-29T04:09:19.257 INFO:teuthology.orchestra.run.smithi073.stderr: 79850K .......... .......... .......... .......... .......... 47% 25.3M 3s 2024-03-29T04:09:19.257 INFO:teuthology.orchestra.run.smithi073.stderr: 79900K .......... .......... .......... .......... .......... 47% 34.8M 3s 2024-03-29T04:09:19.257 INFO:teuthology.orchestra.run.smithi073.stderr: 79950K .......... .......... .......... .......... .......... 47% 24.5M 3s 2024-03-29T04:09:19.257 INFO:teuthology.orchestra.run.smithi073.stderr: 80000K .......... .......... .......... .......... .......... 47% 23.2M 3s 2024-03-29T04:09:19.257 INFO:teuthology.orchestra.run.smithi073.stderr: 80050K .......... .......... .......... .......... .......... 47% 49.5M 3s 2024-03-29T04:09:19.257 INFO:teuthology.orchestra.run.smithi073.stderr: 80100K .......... .......... .......... .......... .......... 47% 24.2M 3s 2024-03-29T04:09:19.257 INFO:teuthology.orchestra.run.smithi073.stderr: 80150K .......... .......... .......... .......... .......... 47% 33.1M 3s 2024-03-29T04:09:19.257 INFO:teuthology.orchestra.run.smithi073.stderr: 80200K .......... .......... .......... .......... .......... 47% 24.4M 3s 2024-03-29T04:09:19.257 INFO:teuthology.orchestra.run.smithi073.stderr: 80250K .......... .......... .......... .......... .......... 47% 24.9M 3s 2024-03-29T04:09:19.258 INFO:teuthology.orchestra.run.smithi073.stderr: 80300K .......... .......... .......... .......... .......... 47% 49.0M 3s 2024-03-29T04:09:19.258 INFO:teuthology.orchestra.run.smithi073.stderr: 80350K .......... .......... .......... .......... .......... 47% 24.5M 3s 2024-03-29T04:09:19.258 INFO:teuthology.orchestra.run.smithi073.stderr: 80400K .......... .......... .......... .......... .......... 47% 35.5M 3s 2024-03-29T04:09:19.258 INFO:teuthology.orchestra.run.smithi073.stderr: 80450K .......... .......... .......... .......... .......... 47% 24.3M 3s 2024-03-29T04:09:19.258 INFO:teuthology.orchestra.run.smithi073.stderr: 80500K .......... .......... .......... .......... .......... 47% 23.9M 3s 2024-03-29T04:09:19.258 INFO:teuthology.orchestra.run.smithi073.stderr: 80550K .......... .......... .......... .......... .......... 47% 47.6M 3s 2024-03-29T04:09:19.258 INFO:teuthology.orchestra.run.smithi073.stderr: 80600K .......... .......... .......... .......... .......... 47% 23.7M 3s 2024-03-29T04:09:19.258 INFO:teuthology.orchestra.run.smithi073.stderr: 80650K .......... .......... .......... .......... .......... 47% 37.5M 3s 2024-03-29T04:09:19.258 INFO:teuthology.orchestra.run.smithi073.stderr: 80700K .......... .......... .......... .......... .......... 47% 24.2M 3s 2024-03-29T04:09:19.258 INFO:teuthology.orchestra.run.smithi073.stderr: 80750K .......... .......... .......... .......... .......... 47% 41.0M 3s 2024-03-29T04:09:19.258 INFO:teuthology.orchestra.run.smithi073.stderr: 80800K .......... .......... .......... .......... .......... 47% 19.1M 3s 2024-03-29T04:09:19.258 INFO:teuthology.orchestra.run.smithi073.stderr: 80850K .......... .......... .......... .......... .......... 47% 37.0M 3s 2024-03-29T04:09:19.258 INFO:teuthology.orchestra.run.smithi073.stderr: 80900K .......... .......... .......... .......... .......... 48% 38.3M 3s 2024-03-29T04:09:19.259 INFO:teuthology.orchestra.run.smithi073.stderr: 80950K .......... .......... .......... .......... .......... 48% 26.5M 3s 2024-03-29T04:09:19.259 INFO:teuthology.orchestra.run.smithi073.stderr: 81000K .......... .......... .......... .......... .......... 48% 27.3M 3s 2024-03-29T04:09:19.259 INFO:teuthology.orchestra.run.smithi073.stderr: 81050K .......... .......... .......... .......... .......... 48% 35.7M 3s 2024-03-29T04:09:19.259 INFO:teuthology.orchestra.run.smithi073.stderr: 81100K .......... .......... .......... .......... .......... 48% 23.9M 3s 2024-03-29T04:09:19.259 INFO:teuthology.orchestra.run.smithi073.stderr: 81150K .......... .......... .......... .......... .......... 48% 32.6M 3s 2024-03-29T04:09:19.259 INFO:teuthology.orchestra.run.smithi073.stderr: 81200K .......... .......... .......... .......... .......... 48% 23.8M 3s 2024-03-29T04:09:19.259 INFO:teuthology.orchestra.run.smithi073.stderr: 81250K .......... .......... .......... .......... .......... 48% 61.5M 3s 2024-03-29T04:09:19.259 INFO:teuthology.orchestra.run.smithi073.stderr: 81300K .......... .......... .......... .......... .......... 48% 23.6M 3s 2024-03-29T04:09:19.259 INFO:teuthology.orchestra.run.smithi073.stderr: 81350K .......... .......... .......... .......... .......... 48% 31.1M 3s 2024-03-29T04:09:19.259 INFO:teuthology.orchestra.run.smithi073.stderr: 81400K .......... .......... .......... .......... .......... 48% 24.3M 3s 2024-03-29T04:09:19.259 INFO:teuthology.orchestra.run.smithi073.stderr: 81450K .......... .......... .......... .......... .......... 48% 26.2M 3s 2024-03-29T04:09:19.259 INFO:teuthology.orchestra.run.smithi073.stderr: 81500K .......... .......... .......... .......... .......... 48% 28.1M 3s 2024-03-29T04:09:19.259 INFO:teuthology.orchestra.run.smithi073.stderr: 81550K .......... .......... .......... .......... .......... 48% 44.8M 3s 2024-03-29T04:09:19.259 INFO:teuthology.orchestra.run.smithi073.stderr: 81600K .......... .......... .......... .......... .......... 48% 24.9M 3s 2024-03-29T04:09:19.260 INFO:teuthology.orchestra.run.smithi073.stderr: 81650K .......... .......... .......... .......... .......... 48% 23.7M 3s 2024-03-29T04:09:19.260 INFO:teuthology.orchestra.run.smithi073.stderr: 81700K .......... .......... .......... .......... .......... 48% 29.4M 3s 2024-03-29T04:09:19.260 INFO:teuthology.orchestra.run.smithi073.stderr: 81750K .......... .......... .......... .......... .......... 48% 33.9M 3s 2024-03-29T04:09:19.260 INFO:teuthology.orchestra.run.smithi073.stderr: 81800K .......... .......... .......... .......... .......... 48% 36.8M 3s 2024-03-29T04:09:19.260 INFO:teuthology.orchestra.run.smithi073.stderr: 81850K .......... .......... .......... .......... .......... 48% 29.3M 3s 2024-03-29T04:09:19.260 INFO:teuthology.orchestra.run.smithi073.stderr: 81900K .......... .......... .......... .......... .......... 48% 22.6M 3s 2024-03-29T04:09:19.260 INFO:teuthology.orchestra.run.smithi073.stderr: 81950K .......... .......... .......... .......... .......... 48% 27.3M 3s 2024-03-29T04:09:19.260 INFO:teuthology.orchestra.run.smithi073.stderr: 82000K .......... .......... .......... .......... .......... 48% 47.1M 3s 2024-03-29T04:09:19.260 INFO:teuthology.orchestra.run.smithi073.stderr: 82050K .......... .......... .......... .......... .......... 48% 29.0M 3s 2024-03-29T04:09:19.260 INFO:teuthology.orchestra.run.smithi073.stderr: 82100K .......... .......... .......... .......... .......... 48% 28.0M 3s 2024-03-29T04:09:19.260 INFO:teuthology.orchestra.run.smithi073.stderr: 82150K .......... .......... .......... .......... .......... 48% 24.1M 3s 2024-03-29T04:09:19.260 INFO:teuthology.orchestra.run.smithi073.stderr: 82200K .......... .......... .......... .......... .......... 48% 25.6M 3s 2024-03-29T04:09:19.260 INFO:teuthology.orchestra.run.smithi073.stderr: 82250K .......... .......... .......... .......... .......... 48% 52.9M 3s 2024-03-29T04:09:19.261 INFO:teuthology.orchestra.run.smithi073.stderr: 82300K .......... .......... .......... .......... .......... 48% 28.5M 3s 2024-03-29T04:09:19.261 INFO:teuthology.orchestra.run.smithi073.stderr: 82350K .......... .......... .......... .......... .......... 48% 26.3M 3s 2024-03-29T04:09:19.261 INFO:teuthology.orchestra.run.smithi073.stderr: 82400K .......... .......... .......... .......... .......... 48% 29.9M 3s 2024-03-29T04:09:19.261 INFO:teuthology.orchestra.run.smithi073.stderr: 82450K .......... .......... .......... .......... .......... 48% 34.0M 3s 2024-03-29T04:09:19.261 INFO:teuthology.orchestra.run.smithi073.stderr: 82500K .......... .......... .......... .......... .......... 48% 25.0M 3s 2024-03-29T04:09:19.261 INFO:teuthology.orchestra.run.smithi073.stderr: 82550K .......... .......... .......... .......... .......... 49% 29.6M 3s 2024-03-29T04:09:19.261 INFO:teuthology.orchestra.run.smithi073.stderr: 82600K .......... .......... .......... .......... .......... 49% 27.7M 3s 2024-03-29T04:09:19.261 INFO:teuthology.orchestra.run.smithi073.stderr: 82650K .......... .......... .......... .......... .......... 49% 32.1M 3s 2024-03-29T04:09:19.261 INFO:teuthology.orchestra.run.smithi073.stderr: 82700K .......... .......... .......... .......... .......... 49% 19.2M 3s 2024-03-29T04:09:19.261 INFO:teuthology.orchestra.run.smithi073.stderr: 82750K .......... .......... .......... .......... .......... 49% 56.4M 3s 2024-03-29T04:09:19.261 INFO:teuthology.orchestra.run.smithi073.stderr: 82800K .......... .......... .......... .......... .......... 49% 33.3M 3s 2024-03-29T04:09:19.261 INFO:teuthology.orchestra.run.smithi073.stderr: 82850K .......... .......... .......... .......... .......... 49% 22.5M 3s 2024-03-29T04:09:19.261 INFO:teuthology.orchestra.run.smithi073.stderr: 82900K .......... .......... .......... .......... .......... 49% 34.4M 3s 2024-03-29T04:09:19.262 INFO:teuthology.orchestra.run.smithi073.stderr: 82950K .......... .......... .......... .......... .......... 49% 28.6M 3s 2024-03-29T04:09:19.262 INFO:teuthology.orchestra.run.smithi073.stderr: 83000K .......... .......... .......... .......... .......... 49% 25.3M 3s 2024-03-29T04:09:19.262 INFO:teuthology.orchestra.run.smithi073.stderr: 83050K .......... .......... .......... .......... .......... 49% 34.4M 3s 2024-03-29T04:09:19.262 INFO:teuthology.orchestra.run.smithi073.stderr: 83100K .......... .......... .......... .......... .......... 49% 25.9M 3s 2024-03-29T04:09:19.262 INFO:teuthology.orchestra.run.smithi073.stderr: 83150K .......... .......... .......... .......... .......... 49% 33.0M 3s 2024-03-29T04:09:19.262 INFO:teuthology.orchestra.run.smithi073.stderr: 83200K .......... .......... .......... .......... .......... 49% 27.9M 3s 2024-03-29T04:09:19.262 INFO:teuthology.orchestra.run.smithi073.stderr: 83250K .......... .......... .......... .......... .......... 49% 24.7M 3s 2024-03-29T04:09:19.262 INFO:teuthology.orchestra.run.smithi073.stderr: 83300K .......... .......... .......... .......... .......... 49% 37.1M 3s 2024-03-29T04:09:19.262 INFO:teuthology.orchestra.run.smithi073.stderr: 83350K .......... .......... .......... .......... .......... 49% 24.9M 3s 2024-03-29T04:09:19.262 INFO:teuthology.orchestra.run.smithi073.stderr: 83400K .......... .......... .......... .......... .......... 49% 25.3M 3s 2024-03-29T04:09:19.262 INFO:teuthology.orchestra.run.smithi073.stderr: 83450K .......... .......... .......... .......... .......... 49% 29.7M 3s 2024-03-29T04:09:19.262 INFO:teuthology.orchestra.run.smithi073.stderr: 83500K .......... .......... .......... .......... .......... 49% 30.2M 3s 2024-03-29T04:09:19.262 INFO:teuthology.orchestra.run.smithi073.stderr: 83550K .......... .......... .......... .......... .......... 49% 41.2M 3s 2024-03-29T04:09:19.263 INFO:teuthology.orchestra.run.smithi073.stderr: 83600K .......... .......... .......... .......... .......... 49% 24.3M 3s 2024-03-29T04:09:19.263 INFO:teuthology.orchestra.run.smithi073.stderr: 83650K .......... .......... .......... .......... .......... 49% 23.7M 3s 2024-03-29T04:09:19.263 INFO:teuthology.orchestra.run.smithi073.stderr: 83700K .......... .......... .......... .......... .......... 49% 36.7M 3s 2024-03-29T04:09:19.263 INFO:teuthology.orchestra.run.smithi073.stderr: 83750K .......... .......... .......... .......... .......... 49% 24.6M 3s 2024-03-29T04:09:19.263 INFO:teuthology.orchestra.run.smithi073.stderr: 83800K .......... .......... .......... .......... .......... 49% 46.5M 3s 2024-03-29T04:09:19.263 INFO:teuthology.orchestra.run.smithi073.stderr: 83850K .......... .......... .......... .......... .......... 49% 25.9M 3s 2024-03-29T04:09:19.263 INFO:teuthology.orchestra.run.smithi073.stderr: 83900K .......... .......... .......... .......... .......... 49% 33.2M 3s 2024-03-29T04:09:19.263 INFO:teuthology.orchestra.run.smithi073.stderr: 83950K .......... .......... .......... .......... .......... 49% 27.8M 3s 2024-03-29T04:09:19.263 INFO:teuthology.orchestra.run.smithi073.stderr: 84000K .......... .......... .......... .......... .......... 49% 21.6M 3s 2024-03-29T04:09:19.263 INFO:teuthology.orchestra.run.smithi073.stderr: 84050K .......... .......... .......... .......... .......... 49% 52.6M 3s 2024-03-29T04:09:19.263 INFO:teuthology.orchestra.run.smithi073.stderr: 84100K .......... .......... .......... .......... .......... 49% 24.8M 3s 2024-03-29T04:09:19.263 INFO:teuthology.orchestra.run.smithi073.stderr: 84150K .......... .......... .......... .......... .......... 49% 34.5M 3s 2024-03-29T04:09:19.263 INFO:teuthology.orchestra.run.smithi073.stderr: 84200K .......... .......... .......... .......... .......... 49% 24.6M 3s 2024-03-29T04:09:19.264 INFO:teuthology.orchestra.run.smithi073.stderr: 84250K .......... .......... .......... .......... .......... 50% 24.2M 3s 2024-03-29T04:09:19.264 INFO:teuthology.orchestra.run.smithi073.stderr: 84300K .......... .......... .......... .......... .......... 50% 52.3M 3s 2024-03-29T04:09:19.264 INFO:teuthology.orchestra.run.smithi073.stderr: 84350K .......... .......... .......... .......... .......... 50% 24.2M 3s 2024-03-29T04:09:19.264 INFO:teuthology.orchestra.run.smithi073.stderr: 84400K .......... .......... .......... .......... .......... 50% 32.9M 3s 2024-03-29T04:09:19.264 INFO:teuthology.orchestra.run.smithi073.stderr: 84450K .......... .......... .......... .......... .......... 50% 27.5M 3s 2024-03-29T04:09:19.264 INFO:teuthology.orchestra.run.smithi073.stderr: 84500K .......... .......... .......... .......... .......... 50% 23.6M 3s 2024-03-29T04:09:19.264 INFO:teuthology.orchestra.run.smithi073.stderr: 84550K .......... .......... .......... .......... .......... 50% 23.9M 3s 2024-03-29T04:09:19.264 INFO:teuthology.orchestra.run.smithi073.stderr: 84600K .......... .......... .......... .......... .......... 50% 73.1M 3s 2024-03-29T04:09:19.264 INFO:teuthology.orchestra.run.smithi073.stderr: 84650K .......... .......... .......... .......... .......... 50% 26.2M 3s 2024-03-29T04:09:19.264 INFO:teuthology.orchestra.run.smithi073.stderr: 84700K .......... .......... .......... .......... .......... 50% 25.7M 3s 2024-03-29T04:09:19.264 INFO:teuthology.orchestra.run.smithi073.stderr: 84750K .......... .......... .......... .......... .......... 50% 23.5M 3s 2024-03-29T04:09:19.264 INFO:teuthology.orchestra.run.smithi073.stderr: 84800K .......... .......... .......... .......... .......... 50% 24.2M 3s 2024-03-29T04:09:19.265 INFO:teuthology.orchestra.run.smithi073.stderr: 84850K .......... .......... .......... .......... .......... 50% 72.6M 3s 2024-03-29T04:09:19.265 INFO:teuthology.orchestra.run.smithi073.stderr: 84900K .......... .......... .......... .......... .......... 50% 21.6M 3s 2024-03-29T04:09:19.265 INFO:teuthology.orchestra.run.smithi073.stderr: 84950K .......... .......... .......... .......... .......... 50% 33.2M 3s 2024-03-29T04:09:19.265 INFO:teuthology.orchestra.run.smithi073.stderr: 85000K .......... .......... .......... .......... .......... 50% 25.0M 3s 2024-03-29T04:09:19.265 INFO:teuthology.orchestra.run.smithi073.stderr: 85050K .......... .......... .......... .......... .......... 50% 24.8M 3s 2024-03-29T04:09:19.265 INFO:teuthology.orchestra.run.smithi073.stderr: 85100K .......... .......... .......... .......... .......... 50% 47.3M 3s 2024-03-29T04:09:19.265 INFO:teuthology.orchestra.run.smithi073.stderr: 85150K .......... .......... .......... .......... .......... 50% 24.7M 3s 2024-03-29T04:09:19.265 INFO:teuthology.orchestra.run.smithi073.stderr: 85200K .......... .......... .......... .......... .......... 50% 34.8M 3s 2024-03-29T04:09:19.265 INFO:teuthology.orchestra.run.smithi073.stderr: 85250K .......... .......... .......... .......... .......... 50% 24.7M 3s 2024-03-29T04:09:19.265 INFO:teuthology.orchestra.run.smithi073.stderr: 85300K .......... .......... .......... .......... .......... 50% 24.4M 3s 2024-03-29T04:09:19.265 INFO:teuthology.orchestra.run.smithi073.stderr: 85350K .......... .......... .......... .......... .......... 50% 47.5M 3s 2024-03-29T04:09:19.265 INFO:teuthology.orchestra.run.smithi073.stderr: 85400K .......... .......... .......... .......... .......... 50% 26.1M 3s 2024-03-29T04:09:19.265 INFO:teuthology.orchestra.run.smithi073.stderr: 85450K .......... .......... .......... .......... .......... 50% 32.5M 3s 2024-03-29T04:09:19.266 INFO:teuthology.orchestra.run.smithi073.stderr: 85500K .......... .......... .......... .......... .......... 50% 24.8M 3s 2024-03-29T04:09:19.266 INFO:teuthology.orchestra.run.smithi073.stderr: 85550K .......... .......... .......... .......... .......... 50% 24.5M 3s 2024-03-29T04:09:19.266 INFO:teuthology.orchestra.run.smithi073.stderr: 85600K .......... .......... .......... .......... .......... 50% 50.0M 3s 2024-03-29T04:09:19.266 INFO:teuthology.orchestra.run.smithi073.stderr: 85650K .......... .......... .......... .......... .......... 50% 24.2M 3s 2024-03-29T04:09:19.266 INFO:teuthology.orchestra.run.smithi073.stderr: 85700K .......... .......... .......... .......... .......... 50% 32.6M 3s 2024-03-29T04:09:19.266 INFO:teuthology.orchestra.run.smithi073.stderr: 85750K .......... .......... .......... .......... .......... 50% 25.4M 3s 2024-03-29T04:09:19.266 INFO:teuthology.orchestra.run.smithi073.stderr: 85800K .......... .......... .......... .......... .......... 50% 25.0M 3s 2024-03-29T04:09:19.266 INFO:teuthology.orchestra.run.smithi073.stderr: 85850K .......... .......... .......... .......... .......... 50% 47.1M 3s 2024-03-29T04:09:19.266 INFO:teuthology.orchestra.run.smithi073.stderr: 85900K .......... .......... .......... .......... .......... 50% 23.8M 3s 2024-03-29T04:09:19.266 INFO:teuthology.orchestra.run.smithi073.stderr: 85950K .......... .......... .......... .......... .......... 51% 37.3M 3s 2024-03-29T04:09:19.266 INFO:teuthology.orchestra.run.smithi073.stderr: 86000K .......... .......... .......... .......... .......... 51% 24.2M 3s 2024-03-29T04:09:19.267 INFO:teuthology.orchestra.run.smithi073.stderr: 86050K .......... .......... .......... .......... .......... 51% 24.3M 3s 2024-03-29T04:09:19.267 INFO:teuthology.orchestra.run.smithi073.stderr: 86100K .......... .......... .......... .......... .......... 51% 51.3M 3s 2024-03-29T04:09:19.267 INFO:teuthology.orchestra.run.smithi073.stderr: 86150K .......... .......... .......... .......... .......... 51% 33.2M 3s 2024-03-29T04:09:19.267 INFO:teuthology.orchestra.run.smithi073.stderr: 86200K .......... .......... .......... .......... .......... 51% 24.3M 3s 2024-03-29T04:09:19.267 INFO:teuthology.orchestra.run.smithi073.stderr: 86250K .......... .......... .......... .......... .......... 51% 24.2M 3s 2024-03-29T04:09:19.267 INFO:teuthology.orchestra.run.smithi073.stderr: 86300K .......... .......... .......... .......... .......... 51% 24.4M 3s 2024-03-29T04:09:19.267 INFO:teuthology.orchestra.run.smithi073.stderr: 86350K .......... .......... .......... .......... .......... 51% 54.4M 3s 2024-03-29T04:09:19.267 INFO:teuthology.orchestra.run.smithi073.stderr: 86400K .......... .......... .......... .......... .......... 51% 32.2M 3s 2024-03-29T04:09:19.267 INFO:teuthology.orchestra.run.smithi073.stderr: 86450K .......... .......... .......... .......... .......... 51% 25.0M 3s 2024-03-29T04:09:19.267 INFO:teuthology.orchestra.run.smithi073.stderr: 86500K .......... .......... .......... .......... .......... 51% 24.9M 3s 2024-03-29T04:09:19.267 INFO:teuthology.orchestra.run.smithi073.stderr: 86550K .......... .......... .......... .......... .......... 51% 32.8M 3s 2024-03-29T04:09:19.267 INFO:teuthology.orchestra.run.smithi073.stderr: 86600K .......... .......... .......... .......... .......... 51% 34.8M 3s 2024-03-29T04:09:19.268 INFO:teuthology.orchestra.run.smithi073.stderr: 86650K .......... .......... .......... .......... .......... 51% 30.4M 3s 2024-03-29T04:09:19.268 INFO:teuthology.orchestra.run.smithi073.stderr: 86700K .......... .......... .......... .......... .......... 51% 25.5M 3s 2024-03-29T04:09:19.268 INFO:teuthology.orchestra.run.smithi073.stderr: 86750K .......... .......... .......... .......... .......... 51% 24.6M 3s 2024-03-29T04:09:19.268 INFO:teuthology.orchestra.run.smithi073.stderr: 86800K .......... .......... .......... .......... .......... 51% 24.5M 3s 2024-03-29T04:09:19.268 INFO:teuthology.orchestra.run.smithi073.stderr: 86850K .......... .......... .......... .......... .......... 51% 56.2M 3s 2024-03-29T04:09:19.268 INFO:teuthology.orchestra.run.smithi073.stderr: 86900K .......... .......... .......... .......... .......... 51% 27.2M 3s 2024-03-29T04:09:19.268 INFO:teuthology.orchestra.run.smithi073.stderr: 86950K .......... .......... .......... .......... .......... 51% 28.7M 3s 2024-03-29T04:09:19.268 INFO:teuthology.orchestra.run.smithi073.stderr: 87000K .......... .......... .......... .......... .......... 51% 24.5M 3s 2024-03-29T04:09:19.268 INFO:teuthology.orchestra.run.smithi073.stderr: 87050K .......... .......... .......... .......... .......... 51% 24.3M 3s 2024-03-29T04:09:19.268 INFO:teuthology.orchestra.run.smithi073.stderr: 87100K .......... .......... .......... .......... .......... 51% 53.8M 3s 2024-03-29T04:09:19.268 INFO:teuthology.orchestra.run.smithi073.stderr: 87150K .......... .......... .......... .......... .......... 51% 28.3M 3s 2024-03-29T04:09:19.268 INFO:teuthology.orchestra.run.smithi073.stderr: 87200K .......... .......... .......... .......... .......... 51% 28.0M 3s 2024-03-29T04:09:19.269 INFO:teuthology.orchestra.run.smithi073.stderr: 87250K .......... .......... .......... .......... .......... 51% 24.5M 3s 2024-03-29T04:09:19.269 INFO:teuthology.orchestra.run.smithi073.stderr: 87300K .......... .......... .......... .......... .......... 51% 24.9M 3s 2024-03-29T04:09:19.269 INFO:teuthology.orchestra.run.smithi073.stderr: 87350K .......... .......... .......... .......... .......... 51% 53.0M 3s 2024-03-29T04:09:19.269 INFO:teuthology.orchestra.run.smithi073.stderr: 87400K .......... .......... .......... .......... .......... 51% 25.5M 3s 2024-03-29T04:09:19.269 INFO:teuthology.orchestra.run.smithi073.stderr: 87450K .......... .......... .......... .......... .......... 51% 28.8M 3s 2024-03-29T04:09:19.269 INFO:teuthology.orchestra.run.smithi073.stderr: 87500K .......... .......... .......... .......... .......... 51% 21.5M 3s 2024-03-29T04:09:19.269 INFO:teuthology.orchestra.run.smithi073.stderr: 87550K .......... .......... .......... .......... .......... 51% 29.1M 3s 2024-03-29T04:09:19.269 INFO:teuthology.orchestra.run.smithi073.stderr: 87600K .......... .......... .......... .......... .......... 51% 55.6M 3s 2024-03-29T04:09:19.269 INFO:teuthology.orchestra.run.smithi073.stderr: 87650K .......... .......... .......... .......... .......... 52% 24.4M 3s 2024-03-29T04:09:19.269 INFO:teuthology.orchestra.run.smithi073.stderr: 87700K .......... .......... .......... .......... .......... 52% 31.9M 3s 2024-03-29T04:09:19.269 INFO:teuthology.orchestra.run.smithi073.stderr: 87750K .......... .......... .......... .......... .......... 52% 24.8M 3s 2024-03-29T04:09:19.269 INFO:teuthology.orchestra.run.smithi073.stderr: 87800K .......... .......... .......... .......... .......... 52% 23.2M 3s 2024-03-29T04:09:19.270 INFO:teuthology.orchestra.run.smithi073.stderr: 87850K .......... .......... .......... .......... .......... 52% 65.2M 3s 2024-03-29T04:09:19.270 INFO:teuthology.orchestra.run.smithi073.stderr: 87900K .......... .......... .......... .......... .......... 52% 24.9M 3s 2024-03-29T04:09:19.270 INFO:teuthology.orchestra.run.smithi073.stderr: 87950K .......... .......... .......... .......... .......... 52% 30.1M 3s 2024-03-29T04:09:19.270 INFO:teuthology.orchestra.run.smithi073.stderr: 88000K .......... .......... .......... .......... .......... 52% 25.4M 3s 2024-03-29T04:09:19.270 INFO:teuthology.orchestra.run.smithi073.stderr: 88050K .......... .......... .......... .......... .......... 52% 23.8M 3s 2024-03-29T04:09:19.270 INFO:teuthology.orchestra.run.smithi073.stderr: 88100K .......... .......... .......... .......... .......... 52% 56.1M 3s 2024-03-29T04:09:19.270 INFO:teuthology.orchestra.run.smithi073.stderr: 88150K .......... .......... .......... .......... .......... 52% 24.2M 3s 2024-03-29T04:09:19.270 INFO:teuthology.orchestra.run.smithi073.stderr: 88200K .......... .......... .......... .......... .......... 52% 32.3M 3s 2024-03-29T04:09:19.270 INFO:teuthology.orchestra.run.smithi073.stderr: 88250K .......... .......... .......... .......... .......... 52% 25.4M 3s 2024-03-29T04:09:19.270 INFO:teuthology.orchestra.run.smithi073.stderr: 88300K .......... .......... .......... .......... .......... 52% 24.1M 3s 2024-03-29T04:09:19.270 INFO:teuthology.orchestra.run.smithi073.stderr: 88350K .......... .......... .......... .......... .......... 52% 48.6M 3s 2024-03-29T04:09:19.270 INFO:teuthology.orchestra.run.smithi073.stderr: 88400K .......... .......... .......... .......... .......... 52% 25.3M 3s 2024-03-29T04:09:19.271 INFO:teuthology.orchestra.run.smithi073.stderr: 88450K .......... .......... .......... .......... .......... 52% 32.7M 3s 2024-03-29T04:09:19.271 INFO:teuthology.orchestra.run.smithi073.stderr: 88500K .......... .......... .......... .......... .......... 52% 25.2M 3s 2024-03-29T04:09:19.271 INFO:teuthology.orchestra.run.smithi073.stderr: 88550K .......... .......... .......... .......... .......... 52% 24.8M 3s 2024-03-29T04:09:19.271 INFO:teuthology.orchestra.run.smithi073.stderr: 88600K .......... .......... .......... .......... .......... 52% 47.4M 3s 2024-03-29T04:09:19.271 INFO:teuthology.orchestra.run.smithi073.stderr: 88650K .......... .......... .......... .......... .......... 52% 23.9M 3s 2024-03-29T04:09:19.271 INFO:teuthology.orchestra.run.smithi073.stderr: 88700K .......... .......... .......... .......... .......... 52% 26.7M 3s 2024-03-29T04:09:19.271 INFO:teuthology.orchestra.run.smithi073.stderr: 88750K .......... .......... .......... .......... .......... 52% 32.4M 3s 2024-03-29T04:09:19.271 INFO:teuthology.orchestra.run.smithi073.stderr: 88800K .......... .......... .......... .......... .......... 52% 25.1M 3s 2024-03-29T04:09:19.271 INFO:teuthology.orchestra.run.smithi073.stderr: 88850K .......... .......... .......... .......... .......... 52% 41.8M 3s 2024-03-29T04:09:19.271 INFO:teuthology.orchestra.run.smithi073.stderr: 88900K .......... .......... .......... .......... .......... 52% 24.7M 3s 2024-03-29T04:09:19.271 INFO:teuthology.orchestra.run.smithi073.stderr: 88950K .......... .......... .......... .......... .......... 52% 24.7M 3s 2024-03-29T04:09:19.271 INFO:teuthology.orchestra.run.smithi073.stderr: 89000K .......... .......... .......... .......... .......... 52% 35.9M 3s 2024-03-29T04:09:19.271 INFO:teuthology.orchestra.run.smithi073.stderr: 89050K .......... .......... .......... .......... .......... 52% 24.7M 3s 2024-03-29T04:09:19.272 INFO:teuthology.orchestra.run.smithi073.stderr: 89100K .......... .......... .......... .......... .......... 52% 44.4M 3s 2024-03-29T04:09:19.272 INFO:teuthology.orchestra.run.smithi073.stderr: 89150K .......... .......... .......... .......... .......... 52% 25.2M 3s 2024-03-29T04:09:19.272 INFO:teuthology.orchestra.run.smithi073.stderr: 89200K .......... .......... .......... .......... .......... 52% 32.3M 3s 2024-03-29T04:09:19.272 INFO:teuthology.orchestra.run.smithi073.stderr: 89250K .......... .......... .......... .......... .......... 52% 24.0M 3s 2024-03-29T04:09:19.272 INFO:teuthology.orchestra.run.smithi073.stderr: 89300K .......... .......... .......... .......... .......... 53% 24.6M 3s 2024-03-29T04:09:19.272 INFO:teuthology.orchestra.run.smithi073.stderr: 89350K .......... .......... .......... .......... .......... 53% 56.8M 3s 2024-03-29T04:09:19.272 INFO:teuthology.orchestra.run.smithi073.stderr: 89400K .......... .......... .......... .......... .......... 53% 25.0M 3s 2024-03-29T04:09:19.272 INFO:teuthology.orchestra.run.smithi073.stderr: 89450K .......... .......... .......... .......... .......... 53% 31.0M 3s 2024-03-29T04:09:19.272 INFO:teuthology.orchestra.run.smithi073.stderr: 89500K .......... .......... .......... .......... .......... 53% 24.8M 3s 2024-03-29T04:09:19.272 INFO:teuthology.orchestra.run.smithi073.stderr: 89550K .......... .......... .......... .......... .......... 53% 22.5M 3s 2024-03-29T04:09:19.272 INFO:teuthology.orchestra.run.smithi073.stderr: 89600K .......... .......... .......... .......... .......... 53% 61.3M 3s 2024-03-29T04:09:19.272 INFO:teuthology.orchestra.run.smithi073.stderr: 89650K .......... .......... .......... .......... .......... 53% 26.0M 3s 2024-03-29T04:09:19.272 INFO:teuthology.orchestra.run.smithi073.stderr: 89700K .......... .......... .......... .......... .......... 53% 27.9M 3s 2024-03-29T04:09:19.273 INFO:teuthology.orchestra.run.smithi073.stderr: 89750K .......... .......... .......... .......... .......... 53% 24.4M 3s 2024-03-29T04:09:19.273 INFO:teuthology.orchestra.run.smithi073.stderr: 89800K .......... .......... .......... .......... .......... 53% 23.6M 3s 2024-03-29T04:09:19.273 INFO:teuthology.orchestra.run.smithi073.stderr: 89850K .......... .......... .......... .......... .......... 53% 64.0M 3s 2024-03-29T04:09:19.273 INFO:teuthology.orchestra.run.smithi073.stderr: 89900K .......... .......... .......... .......... .......... 53% 25.8M 3s 2024-03-29T04:09:19.273 INFO:teuthology.orchestra.run.smithi073.stderr: 89950K .......... .......... .......... .......... .......... 53% 25.6M 3s 2024-03-29T04:09:19.273 INFO:teuthology.orchestra.run.smithi073.stderr: 90000K .......... .......... .......... .......... .......... 53% 25.8M 3s 2024-03-29T04:09:19.273 INFO:teuthology.orchestra.run.smithi073.stderr: 90050K .......... .......... .......... .......... .......... 53% 26.0M 3s 2024-03-29T04:09:19.273 INFO:teuthology.orchestra.run.smithi073.stderr: 90100K .......... .......... .......... .......... .......... 53% 57.2M 3s 2024-03-29T04:09:19.273 INFO:teuthology.orchestra.run.smithi073.stderr: 90150K .......... .......... .......... .......... .......... 53% 26.5M 3s 2024-03-29T04:09:19.273 INFO:teuthology.orchestra.run.smithi073.stderr: 90200K .......... .......... .......... .......... .......... 53% 28.7M 3s 2024-03-29T04:09:19.273 INFO:teuthology.orchestra.run.smithi073.stderr: 90250K .......... .......... .......... .......... .......... 53% 24.3M 3s 2024-03-29T04:09:19.273 INFO:teuthology.orchestra.run.smithi073.stderr: 90300K .......... .......... .......... .......... .......... 53% 25.1M 3s 2024-03-29T04:09:19.274 INFO:teuthology.orchestra.run.smithi073.stderr: 90350K .......... .......... .......... .......... .......... 53% 49.9M 3s 2024-03-29T04:09:19.274 INFO:teuthology.orchestra.run.smithi073.stderr: 90400K .......... .......... .......... .......... .......... 53% 29.6M 3s 2024-03-29T04:09:19.274 INFO:teuthology.orchestra.run.smithi073.stderr: 90450K .......... .......... .......... .......... .......... 53% 27.0M 3s 2024-03-29T04:09:19.274 INFO:teuthology.orchestra.run.smithi073.stderr: 90500K .......... .......... .......... .......... .......... 53% 24.3M 3s 2024-03-29T04:09:19.274 INFO:teuthology.orchestra.run.smithi073.stderr: 90550K .......... .......... .......... .......... .......... 53% 23.9M 3s 2024-03-29T04:09:19.274 INFO:teuthology.orchestra.run.smithi073.stderr: 90600K .......... .......... .......... .......... .......... 53% 55.8M 3s 2024-03-29T04:09:19.274 INFO:teuthology.orchestra.run.smithi073.stderr: 90650K .......... .......... .......... .......... .......... 53% 29.8M 3s 2024-03-29T04:09:19.274 INFO:teuthology.orchestra.run.smithi073.stderr: 90700K .......... .......... .......... .......... .......... 53% 26.0M 3s 2024-03-29T04:09:19.274 INFO:teuthology.orchestra.run.smithi073.stderr: 90750K .......... .......... .......... .......... .......... 53% 24.5M 3s 2024-03-29T04:09:19.274 INFO:teuthology.orchestra.run.smithi073.stderr: 90800K .......... .......... .......... .......... .......... 53% 30.3M 3s 2024-03-29T04:09:19.274 INFO:teuthology.orchestra.run.smithi073.stderr: 90850K .......... .......... .......... .......... .......... 53% 37.9M 3s 2024-03-29T04:09:19.274 INFO:teuthology.orchestra.run.smithi073.stderr: 90900K .......... .......... .......... .......... .......... 53% 30.6M 3s 2024-03-29T04:09:19.274 INFO:teuthology.orchestra.run.smithi073.stderr: 90950K .......... .......... .......... .......... .......... 53% 25.9M 3s 2024-03-29T04:09:19.275 INFO:teuthology.orchestra.run.smithi073.stderr: 91000K .......... .......... .......... .......... .......... 54% 22.9M 3s 2024-03-29T04:09:19.275 INFO:teuthology.orchestra.run.smithi073.stderr: 91050K .......... .......... .......... .......... .......... 54% 49.8M 3s 2024-03-29T04:09:19.275 INFO:teuthology.orchestra.run.smithi073.stderr: 91100K .......... .......... .......... .......... .......... 54% 24.1M 3s 2024-03-29T04:09:19.275 INFO:teuthology.orchestra.run.smithi073.stderr: 91150K .......... .......... .......... .......... .......... 54% 34.3M 3s 2024-03-29T04:09:19.275 INFO:teuthology.orchestra.run.smithi073.stderr: 91200K .......... .......... .......... .......... .......... 54% 26.1M 3s 2024-03-29T04:09:19.275 INFO:teuthology.orchestra.run.smithi073.stderr: 91250K .......... .......... .......... .......... .......... 54% 24.0M 3s 2024-03-29T04:09:19.275 INFO:teuthology.orchestra.run.smithi073.stderr: 91300K .......... .......... .......... .......... .......... 54% 45.7M 3s 2024-03-29T04:09:19.275 INFO:teuthology.orchestra.run.smithi073.stderr: 91350K .......... .......... .......... .......... .......... 54% 23.9M 3s 2024-03-29T04:09:19.275 INFO:teuthology.orchestra.run.smithi073.stderr: 91400K .......... .......... .......... .......... .......... 54% 35.6M 3s 2024-03-29T04:09:19.275 INFO:teuthology.orchestra.run.smithi073.stderr: 91450K .......... .......... .......... .......... .......... 54% 24.6M 3s 2024-03-29T04:09:19.275 INFO:teuthology.orchestra.run.smithi073.stderr: 91500K .......... .......... .......... .......... .......... 54% 23.4M 3s 2024-03-29T04:09:19.275 INFO:teuthology.orchestra.run.smithi073.stderr: 91550K .......... .......... .......... .......... .......... 54% 48.1M 3s 2024-03-29T04:09:19.276 INFO:teuthology.orchestra.run.smithi073.stderr: 91600K .......... .......... .......... .......... .......... 54% 23.3M 3s 2024-03-29T04:09:19.276 INFO:teuthology.orchestra.run.smithi073.stderr: 91650K .......... .......... .......... .......... .......... 54% 36.0M 3s 2024-03-29T04:09:19.276 INFO:teuthology.orchestra.run.smithi073.stderr: 91700K .......... .......... .......... .......... .......... 54% 25.0M 3s 2024-03-29T04:09:19.276 INFO:teuthology.orchestra.run.smithi073.stderr: 91750K .......... .......... .......... .......... .......... 54% 35.9M 3s 2024-03-29T04:09:19.276 INFO:teuthology.orchestra.run.smithi073.stderr: 91800K .......... .......... .......... .......... .......... 54% 27.0M 3s 2024-03-29T04:09:19.276 INFO:teuthology.orchestra.run.smithi073.stderr: 91850K .......... .......... .......... .......... .......... 54% 23.8M 3s 2024-03-29T04:09:19.276 INFO:teuthology.orchestra.run.smithi073.stderr: 91900K .......... .......... .......... .......... .......... 54% 42.6M 3s 2024-03-29T04:09:19.276 INFO:teuthology.orchestra.run.smithi073.stderr: 91950K .......... .......... .......... .......... .......... 54% 25.1M 3s 2024-03-29T04:09:19.276 INFO:teuthology.orchestra.run.smithi073.stderr: 92000K .......... .......... .......... .......... .......... 54% 36.8M 3s 2024-03-29T04:09:19.276 INFO:teuthology.orchestra.run.smithi073.stderr: 92050K .......... .......... .......... .......... .......... 54% 23.9M 3s 2024-03-29T04:09:19.276 INFO:teuthology.orchestra.run.smithi073.stderr: 92100K .......... .......... .......... .......... .......... 54% 24.2M 3s 2024-03-29T04:09:19.276 INFO:teuthology.orchestra.run.smithi073.stderr: 92150K .......... .......... .......... .......... .......... 54% 49.1M 3s 2024-03-29T04:09:19.276 INFO:teuthology.orchestra.run.smithi073.stderr: 92200K .......... .......... .......... .......... .......... 54% 24.7M 3s 2024-03-29T04:09:19.277 INFO:teuthology.orchestra.run.smithi073.stderr: 92250K .......... .......... .......... .......... .......... 54% 34.8M 3s 2024-03-29T04:09:19.277 INFO:teuthology.orchestra.run.smithi073.stderr: 92300K .......... .......... .......... .......... .......... 54% 24.6M 3s 2024-03-29T04:09:19.277 INFO:teuthology.orchestra.run.smithi073.stderr: 92350K .......... .......... .......... .......... .......... 54% 25.0M 3s 2024-03-29T04:09:19.277 INFO:teuthology.orchestra.run.smithi073.stderr: 92400K .......... .......... .......... .......... .......... 54% 47.1M 3s 2024-03-29T04:09:19.277 INFO:teuthology.orchestra.run.smithi073.stderr: 92450K .......... .......... .......... .......... .......... 54% 24.3M 3s 2024-03-29T04:09:19.277 INFO:teuthology.orchestra.run.smithi073.stderr: 92500K .......... .......... .......... .......... .......... 54% 35.2M 3s 2024-03-29T04:09:19.277 INFO:teuthology.orchestra.run.smithi073.stderr: 92550K .......... .......... .......... .......... .......... 54% 24.7M 3s 2024-03-29T04:09:19.277 INFO:teuthology.orchestra.run.smithi073.stderr: 92600K .......... .......... .......... .......... .......... 54% 24.3M 3s 2024-03-29T04:09:19.277 INFO:teuthology.orchestra.run.smithi073.stderr: 92650K .......... .......... .......... .......... .......... 54% 53.5M 3s 2024-03-29T04:09:19.277 INFO:teuthology.orchestra.run.smithi073.stderr: 92700K .......... .......... .......... .......... .......... 55% 32.4M 3s 2024-03-29T04:09:19.277 INFO:teuthology.orchestra.run.smithi073.stderr: 92750K .......... .......... .......... .......... .......... 55% 25.1M 3s 2024-03-29T04:09:19.277 INFO:teuthology.orchestra.run.smithi073.stderr: 92800K .......... .......... .......... .......... .......... 55% 24.6M 3s 2024-03-29T04:09:19.278 INFO:teuthology.orchestra.run.smithi073.stderr: 92850K .......... .......... .......... .......... .......... 55% 24.8M 3s 2024-03-29T04:09:19.278 INFO:teuthology.orchestra.run.smithi073.stderr: 92900K .......... .......... .......... .......... .......... 55% 49.8M 3s 2024-03-29T04:09:19.278 INFO:teuthology.orchestra.run.smithi073.stderr: 92950K .......... .......... .......... .......... .......... 55% 23.6M 3s 2024-03-29T04:09:19.278 INFO:teuthology.orchestra.run.smithi073.stderr: 93000K .......... .......... .......... .......... .......... 55% 23.1M 3s 2024-03-29T04:09:19.278 INFO:teuthology.orchestra.run.smithi073.stderr: 93050K .......... .......... .......... .......... .......... 55% 36.9M 3s 2024-03-29T04:09:19.278 INFO:teuthology.orchestra.run.smithi073.stderr: 93100K .......... .......... .......... .......... .......... 55% 26.7M 3s 2024-03-29T04:09:19.278 INFO:teuthology.orchestra.run.smithi073.stderr: 93150K .......... .......... .......... .......... .......... 55% 46.3M 3s 2024-03-29T04:09:19.278 INFO:teuthology.orchestra.run.smithi073.stderr: 93200K .......... .......... .......... .......... .......... 55% 26.9M 3s 2024-03-29T04:09:19.278 INFO:teuthology.orchestra.run.smithi073.stderr: 93250K .......... .......... .......... .......... .......... 55% 27.9M 3s 2024-03-29T04:09:19.278 INFO:teuthology.orchestra.run.smithi073.stderr: 93300K .......... .......... .......... .......... .......... 55% 25.0M 3s 2024-03-29T04:09:19.278 INFO:teuthology.orchestra.run.smithi073.stderr: 93350K .......... .......... .......... .......... .......... 55% 24.8M 3s 2024-03-29T04:09:19.278 INFO:teuthology.orchestra.run.smithi073.stderr: 93400K .......... .......... .......... .......... .......... 55% 57.8M 3s 2024-03-29T04:09:19.278 INFO:teuthology.orchestra.run.smithi073.stderr: 93450K .......... .......... .......... .......... .......... 55% 23.6M 3s 2024-03-29T04:09:19.279 INFO:teuthology.orchestra.run.smithi073.stderr: 93500K .......... .......... .......... .......... .......... 55% 31.2M 3s 2024-03-29T04:09:19.279 INFO:teuthology.orchestra.run.smithi073.stderr: 93550K .......... .......... .......... .......... .......... 55% 25.1M 3s 2024-03-29T04:09:19.279 INFO:teuthology.orchestra.run.smithi073.stderr: 93600K .......... .......... .......... .......... .......... 55% 24.7M 3s 2024-03-29T04:09:19.279 INFO:teuthology.orchestra.run.smithi073.stderr: 93650K .......... .......... .......... .......... .......... 55% 47.5M 3s 2024-03-29T04:09:19.279 INFO:teuthology.orchestra.run.smithi073.stderr: 93700K .......... .......... .......... .......... .......... 55% 24.1M 3s 2024-03-29T04:09:19.279 INFO:teuthology.orchestra.run.smithi073.stderr: 93750K .......... .......... .......... .......... .......... 55% 36.0M 3s 2024-03-29T04:09:19.279 INFO:teuthology.orchestra.run.smithi073.stderr: 93800K .......... .......... .......... .......... .......... 55% 23.8M 3s 2024-03-29T04:09:19.279 INFO:teuthology.orchestra.run.smithi073.stderr: 93850K .......... .......... .......... .......... .......... 55% 29.2M 3s 2024-03-29T04:09:19.279 INFO:teuthology.orchestra.run.smithi073.stderr: 93900K .......... .......... .......... .......... .......... 55% 38.4M 3s 2024-03-29T04:09:19.279 INFO:teuthology.orchestra.run.smithi073.stderr: 93950K .......... .......... .......... .......... .......... 55% 25.2M 3s 2024-03-29T04:09:19.279 INFO:teuthology.orchestra.run.smithi073.stderr: 94000K .......... .......... .......... .......... .......... 55% 32.8M 3s 2024-03-29T04:09:19.279 INFO:teuthology.orchestra.run.smithi073.stderr: 94050K .......... .......... .......... .......... .......... 55% 24.7M 3s 2024-03-29T04:09:19.279 INFO:teuthology.orchestra.run.smithi073.stderr: 94100K .......... .......... .......... .......... .......... 55% 24.7M 3s 2024-03-29T04:09:19.280 INFO:teuthology.orchestra.run.smithi073.stderr: 94150K .......... .......... .......... .......... .......... 55% 55.4M 3s 2024-03-29T04:09:19.280 INFO:teuthology.orchestra.run.smithi073.stderr: 94200K .......... .......... .......... .......... .......... 55% 23.6M 3s 2024-03-29T04:09:19.280 INFO:teuthology.orchestra.run.smithi073.stderr: 94250K .......... .......... .......... .......... .......... 55% 32.3M 3s 2024-03-29T04:09:19.280 INFO:teuthology.orchestra.run.smithi073.stderr: 94300K .......... .......... .......... .......... .......... 55% 24.9M 3s 2024-03-29T04:09:19.280 INFO:teuthology.orchestra.run.smithi073.stderr: 94350K .......... .......... .......... .......... .......... 56% 25.0M 3s 2024-03-29T04:09:19.280 INFO:teuthology.orchestra.run.smithi073.stderr: 94400K .......... .......... .......... .......... .......... 56% 49.0M 3s 2024-03-29T04:09:19.280 INFO:teuthology.orchestra.run.smithi073.stderr: 94450K .......... .......... .......... .......... .......... 56% 25.2M 3s 2024-03-29T04:09:19.280 INFO:teuthology.orchestra.run.smithi073.stderr: 94500K .......... .......... .......... .......... .......... 56% 33.5M 3s 2024-03-29T04:09:19.280 INFO:teuthology.orchestra.run.smithi073.stderr: 94550K .......... .......... .......... .......... .......... 56% 24.3M 3s 2024-03-29T04:09:19.280 INFO:teuthology.orchestra.run.smithi073.stderr: 94600K .......... .......... .......... .......... .......... 56% 24.5M 3s 2024-03-29T04:09:19.280 INFO:teuthology.orchestra.run.smithi073.stderr: 94650K .......... .......... .......... .......... .......... 56% 49.0M 3s 2024-03-29T04:09:19.280 INFO:teuthology.orchestra.run.smithi073.stderr: 94700K .......... .......... .......... .......... .......... 56% 24.4M 3s 2024-03-29T04:09:19.280 INFO:teuthology.orchestra.run.smithi073.stderr: 94750K .......... .......... .......... .......... .......... 56% 34.3M 3s 2024-03-29T04:09:19.281 INFO:teuthology.orchestra.run.smithi073.stderr: 94800K .......... .......... .......... .......... .......... 56% 24.4M 3s 2024-03-29T04:09:19.281 INFO:teuthology.orchestra.run.smithi073.stderr: 94850K .......... .......... .......... .......... .......... 56% 24.8M 3s 2024-03-29T04:09:19.281 INFO:teuthology.orchestra.run.smithi073.stderr: 94900K .......... .......... .......... .......... .......... 56% 42.7M 3s 2024-03-29T04:09:19.281 INFO:teuthology.orchestra.run.smithi073.stderr: 94950K .......... .......... .......... .......... .......... 56% 27.3M 3s 2024-03-29T04:09:19.281 INFO:teuthology.orchestra.run.smithi073.stderr: 95000K .......... .......... .......... .......... .......... 56% 32.5M 3s 2024-03-29T04:09:19.281 INFO:teuthology.orchestra.run.smithi073.stderr: 95050K .......... .......... .......... .......... .......... 56% 25.0M 3s 2024-03-29T04:09:19.281 INFO:teuthology.orchestra.run.smithi073.stderr: 95100K .......... .......... .......... .......... .......... 56% 24.7M 3s 2024-03-29T04:09:19.281 INFO:teuthology.orchestra.run.smithi073.stderr: 95150K .......... .......... .......... .......... .......... 56% 25.5M 3s 2024-03-29T04:09:19.281 INFO:teuthology.orchestra.run.smithi073.stderr: 95200K .......... .......... .......... .......... .......... 56% 41.2M 3s 2024-03-29T04:09:19.281 INFO:teuthology.orchestra.run.smithi073.stderr: 95250K .......... .......... .......... .......... .......... 56% 25.5M 3s 2024-03-29T04:09:19.281 INFO:teuthology.orchestra.run.smithi073.stderr: 95300K .......... .......... .......... .......... .......... 56% 34.9M 3s 2024-03-29T04:09:19.281 INFO:teuthology.orchestra.run.smithi073.stderr: 95350K .......... .......... .......... .......... .......... 56% 24.4M 3s 2024-03-29T04:09:19.281 INFO:teuthology.orchestra.run.smithi073.stderr: 95400K .......... .......... .......... .......... .......... 56% 24.6M 3s 2024-03-29T04:09:19.282 INFO:teuthology.orchestra.run.smithi073.stderr: 95450K .......... .......... .......... .......... .......... 56% 73.5M 3s 2024-03-29T04:09:19.282 INFO:teuthology.orchestra.run.smithi073.stderr: 95500K .......... .......... .......... .......... .......... 56% 24.9M 3s 2024-03-29T04:09:19.282 INFO:teuthology.orchestra.run.smithi073.stderr: 95550K .......... .......... .......... .......... .......... 56% 27.8M 3s 2024-03-29T04:09:19.282 INFO:teuthology.orchestra.run.smithi073.stderr: 95600K .......... .......... .......... .......... .......... 56% 24.8M 3s 2024-03-29T04:09:19.282 INFO:teuthology.orchestra.run.smithi073.stderr: 95650K .......... .......... .......... .......... .......... 56% 8.73M 3s 2024-03-29T04:09:19.282 INFO:teuthology.orchestra.run.smithi073.stderr: 95700K .......... .......... .......... .......... .......... 56% 258M 3s 2024-03-29T04:09:19.282 INFO:teuthology.orchestra.run.smithi073.stderr: 95750K .......... .......... .......... .......... .......... 56% 139M 3s 2024-03-29T04:09:19.282 INFO:teuthology.orchestra.run.smithi073.stderr: 95800K .......... .......... .......... .......... .......... 56% 66.7M 3s 2024-03-29T04:09:19.282 INFO:teuthology.orchestra.run.smithi073.stderr: 95850K .......... .......... .......... .......... .......... 56% 32.5M 3s 2024-03-29T04:09:19.282 INFO:teuthology.orchestra.run.smithi073.stderr: 95900K .......... .......... .......... .......... .......... 56% 24.4M 3s 2024-03-29T04:09:19.282 INFO:teuthology.orchestra.run.smithi073.stderr: 95950K .......... .......... .......... .......... .......... 56% 68.2M 3s 2024-03-29T04:09:19.282 INFO:teuthology.orchestra.run.smithi073.stderr: 96000K .......... .......... .......... .......... .......... 56% 21.1M 3s 2024-03-29T04:09:19.283 INFO:teuthology.orchestra.run.smithi073.stderr: 96050K .......... .......... .......... .......... .......... 57% 36.9M 3s 2024-03-29T04:09:19.283 INFO:teuthology.orchestra.run.smithi073.stderr: 96100K .......... .......... .......... .......... .......... 57% 24.6M 3s 2024-03-29T04:09:19.283 INFO:teuthology.orchestra.run.smithi073.stderr: 96150K .......... .......... .......... .......... .......... 57% 24.2M 3s 2024-03-29T04:09:19.283 INFO:teuthology.orchestra.run.smithi073.stderr: 96200K .......... .......... .......... .......... .......... 57% 60.6M 3s 2024-03-29T04:09:19.283 INFO:teuthology.orchestra.run.smithi073.stderr: 96250K .......... .......... .......... .......... .......... 57% 23.4M 3s 2024-03-29T04:09:19.283 INFO:teuthology.orchestra.run.smithi073.stderr: 96300K .......... .......... .......... .......... .......... 57% 33.5M 3s 2024-03-29T04:09:19.283 INFO:teuthology.orchestra.run.smithi073.stderr: 96350K .......... .......... .......... .......... .......... 57% 24.0M 3s 2024-03-29T04:09:19.283 INFO:teuthology.orchestra.run.smithi073.stderr: 96400K .......... .......... .......... .......... .......... 57% 24.1M 3s 2024-03-29T04:09:19.283 INFO:teuthology.orchestra.run.smithi073.stderr: 96450K .......... .......... .......... .......... .......... 57% 53.6M 3s 2024-03-29T04:09:19.283 INFO:teuthology.orchestra.run.smithi073.stderr: 96500K .......... .......... .......... .......... .......... 57% 25.6M 3s 2024-03-29T04:09:19.283 INFO:teuthology.orchestra.run.smithi073.stderr: 96550K .......... .......... .......... .......... .......... 57% 30.7M 3s 2024-03-29T04:09:19.283 INFO:teuthology.orchestra.run.smithi073.stderr: 96600K .......... .......... .......... .......... .......... 57% 24.6M 3s 2024-03-29T04:09:19.283 INFO:teuthology.orchestra.run.smithi073.stderr: 96650K .......... .......... .......... .......... .......... 57% 24.7M 3s 2024-03-29T04:09:19.284 INFO:teuthology.orchestra.run.smithi073.stderr: 96700K .......... .......... .......... .......... .......... 57% 50.0M 3s 2024-03-29T04:09:19.284 INFO:teuthology.orchestra.run.smithi073.stderr: 96750K .......... .......... .......... .......... .......... 57% 24.2M 3s 2024-03-29T04:09:19.284 INFO:teuthology.orchestra.run.smithi073.stderr: 96800K .......... .......... .......... .......... .......... 57% 33.7M 3s 2024-03-29T04:09:19.284 INFO:teuthology.orchestra.run.smithi073.stderr: 96850K .......... .......... .......... .......... .......... 57% 25.2M 3s 2024-03-29T04:09:19.284 INFO:teuthology.orchestra.run.smithi073.stderr: 96900K .......... .......... .......... .......... .......... 57% 24.8M 3s 2024-03-29T04:09:19.284 INFO:teuthology.orchestra.run.smithi073.stderr: 96950K .......... .......... .......... .......... .......... 57% 49.1M 3s 2024-03-29T04:09:19.284 INFO:teuthology.orchestra.run.smithi073.stderr: 97000K .......... .......... .......... .......... .......... 57% 23.7M 3s 2024-03-29T04:09:19.284 INFO:teuthology.orchestra.run.smithi073.stderr: 97050K .......... .......... .......... .......... .......... 57% 35.2M 3s 2024-03-29T04:09:19.284 INFO:teuthology.orchestra.run.smithi073.stderr: 97100K .......... .......... .......... .......... .......... 57% 24.9M 3s 2024-03-29T04:09:19.284 INFO:teuthology.orchestra.run.smithi073.stderr: 97150K .......... .......... .......... .......... .......... 57% 24.7M 3s 2024-03-29T04:09:19.284 INFO:teuthology.orchestra.run.smithi073.stderr: 97200K .......... .......... .......... .......... .......... 57% 48.5M 3s 2024-03-29T04:09:19.284 INFO:teuthology.orchestra.run.smithi073.stderr: 97250K .......... .......... .......... .......... .......... 57% 24.7M 3s 2024-03-29T04:09:19.284 INFO:teuthology.orchestra.run.smithi073.stderr: 97300K .......... .......... .......... .......... .......... 57% 33.8M 3s 2024-03-29T04:09:19.285 INFO:teuthology.orchestra.run.smithi073.stderr: 97350K .......... .......... .......... .......... .......... 57% 25.4M 3s 2024-03-29T04:09:19.285 INFO:teuthology.orchestra.run.smithi073.stderr: 97400K .......... .......... .......... .......... .......... 57% 24.7M 3s 2024-03-29T04:09:19.285 INFO:teuthology.orchestra.run.smithi073.stderr: 97450K .......... .......... .......... .......... .......... 57% 44.1M 3s 2024-03-29T04:09:19.285 INFO:teuthology.orchestra.run.smithi073.stderr: 97500K .......... .......... .......... .......... .......... 57% 24.7M 3s 2024-03-29T04:09:19.285 INFO:teuthology.orchestra.run.smithi073.stderr: 97550K .......... .......... .......... .......... .......... 57% 36.5M 3s 2024-03-29T04:09:19.285 INFO:teuthology.orchestra.run.smithi073.stderr: 97600K .......... .......... .......... .......... .......... 57% 24.1M 3s 2024-03-29T04:09:19.285 INFO:teuthology.orchestra.run.smithi073.stderr: 97650K .......... .......... .......... .......... .......... 57% 25.4M 3s 2024-03-29T04:09:19.285 INFO:teuthology.orchestra.run.smithi073.stderr: 97700K .......... .......... .......... .......... .......... 57% 44.5M 3s 2024-03-29T04:09:19.285 INFO:teuthology.orchestra.run.smithi073.stderr: 97750K .......... .......... .......... .......... .......... 58% 25.4M 3s 2024-03-29T04:09:19.285 INFO:teuthology.orchestra.run.smithi073.stderr: 97800K .......... .......... .......... .......... .......... 58% 32.3M 3s 2024-03-29T04:09:19.285 INFO:teuthology.orchestra.run.smithi073.stderr: 97850K .......... .......... .......... .......... .......... 58% 23.6M 3s 2024-03-29T04:09:19.285 INFO:teuthology.orchestra.run.smithi073.stderr: 97900K .......... .......... .......... .......... .......... 58% 26.7M 3s 2024-03-29T04:09:19.286 INFO:teuthology.orchestra.run.smithi073.stderr: 97950K .......... .......... .......... .......... .......... 58% 45.4M 3s 2024-03-29T04:09:19.286 INFO:teuthology.orchestra.run.smithi073.stderr: 98000K .......... .......... .......... .......... .......... 58% 24.5M 3s 2024-03-29T04:09:19.286 INFO:teuthology.orchestra.run.smithi073.stderr: 98050K .......... .......... .......... .......... .......... 58% 26.4M 3s 2024-03-29T04:09:19.286 INFO:teuthology.orchestra.run.smithi073.stderr: 98100K .......... .......... .......... .......... .......... 58% 29.6M 3s 2024-03-29T04:09:19.286 INFO:teuthology.orchestra.run.smithi073.stderr: 98150K .......... .......... .......... .......... .......... 58% 53.6M 3s 2024-03-29T04:09:19.286 INFO:teuthology.orchestra.run.smithi073.stderr: 98200K .......... .......... .......... .......... .......... 58% 25.8M 3s 2024-03-29T04:09:19.286 INFO:teuthology.orchestra.run.smithi073.stderr: 98250K .......... .......... .......... .......... .......... 58% 24.1M 3s 2024-03-29T04:09:19.286 INFO:teuthology.orchestra.run.smithi073.stderr: 98300K .......... .......... .......... .......... .......... 58% 28.5M 3s 2024-03-29T04:09:19.286 INFO:teuthology.orchestra.run.smithi073.stderr: 98350K .......... .......... .......... .......... .......... 58% 24.7M 3s 2024-03-29T04:09:19.286 INFO:teuthology.orchestra.run.smithi073.stderr: 98400K .......... .......... .......... .......... .......... 58% 59.9M 2s 2024-03-29T04:09:19.286 INFO:teuthology.orchestra.run.smithi073.stderr: 98450K .......... .......... .......... .......... .......... 58% 26.1M 2s 2024-03-29T04:09:19.287 INFO:teuthology.orchestra.run.smithi073.stderr: 98500K .......... .......... .......... .......... .......... 58% 24.6M 2s 2024-03-29T04:09:19.287 INFO:teuthology.orchestra.run.smithi073.stderr: 98550K .......... .......... .......... .......... .......... 58% 27.6M 2s 2024-03-29T04:09:19.287 INFO:teuthology.orchestra.run.smithi073.stderr: 98600K .......... .......... .......... .......... .......... 58% 24.5M 2s 2024-03-29T04:09:19.287 INFO:teuthology.orchestra.run.smithi073.stderr: 98650K .......... .......... .......... .......... .......... 58% 52.7M 2s 2024-03-29T04:09:19.287 INFO:teuthology.orchestra.run.smithi073.stderr: 98700K .......... .......... .......... .......... .......... 58% 25.8M 2s 2024-03-29T04:09:19.287 INFO:teuthology.orchestra.run.smithi073.stderr: 98750K .......... .......... .......... .......... .......... 58% 26.3M 2s 2024-03-29T04:09:19.287 INFO:teuthology.orchestra.run.smithi073.stderr: 98800K .......... .......... .......... .......... .......... 58% 29.3M 2s 2024-03-29T04:09:19.287 INFO:teuthology.orchestra.run.smithi073.stderr: 98850K .......... .......... .......... .......... .......... 58% 23.1M 2s 2024-03-29T04:09:19.287 INFO:teuthology.orchestra.run.smithi073.stderr: 98900K .......... .......... .......... .......... .......... 58% 48.0M 2s 2024-03-29T04:09:19.287 INFO:teuthology.orchestra.run.smithi073.stderr: 98950K .......... .......... .......... .......... .......... 58% 31.7M 2s 2024-03-29T04:09:19.287 INFO:teuthology.orchestra.run.smithi073.stderr: 99000K .......... .......... .......... .......... .......... 58% 26.1M 2s 2024-03-29T04:09:19.288 INFO:teuthology.orchestra.run.smithi073.stderr: 99050K .......... .......... .......... .......... .......... 58% 24.6M 2s 2024-03-29T04:09:19.288 INFO:teuthology.orchestra.run.smithi073.stderr: 99100K .......... .......... .......... .......... .......... 58% 24.7M 2s 2024-03-29T04:09:19.288 INFO:teuthology.orchestra.run.smithi073.stderr: 99150K .......... .......... .......... .......... .......... 58% 45.3M 2s 2024-03-29T04:09:19.288 INFO:teuthology.orchestra.run.smithi073.stderr: 99200K .......... .......... .......... .......... .......... 58% 29.9M 2s 2024-03-29T04:09:19.288 INFO:teuthology.orchestra.run.smithi073.stderr: 99250K .......... .......... .......... .......... .......... 58% 27.2M 2s 2024-03-29T04:09:19.288 INFO:teuthology.orchestra.run.smithi073.stderr: 99300K .......... .......... .......... .......... .......... 58% 23.9M 2s 2024-03-29T04:09:19.288 INFO:teuthology.orchestra.run.smithi073.stderr: 99350K .......... .......... .......... .......... .......... 58% 24.2M 2s 2024-03-29T04:09:19.288 INFO:teuthology.orchestra.run.smithi073.stderr: 99400K .......... .......... .......... .......... .......... 58% 59.8M 2s 2024-03-29T04:09:19.288 INFO:teuthology.orchestra.run.smithi073.stderr: 99450K .......... .......... .......... .......... .......... 59% 28.7M 2s 2024-03-29T04:09:19.288 INFO:teuthology.orchestra.run.smithi073.stderr: 99500K .......... .......... .......... .......... .......... 59% 20.7M 2s 2024-03-29T04:09:19.288 INFO:teuthology.orchestra.run.smithi073.stderr: 99550K .......... .......... .......... .......... .......... 59% 31.5M 2s 2024-03-29T04:09:19.288 INFO:teuthology.orchestra.run.smithi073.stderr: 99600K .......... .......... .......... .......... .......... 59% 24.5M 2s 2024-03-29T04:09:19.288 INFO:teuthology.orchestra.run.smithi073.stderr: 99650K .......... .......... .......... .......... .......... 59% 32.1M 2s 2024-03-29T04:09:19.288 INFO:teuthology.orchestra.run.smithi073.stderr: 99700K .......... .......... .......... .......... .......... 59% 42.6M 2s 2024-03-29T04:09:19.289 INFO:teuthology.orchestra.run.smithi073.stderr: 99750K .......... .......... .......... .......... .......... 59% 28.6M 2s 2024-03-29T04:09:19.289 INFO:teuthology.orchestra.run.smithi073.stderr: 99800K .......... .......... .......... .......... .......... 59% 19.7M 2s 2024-03-29T04:09:19.289 INFO:teuthology.orchestra.run.smithi073.stderr: 99850K .......... .......... .......... .......... .......... 59% 31.4M 2s 2024-03-29T04:09:19.289 INFO:teuthology.orchestra.run.smithi073.stderr: 99900K .......... .......... .......... .......... .......... 59% 44.0M 2s 2024-03-29T04:09:19.289 INFO:teuthology.orchestra.run.smithi073.stderr: 99950K .......... .......... .......... .......... .......... 59% 34.5M 2s 2024-03-29T04:09:19.289 INFO:teuthology.orchestra.run.smithi073.stderr:100000K .......... .......... .......... .......... .......... 59% 24.5M 2s 2024-03-29T04:09:19.289 INFO:teuthology.orchestra.run.smithi073.stderr:100050K .......... .......... .......... .......... .......... 59% 23.0M 2s 2024-03-29T04:09:19.289 INFO:teuthology.orchestra.run.smithi073.stderr:100100K .......... .......... .......... .......... .......... 59% 27.5M 2s 2024-03-29T04:09:19.289 INFO:teuthology.orchestra.run.smithi073.stderr:100150K .......... .......... .......... .......... .......... 59% 45.7M 2s 2024-03-29T04:09:19.289 INFO:teuthology.orchestra.run.smithi073.stderr:100200K .......... .......... .......... .......... .......... 59% 34.0M 2s 2024-03-29T04:09:19.289 INFO:teuthology.orchestra.run.smithi073.stderr:100250K .......... .......... .......... .......... .......... 59% 23.6M 2s 2024-03-29T04:09:19.289 INFO:teuthology.orchestra.run.smithi073.stderr:100300K .......... .......... .......... .......... .......... 59% 23.9M 2s 2024-03-29T04:09:19.289 INFO:teuthology.orchestra.run.smithi073.stderr:100350K .......... .......... .......... .......... .......... 59% 40.7M 2s 2024-03-29T04:09:19.290 INFO:teuthology.orchestra.run.smithi073.stderr:100400K .......... .......... .......... .......... .......... 59% 24.7M 2s 2024-03-29T04:09:19.290 INFO:teuthology.orchestra.run.smithi073.stderr:100450K .......... .......... .......... .......... .......... 59% 22.0M 2s 2024-03-29T04:09:19.290 INFO:teuthology.orchestra.run.smithi073.stderr:100500K .......... .......... .......... .......... .......... 59% 50.3M 2s 2024-03-29T04:09:19.290 INFO:teuthology.orchestra.run.smithi073.stderr:100550K .......... .......... .......... .......... .......... 59% 23.4M 2s 2024-03-29T04:09:19.290 INFO:teuthology.orchestra.run.smithi073.stderr:100600K .......... .......... .......... .......... .......... 59% 38.9M 2s 2024-03-29T04:09:19.290 INFO:teuthology.orchestra.run.smithi073.stderr:100650K .......... .......... .......... .......... .......... 59% 24.9M 2s 2024-03-29T04:09:19.290 INFO:teuthology.orchestra.run.smithi073.stderr:100700K .......... .......... .......... .......... .......... 59% 23.6M 2s 2024-03-29T04:09:19.290 INFO:teuthology.orchestra.run.smithi073.stderr:100750K .......... .......... .......... .......... .......... 59% 45.2M 2s 2024-03-29T04:09:19.290 INFO:teuthology.orchestra.run.smithi073.stderr:100800K .......... .......... .......... .......... .......... 59% 24.2M 2s 2024-03-29T04:09:19.290 INFO:teuthology.orchestra.run.smithi073.stderr:100850K .......... .......... .......... .......... .......... 59% 37.6M 2s 2024-03-29T04:09:19.290 INFO:teuthology.orchestra.run.smithi073.stderr:100900K .......... .......... .......... .......... .......... 59% 24.1M 2s 2024-03-29T04:09:19.290 INFO:teuthology.orchestra.run.smithi073.stderr:100950K .......... .......... .......... .......... .......... 59% 24.2M 2s 2024-03-29T04:09:19.291 INFO:teuthology.orchestra.run.smithi073.stderr:101000K .......... .......... .......... .......... .......... 59% 48.7M 2s 2024-03-29T04:09:19.291 INFO:teuthology.orchestra.run.smithi073.stderr:101050K .......... .......... .......... .......... .......... 59% 24.7M 2s 2024-03-29T04:09:19.291 INFO:teuthology.orchestra.run.smithi073.stderr:101100K .......... .......... .......... .......... .......... 60% 34.7M 2s 2024-03-29T04:09:19.291 INFO:teuthology.orchestra.run.smithi073.stderr:101150K .......... .......... .......... .......... .......... 60% 23.4M 2s 2024-03-29T04:09:19.291 INFO:teuthology.orchestra.run.smithi073.stderr:101200K .......... .......... .......... .......... .......... 60% 24.7M 2s 2024-03-29T04:09:19.291 INFO:teuthology.orchestra.run.smithi073.stderr:101250K .......... .......... .......... .......... .......... 60% 46.9M 2s 2024-03-29T04:09:19.291 INFO:teuthology.orchestra.run.smithi073.stderr:101300K .......... .......... .......... .......... .......... 60% 35.7M 2s 2024-03-29T04:09:19.291 INFO:teuthology.orchestra.run.smithi073.stderr:101350K .......... .......... .......... .......... .......... 60% 24.5M 2s 2024-03-29T04:09:19.291 INFO:teuthology.orchestra.run.smithi073.stderr:101400K .......... .......... .......... .......... .......... 60% 24.3M 2s 2024-03-29T04:09:19.291 INFO:teuthology.orchestra.run.smithi073.stderr:101450K .......... .......... .......... .......... .......... 60% 24.4M 2s 2024-03-29T04:09:19.291 INFO:teuthology.orchestra.run.smithi073.stderr:101500K .......... .......... .......... .......... .......... 60% 54.3M 2s 2024-03-29T04:09:19.291 INFO:teuthology.orchestra.run.smithi073.stderr:101550K .......... .......... .......... .......... .......... 60% 30.3M 2s 2024-03-29T04:09:19.291 INFO:teuthology.orchestra.run.smithi073.stderr:101600K .......... .......... .......... .......... .......... 60% 26.1M 2s 2024-03-29T04:09:19.292 INFO:teuthology.orchestra.run.smithi073.stderr:101650K .......... .......... .......... .......... .......... 60% 24.8M 2s 2024-03-29T04:09:19.292 INFO:teuthology.orchestra.run.smithi073.stderr:101700K .......... .......... .......... .......... .......... 60% 25.8M 2s 2024-03-29T04:09:19.292 INFO:teuthology.orchestra.run.smithi073.stderr:101750K .......... .......... .......... .......... .......... 60% 48.7M 2s 2024-03-29T04:09:19.292 INFO:teuthology.orchestra.run.smithi073.stderr:101800K .......... .......... .......... .......... .......... 60% 30.4M 2s 2024-03-29T04:09:19.292 INFO:teuthology.orchestra.run.smithi073.stderr:101850K .......... .......... .......... .......... .......... 60% 28.0M 2s 2024-03-29T04:09:19.292 INFO:teuthology.orchestra.run.smithi073.stderr:101900K .......... .......... .......... .......... .......... 60% 23.8M 2s 2024-03-29T04:09:19.292 INFO:teuthology.orchestra.run.smithi073.stderr:101950K .......... .......... .......... .......... .......... 60% 25.3M 2s 2024-03-29T04:09:19.292 INFO:teuthology.orchestra.run.smithi073.stderr:102000K .......... .......... .......... .......... .......... 60% 48.0M 2s 2024-03-29T04:09:19.292 INFO:teuthology.orchestra.run.smithi073.stderr:102050K .......... .......... .......... .......... .......... 60% 23.3M 2s 2024-03-29T04:09:19.292 INFO:teuthology.orchestra.run.smithi073.stderr:102100K .......... .......... .......... .......... .......... 60% 35.1M 2s 2024-03-29T04:09:19.292 INFO:teuthology.orchestra.run.smithi073.stderr:102150K .......... .......... .......... .......... .......... 60% 24.8M 2s 2024-03-29T04:09:19.292 INFO:teuthology.orchestra.run.smithi073.stderr:102200K .......... .......... .......... .......... .......... 60% 24.2M 2s 2024-03-29T04:09:19.292 INFO:teuthology.orchestra.run.smithi073.stderr:102250K .......... .......... .......... .......... .......... 60% 51.6M 2s 2024-03-29T04:09:19.292 INFO:teuthology.orchestra.run.smithi073.stderr:102300K .......... .......... .......... .......... .......... 60% 26.0M 2s 2024-03-29T04:09:19.293 INFO:teuthology.orchestra.run.smithi073.stderr:102350K .......... .......... .......... .......... .......... 60% 31.0M 2s 2024-03-29T04:09:19.293 INFO:teuthology.orchestra.run.smithi073.stderr:102400K .......... .......... .......... .......... .......... 60% 25.0M 2s 2024-03-29T04:09:19.293 INFO:teuthology.orchestra.run.smithi073.stderr:102450K .......... .......... .......... .......... .......... 60% 25.2M 2s 2024-03-29T04:09:19.293 INFO:teuthology.orchestra.run.smithi073.stderr:102500K .......... .......... .......... .......... .......... 60% 44.9M 2s 2024-03-29T04:09:19.293 INFO:teuthology.orchestra.run.smithi073.stderr:102550K .......... .......... .......... .......... .......... 60% 24.5M 2s 2024-03-29T04:09:19.293 INFO:teuthology.orchestra.run.smithi073.stderr:102600K .......... .......... .......... .......... .......... 60% 25.5M 2s 2024-03-29T04:09:19.293 INFO:teuthology.orchestra.run.smithi073.stderr:102650K .......... .......... .......... .......... .......... 60% 33.8M 2s 2024-03-29T04:09:19.293 INFO:teuthology.orchestra.run.smithi073.stderr:102700K .......... .......... .......... .......... .......... 60% 24.5M 2s 2024-03-29T04:09:19.293 INFO:teuthology.orchestra.run.smithi073.stderr:102750K .......... .......... .......... .......... .......... 60% 49.0M 2s 2024-03-29T04:09:19.293 INFO:teuthology.orchestra.run.smithi073.stderr:102800K .......... .......... .......... .......... .......... 61% 24.6M 2s 2024-03-29T04:09:19.293 INFO:teuthology.orchestra.run.smithi073.stderr:102850K .......... .......... .......... .......... .......... 61% 34.8M 2s 2024-03-29T04:09:19.293 INFO:teuthology.orchestra.run.smithi073.stderr:102900K .......... .......... .......... .......... .......... 61% 25.3M 2s 2024-03-29T04:09:19.293 INFO:teuthology.orchestra.run.smithi073.stderr:102950K .......... .......... .......... .......... .......... 61% 24.4M 2s 2024-03-29T04:09:19.294 INFO:teuthology.orchestra.run.smithi073.stderr:103000K .......... .......... .......... .......... .......... 61% 53.7M 2s 2024-03-29T04:09:19.294 INFO:teuthology.orchestra.run.smithi073.stderr:103050K .......... .......... .......... .......... .......... 61% 23.4M 2s 2024-03-29T04:09:19.294 INFO:teuthology.orchestra.run.smithi073.stderr:103100K .......... .......... .......... .......... .......... 61% 33.2M 2s 2024-03-29T04:09:19.294 INFO:teuthology.orchestra.run.smithi073.stderr:103150K .......... .......... .......... .......... .......... 61% 24.7M 2s 2024-03-29T04:09:19.294 INFO:teuthology.orchestra.run.smithi073.stderr:103200K .......... .......... .......... .......... .......... 61% 24.9M 2s 2024-03-29T04:09:19.294 INFO:teuthology.orchestra.run.smithi073.stderr:103250K .......... .......... .......... .......... .......... 61% 49.2M 2s 2024-03-29T04:09:19.294 INFO:teuthology.orchestra.run.smithi073.stderr:103300K .......... .......... .......... .......... .......... 61% 24.5M 2s 2024-03-29T04:09:19.294 INFO:teuthology.orchestra.run.smithi073.stderr:103350K .......... .......... .......... .......... .......... 61% 35.3M 2s 2024-03-29T04:09:19.294 INFO:teuthology.orchestra.run.smithi073.stderr:103400K .......... .......... .......... .......... .......... 61% 24.9M 2s 2024-03-29T04:09:19.294 INFO:teuthology.orchestra.run.smithi073.stderr:103450K .......... .......... .......... .......... .......... 61% 23.9M 2s 2024-03-29T04:09:19.294 INFO:teuthology.orchestra.run.smithi073.stderr:103500K .......... .......... .......... .......... .......... 61% 49.1M 2s 2024-03-29T04:09:19.294 INFO:teuthology.orchestra.run.smithi073.stderr:103550K .......... .......... .......... .......... .......... 61% 24.7M 2s 2024-03-29T04:09:19.294 INFO:teuthology.orchestra.run.smithi073.stderr:103600K .......... .......... .......... .......... .......... 61% 32.6M 2s 2024-03-29T04:09:19.295 INFO:teuthology.orchestra.run.smithi073.stderr:103650K .......... .......... .......... .......... .......... 61% 26.0M 2s 2024-03-29T04:09:19.295 INFO:teuthology.orchestra.run.smithi073.stderr:103700K .......... .......... .......... .......... .......... 61% 23.7M 2s 2024-03-29T04:09:19.295 INFO:teuthology.orchestra.run.smithi073.stderr:103750K .......... .......... .......... .......... .......... 61% 53.3M 2s 2024-03-29T04:09:19.295 INFO:teuthology.orchestra.run.smithi073.stderr:103800K .......... .......... .......... .......... .......... 61% 31.7M 2s 2024-03-29T04:09:19.295 INFO:teuthology.orchestra.run.smithi073.stderr:103850K .......... .......... .......... .......... .......... 61% 25.6M 2s 2024-03-29T04:09:19.295 INFO:teuthology.orchestra.run.smithi073.stderr:103900K .......... .......... .......... .......... .......... 61% 24.5M 2s 2024-03-29T04:09:19.295 INFO:teuthology.orchestra.run.smithi073.stderr:103950K .......... .......... .......... .......... .......... 61% 24.7M 2s 2024-03-29T04:09:19.295 INFO:teuthology.orchestra.run.smithi073.stderr:104000K .......... .......... .......... .......... .......... 61% 50.9M 2s 2024-03-29T04:09:19.295 INFO:teuthology.orchestra.run.smithi073.stderr:104050K .......... .......... .......... .......... .......... 61% 31.5M 2s 2024-03-29T04:09:19.295 INFO:teuthology.orchestra.run.smithi073.stderr:104100K .......... .......... .......... .......... .......... 61% 24.7M 2s 2024-03-29T04:09:19.295 INFO:teuthology.orchestra.run.smithi073.stderr:104150K .......... .......... .......... .......... .......... 61% 24.9M 2s 2024-03-29T04:09:19.295 INFO:teuthology.orchestra.run.smithi073.stderr:104200K .......... .......... .......... .......... .......... 61% 24.1M 2s 2024-03-29T04:09:19.295 INFO:teuthology.orchestra.run.smithi073.stderr:104250K .......... .......... .......... .......... .......... 61% 53.0M 2s 2024-03-29T04:09:19.296 INFO:teuthology.orchestra.run.smithi073.stderr:104300K .......... .......... .......... .......... .......... 61% 29.1M 2s 2024-03-29T04:09:19.296 INFO:teuthology.orchestra.run.smithi073.stderr:104350K .......... .......... .......... .......... .......... 61% 26.8M 2s 2024-03-29T04:09:19.296 INFO:teuthology.orchestra.run.smithi073.stderr:104400K .......... .......... .......... .......... .......... 61% 24.8M 2s 2024-03-29T04:09:19.296 INFO:teuthology.orchestra.run.smithi073.stderr:104450K .......... .......... .......... .......... .......... 61% 24.6M 2s 2024-03-29T04:09:19.296 INFO:teuthology.orchestra.run.smithi073.stderr:104500K .......... .......... .......... .......... .......... 62% 52.1M 2s 2024-03-29T04:09:19.296 INFO:teuthology.orchestra.run.smithi073.stderr:104550K .......... .......... .......... .......... .......... 62% 29.4M 2s 2024-03-29T04:09:19.296 INFO:teuthology.orchestra.run.smithi073.stderr:104600K .......... .......... .......... .......... .......... 62% 27.0M 2s 2024-03-29T04:09:19.296 INFO:teuthology.orchestra.run.smithi073.stderr:104650K .......... .......... .......... .......... .......... 62% 24.5M 2s 2024-03-29T04:09:19.296 INFO:teuthology.orchestra.run.smithi073.stderr:104700K .......... .......... .......... .......... .......... 62% 24.7M 2s 2024-03-29T04:09:19.296 INFO:teuthology.orchestra.run.smithi073.stderr:104750K .......... .......... .......... .......... .......... 62% 58.2M 2s 2024-03-29T04:09:19.296 INFO:teuthology.orchestra.run.smithi073.stderr:104800K .......... .......... .......... .......... .......... 62% 22.6M 2s 2024-03-29T04:09:19.296 INFO:teuthology.orchestra.run.smithi073.stderr:104850K .......... .......... .......... .......... .......... 62% 25.1M 2s 2024-03-29T04:09:19.296 INFO:teuthology.orchestra.run.smithi073.stderr:104900K .......... .......... .......... .......... .......... 62% 32.7M 2s 2024-03-29T04:09:19.297 INFO:teuthology.orchestra.run.smithi073.stderr:104950K .......... .......... .......... .......... .......... 62% 23.6M 2s 2024-03-29T04:09:19.297 INFO:teuthology.orchestra.run.smithi073.stderr:105000K .......... .......... .......... .......... .......... 62% 62.2M 2s 2024-03-29T04:09:19.297 INFO:teuthology.orchestra.run.smithi073.stderr:105050K .......... .......... .......... .......... .......... 62% 26.3M 2s 2024-03-29T04:09:19.297 INFO:teuthology.orchestra.run.smithi073.stderr:105100K .......... .......... .......... .......... .......... 62% 24.1M 2s 2024-03-29T04:09:19.297 INFO:teuthology.orchestra.run.smithi073.stderr:105150K .......... .......... .......... .......... .......... 62% 29.9M 2s 2024-03-29T04:09:19.297 INFO:teuthology.orchestra.run.smithi073.stderr:105200K .......... .......... .......... .......... .......... 62% 24.3M 2s 2024-03-29T04:09:19.297 INFO:teuthology.orchestra.run.smithi073.stderr:105250K .......... .......... .......... .......... .......... 62% 55.8M 2s 2024-03-29T04:09:19.297 INFO:teuthology.orchestra.run.smithi073.stderr:105300K .......... .......... .......... .......... .......... 62% 25.3M 2s 2024-03-29T04:09:19.297 INFO:teuthology.orchestra.run.smithi073.stderr:105350K .......... .......... .......... .......... .......... 62% 23.2M 2s 2024-03-29T04:09:19.297 INFO:teuthology.orchestra.run.smithi073.stderr:105400K .......... .......... .......... .......... .......... 62% 32.6M 2s 2024-03-29T04:09:19.297 INFO:teuthology.orchestra.run.smithi073.stderr:105450K .......... .......... .......... .......... .......... 62% 24.8M 2s 2024-03-29T04:09:19.297 INFO:teuthology.orchestra.run.smithi073.stderr:105500K .......... .......... .......... .......... .......... 62% 51.8M 2s 2024-03-29T04:09:19.298 INFO:teuthology.orchestra.run.smithi073.stderr:105550K .......... .......... .......... .......... .......... 62% 26.0M 2s 2024-03-29T04:09:19.298 INFO:teuthology.orchestra.run.smithi073.stderr:105600K .......... .......... .......... .......... .......... 62% 25.2M 2s 2024-03-29T04:09:19.298 INFO:teuthology.orchestra.run.smithi073.stderr:105650K .......... .......... .......... .......... .......... 62% 29.4M 2s 2024-03-29T04:09:19.298 INFO:teuthology.orchestra.run.smithi073.stderr:105700K .......... .......... .......... .......... .......... 62% 25.0M 2s 2024-03-29T04:09:19.298 INFO:teuthology.orchestra.run.smithi073.stderr:105750K .......... .......... .......... .......... .......... 62% 24.9M 2s 2024-03-29T04:09:19.298 INFO:teuthology.orchestra.run.smithi073.stderr:105800K .......... .......... .......... .......... .......... 62% 55.4M 2s 2024-03-29T04:09:19.298 INFO:teuthology.orchestra.run.smithi073.stderr:105850K .......... .......... .......... .......... .......... 62% 24.1M 2s 2024-03-29T04:09:19.298 INFO:teuthology.orchestra.run.smithi073.stderr:105900K .......... .......... .......... .......... .......... 62% 32.0M 2s 2024-03-29T04:09:19.298 INFO:teuthology.orchestra.run.smithi073.stderr:105950K .......... .......... .......... .......... .......... 62% 24.7M 2s 2024-03-29T04:09:19.298 INFO:teuthology.orchestra.run.smithi073.stderr:106000K .......... .......... .......... .......... .......... 62% 24.3M 2s 2024-03-29T04:09:19.298 INFO:teuthology.orchestra.run.smithi073.stderr:106050K .......... .......... .......... .......... .......... 62% 50.7M 2s 2024-03-29T04:09:19.298 INFO:teuthology.orchestra.run.smithi073.stderr:106100K .......... .......... .......... .......... .......... 62% 24.6M 2s 2024-03-29T04:09:19.298 INFO:teuthology.orchestra.run.smithi073.stderr:106150K .......... .......... .......... .......... .......... 63% 33.4M 2s 2024-03-29T04:09:19.299 INFO:teuthology.orchestra.run.smithi073.stderr:106200K .......... .......... .......... .......... .......... 63% 24.8M 2s 2024-03-29T04:09:19.299 INFO:teuthology.orchestra.run.smithi073.stderr:106250K .......... .......... .......... .......... .......... 63% 24.4M 2s 2024-03-29T04:09:19.299 INFO:teuthology.orchestra.run.smithi073.stderr:106300K .......... .......... .......... .......... .......... 63% 48.7M 2s 2024-03-29T04:09:19.299 INFO:teuthology.orchestra.run.smithi073.stderr:106350K .......... .......... .......... .......... .......... 63% 24.6M 2s 2024-03-29T04:09:19.299 INFO:teuthology.orchestra.run.smithi073.stderr:106400K .......... .......... .......... .......... .......... 63% 36.4M 2s 2024-03-29T04:09:19.299 INFO:teuthology.orchestra.run.smithi073.stderr:106450K .......... .......... .......... .......... .......... 63% 24.6M 2s 2024-03-29T04:09:19.299 INFO:teuthology.orchestra.run.smithi073.stderr:106500K .......... .......... .......... .......... .......... 63% 24.7M 2s 2024-03-29T04:09:19.299 INFO:teuthology.orchestra.run.smithi073.stderr:106550K .......... .......... .......... .......... .......... 63% 45.8M 2s 2024-03-29T04:09:19.299 INFO:teuthology.orchestra.run.smithi073.stderr:106600K .......... .......... .......... .......... .......... 63% 24.8M 2s 2024-03-29T04:09:19.299 INFO:teuthology.orchestra.run.smithi073.stderr:106650K .......... .......... .......... .......... .......... 63% 34.8M 2s 2024-03-29T04:09:19.299 INFO:teuthology.orchestra.run.smithi073.stderr:106700K .......... .......... .......... .......... .......... 63% 23.8M 2s 2024-03-29T04:09:19.299 INFO:teuthology.orchestra.run.smithi073.stderr:106750K .......... .......... .......... .......... .......... 63% 25.5M 2s 2024-03-29T04:09:19.299 INFO:teuthology.orchestra.run.smithi073.stderr:106800K .......... .......... .......... .......... .......... 63% 46.3M 2s 2024-03-29T04:09:19.300 INFO:teuthology.orchestra.run.smithi073.stderr:106850K .......... .......... .......... .......... .......... 63% 24.0M 2s 2024-03-29T04:09:19.300 INFO:teuthology.orchestra.run.smithi073.stderr:106900K .......... .......... .......... .......... .......... 63% 36.0M 2s 2024-03-29T04:09:19.300 INFO:teuthology.orchestra.run.smithi073.stderr:106950K .......... .......... .......... .......... .......... 63% 23.9M 2s 2024-03-29T04:09:19.300 INFO:teuthology.orchestra.run.smithi073.stderr:107000K .......... .......... .......... .......... .......... 63% 53.8M 2s 2024-03-29T04:09:19.300 INFO:teuthology.orchestra.run.smithi073.stderr:107050K .......... .......... .......... .......... .......... 63% 24.5M 2s 2024-03-29T04:09:19.300 INFO:teuthology.orchestra.run.smithi073.stderr:107100K .......... .......... .......... .......... .......... 63% 23.8M 2s 2024-03-29T04:09:19.300 INFO:teuthology.orchestra.run.smithi073.stderr:107150K .......... .......... .......... .......... .......... 63% 34.1M 2s 2024-03-29T04:09:19.300 INFO:teuthology.orchestra.run.smithi073.stderr:107200K .......... .......... .......... .......... .......... 63% 24.4M 2s 2024-03-29T04:09:19.300 INFO:teuthology.orchestra.run.smithi073.stderr:107250K .......... .......... .......... .......... .......... 63% 23.8M 2s 2024-03-29T04:09:19.300 INFO:teuthology.orchestra.run.smithi073.stderr:107300K .......... .......... .......... .......... .......... 63% 56.3M 2s 2024-03-29T04:09:19.300 INFO:teuthology.orchestra.run.smithi073.stderr:107350K .......... .......... .......... .......... .......... 63% 30.6M 2s 2024-03-29T04:09:19.300 INFO:teuthology.orchestra.run.smithi073.stderr:107400K .......... .......... .......... .......... .......... 63% 25.0M 2s 2024-03-29T04:09:19.300 INFO:teuthology.orchestra.run.smithi073.stderr:107450K .......... .......... .......... .......... .......... 63% 24.0M 2s 2024-03-29T04:09:19.301 INFO:teuthology.orchestra.run.smithi073.stderr:107500K .......... .......... .......... .......... .......... 63% 48.9M 2s 2024-03-29T04:09:19.301 INFO:teuthology.orchestra.run.smithi073.stderr:107550K .......... .......... .......... .......... .......... 63% 28.1M 2s 2024-03-29T04:09:19.301 INFO:teuthology.orchestra.run.smithi073.stderr:107600K .......... .......... .......... .......... .......... 63% 29.0M 2s 2024-03-29T04:09:19.301 INFO:teuthology.orchestra.run.smithi073.stderr:107650K .......... .......... .......... .......... .......... 63% 24.5M 2s 2024-03-29T04:09:19.301 INFO:teuthology.orchestra.run.smithi073.stderr:107700K .......... .......... .......... .......... .......... 63% 23.1M 2s 2024-03-29T04:09:19.301 INFO:teuthology.orchestra.run.smithi073.stderr:107750K .......... .......... .......... .......... .......... 63% 48.9M 2s 2024-03-29T04:09:19.301 INFO:teuthology.orchestra.run.smithi073.stderr:107800K .......... .......... .......... .......... .......... 63% 30.4M 2s 2024-03-29T04:09:19.301 INFO:teuthology.orchestra.run.smithi073.stderr:107850K .......... .......... .......... .......... .......... 64% 26.0M 2s 2024-03-29T04:09:19.301 INFO:teuthology.orchestra.run.smithi073.stderr:107900K .......... .......... .......... .......... .......... 64% 25.4M 2s 2024-03-29T04:09:19.301 INFO:teuthology.orchestra.run.smithi073.stderr:107950K .......... .......... .......... .......... .......... 64% 23.3M 2s 2024-03-29T04:09:19.301 INFO:teuthology.orchestra.run.smithi073.stderr:108000K .......... .......... .......... .......... .......... 64% 66.8M 2s 2024-03-29T04:09:19.301 INFO:teuthology.orchestra.run.smithi073.stderr:108050K .......... .......... .......... .......... .......... 64% 26.1M 2s 2024-03-29T04:09:19.301 INFO:teuthology.orchestra.run.smithi073.stderr:108100K .......... .......... .......... .......... .......... 64% 27.9M 2s 2024-03-29T04:09:19.301 INFO:teuthology.orchestra.run.smithi073.stderr:108150K .......... .......... .......... .......... .......... 64% 24.6M 2s 2024-03-29T04:09:19.302 INFO:teuthology.orchestra.run.smithi073.stderr:108200K .......... .......... .......... .......... .......... 64% 24.6M 2s 2024-03-29T04:09:19.302 INFO:teuthology.orchestra.run.smithi073.stderr:108250K .......... .......... .......... .......... .......... 64% 59.2M 2s 2024-03-29T04:09:19.302 INFO:teuthology.orchestra.run.smithi073.stderr:108300K .......... .......... .......... .......... .......... 64% 25.4M 2s 2024-03-29T04:09:19.302 INFO:teuthology.orchestra.run.smithi073.stderr:108350K .......... .......... .......... .......... .......... 64% 28.6M 2s 2024-03-29T04:09:19.302 INFO:teuthology.orchestra.run.smithi073.stderr:108400K .......... .......... .......... .......... .......... 64% 23.6M 2s 2024-03-29T04:09:19.302 INFO:teuthology.orchestra.run.smithi073.stderr:108450K .......... .......... .......... .......... .......... 64% 26.0M 2s 2024-03-29T04:09:19.302 INFO:teuthology.orchestra.run.smithi073.stderr:108500K .......... .......... .......... .......... .......... 64% 45.7M 2s 2024-03-29T04:09:19.302 INFO:teuthology.orchestra.run.smithi073.stderr:108550K .......... .......... .......... .......... .......... 64% 30.6M 2s 2024-03-29T04:09:19.302 INFO:teuthology.orchestra.run.smithi073.stderr:108600K .......... .......... .......... .......... .......... 64% 26.4M 2s 2024-03-29T04:09:19.302 INFO:teuthology.orchestra.run.smithi073.stderr:108650K .......... .......... .......... .......... .......... 64% 24.3M 2s 2024-03-29T04:09:19.302 INFO:teuthology.orchestra.run.smithi073.stderr:108700K .......... .......... .......... .......... .......... 64% 23.2M 2s 2024-03-29T04:09:19.302 INFO:teuthology.orchestra.run.smithi073.stderr:108750K .......... .......... .......... .......... .......... 64% 46.6M 2s 2024-03-29T04:09:19.303 INFO:teuthology.orchestra.run.smithi073.stderr:108800K .......... .......... .......... .......... .......... 64% 33.0M 2s 2024-03-29T04:09:19.303 INFO:teuthology.orchestra.run.smithi073.stderr:108850K .......... .......... .......... .......... .......... 64% 23.1M 2s 2024-03-29T04:09:19.303 INFO:teuthology.orchestra.run.smithi073.stderr:108900K .......... .......... .......... .......... .......... 64% 26.2M 2s 2024-03-29T04:09:19.303 INFO:teuthology.orchestra.run.smithi073.stderr:108950K .......... .......... .......... .......... .......... 64% 24.8M 2s 2024-03-29T04:09:19.303 INFO:teuthology.orchestra.run.smithi073.stderr:109000K .......... .......... .......... .......... .......... 64% 36.3M 2s 2024-03-29T04:09:19.303 INFO:teuthology.orchestra.run.smithi073.stderr:109050K .......... .......... .......... .......... .......... 64% 43.4M 2s 2024-03-29T04:09:19.303 INFO:teuthology.orchestra.run.smithi073.stderr:109100K .......... .......... .......... .......... .......... 64% 24.8M 2s 2024-03-29T04:09:19.303 INFO:teuthology.orchestra.run.smithi073.stderr:109150K .......... .......... .......... .......... .......... 64% 25.0M 2s 2024-03-29T04:09:19.303 INFO:teuthology.orchestra.run.smithi073.stderr:109200K .......... .......... .......... .......... .......... 64% 47.9M 2s 2024-03-29T04:09:19.303 INFO:teuthology.orchestra.run.smithi073.stderr:109250K .......... .......... .......... .......... .......... 64% 21.8M 2s 2024-03-29T04:09:19.303 INFO:teuthology.orchestra.run.smithi073.stderr:109300K .......... .......... .......... .......... .......... 64% 36.5M 2s 2024-03-29T04:09:19.303 INFO:teuthology.orchestra.run.smithi073.stderr:109350K .......... .......... .......... .......... .......... 64% 32.3M 2s 2024-03-29T04:09:19.303 INFO:teuthology.orchestra.run.smithi073.stderr:109400K .......... .......... .......... .......... .......... 64% 20.5M 2s 2024-03-29T04:09:19.304 INFO:teuthology.orchestra.run.smithi073.stderr:109450K .......... .......... .......... .......... .......... 64% 49.1M 2s 2024-03-29T04:09:19.304 INFO:teuthology.orchestra.run.smithi073.stderr:109500K .......... .......... .......... .......... .......... 64% 24.7M 2s 2024-03-29T04:09:19.304 INFO:teuthology.orchestra.run.smithi073.stderr:109550K .......... .......... .......... .......... .......... 65% 34.0M 2s 2024-03-29T04:09:19.304 INFO:teuthology.orchestra.run.smithi073.stderr:109600K .......... .......... .......... .......... .......... 65% 24.1M 2s 2024-03-29T04:09:19.304 INFO:teuthology.orchestra.run.smithi073.stderr:109650K .......... .......... .......... .......... .......... 65% 24.6M 2s 2024-03-29T04:09:19.304 INFO:teuthology.orchestra.run.smithi073.stderr:109700K .......... .......... .......... .......... .......... 65% 43.7M 2s 2024-03-29T04:09:19.304 INFO:teuthology.orchestra.run.smithi073.stderr:109750K .......... .......... .......... .......... .......... 65% 22.6M 2s 2024-03-29T04:09:19.304 INFO:teuthology.orchestra.run.smithi073.stderr:109800K .......... .......... .......... .......... .......... 65% 43.9M 2s 2024-03-29T04:09:19.304 INFO:teuthology.orchestra.run.smithi073.stderr:109850K .......... .......... .......... .......... .......... 65% 24.2M 2s 2024-03-29T04:09:19.304 INFO:teuthology.orchestra.run.smithi073.stderr:109900K .......... .......... .......... .......... .......... 65% 24.6M 2s 2024-03-29T04:09:19.304 INFO:teuthology.orchestra.run.smithi073.stderr:109950K .......... .......... .......... .......... .......... 65% 40.4M 2s 2024-03-29T04:09:19.304 INFO:teuthology.orchestra.run.smithi073.stderr:110000K .......... .......... .......... .......... .......... 65% 27.6M 2s 2024-03-29T04:09:19.304 INFO:teuthology.orchestra.run.smithi073.stderr:110050K .......... .......... .......... .......... .......... 65% 36.6M 2s 2024-03-29T04:09:19.304 INFO:teuthology.orchestra.run.smithi073.stderr:110100K .......... .......... .......... .......... .......... 65% 24.3M 2s 2024-03-29T04:09:19.305 INFO:teuthology.orchestra.run.smithi073.stderr:110150K .......... .......... .......... .......... .......... 65% 24.8M 2s 2024-03-29T04:09:19.305 INFO:teuthology.orchestra.run.smithi073.stderr:110200K .......... .......... .......... .......... .......... 65% 35.6M 2s 2024-03-29T04:09:19.305 INFO:teuthology.orchestra.run.smithi073.stderr:110250K .......... .......... .......... .......... .......... 65% 25.5M 2s 2024-03-29T04:09:19.305 INFO:teuthology.orchestra.run.smithi073.stderr:110300K .......... .......... .......... .......... .......... 65% 43.4M 2s 2024-03-29T04:09:19.305 INFO:teuthology.orchestra.run.smithi073.stderr:110350K .......... .......... .......... .......... .......... 65% 24.7M 2s 2024-03-29T04:09:19.305 INFO:teuthology.orchestra.run.smithi073.stderr:110400K .......... .......... .......... .......... .......... 65% 34.6M 2s 2024-03-29T04:09:19.305 INFO:teuthology.orchestra.run.smithi073.stderr:110450K .......... .......... .......... .......... .......... 65% 24.8M 2s 2024-03-29T04:09:19.305 INFO:teuthology.orchestra.run.smithi073.stderr:110500K .......... .......... .......... .......... .......... 65% 19.1M 2s 2024-03-29T04:09:19.305 INFO:teuthology.orchestra.run.smithi073.stderr:110550K .......... .......... .......... .......... .......... 65% 44.2M 2s 2024-03-29T04:09:19.305 INFO:teuthology.orchestra.run.smithi073.stderr:110600K .......... .......... .......... .......... .......... 65% 38.5M 2s 2024-03-29T04:09:19.305 INFO:teuthology.orchestra.run.smithi073.stderr:110650K .......... .......... .......... .......... .......... 65% 34.0M 2s 2024-03-29T04:09:19.305 INFO:teuthology.orchestra.run.smithi073.stderr:110700K .......... .......... .......... .......... .......... 65% 24.4M 2s 2024-03-29T04:09:19.305 INFO:teuthology.orchestra.run.smithi073.stderr:110750K .......... .......... .......... .......... .......... 65% 23.7M 2s 2024-03-29T04:09:19.306 INFO:teuthology.orchestra.run.smithi073.stderr:110800K .......... .......... .......... .......... .......... 65% 24.8M 2s 2024-03-29T04:09:19.306 INFO:teuthology.orchestra.run.smithi073.stderr:110850K .......... .......... .......... .......... .......... 65% 76.2M 2s 2024-03-29T04:09:19.306 INFO:teuthology.orchestra.run.smithi073.stderr:110900K .......... .......... .......... .......... .......... 65% 28.1M 2s 2024-03-29T04:09:19.306 INFO:teuthology.orchestra.run.smithi073.stderr:110950K .......... .......... .......... .......... .......... 65% 24.6M 2s 2024-03-29T04:09:19.306 INFO:teuthology.orchestra.run.smithi073.stderr:111000K .......... .......... .......... .......... .......... 65% 25.1M 2s 2024-03-29T04:09:19.306 INFO:teuthology.orchestra.run.smithi073.stderr:111050K .......... .......... .......... .......... .......... 65% 24.6M 2s 2024-03-29T04:09:19.306 INFO:teuthology.orchestra.run.smithi073.stderr:111100K .......... .......... .......... .......... .......... 65% 56.7M 2s 2024-03-29T04:09:19.306 INFO:teuthology.orchestra.run.smithi073.stderr:111150K .......... .......... .......... .......... .......... 65% 28.2M 2s 2024-03-29T04:09:19.306 INFO:teuthology.orchestra.run.smithi073.stderr:111200K .......... .......... .......... .......... .......... 65% 25.0M 2s 2024-03-29T04:09:19.306 INFO:teuthology.orchestra.run.smithi073.stderr:111250K .......... .......... .......... .......... .......... 66% 25.6M 2s 2024-03-29T04:09:19.306 INFO:teuthology.orchestra.run.smithi073.stderr:111300K .......... .......... .......... .......... .......... 66% 23.6M 2s 2024-03-29T04:09:19.306 INFO:teuthology.orchestra.run.smithi073.stderr:111350K .......... .......... .......... .......... .......... 66% 56.7M 2s 2024-03-29T04:09:19.307 INFO:teuthology.orchestra.run.smithi073.stderr:111400K .......... .......... .......... .......... .......... 66% 24.7M 2s 2024-03-29T04:09:19.307 INFO:teuthology.orchestra.run.smithi073.stderr:111450K .......... .......... .......... .......... .......... 66% 29.3M 2s 2024-03-29T04:09:19.307 INFO:teuthology.orchestra.run.smithi073.stderr:111500K .......... .......... .......... .......... .......... 66% 24.1M 2s 2024-03-29T04:09:19.307 INFO:teuthology.orchestra.run.smithi073.stderr:111550K .......... .......... .......... .......... .......... 66% 25.7M 2s 2024-03-29T04:09:19.307 INFO:teuthology.orchestra.run.smithi073.stderr:111600K .......... .......... .......... .......... .......... 66% 43.8M 2s 2024-03-29T04:09:19.307 INFO:teuthology.orchestra.run.smithi073.stderr:111650K .......... .......... .......... .......... .......... 66% 26.7M 2s 2024-03-29T04:09:19.307 INFO:teuthology.orchestra.run.smithi073.stderr:111700K .......... .......... .......... .......... .......... 66% 32.4M 2s 2024-03-29T04:09:19.307 INFO:teuthology.orchestra.run.smithi073.stderr:111750K .......... .......... .......... .......... .......... 66% 24.7M 2s 2024-03-29T04:09:19.307 INFO:teuthology.orchestra.run.smithi073.stderr:111800K .......... .......... .......... .......... .......... 66% 22.8M 2s 2024-03-29T04:09:19.307 INFO:teuthology.orchestra.run.smithi073.stderr:111850K .......... .......... .......... .......... .......... 66% 49.6M 2s 2024-03-29T04:09:19.307 INFO:teuthology.orchestra.run.smithi073.stderr:111900K .......... .......... .......... .......... .......... 66% 24.4M 2s 2024-03-29T04:09:19.307 INFO:teuthology.orchestra.run.smithi073.stderr:111950K .......... .......... .......... .......... .......... 66% 35.9M 2s 2024-03-29T04:09:19.307 INFO:teuthology.orchestra.run.smithi073.stderr:112000K .......... .......... .......... .......... .......... 66% 25.3M 2s 2024-03-29T04:09:19.308 INFO:teuthology.orchestra.run.smithi073.stderr:112050K .......... .......... .......... .......... .......... 66% 24.6M 2s 2024-03-29T04:09:19.308 INFO:teuthology.orchestra.run.smithi073.stderr:112100K .......... .......... .......... .......... .......... 66% 50.5M 2s 2024-03-29T04:09:19.308 INFO:teuthology.orchestra.run.smithi073.stderr:112150K .......... .......... .......... .......... .......... 66% 25.3M 2s 2024-03-29T04:09:19.308 INFO:teuthology.orchestra.run.smithi073.stderr:112200K .......... .......... .......... .......... .......... 66% 23.0M 2s 2024-03-29T04:09:19.308 INFO:teuthology.orchestra.run.smithi073.stderr:112250K .......... .......... .......... .......... .......... 66% 38.4M 2s 2024-03-29T04:09:19.308 INFO:teuthology.orchestra.run.smithi073.stderr:112300K .......... .......... .......... .......... .......... 66% 22.9M 2s 2024-03-29T04:09:19.308 INFO:teuthology.orchestra.run.smithi073.stderr:112350K .......... .......... .......... .......... .......... 66% 48.1M 2s 2024-03-29T04:09:19.308 INFO:teuthology.orchestra.run.smithi073.stderr:112400K .......... .......... .......... .......... .......... 66% 34.4M 2s 2024-03-29T04:09:19.308 INFO:teuthology.orchestra.run.smithi073.stderr:112450K .......... .......... .......... .......... .......... 66% 24.9M 2s 2024-03-29T04:09:19.308 INFO:teuthology.orchestra.run.smithi073.stderr:112500K .......... .......... .......... .......... .......... 66% 24.4M 2s 2024-03-29T04:09:19.308 INFO:teuthology.orchestra.run.smithi073.stderr:112550K .......... .......... .......... .......... .......... 66% 25.0M 2s 2024-03-29T04:09:19.308 INFO:teuthology.orchestra.run.smithi073.stderr:112600K .......... .......... .......... .......... .......... 66% 43.2M 2s 2024-03-29T04:09:19.308 INFO:teuthology.orchestra.run.smithi073.stderr:112650K .......... .......... .......... .......... .......... 66% 33.4M 2s 2024-03-29T04:09:19.309 INFO:teuthology.orchestra.run.smithi073.stderr:112700K .......... .......... .......... .......... .......... 66% 27.5M 2s 2024-03-29T04:09:19.309 INFO:teuthology.orchestra.run.smithi073.stderr:112750K .......... .......... .......... .......... .......... 66% 24.9M 2s 2024-03-29T04:09:19.309 INFO:teuthology.orchestra.run.smithi073.stderr:112800K .......... .......... .......... .......... .......... 66% 24.2M 2s 2024-03-29T04:09:19.309 INFO:teuthology.orchestra.run.smithi073.stderr:112850K .......... .......... .......... .......... .......... 66% 45.3M 2s 2024-03-29T04:09:19.309 INFO:teuthology.orchestra.run.smithi073.stderr:112900K .......... .......... .......... .......... .......... 67% 26.2M 2s 2024-03-29T04:09:19.309 INFO:teuthology.orchestra.run.smithi073.stderr:112950K .......... .......... .......... .......... .......... 67% 32.4M 2s 2024-03-29T04:09:19.309 INFO:teuthology.orchestra.run.smithi073.stderr:113000K .......... .......... .......... .......... .......... 67% 23.6M 2s 2024-03-29T04:09:19.309 INFO:teuthology.orchestra.run.smithi073.stderr:113050K .......... .......... .......... .......... .......... 67% 24.4M 2s 2024-03-29T04:09:19.309 INFO:teuthology.orchestra.run.smithi073.stderr:113100K .......... .......... .......... .......... .......... 67% 52.0M 2s 2024-03-29T04:09:19.309 INFO:teuthology.orchestra.run.smithi073.stderr:113150K .......... .......... .......... .......... .......... 67% 33.4M 2s 2024-03-29T04:09:19.309 INFO:teuthology.orchestra.run.smithi073.stderr:113200K .......... .......... .......... .......... .......... 67% 24.2M 2s 2024-03-29T04:09:19.309 INFO:teuthology.orchestra.run.smithi073.stderr:113250K .......... .......... .......... .......... .......... 67% 25.1M 2s 2024-03-29T04:09:19.309 INFO:teuthology.orchestra.run.smithi073.stderr:113300K .......... .......... .......... .......... .......... 67% 24.6M 2s 2024-03-29T04:09:19.310 INFO:teuthology.orchestra.run.smithi073.stderr:113350K .......... .......... .......... .......... .......... 67% 50.1M 2s 2024-03-29T04:09:19.310 INFO:teuthology.orchestra.run.smithi073.stderr:113400K .......... .......... .......... .......... .......... 67% 33.7M 2s 2024-03-29T04:09:19.310 INFO:teuthology.orchestra.run.smithi073.stderr:113450K .......... .......... .......... .......... .......... 67% 24.4M 2s 2024-03-29T04:09:19.310 INFO:teuthology.orchestra.run.smithi073.stderr:113500K .......... .......... .......... .......... .......... 67% 24.9M 2s 2024-03-29T04:09:19.310 INFO:teuthology.orchestra.run.smithi073.stderr:113550K .......... .......... .......... .......... .......... 67% 29.0M 2s 2024-03-29T04:09:19.310 INFO:teuthology.orchestra.run.smithi073.stderr:113600K .......... .......... .......... .......... .......... 67% 39.5M 2s 2024-03-29T04:09:19.310 INFO:teuthology.orchestra.run.smithi073.stderr:113650K .......... .......... .......... .......... .......... 67% 30.0M 2s 2024-03-29T04:09:19.310 INFO:teuthology.orchestra.run.smithi073.stderr:113700K .......... .......... .......... .......... .......... 67% 26.6M 2s 2024-03-29T04:09:19.310 INFO:teuthology.orchestra.run.smithi073.stderr:113750K .......... .......... .......... .......... .......... 67% 24.4M 2s 2024-03-29T04:09:19.310 INFO:teuthology.orchestra.run.smithi073.stderr:113800K .......... .......... .......... .......... .......... 67% 24.8M 2s 2024-03-29T04:09:19.310 INFO:teuthology.orchestra.run.smithi073.stderr:113850K .......... .......... .......... .......... .......... 67% 52.1M 2s 2024-03-29T04:09:19.310 INFO:teuthology.orchestra.run.smithi073.stderr:113900K .......... .......... .......... .......... .......... 67% 29.4M 2s 2024-03-29T04:09:19.311 INFO:teuthology.orchestra.run.smithi073.stderr:113950K .......... .......... .......... .......... .......... 67% 27.1M 2s 2024-03-29T04:09:19.311 INFO:teuthology.orchestra.run.smithi073.stderr:114000K .......... .......... .......... .......... .......... 67% 24.4M 2s 2024-03-29T04:09:19.311 INFO:teuthology.orchestra.run.smithi073.stderr:114050K .......... .......... .......... .......... .......... 67% 25.0M 2s 2024-03-29T04:09:19.311 INFO:teuthology.orchestra.run.smithi073.stderr:114100K .......... .......... .......... .......... .......... 67% 50.5M 2s 2024-03-29T04:09:19.311 INFO:teuthology.orchestra.run.smithi073.stderr:114150K .......... .......... .......... .......... .......... 67% 29.2M 2s 2024-03-29T04:09:19.311 INFO:teuthology.orchestra.run.smithi073.stderr:114200K .......... .......... .......... .......... .......... 67% 27.2M 2s 2024-03-29T04:09:19.311 INFO:teuthology.orchestra.run.smithi073.stderr:114250K .......... .......... .......... .......... .......... 67% 24.5M 2s 2024-03-29T04:09:19.311 INFO:teuthology.orchestra.run.smithi073.stderr:114300K .......... .......... .......... .......... .......... 67% 24.6M 2s 2024-03-29T04:09:19.311 INFO:teuthology.orchestra.run.smithi073.stderr:114350K .......... .......... .......... .......... .......... 67% 51.0M 2s 2024-03-29T04:09:19.311 INFO:teuthology.orchestra.run.smithi073.stderr:114400K .......... .......... .......... .......... .......... 67% 25.9M 2s 2024-03-29T04:09:19.311 INFO:teuthology.orchestra.run.smithi073.stderr:114450K .......... .......... .......... .......... .......... 67% 25.2M 2s 2024-03-29T04:09:19.311 INFO:teuthology.orchestra.run.smithi073.stderr:114500K .......... .......... .......... .......... .......... 67% 23.9M 2s 2024-03-29T04:09:19.311 INFO:teuthology.orchestra.run.smithi073.stderr:114550K .......... .......... .......... .......... .......... 67% 39.1M 2s 2024-03-29T04:09:19.312 INFO:teuthology.orchestra.run.smithi073.stderr:114600K .......... .......... .......... .......... .......... 68% 40.5M 2s 2024-03-29T04:09:19.312 INFO:teuthology.orchestra.run.smithi073.stderr:114650K .......... .......... .......... .......... .......... 68% 26.0M 2s 2024-03-29T04:09:19.312 INFO:teuthology.orchestra.run.smithi073.stderr:114700K .......... .......... .......... .......... .......... 68% 24.3M 2s 2024-03-29T04:09:19.312 INFO:teuthology.orchestra.run.smithi073.stderr:114750K .......... .......... .......... .......... .......... 68% 30.4M 2s 2024-03-29T04:09:19.312 INFO:teuthology.orchestra.run.smithi073.stderr:114800K .......... .......... .......... .......... .......... 68% 24.7M 2s 2024-03-29T04:09:19.312 INFO:teuthology.orchestra.run.smithi073.stderr:114850K .......... .......... .......... .......... .......... 68% 56.1M 2s 2024-03-29T04:09:19.312 INFO:teuthology.orchestra.run.smithi073.stderr:114900K .......... .......... .......... .......... .......... 68% 25.4M 2s 2024-03-29T04:09:19.312 INFO:teuthology.orchestra.run.smithi073.stderr:114950K .......... .......... .......... .......... .......... 68% 23.6M 2s 2024-03-29T04:09:19.312 INFO:teuthology.orchestra.run.smithi073.stderr:115000K .......... .......... .......... .......... .......... 68% 31.2M 2s 2024-03-29T04:09:19.312 INFO:teuthology.orchestra.run.smithi073.stderr:115050K .......... .......... .......... .......... .......... 68% 24.4M 2s 2024-03-29T04:09:19.312 INFO:teuthology.orchestra.run.smithi073.stderr:115100K .......... .......... .......... .......... .......... 68% 61.7M 2s 2024-03-29T04:09:19.312 INFO:teuthology.orchestra.run.smithi073.stderr:115150K .......... .......... .......... .......... .......... 68% 24.2M 2s 2024-03-29T04:09:19.312 INFO:teuthology.orchestra.run.smithi073.stderr:115200K .......... .......... .......... .......... .......... 68% 23.1M 2s 2024-03-29T04:09:19.313 INFO:teuthology.orchestra.run.smithi073.stderr:115250K .......... .......... .......... .......... .......... 68% 35.0M 2s 2024-03-29T04:09:19.313 INFO:teuthology.orchestra.run.smithi073.stderr:115300K .......... .......... .......... .......... .......... 68% 25.2M 2s 2024-03-29T04:09:19.313 INFO:teuthology.orchestra.run.smithi073.stderr:115350K .......... .......... .......... .......... .......... 68% 48.9M 2s 2024-03-29T04:09:19.313 INFO:teuthology.orchestra.run.smithi073.stderr:115400K .......... .......... .......... .......... .......... 68% 23.6M 2s 2024-03-29T04:09:19.313 INFO:teuthology.orchestra.run.smithi073.stderr:115450K .......... .......... .......... .......... .......... 68% 26.2M 2s 2024-03-29T04:09:19.313 INFO:teuthology.orchestra.run.smithi073.stderr:115500K .......... .......... .......... .......... .......... 68% 33.4M 2s 2024-03-29T04:09:19.313 INFO:teuthology.orchestra.run.smithi073.stderr:115550K .......... .......... .......... .......... .......... 68% 24.3M 2s 2024-03-29T04:09:19.313 INFO:teuthology.orchestra.run.smithi073.stderr:115600K .......... .......... .......... .......... .......... 68% 50.4M 2s 2024-03-29T04:09:19.313 INFO:teuthology.orchestra.run.smithi073.stderr:115650K .......... .......... .......... .......... .......... 68% 24.6M 2s 2024-03-29T04:09:19.313 INFO:teuthology.orchestra.run.smithi073.stderr:115700K .......... .......... .......... .......... .......... 68% 24.7M 2s 2024-03-29T04:09:19.313 INFO:teuthology.orchestra.run.smithi073.stderr:115750K .......... .......... .......... .......... .......... 68% 34.9M 2s 2024-03-29T04:09:19.313 INFO:teuthology.orchestra.run.smithi073.stderr:115800K .......... .......... .......... .......... .......... 68% 24.4M 2s 2024-03-29T04:09:19.313 INFO:teuthology.orchestra.run.smithi073.stderr:115850K .......... .......... .......... .......... .......... 68% 46.5M 2s 2024-03-29T04:09:19.314 INFO:teuthology.orchestra.run.smithi073.stderr:115900K .......... .......... .......... .......... .......... 68% 24.7M 2s 2024-03-29T04:09:19.314 INFO:teuthology.orchestra.run.smithi073.stderr:115950K .......... .......... .......... .......... .......... 68% 24.5M 2s 2024-03-29T04:09:19.314 INFO:teuthology.orchestra.run.smithi073.stderr:116000K .......... .......... .......... .......... .......... 68% 35.8M 2s 2024-03-29T04:09:19.314 INFO:teuthology.orchestra.run.smithi073.stderr:116050K .......... .......... .......... .......... .......... 68% 24.4M 2s 2024-03-29T04:09:19.314 INFO:teuthology.orchestra.run.smithi073.stderr:116100K .......... .......... .......... .......... .......... 68% 24.0M 2s 2024-03-29T04:09:19.314 INFO:teuthology.orchestra.run.smithi073.stderr:116150K .......... .......... .......... .......... .......... 68% 45.8M 2s 2024-03-29T04:09:19.314 INFO:teuthology.orchestra.run.smithi073.stderr:116200K .......... .......... .......... .......... .......... 68% 23.8M 2s 2024-03-29T04:09:19.314 INFO:teuthology.orchestra.run.smithi073.stderr:116250K .......... .......... .......... .......... .......... 68% 36.1M 2s 2024-03-29T04:09:19.314 INFO:teuthology.orchestra.run.smithi073.stderr:116300K .......... .......... .......... .......... .......... 69% 24.7M 2s 2024-03-29T04:09:19.314 INFO:teuthology.orchestra.run.smithi073.stderr:116350K .......... .......... .......... .......... .......... 69% 24.5M 2s 2024-03-29T04:09:19.314 INFO:teuthology.orchestra.run.smithi073.stderr:116400K .......... .......... .......... .......... .......... 69% 44.8M 2s 2024-03-29T04:09:19.314 INFO:teuthology.orchestra.run.smithi073.stderr:116450K .......... .......... .......... .......... .......... 69% 24.5M 2s 2024-03-29T04:09:19.314 INFO:teuthology.orchestra.run.smithi073.stderr:116500K .......... .......... .......... .......... .......... 69% 33.7M 2s 2024-03-29T04:09:19.315 INFO:teuthology.orchestra.run.smithi073.stderr:116550K .......... .......... .......... .......... .......... 69% 24.8M 2s 2024-03-29T04:09:19.315 INFO:teuthology.orchestra.run.smithi073.stderr:116600K .......... .......... .......... .......... .......... 69% 51.6M 2s 2024-03-29T04:09:19.315 INFO:teuthology.orchestra.run.smithi073.stderr:116650K .......... .......... .......... .......... .......... 69% 24.7M 2s 2024-03-29T04:09:19.315 INFO:teuthology.orchestra.run.smithi073.stderr:116700K .......... .......... .......... .......... .......... 69% 24.5M 2s 2024-03-29T04:09:19.315 INFO:teuthology.orchestra.run.smithi073.stderr:116750K .......... .......... .......... .......... .......... 69% 25.7M 2s 2024-03-29T04:09:19.315 INFO:teuthology.orchestra.run.smithi073.stderr:116800K .......... .......... .......... .......... .......... 69% 41.7M 2s 2024-03-29T04:09:19.315 INFO:teuthology.orchestra.run.smithi073.stderr:116850K .......... .......... .......... .......... .......... 69% 22.0M 2s 2024-03-29T04:09:19.315 INFO:teuthology.orchestra.run.smithi073.stderr:116900K .......... .......... .......... .......... .......... 69% 40.9M 2s 2024-03-29T04:09:19.315 INFO:teuthology.orchestra.run.smithi073.stderr:116950K .......... .......... .......... .......... .......... 69% 32.8M 2s 2024-03-29T04:09:19.315 INFO:teuthology.orchestra.run.smithi073.stderr:117000K .......... .......... .......... .......... .......... 69% 24.7M 2s 2024-03-29T04:09:19.315 INFO:teuthology.orchestra.run.smithi073.stderr:117050K .......... .......... .......... .......... .......... 69% 24.2M 2s 2024-03-29T04:09:19.315 INFO:teuthology.orchestra.run.smithi073.stderr:117100K .......... .......... .......... .......... .......... 69% 53.1M 2s 2024-03-29T04:09:19.315 INFO:teuthology.orchestra.run.smithi073.stderr:117150K .......... .......... .......... .......... .......... 69% 26.5M 2s 2024-03-29T04:09:19.316 INFO:teuthology.orchestra.run.smithi073.stderr:117200K .......... .......... .......... .......... .......... 69% 29.6M 2s 2024-03-29T04:09:19.316 INFO:teuthology.orchestra.run.smithi073.stderr:117250K .......... .......... .......... .......... .......... 69% 24.1M 2s 2024-03-29T04:09:19.316 INFO:teuthology.orchestra.run.smithi073.stderr:117300K .......... .......... .......... .......... .......... 69% 24.9M 2s 2024-03-29T04:09:19.316 INFO:teuthology.orchestra.run.smithi073.stderr:117350K .......... .......... .......... .......... .......... 69% 54.2M 2s 2024-03-29T04:09:19.316 INFO:teuthology.orchestra.run.smithi073.stderr:117400K .......... .......... .......... .......... .......... 69% 24.7M 2s 2024-03-29T04:09:19.316 INFO:teuthology.orchestra.run.smithi073.stderr:117450K .......... .......... .......... .......... .......... 69% 28.4M 2s 2024-03-29T04:09:19.316 INFO:teuthology.orchestra.run.smithi073.stderr:117500K .......... .......... .......... .......... .......... 69% 24.9M 2s 2024-03-29T04:09:19.316 INFO:teuthology.orchestra.run.smithi073.stderr:117550K .......... .......... .......... .......... .......... 69% 23.9M 2s 2024-03-29T04:09:19.316 INFO:teuthology.orchestra.run.smithi073.stderr:117600K .......... .......... .......... .......... .......... 69% 52.2M 2s 2024-03-29T04:09:19.316 INFO:teuthology.orchestra.run.smithi073.stderr:117650K .......... .......... .......... .......... .......... 69% 28.0M 2s 2024-03-29T04:09:19.316 INFO:teuthology.orchestra.run.smithi073.stderr:117700K .......... .......... .......... .......... .......... 69% 28.9M 2s 2024-03-29T04:09:19.316 INFO:teuthology.orchestra.run.smithi073.stderr:117750K .......... .......... .......... .......... .......... 69% 22.3M 2s 2024-03-29T04:09:19.316 INFO:teuthology.orchestra.run.smithi073.stderr:117800K .......... .......... .......... .......... .......... 69% 27.0M 2s 2024-03-29T04:09:19.317 INFO:teuthology.orchestra.run.smithi073.stderr:117850K .......... .......... .......... .......... .......... 69% 48.6M 2s 2024-03-29T04:09:19.317 INFO:teuthology.orchestra.run.smithi073.stderr:117900K .......... .......... .......... .......... .......... 69% 29.2M 2s 2024-03-29T04:09:19.317 INFO:teuthology.orchestra.run.smithi073.stderr:117950K .......... .......... .......... .......... .......... 70% 26.7M 2s 2024-03-29T04:09:19.317 INFO:teuthology.orchestra.run.smithi073.stderr:118000K .......... .......... .......... .......... .......... 70% 24.1M 2s 2024-03-29T04:09:19.317 INFO:teuthology.orchestra.run.smithi073.stderr:118050K .......... .......... .......... .......... .......... 70% 25.2M 2s 2024-03-29T04:09:19.317 INFO:teuthology.orchestra.run.smithi073.stderr:118100K .......... .......... .......... .......... .......... 70% 48.8M 2s 2024-03-29T04:09:19.317 INFO:teuthology.orchestra.run.smithi073.stderr:118150K .......... .......... .......... .......... .......... 70% 31.2M 2s 2024-03-29T04:09:19.317 INFO:teuthology.orchestra.run.smithi073.stderr:118200K .......... .......... .......... .......... .......... 70% 26.1M 2s 2024-03-29T04:09:19.317 INFO:teuthology.orchestra.run.smithi073.stderr:118250K .......... .......... .......... .......... .......... 70% 23.6M 2s 2024-03-29T04:09:19.317 INFO:teuthology.orchestra.run.smithi073.stderr:118300K .......... .......... .......... .......... .......... 70% 26.2M 2s 2024-03-29T04:09:19.317 INFO:teuthology.orchestra.run.smithi073.stderr:118350K .......... .......... .......... .......... .......... 70% 51.2M 2s 2024-03-29T04:09:19.317 INFO:teuthology.orchestra.run.smithi073.stderr:118400K .......... .......... .......... .......... .......... 70% 30.3M 2s 2024-03-29T04:09:19.317 INFO:teuthology.orchestra.run.smithi073.stderr:118450K .......... .......... .......... .......... .......... 70% 23.3M 2s 2024-03-29T04:09:19.318 INFO:teuthology.orchestra.run.smithi073.stderr:118500K .......... .......... .......... .......... .......... 70% 23.9M 2s 2024-03-29T04:09:19.318 INFO:teuthology.orchestra.run.smithi073.stderr:118550K .......... .......... .......... .......... .......... 70% 46.8M 2s 2024-03-29T04:09:19.318 INFO:teuthology.orchestra.run.smithi073.stderr:118600K .......... .......... .......... .......... .......... 70% 24.3M 2s 2024-03-29T04:09:19.318 INFO:teuthology.orchestra.run.smithi073.stderr:118650K .......... .......... .......... .......... .......... 70% 33.5M 2s 2024-03-29T04:09:19.318 INFO:teuthology.orchestra.run.smithi073.stderr:118700K .......... .......... .......... .......... .......... 70% 23.2M 2s 2024-03-29T04:09:19.318 INFO:teuthology.orchestra.run.smithi073.stderr:118750K .......... .......... .......... .......... .......... 70% 28.5M 2s 2024-03-29T04:09:19.318 INFO:teuthology.orchestra.run.smithi073.stderr:118800K .......... .......... .......... .......... .......... 70% 24.0M 2s 2024-03-29T04:09:19.318 INFO:teuthology.orchestra.run.smithi073.stderr:118850K .......... .......... .......... .......... .......... 70% 45.6M 2s 2024-03-29T04:09:19.318 INFO:teuthology.orchestra.run.smithi073.stderr:118900K .......... .......... .......... .......... .......... 70% 34.9M 2s 2024-03-29T04:09:19.318 INFO:teuthology.orchestra.run.smithi073.stderr:118950K .......... .......... .......... .......... .......... 70% 24.3M 2s 2024-03-29T04:09:19.318 INFO:teuthology.orchestra.run.smithi073.stderr:119000K .......... .......... .......... .......... .......... 70% 24.1M 2s 2024-03-29T04:09:19.318 INFO:teuthology.orchestra.run.smithi073.stderr:119050K .......... .......... .......... .......... .......... 70% 33.5M 2s 2024-03-29T04:09:19.318 INFO:teuthology.orchestra.run.smithi073.stderr:119100K .......... .......... .......... .......... .......... 70% 24.3M 2s 2024-03-29T04:09:19.319 INFO:teuthology.orchestra.run.smithi073.stderr:119150K .......... .......... .......... .......... .......... 70% 52.2M 2s 2024-03-29T04:09:19.319 INFO:teuthology.orchestra.run.smithi073.stderr:119200K .......... .......... .......... .......... .......... 70% 26.0M 2s 2024-03-29T04:09:19.319 INFO:teuthology.orchestra.run.smithi073.stderr:119250K .......... .......... .......... .......... .......... 70% 22.7M 2s 2024-03-29T04:09:19.319 INFO:teuthology.orchestra.run.smithi073.stderr:119300K .......... .......... .......... .......... .......... 70% 42.2M 2s 2024-03-29T04:09:19.319 INFO:teuthology.orchestra.run.smithi073.stderr:119350K .......... .......... .......... .......... .......... 70% 24.2M 2s 2024-03-29T04:09:19.319 INFO:teuthology.orchestra.run.smithi073.stderr:119400K .......... .......... .......... .......... .......... 70% 35.9M 2s 2024-03-29T04:09:19.319 INFO:teuthology.orchestra.run.smithi073.stderr:119450K .......... .......... .......... .......... .......... 70% 25.3M 2s 2024-03-29T04:09:19.319 INFO:teuthology.orchestra.run.smithi073.stderr:119500K .......... .......... .......... .......... .......... 70% 23.9M 2s 2024-03-29T04:09:19.319 INFO:teuthology.orchestra.run.smithi073.stderr:119550K .......... .......... .......... .......... .......... 70% 39.0M 2s 2024-03-29T04:09:19.319 INFO:teuthology.orchestra.run.smithi073.stderr:119600K .......... .......... .......... .......... .......... 70% 24.5M 2s 2024-03-29T04:09:19.319 INFO:teuthology.orchestra.run.smithi073.stderr:119650K .......... .......... .......... .......... .......... 71% 43.7M 2s 2024-03-29T04:09:19.319 INFO:teuthology.orchestra.run.smithi073.stderr:119700K .......... .......... .......... .......... .......... 71% 23.6M 2s 2024-03-29T04:09:19.319 INFO:teuthology.orchestra.run.smithi073.stderr:119750K .......... .......... .......... .......... .......... 71% 24.8M 2s 2024-03-29T04:09:19.320 INFO:teuthology.orchestra.run.smithi073.stderr:119800K .......... .......... .......... .......... .......... 71% 39.2M 2s 2024-03-29T04:09:19.320 INFO:teuthology.orchestra.run.smithi073.stderr:119850K .......... .......... .......... .......... .......... 71% 24.1M 2s 2024-03-29T04:09:19.320 INFO:teuthology.orchestra.run.smithi073.stderr:119900K .......... .......... .......... .......... .......... 71% 43.0M 2s 2024-03-29T04:09:19.320 INFO:teuthology.orchestra.run.smithi073.stderr:119950K .......... .......... .......... .......... .......... 71% 24.4M 2s 2024-03-29T04:09:19.320 INFO:teuthology.orchestra.run.smithi073.stderr:120000K .......... .......... .......... .......... .......... 71% 35.9M 2s 2024-03-29T04:09:19.320 INFO:teuthology.orchestra.run.smithi073.stderr:120050K .......... .......... .......... .......... .......... 71% 30.1M 2s 2024-03-29T04:09:19.320 INFO:teuthology.orchestra.run.smithi073.stderr:120100K .......... .......... .......... .......... .......... 71% 21.2M 2s 2024-03-29T04:09:19.320 INFO:teuthology.orchestra.run.smithi073.stderr:120150K .......... .......... .......... .......... .......... 71% 46.1M 2s 2024-03-29T04:09:19.320 INFO:teuthology.orchestra.run.smithi073.stderr:120200K .......... .......... .......... .......... .......... 71% 25.4M 2s 2024-03-29T04:09:19.320 INFO:teuthology.orchestra.run.smithi073.stderr:120250K .......... .......... .......... .......... .......... 71% 33.6M 2s 2024-03-29T04:09:19.320 INFO:teuthology.orchestra.run.smithi073.stderr:120300K .......... .......... .......... .......... .......... 71% 25.1M 2s 2024-03-29T04:09:19.320 INFO:teuthology.orchestra.run.smithi073.stderr:120350K .......... .......... .......... .......... .......... 71% 24.9M 2s 2024-03-29T04:09:19.320 INFO:teuthology.orchestra.run.smithi073.stderr:120400K .......... .......... .......... .......... .......... 71% 44.4M 2s 2024-03-29T04:09:19.321 INFO:teuthology.orchestra.run.smithi073.stderr:120450K .......... .......... .......... .......... .......... 71% 25.0M 2s 2024-03-29T04:09:19.321 INFO:teuthology.orchestra.run.smithi073.stderr:120500K .......... .......... .......... .......... .......... 71% 34.0M 2s 2024-03-29T04:09:19.321 INFO:teuthology.orchestra.run.smithi073.stderr:120550K .......... .......... .......... .......... .......... 71% 24.6M 2s 2024-03-29T04:09:19.321 INFO:teuthology.orchestra.run.smithi073.stderr:120600K .......... .......... .......... .......... .......... 71% 24.9M 2s 2024-03-29T04:09:19.321 INFO:teuthology.orchestra.run.smithi073.stderr:120650K .......... .......... .......... .......... .......... 71% 48.7M 2s 2024-03-29T04:09:19.321 INFO:teuthology.orchestra.run.smithi073.stderr:120700K .......... .......... .......... .......... .......... 71% 24.6M 2s 2024-03-29T04:09:19.321 INFO:teuthology.orchestra.run.smithi073.stderr:120750K .......... .......... .......... .......... .......... 71% 34.6M 2s 2024-03-29T04:09:19.321 INFO:teuthology.orchestra.run.smithi073.stderr:120800K .......... .......... .......... .......... .......... 71% 24.6M 2s 2024-03-29T04:09:19.321 INFO:teuthology.orchestra.run.smithi073.stderr:120850K .......... .......... .......... .......... .......... 71% 24.2M 2s 2024-03-29T04:09:19.321 INFO:teuthology.orchestra.run.smithi073.stderr:120900K .......... .......... .......... .......... .......... 71% 55.9M 2s 2024-03-29T04:09:19.321 INFO:teuthology.orchestra.run.smithi073.stderr:120950K .......... .......... .......... .......... .......... 71% 26.3M 2s 2024-03-29T04:09:19.321 INFO:teuthology.orchestra.run.smithi073.stderr:121000K .......... .......... .......... .......... .......... 71% 21.1M 2s 2024-03-29T04:09:19.321 INFO:teuthology.orchestra.run.smithi073.stderr:121050K .......... .......... .......... .......... .......... 71% 43.2M 2s 2024-03-29T04:09:19.322 INFO:teuthology.orchestra.run.smithi073.stderr:121100K .......... .......... .......... .......... .......... 71% 22.4M 2s 2024-03-29T04:09:19.322 INFO:teuthology.orchestra.run.smithi073.stderr:121150K .......... .......... .......... .......... .......... 71% 54.1M 2s 2024-03-29T04:09:19.322 INFO:teuthology.orchestra.run.smithi073.stderr:121200K .......... .......... .......... .......... .......... 71% 28.0M 2s 2024-03-29T04:09:19.322 INFO:teuthology.orchestra.run.smithi073.stderr:121250K .......... .......... .......... .......... .......... 71% 23.3M 2s 2024-03-29T04:09:19.322 INFO:teuthology.orchestra.run.smithi073.stderr:121300K .......... .......... .......... .......... .......... 71% 29.9M 2s 2024-03-29T04:09:19.322 INFO:teuthology.orchestra.run.smithi073.stderr:121350K .......... .......... .......... .......... .......... 72% 24.5M 2s 2024-03-29T04:09:19.322 INFO:teuthology.orchestra.run.smithi073.stderr:121400K .......... .......... .......... .......... .......... 72% 25.1M 2s 2024-03-29T04:09:19.322 INFO:teuthology.orchestra.run.smithi073.stderr:121450K .......... .......... .......... .......... .......... 72% 44.7M 2s 2024-03-29T04:09:19.322 INFO:teuthology.orchestra.run.smithi073.stderr:121500K .......... .......... .......... .......... .......... 72% 27.4M 2s 2024-03-29T04:09:19.322 INFO:teuthology.orchestra.run.smithi073.stderr:121550K .......... .......... .......... .......... .......... 72% 31.5M 2s 2024-03-29T04:09:19.322 INFO:teuthology.orchestra.run.smithi073.stderr:121600K .......... .......... .......... .......... .......... 72% 25.2M 2s 2024-03-29T04:09:19.322 INFO:teuthology.orchestra.run.smithi073.stderr:121650K .......... .......... .......... .......... .......... 72% 23.8M 2s 2024-03-29T04:09:19.322 INFO:teuthology.orchestra.run.smithi073.stderr:121700K .......... .......... .......... .......... .......... 72% 42.2M 2s 2024-03-29T04:09:19.323 INFO:teuthology.orchestra.run.smithi073.stderr:121750K .......... .......... .......... .......... .......... 72% 26.5M 2s 2024-03-29T04:09:19.323 INFO:teuthology.orchestra.run.smithi073.stderr:121800K .......... .......... .......... .......... .......... 72% 26.8M 2s 2024-03-29T04:09:19.323 INFO:teuthology.orchestra.run.smithi073.stderr:121850K .......... .......... .......... .......... .......... 72% 32.2M 2s 2024-03-29T04:09:19.323 INFO:teuthology.orchestra.run.smithi073.stderr:121900K .......... .......... .......... .......... .......... 72% 24.7M 2s 2024-03-29T04:09:19.323 INFO:teuthology.orchestra.run.smithi073.stderr:121950K .......... .......... .......... .......... .......... 72% 50.5M 2s 2024-03-29T04:09:19.323 INFO:teuthology.orchestra.run.smithi073.stderr:122000K .......... .......... .......... .......... .......... 72% 30.9M 2s 2024-03-29T04:09:19.323 INFO:teuthology.orchestra.run.smithi073.stderr:122050K .......... .......... .......... .......... .......... 72% 21.9M 2s 2024-03-29T04:09:19.323 INFO:teuthology.orchestra.run.smithi073.stderr:122100K .......... .......... .......... .......... .......... 72% 30.4M 2s 2024-03-29T04:09:19.323 INFO:teuthology.orchestra.run.smithi073.stderr:122150K .......... .......... .......... .......... .......... 72% 24.2M 2s 2024-03-29T04:09:19.323 INFO:teuthology.orchestra.run.smithi073.stderr:122200K .......... .......... .......... .......... .......... 72% 49.0M 2s 2024-03-29T04:09:19.323 INFO:teuthology.orchestra.run.smithi073.stderr:122250K .......... .......... .......... .......... .......... 72% 21.4M 2s 2024-03-29T04:09:19.323 INFO:teuthology.orchestra.run.smithi073.stderr:122300K .......... .......... .......... .......... .......... 72% 44.4M 2s 2024-03-29T04:09:19.323 INFO:teuthology.orchestra.run.smithi073.stderr:122350K .......... .......... .......... .......... .......... 72% 24.9M 2s 2024-03-29T04:09:19.324 INFO:teuthology.orchestra.run.smithi073.stderr:122400K .......... .......... .......... .......... .......... 72% 34.4M 2s 2024-03-29T04:09:19.324 INFO:teuthology.orchestra.run.smithi073.stderr:122450K .......... .......... .......... .......... .......... 72% 29.6M 2s 2024-03-29T04:09:19.324 INFO:teuthology.orchestra.run.smithi073.stderr:122500K .......... .......... .......... .......... .......... 72% 33.0M 2s 2024-03-29T04:09:19.324 INFO:teuthology.orchestra.run.smithi073.stderr:122550K .......... .......... .......... .......... .......... 72% 26.5M 2s 2024-03-29T04:09:19.324 INFO:teuthology.orchestra.run.smithi073.stderr:122600K .......... .......... .......... .......... .......... 72% 24.5M 2s 2024-03-29T04:09:19.324 INFO:teuthology.orchestra.run.smithi073.stderr:122650K .......... .......... .......... .......... .......... 72% 24.4M 2s 2024-03-29T04:09:19.324 INFO:teuthology.orchestra.run.smithi073.stderr:122700K .......... .......... .......... .......... .......... 72% 54.2M 2s 2024-03-29T04:09:19.324 INFO:teuthology.orchestra.run.smithi073.stderr:122750K .......... .......... .......... .......... .......... 72% 23.2M 2s 2024-03-29T04:09:19.324 INFO:teuthology.orchestra.run.smithi073.stderr:122800K .......... .......... .......... .......... .......... 72% 35.0M 2s 2024-03-29T04:09:19.324 INFO:teuthology.orchestra.run.smithi073.stderr:122850K .......... .......... .......... .......... .......... 72% 25.3M 2s 2024-03-29T04:09:19.324 INFO:teuthology.orchestra.run.smithi073.stderr:122900K .......... .......... .......... .......... .......... 72% 24.4M 2s 2024-03-29T04:09:19.324 INFO:teuthology.orchestra.run.smithi073.stderr:122950K .......... .......... .......... .......... .......... 72% 48.5M 2s 2024-03-29T04:09:19.324 INFO:teuthology.orchestra.run.smithi073.stderr:123000K .......... .......... .......... .......... .......... 72% 33.8M 2s 2024-03-29T04:09:19.324 INFO:teuthology.orchestra.run.smithi073.stderr:123050K .......... .......... .......... .......... .......... 73% 24.8M 2s 2024-03-29T04:09:19.325 INFO:teuthology.orchestra.run.smithi073.stderr:123100K .......... .......... .......... .......... .......... 73% 24.6M 2s 2024-03-29T04:09:19.325 INFO:teuthology.orchestra.run.smithi073.stderr:123150K .......... .......... .......... .......... .......... 73% 24.4M 2s 2024-03-29T04:09:19.325 INFO:teuthology.orchestra.run.smithi073.stderr:123200K .......... .......... .......... .......... .......... 73% 48.4M 2s 2024-03-29T04:09:19.325 INFO:teuthology.orchestra.run.smithi073.stderr:123250K .......... .......... .......... .......... .......... 73% 32.2M 2s 2024-03-29T04:09:19.325 INFO:teuthology.orchestra.run.smithi073.stderr:123300K .......... .......... .......... .......... .......... 73% 25.8M 2s 2024-03-29T04:09:19.325 INFO:teuthology.orchestra.run.smithi073.stderr:123350K .......... .......... .......... .......... .......... 73% 26.1M 2s 2024-03-29T04:09:19.325 INFO:teuthology.orchestra.run.smithi073.stderr:123400K .......... .......... .......... .......... .......... 73% 23.5M 2s 2024-03-29T04:09:19.325 INFO:teuthology.orchestra.run.smithi073.stderr:123450K .......... .......... .......... .......... .......... 73% 45.4M 2s 2024-03-29T04:09:19.325 INFO:teuthology.orchestra.run.smithi073.stderr:123500K .......... .......... .......... .......... .......... 73% 31.8M 2s 2024-03-29T04:09:19.325 INFO:teuthology.orchestra.run.smithi073.stderr:123550K .......... .......... .......... .......... .......... 73% 24.5M 2s 2024-03-29T04:09:19.325 INFO:teuthology.orchestra.run.smithi073.stderr:123600K .......... .......... .......... .......... .......... 73% 25.7M 2s 2024-03-29T04:09:19.325 INFO:teuthology.orchestra.run.smithi073.stderr:123650K .......... .......... .......... .......... .......... 73% 24.4M 2s 2024-03-29T04:09:19.325 INFO:teuthology.orchestra.run.smithi073.stderr:123700K .......... .......... .......... .......... .......... 73% 53.7M 2s 2024-03-29T04:09:19.326 INFO:teuthology.orchestra.run.smithi073.stderr:123750K .......... .......... .......... .......... .......... 73% 27.8M 2s 2024-03-29T04:09:19.326 INFO:teuthology.orchestra.run.smithi073.stderr:123800K .......... .......... .......... .......... .......... 73% 28.5M 2s 2024-03-29T04:09:19.326 INFO:teuthology.orchestra.run.smithi073.stderr:123850K .......... .......... .......... .......... .......... 73% 24.7M 2s 2024-03-29T04:09:19.326 INFO:teuthology.orchestra.run.smithi073.stderr:123900K .......... .......... .......... .......... .......... 73% 24.6M 2s 2024-03-29T04:09:19.326 INFO:teuthology.orchestra.run.smithi073.stderr:123950K .......... .......... .......... .......... .......... 73% 54.2M 2s 2024-03-29T04:09:19.326 INFO:teuthology.orchestra.run.smithi073.stderr:124000K .......... .......... .......... .......... .......... 73% 29.2M 2s 2024-03-29T04:09:19.326 INFO:teuthology.orchestra.run.smithi073.stderr:124050K .......... .......... .......... .......... .......... 73% 27.5M 2s 2024-03-29T04:09:19.326 INFO:teuthology.orchestra.run.smithi073.stderr:124100K .......... .......... .......... .......... .......... 73% 23.8M 2s 2024-03-29T04:09:19.326 INFO:teuthology.orchestra.run.smithi073.stderr:124150K .......... .......... .......... .......... .......... 73% 25.3M 2s 2024-03-29T04:09:19.326 INFO:teuthology.orchestra.run.smithi073.stderr:124200K .......... .......... .......... .......... .......... 73% 52.0M 2s 2024-03-29T04:09:19.326 INFO:teuthology.orchestra.run.smithi073.stderr:124250K .......... .......... .......... .......... .......... 73% 28.3M 2s 2024-03-29T04:09:19.326 INFO:teuthology.orchestra.run.smithi073.stderr:124300K .......... .......... .......... .......... .......... 73% 27.6M 2s 2024-03-29T04:09:19.326 INFO:teuthology.orchestra.run.smithi073.stderr:124350K .......... .......... .......... .......... .......... 73% 24.0M 2s 2024-03-29T04:09:19.327 INFO:teuthology.orchestra.run.smithi073.stderr:124400K .......... .......... .......... .......... .......... 73% 27.9M 2s 2024-03-29T04:09:19.327 INFO:teuthology.orchestra.run.smithi073.stderr:124450K .......... .......... .......... .......... .......... 73% 45.3M 2s 2024-03-29T04:09:19.327 INFO:teuthology.orchestra.run.smithi073.stderr:124500K .......... .......... .......... .......... .......... 73% 24.4M 2s 2024-03-29T04:09:19.327 INFO:teuthology.orchestra.run.smithi073.stderr:124550K .......... .......... .......... .......... .......... 73% 32.1M 2s 2024-03-29T04:09:19.327 INFO:teuthology.orchestra.run.smithi073.stderr:124600K .......... .......... .......... .......... .......... 73% 27.0M 2s 2024-03-29T04:09:19.327 INFO:teuthology.orchestra.run.smithi073.stderr:124650K .......... .......... .......... .......... .......... 73% 22.4M 2s 2024-03-29T04:09:19.327 INFO:teuthology.orchestra.run.smithi073.stderr:124700K .......... .......... .......... .......... .......... 74% 55.3M 2s 2024-03-29T04:09:19.327 INFO:teuthology.orchestra.run.smithi073.stderr:124750K .......... .......... .......... .......... .......... 74% 22.5M 2s 2024-03-29T04:09:19.327 INFO:teuthology.orchestra.run.smithi073.stderr:124800K .......... .......... .......... .......... .......... 74% 28.4M 2s 2024-03-29T04:09:19.327 INFO:teuthology.orchestra.run.smithi073.stderr:124850K .......... .......... .......... .......... .......... 74% 30.4M 2s 2024-03-29T04:09:19.327 INFO:teuthology.orchestra.run.smithi073.stderr:124900K .......... .......... .......... .......... .......... 74% 24.8M 2s 2024-03-29T04:09:19.327 INFO:teuthology.orchestra.run.smithi073.stderr:124950K .......... .......... .......... .......... .......... 74% 44.9M 2s 2024-03-29T04:09:19.327 INFO:teuthology.orchestra.run.smithi073.stderr:125000K .......... .......... .......... .......... .......... 74% 28.4M 2s 2024-03-29T04:09:19.328 INFO:teuthology.orchestra.run.smithi073.stderr:125050K .......... .......... .......... .......... .......... 74% 30.8M 2s 2024-03-29T04:09:19.328 INFO:teuthology.orchestra.run.smithi073.stderr:125100K .......... .......... .......... .......... .......... 74% 24.3M 2s 2024-03-29T04:09:19.328 INFO:teuthology.orchestra.run.smithi073.stderr:125150K .......... .......... .......... .......... .......... 74% 25.1M 2s 2024-03-29T04:09:19.328 INFO:teuthology.orchestra.run.smithi073.stderr:125200K .......... .......... .......... .......... .......... 74% 55.6M 2s 2024-03-29T04:09:19.328 INFO:teuthology.orchestra.run.smithi073.stderr:125250K .......... .......... .......... .......... .......... 74% 24.8M 2s 2024-03-29T04:09:19.328 INFO:teuthology.orchestra.run.smithi073.stderr:125300K .......... .......... .......... .......... .......... 74% 30.4M 2s 2024-03-29T04:09:19.328 INFO:teuthology.orchestra.run.smithi073.stderr:125350K .......... .......... .......... .......... .......... 74% 25.2M 2s 2024-03-29T04:09:19.328 INFO:teuthology.orchestra.run.smithi073.stderr:125400K .......... .......... .......... .......... .......... 74% 8.56M 2s 2024-03-29T04:09:19.328 INFO:teuthology.orchestra.run.smithi073.stderr:125450K .......... .......... .......... .......... .......... 74% 247M 2s 2024-03-29T04:09:19.328 INFO:teuthology.orchestra.run.smithi073.stderr:125500K .......... .......... .......... .......... .......... 74% 244M 2s 2024-03-29T04:09:19.328 INFO:teuthology.orchestra.run.smithi073.stderr:125550K .......... .......... .......... .......... .......... 74% 74.6M 2s 2024-03-29T04:09:19.328 INFO:teuthology.orchestra.run.smithi073.stderr:125600K .......... .......... .......... .......... .......... 74% 29.9M 2s 2024-03-29T04:09:19.328 INFO:teuthology.orchestra.run.smithi073.stderr:125650K .......... .......... .......... .......... .......... 74% 24.6M 2s 2024-03-29T04:09:19.329 INFO:teuthology.orchestra.run.smithi073.stderr:125700K .......... .......... .......... .......... .......... 74% 52.7M 2s 2024-03-29T04:09:19.329 INFO:teuthology.orchestra.run.smithi073.stderr:125750K .......... .......... .......... .......... .......... 74% 23.8M 2s 2024-03-29T04:09:19.329 INFO:teuthology.orchestra.run.smithi073.stderr:125800K .......... .......... .......... .......... .......... 74% 24.8M 2s 2024-03-29T04:09:19.329 INFO:teuthology.orchestra.run.smithi073.stderr:125850K .......... .......... .......... .......... .......... 74% 34.1M 2s 2024-03-29T04:09:19.329 INFO:teuthology.orchestra.run.smithi073.stderr:125900K .......... .......... .......... .......... .......... 74% 24.9M 1s 2024-03-29T04:09:19.329 INFO:teuthology.orchestra.run.smithi073.stderr:125950K .......... .......... .......... .......... .......... 74% 49.7M 1s 2024-03-29T04:09:19.329 INFO:teuthology.orchestra.run.smithi073.stderr:126000K .......... .......... .......... .......... .......... 74% 23.7M 1s 2024-03-29T04:09:19.329 INFO:teuthology.orchestra.run.smithi073.stderr:126050K .......... .......... .......... .......... .......... 74% 24.7M 1s 2024-03-29T04:09:19.329 INFO:teuthology.orchestra.run.smithi073.stderr:126100K .......... .......... .......... .......... .......... 74% 34.5M 1s 2024-03-29T04:09:19.329 INFO:teuthology.orchestra.run.smithi073.stderr:126150K .......... .......... .......... .......... .......... 74% 25.3M 1s 2024-03-29T04:09:19.329 INFO:teuthology.orchestra.run.smithi073.stderr:126200K .......... .......... .......... .......... .......... 74% 46.6M 1s 2024-03-29T04:09:19.329 INFO:teuthology.orchestra.run.smithi073.stderr:126250K .......... .......... .......... .......... .......... 74% 24.5M 1s 2024-03-29T04:09:19.330 INFO:teuthology.orchestra.run.smithi073.stderr:126300K .......... .......... .......... .......... .......... 74% 24.4M 1s 2024-03-29T04:09:19.330 INFO:teuthology.orchestra.run.smithi073.stderr:126350K .......... .......... .......... .......... .......... 74% 34.8M 1s 2024-03-29T04:09:19.330 INFO:teuthology.orchestra.run.smithi073.stderr:126400K .......... .......... .......... .......... .......... 75% 24.7M 1s 2024-03-29T04:09:19.330 INFO:teuthology.orchestra.run.smithi073.stderr:126450K .......... .......... .......... .......... .......... 75% 48.7M 1s 2024-03-29T04:09:19.330 INFO:teuthology.orchestra.run.smithi073.stderr:126500K .......... .......... .......... .......... .......... 75% 24.3M 1s 2024-03-29T04:09:19.330 INFO:teuthology.orchestra.run.smithi073.stderr:126550K .......... .......... .......... .......... .......... 75% 25.0M 1s 2024-03-29T04:09:19.330 INFO:teuthology.orchestra.run.smithi073.stderr:126600K .......... .......... .......... .......... .......... 75% 35.8M 1s 2024-03-29T04:09:19.330 INFO:teuthology.orchestra.run.smithi073.stderr:126650K .......... .......... .......... .......... .......... 75% 24.6M 1s 2024-03-29T04:09:19.330 INFO:teuthology.orchestra.run.smithi073.stderr:126700K .......... .......... .......... .......... .......... 75% 46.3M 1s 2024-03-29T04:09:19.330 INFO:teuthology.orchestra.run.smithi073.stderr:126750K .......... .......... .......... .......... .......... 75% 24.9M 1s 2024-03-29T04:09:19.330 INFO:teuthology.orchestra.run.smithi073.stderr:126800K .......... .......... .......... .......... .......... 75% 20.7M 1s 2024-03-29T04:09:19.330 INFO:teuthology.orchestra.run.smithi073.stderr:126850K .......... .......... .......... .......... .......... 75% 33.3M 1s 2024-03-29T04:09:19.331 INFO:teuthology.orchestra.run.smithi073.stderr:126900K .......... .......... .......... .......... .......... 75% 22.7M 1s 2024-03-29T04:09:19.331 INFO:teuthology.orchestra.run.smithi073.stderr:126950K .......... .......... .......... .......... .......... 75% 69.9M 1s 2024-03-29T04:09:19.331 INFO:teuthology.orchestra.run.smithi073.stderr:127000K .......... .......... .......... .......... .......... 75% 23.8M 1s 2024-03-29T04:09:19.331 INFO:teuthology.orchestra.run.smithi073.stderr:127050K .......... .......... .......... .......... .......... 75% 27.8M 1s 2024-03-29T04:09:19.331 INFO:teuthology.orchestra.run.smithi073.stderr:127100K .......... .......... .......... .......... .......... 75% 29.1M 1s 2024-03-29T04:09:19.331 INFO:teuthology.orchestra.run.smithi073.stderr:127150K .......... .......... .......... .......... .......... 75% 28.1M 1s 2024-03-29T04:09:19.331 INFO:teuthology.orchestra.run.smithi073.stderr:127200K .......... .......... .......... .......... .......... 75% 33.5M 1s 2024-03-29T04:09:19.331 INFO:teuthology.orchestra.run.smithi073.stderr:127250K .......... .......... .......... .......... .......... 75% 25.9M 1s 2024-03-29T04:09:19.331 INFO:teuthology.orchestra.run.smithi073.stderr:127300K .......... .......... .......... .......... .......... 75% 30.5M 1s 2024-03-29T04:09:19.331 INFO:teuthology.orchestra.run.smithi073.stderr:127350K .......... .......... .......... .......... .......... 75% 22.6M 1s 2024-03-29T04:09:19.331 INFO:teuthology.orchestra.run.smithi073.stderr:127400K .......... .......... .......... .......... .......... 75% 27.3M 1s 2024-03-29T04:09:19.331 INFO:teuthology.orchestra.run.smithi073.stderr:127450K .......... .......... .......... .......... .......... 75% 50.6M 1s 2024-03-29T04:09:19.331 INFO:teuthology.orchestra.run.smithi073.stderr:127500K .......... .......... .......... .......... .......... 75% 25.8M 1s 2024-03-29T04:09:19.332 INFO:teuthology.orchestra.run.smithi073.stderr:127550K .......... .......... .......... .......... .......... 75% 30.2M 1s 2024-03-29T04:09:19.332 INFO:teuthology.orchestra.run.smithi073.stderr:127600K .......... .......... .......... .......... .......... 75% 24.7M 1s 2024-03-29T04:09:19.332 INFO:teuthology.orchestra.run.smithi073.stderr:127650K .......... .......... .......... .......... .......... 75% 24.3M 1s 2024-03-29T04:09:19.332 INFO:teuthology.orchestra.run.smithi073.stderr:127700K .......... .......... .......... .......... .......... 75% 29.1M 1s 2024-03-29T04:09:19.332 INFO:teuthology.orchestra.run.smithi073.stderr:127750K .......... .......... .......... .......... .......... 75% 43.6M 1s 2024-03-29T04:09:19.332 INFO:teuthology.orchestra.run.smithi073.stderr:127800K .......... .......... .......... .......... .......... 75% 23.8M 1s 2024-03-29T04:09:19.332 INFO:teuthology.orchestra.run.smithi073.stderr:127850K .......... .......... .......... .......... .......... 75% 36.4M 1s 2024-03-29T04:09:19.332 INFO:teuthology.orchestra.run.smithi073.stderr:127900K .......... .......... .......... .......... .......... 75% 24.8M 1s 2024-03-29T04:09:19.332 INFO:teuthology.orchestra.run.smithi073.stderr:127950K .......... .......... .......... .......... .......... 75% 42.4M 1s 2024-03-29T04:09:19.332 INFO:teuthology.orchestra.run.smithi073.stderr:128000K .......... .......... .......... .......... .......... 75% 27.0M 1s 2024-03-29T04:09:19.332 INFO:teuthology.orchestra.run.smithi073.stderr:128050K .......... .......... .......... .......... .......... 75% 25.1M 1s 2024-03-29T04:09:19.332 INFO:teuthology.orchestra.run.smithi073.stderr:128100K .......... .......... .......... .......... .......... 76% 20.8M 1s 2024-03-29T04:09:19.332 INFO:teuthology.orchestra.run.smithi073.stderr:128150K .......... .......... .......... .......... .......... 76% 30.2M 1s 2024-03-29T04:09:19.333 INFO:teuthology.orchestra.run.smithi073.stderr:128200K .......... .......... .......... .......... .......... 76% 51.0M 1s 2024-03-29T04:09:19.333 INFO:teuthology.orchestra.run.smithi073.stderr:128250K .......... .......... .......... .......... .......... 76% 29.6M 1s 2024-03-29T04:09:19.333 INFO:teuthology.orchestra.run.smithi073.stderr:128300K .......... .......... .......... .......... .......... 76% 27.3M 1s 2024-03-29T04:09:19.333 INFO:teuthology.orchestra.run.smithi073.stderr:128350K .......... .......... .......... .......... .......... 76% 24.2M 1s 2024-03-29T04:09:19.333 INFO:teuthology.orchestra.run.smithi073.stderr:128400K .......... .......... .......... .......... .......... 76% 24.8M 1s 2024-03-29T04:09:19.333 INFO:teuthology.orchestra.run.smithi073.stderr:128450K .......... .......... .......... .......... .......... 76% 45.2M 1s 2024-03-29T04:09:19.333 INFO:teuthology.orchestra.run.smithi073.stderr:128500K .......... .......... .......... .......... .......... 76% 30.1M 1s 2024-03-29T04:09:19.333 INFO:teuthology.orchestra.run.smithi073.stderr:128550K .......... .......... .......... .......... .......... 76% 27.6M 1s 2024-03-29T04:09:19.333 INFO:teuthology.orchestra.run.smithi073.stderr:128600K .......... .......... .......... .......... .......... 76% 23.5M 1s 2024-03-29T04:09:19.333 INFO:teuthology.orchestra.run.smithi073.stderr:128650K .......... .......... .......... .......... .......... 76% 25.0M 1s 2024-03-29T04:09:19.333 INFO:teuthology.orchestra.run.smithi073.stderr:128700K .......... .......... .......... .......... .......... 76% 52.1M 1s 2024-03-29T04:09:19.333 INFO:teuthology.orchestra.run.smithi073.stderr:128750K .......... .......... .......... .......... .......... 76% 21.9M 1s 2024-03-29T04:09:19.333 INFO:teuthology.orchestra.run.smithi073.stderr:128800K .......... .......... .......... .......... .......... 76% 29.6M 1s 2024-03-29T04:09:19.334 INFO:teuthology.orchestra.run.smithi073.stderr:128850K .......... .......... .......... .......... .......... 76% 29.0M 1s 2024-03-29T04:09:19.334 INFO:teuthology.orchestra.run.smithi073.stderr:128900K .......... .......... .......... .......... .......... 76% 25.8M 1s 2024-03-29T04:09:19.334 INFO:teuthology.orchestra.run.smithi073.stderr:128950K .......... .......... .......... .......... .......... 76% 50.5M 1s 2024-03-29T04:09:19.334 INFO:teuthology.orchestra.run.smithi073.stderr:129000K .......... .......... .......... .......... .......... 76% 31.3M 1s 2024-03-29T04:09:19.334 INFO:teuthology.orchestra.run.smithi073.stderr:129050K .......... .......... .......... .......... .......... 76% 25.5M 1s 2024-03-29T04:09:19.334 INFO:teuthology.orchestra.run.smithi073.stderr:129100K .......... .......... .......... .......... .......... 76% 22.2M 1s 2024-03-29T04:09:19.334 INFO:teuthology.orchestra.run.smithi073.stderr:129150K .......... .......... .......... .......... .......... 76% 20.1M 1s 2024-03-29T04:09:19.334 INFO:teuthology.orchestra.run.smithi073.stderr:129200K .......... .......... .......... .......... .......... 76% 107M 1s 2024-03-29T04:09:19.334 INFO:teuthology.orchestra.run.smithi073.stderr:129250K .......... .......... .......... .......... .......... 76% 34.6M 1s 2024-03-29T04:09:19.334 INFO:teuthology.orchestra.run.smithi073.stderr:129300K .......... .......... .......... .......... .......... 76% 23.8M 1s 2024-03-29T04:09:19.334 INFO:teuthology.orchestra.run.smithi073.stderr:129350K .......... .......... .......... .......... .......... 76% 24.8M 1s 2024-03-29T04:09:19.334 INFO:teuthology.orchestra.run.smithi073.stderr:129400K .......... .......... .......... .......... .......... 76% 33.6M 1s 2024-03-29T04:09:19.334 INFO:teuthology.orchestra.run.smithi073.stderr:129450K .......... .......... .......... .......... .......... 76% 31.6M 1s 2024-03-29T04:09:19.335 INFO:teuthology.orchestra.run.smithi073.stderr:129500K .......... .......... .......... .......... .......... 76% 33.9M 1s 2024-03-29T04:09:19.335 INFO:teuthology.orchestra.run.smithi073.stderr:129550K .......... .......... .......... .......... .......... 76% 32.0M 1s 2024-03-29T04:09:19.335 INFO:teuthology.orchestra.run.smithi073.stderr:129600K .......... .......... .......... .......... .......... 76% 19.3M 1s 2024-03-29T04:09:19.335 INFO:teuthology.orchestra.run.smithi073.stderr:129650K .......... .......... .......... .......... .......... 76% 43.1M 1s 2024-03-29T04:09:19.335 INFO:teuthology.orchestra.run.smithi073.stderr:129700K .......... .......... .......... .......... .......... 76% 22.0M 1s 2024-03-29T04:09:19.335 INFO:teuthology.orchestra.run.smithi073.stderr:129750K .......... .......... .......... .......... .......... 77% 40.1M 1s 2024-03-29T04:09:19.335 INFO:teuthology.orchestra.run.smithi073.stderr:129800K .......... .......... .......... .......... .......... 77% 19.6M 1s 2024-03-29T04:09:19.335 INFO:teuthology.orchestra.run.smithi073.stderr:129850K .......... .......... .......... .......... .......... 77% 14.5M 1s 2024-03-29T04:09:19.335 INFO:teuthology.orchestra.run.smithi073.stderr:129900K .......... .......... .......... .......... .......... 77% 105M 1s 2024-03-29T04:09:19.335 INFO:teuthology.orchestra.run.smithi073.stderr:129950K .......... .......... .......... .......... .......... 77% 78.9M 1s 2024-03-29T04:09:19.335 INFO:teuthology.orchestra.run.smithi073.stderr:130000K .......... .......... .......... .......... .......... 77% 37.8M 1s 2024-03-29T04:09:19.335 INFO:teuthology.orchestra.run.smithi073.stderr:130050K .......... .......... .......... .......... .......... 77% 24.5M 1s 2024-03-29T04:09:19.335 INFO:teuthology.orchestra.run.smithi073.stderr:130100K .......... .......... .......... .......... .......... 77% 25.9M 1s 2024-03-29T04:09:19.336 INFO:teuthology.orchestra.run.smithi073.stderr:130150K .......... .......... .......... .......... .......... 77% 48.1M 1s 2024-03-29T04:09:19.336 INFO:teuthology.orchestra.run.smithi073.stderr:130200K .......... .......... .......... .......... .......... 77% 21.8M 1s 2024-03-29T04:09:19.336 INFO:teuthology.orchestra.run.smithi073.stderr:130250K .......... .......... .......... .......... .......... 77% 39.7M 1s 2024-03-29T04:09:19.336 INFO:teuthology.orchestra.run.smithi073.stderr:130300K .......... .......... .......... .......... .......... 77% 25.6M 1s 2024-03-29T04:09:19.336 INFO:teuthology.orchestra.run.smithi073.stderr:130350K .......... .......... .......... .......... .......... 77% 23.7M 1s 2024-03-29T04:09:19.336 INFO:teuthology.orchestra.run.smithi073.stderr:130400K .......... .......... .......... .......... .......... 77% 37.6M 1s 2024-03-29T04:09:19.336 INFO:teuthology.orchestra.run.smithi073.stderr:130450K .......... .......... .......... .......... .......... 77% 29.0M 1s 2024-03-29T04:09:19.336 INFO:teuthology.orchestra.run.smithi073.stderr:130500K .......... .......... .......... .......... .......... 77% 36.3M 1s 2024-03-29T04:09:19.336 INFO:teuthology.orchestra.run.smithi073.stderr:130550K .......... .......... .......... .......... .......... 77% 24.0M 1s 2024-03-29T04:09:19.336 INFO:teuthology.orchestra.run.smithi073.stderr:130600K .......... .......... .......... .......... .......... 77% 36.9M 1s 2024-03-29T04:09:19.336 INFO:teuthology.orchestra.run.smithi073.stderr:130650K .......... .......... .......... .......... .......... 77% 24.4M 1s 2024-03-29T04:09:19.336 INFO:teuthology.orchestra.run.smithi073.stderr:130700K .......... .......... .......... .......... .......... 77% 24.9M 1s 2024-03-29T04:09:19.336 INFO:teuthology.orchestra.run.smithi073.stderr:130750K .......... .......... .......... .......... .......... 77% 45.0M 1s 2024-03-29T04:09:19.337 INFO:teuthology.orchestra.run.smithi073.stderr:130800K .......... .......... .......... .......... .......... 77% 24.9M 1s 2024-03-29T04:09:19.337 INFO:teuthology.orchestra.run.smithi073.stderr:130850K .......... .......... .......... .......... .......... 77% 35.6M 1s 2024-03-29T04:09:19.337 INFO:teuthology.orchestra.run.smithi073.stderr:130900K .......... .......... .......... .......... .......... 77% 19.2M 1s 2024-03-29T04:09:19.337 INFO:teuthology.orchestra.run.smithi073.stderr:130950K .......... .......... .......... .......... .......... 77% 32.1M 1s 2024-03-29T04:09:19.337 INFO:teuthology.orchestra.run.smithi073.stderr:131000K .......... .......... .......... .......... .......... 77% 48.6M 1s 2024-03-29T04:09:19.337 INFO:teuthology.orchestra.run.smithi073.stderr:131050K .......... .......... .......... .......... .......... 77% 24.3M 1s 2024-03-29T04:09:19.337 INFO:teuthology.orchestra.run.smithi073.stderr:131100K .......... .......... .......... .......... .......... 77% 33.9M 1s 2024-03-29T04:09:19.337 INFO:teuthology.orchestra.run.smithi073.stderr:131150K .......... .......... .......... .......... .......... 77% 27.9M 1s 2024-03-29T04:09:19.337 INFO:teuthology.orchestra.run.smithi073.stderr:131200K .......... .......... .......... .......... .......... 77% 22.4M 1s 2024-03-29T04:09:19.337 INFO:teuthology.orchestra.run.smithi073.stderr:131250K .......... .......... .......... .......... .......... 77% 48.6M 1s 2024-03-29T04:09:19.337 INFO:teuthology.orchestra.run.smithi073.stderr:131300K .......... .......... .......... .......... .......... 77% 25.0M 1s 2024-03-29T04:09:19.337 INFO:teuthology.orchestra.run.smithi073.stderr:131350K .......... .......... .......... .......... .......... 77% 30.6M 1s 2024-03-29T04:09:19.337 INFO:teuthology.orchestra.run.smithi073.stderr:131400K .......... .......... .......... .......... .......... 77% 26.0M 1s 2024-03-29T04:09:19.338 INFO:teuthology.orchestra.run.smithi073.stderr:131450K .......... .......... .......... .......... .......... 78% 24.7M 1s 2024-03-29T04:09:19.338 INFO:teuthology.orchestra.run.smithi073.stderr:131500K .......... .......... .......... .......... .......... 78% 54.6M 1s 2024-03-29T04:09:19.338 INFO:teuthology.orchestra.run.smithi073.stderr:131550K .......... .......... .......... .......... .......... 78% 22.1M 1s 2024-03-29T04:09:19.338 INFO:teuthology.orchestra.run.smithi073.stderr:131600K .......... .......... .......... .......... .......... 78% 28.8M 1s 2024-03-29T04:09:19.338 INFO:teuthology.orchestra.run.smithi073.stderr:131650K .......... .......... .......... .......... .......... 78% 30.4M 1s 2024-03-29T04:09:19.338 INFO:teuthology.orchestra.run.smithi073.stderr:131700K .......... .......... .......... .......... .......... 78% 26.1M 1s 2024-03-29T04:09:19.338 INFO:teuthology.orchestra.run.smithi073.stderr:131750K .......... .......... .......... .......... .......... 78% 41.1M 1s 2024-03-29T04:09:19.338 INFO:teuthology.orchestra.run.smithi073.stderr:131800K .......... .......... .......... .......... .......... 78% 24.6M 1s 2024-03-29T04:09:19.338 INFO:teuthology.orchestra.run.smithi073.stderr:131850K .......... .......... .......... .......... .......... 78% 27.8M 1s 2024-03-29T04:09:19.338 INFO:teuthology.orchestra.run.smithi073.stderr:131900K .......... .......... .......... .......... .......... 78% 32.6M 1s 2024-03-29T04:09:19.338 INFO:teuthology.orchestra.run.smithi073.stderr:131950K .......... .......... .......... .......... .......... 78% 24.0M 1s 2024-03-29T04:09:19.338 INFO:teuthology.orchestra.run.smithi073.stderr:132000K .......... .......... .......... .......... .......... 78% 24.5M 1s 2024-03-29T04:09:19.339 INFO:teuthology.orchestra.run.smithi073.stderr:132050K .......... .......... .......... .......... .......... 78% 48.8M 1s 2024-03-29T04:09:19.339 INFO:teuthology.orchestra.run.smithi073.stderr:132100K .......... .......... .......... .......... .......... 78% 23.7M 1s 2024-03-29T04:09:19.339 INFO:teuthology.orchestra.run.smithi073.stderr:132150K .......... .......... .......... .......... .......... 78% 36.9M 1s 2024-03-29T04:09:19.339 INFO:teuthology.orchestra.run.smithi073.stderr:132200K .......... .......... .......... .......... .......... 78% 24.5M 1s 2024-03-29T04:09:19.339 INFO:teuthology.orchestra.run.smithi073.stderr:132250K .......... .......... .......... .......... .......... 78% 24.8M 1s 2024-03-29T04:09:19.339 INFO:teuthology.orchestra.run.smithi073.stderr:132300K .......... .......... .......... .......... .......... 78% 44.8M 1s 2024-03-29T04:09:19.339 INFO:teuthology.orchestra.run.smithi073.stderr:132350K .......... .......... .......... .......... .......... 78% 24.2M 1s 2024-03-29T04:09:19.339 INFO:teuthology.orchestra.run.smithi073.stderr:132400K .......... .......... .......... .......... .......... 78% 29.5M 1s 2024-03-29T04:09:19.339 INFO:teuthology.orchestra.run.smithi073.stderr:132450K .......... .......... .......... .......... .......... 78% 29.0M 1s 2024-03-29T04:09:19.339 INFO:teuthology.orchestra.run.smithi073.stderr:132500K .......... .......... .......... .......... .......... 78% 25.1M 1s 2024-03-29T04:09:19.339 INFO:teuthology.orchestra.run.smithi073.stderr:132550K .......... .......... .......... .......... .......... 78% 44.2M 1s 2024-03-29T04:09:19.339 INFO:teuthology.orchestra.run.smithi073.stderr:132600K .......... .......... .......... .......... .......... 78% 24.9M 1s 2024-03-29T04:09:19.339 INFO:teuthology.orchestra.run.smithi073.stderr:132650K .......... .......... .......... .......... .......... 78% 35.8M 1s 2024-03-29T04:09:19.340 INFO:teuthology.orchestra.run.smithi073.stderr:132700K .......... .......... .......... .......... .......... 78% 24.4M 1s 2024-03-29T04:09:19.340 INFO:teuthology.orchestra.run.smithi073.stderr:132750K .......... .......... .......... .......... .......... 78% 25.2M 1s 2024-03-29T04:09:19.340 INFO:teuthology.orchestra.run.smithi073.stderr:132800K .......... .......... .......... .......... .......... 78% 49.9M 1s 2024-03-29T04:09:19.340 INFO:teuthology.orchestra.run.smithi073.stderr:132850K .......... .......... .......... .......... .......... 78% 22.9M 1s 2024-03-29T04:09:19.340 INFO:teuthology.orchestra.run.smithi073.stderr:132900K .......... .......... .......... .......... .......... 78% 35.5M 1s 2024-03-29T04:09:19.340 INFO:teuthology.orchestra.run.smithi073.stderr:132950K .......... .......... .......... .......... .......... 78% 26.5M 1s 2024-03-29T04:09:19.340 INFO:teuthology.orchestra.run.smithi073.stderr:133000K .......... .......... .......... .......... .......... 78% 23.7M 1s 2024-03-29T04:09:19.340 INFO:teuthology.orchestra.run.smithi073.stderr:133050K .......... .......... .......... .......... .......... 78% 49.6M 1s 2024-03-29T04:09:19.340 INFO:teuthology.orchestra.run.smithi073.stderr:133100K .......... .......... .......... .......... .......... 78% 34.6M 1s 2024-03-29T04:09:19.340 INFO:teuthology.orchestra.run.smithi073.stderr:133150K .......... .......... .......... .......... .......... 79% 25.0M 1s 2024-03-29T04:09:19.340 INFO:teuthology.orchestra.run.smithi073.stderr:133200K .......... .......... .......... .......... .......... 79% 24.5M 1s 2024-03-29T04:09:19.340 INFO:teuthology.orchestra.run.smithi073.stderr:133250K .......... .......... .......... .......... .......... 79% 27.3M 1s 2024-03-29T04:09:19.341 INFO:teuthology.orchestra.run.smithi073.stderr:133300K .......... .......... .......... .......... .......... 79% 38.9M 1s 2024-03-29T04:09:19.341 INFO:teuthology.orchestra.run.smithi073.stderr:133350K .......... .......... .......... .......... .......... 79% 32.7M 1s 2024-03-29T04:09:19.341 INFO:teuthology.orchestra.run.smithi073.stderr:133400K .......... .......... .......... .......... .......... 79% 25.9M 1s 2024-03-29T04:09:19.341 INFO:teuthology.orchestra.run.smithi073.stderr:133450K .......... .......... .......... .......... .......... 79% 23.8M 1s 2024-03-29T04:09:19.341 INFO:teuthology.orchestra.run.smithi073.stderr:133500K .......... .......... .......... .......... .......... 79% 25.7M 1s 2024-03-29T04:09:19.341 INFO:teuthology.orchestra.run.smithi073.stderr:133550K .......... .......... .......... .......... .......... 79% 46.6M 1s 2024-03-29T04:09:19.341 INFO:teuthology.orchestra.run.smithi073.stderr:133600K .......... .......... .......... .......... .......... 79% 31.0M 1s 2024-03-29T04:09:19.341 INFO:teuthology.orchestra.run.smithi073.stderr:133650K .......... .......... .......... .......... .......... 79% 26.9M 1s 2024-03-29T04:09:19.341 INFO:teuthology.orchestra.run.smithi073.stderr:133700K .......... .......... .......... .......... .......... 79% 24.7M 1s 2024-03-29T04:09:19.341 INFO:teuthology.orchestra.run.smithi073.stderr:133750K .......... .......... .......... .......... .......... 79% 24.7M 1s 2024-03-29T04:09:19.341 INFO:teuthology.orchestra.run.smithi073.stderr:133800K .......... .......... .......... .......... .......... 79% 50.2M 1s 2024-03-29T04:09:19.341 INFO:teuthology.orchestra.run.smithi073.stderr:133850K .......... .......... .......... .......... .......... 79% 31.5M 1s 2024-03-29T04:09:19.342 INFO:teuthology.orchestra.run.smithi073.stderr:133900K .......... .......... .......... .......... .......... 79% 25.3M 1s 2024-03-29T04:09:19.342 INFO:teuthology.orchestra.run.smithi073.stderr:133950K .......... .......... .......... .......... .......... 79% 26.0M 1s 2024-03-29T04:09:19.342 INFO:teuthology.orchestra.run.smithi073.stderr:134000K .......... .......... .......... .......... .......... 79% 23.3M 1s 2024-03-29T04:09:19.342 INFO:teuthology.orchestra.run.smithi073.stderr:134050K .......... .......... .......... .......... .......... 79% 51.6M 1s 2024-03-29T04:09:19.342 INFO:teuthology.orchestra.run.smithi073.stderr:134100K .......... .......... .......... .......... .......... 79% 32.0M 1s 2024-03-29T04:09:19.342 INFO:teuthology.orchestra.run.smithi073.stderr:134150K .......... .......... .......... .......... .......... 79% 22.3M 1s 2024-03-29T04:09:19.342 INFO:teuthology.orchestra.run.smithi073.stderr:134200K .......... .......... .......... .......... .......... 79% 28.3M 1s 2024-03-29T04:09:19.342 INFO:teuthology.orchestra.run.smithi073.stderr:134250K .......... .......... .......... .......... .......... 79% 24.5M 1s 2024-03-29T04:09:19.342 INFO:teuthology.orchestra.run.smithi073.stderr:134300K .......... .......... .......... .......... .......... 79% 50.9M 1s 2024-03-29T04:09:19.342 INFO:teuthology.orchestra.run.smithi073.stderr:134350K .......... .......... .......... .......... .......... 79% 26.2M 1s 2024-03-29T04:09:19.342 INFO:teuthology.orchestra.run.smithi073.stderr:134400K .......... .......... .......... .......... .......... 79% 31.3M 1s 2024-03-29T04:09:19.342 INFO:teuthology.orchestra.run.smithi073.stderr:134450K .......... .......... .......... .......... .......... 79% 24.7M 1s 2024-03-29T04:09:19.343 INFO:teuthology.orchestra.run.smithi073.stderr:134500K .......... .......... .......... .......... .......... 79% 25.4M 1s 2024-03-29T04:09:19.343 INFO:teuthology.orchestra.run.smithi073.stderr:134550K .......... .......... .......... .......... .......... 79% 46.7M 1s 2024-03-29T04:09:19.343 INFO:teuthology.orchestra.run.smithi073.stderr:134600K .......... .......... .......... .......... .......... 79% 31.4M 1s 2024-03-29T04:09:19.343 INFO:teuthology.orchestra.run.smithi073.stderr:134650K .......... .......... .......... .......... .......... 79% 24.5M 1s 2024-03-29T04:09:19.343 INFO:teuthology.orchestra.run.smithi073.stderr:134700K .......... .......... .......... .......... .......... 79% 24.9M 1s 2024-03-29T04:09:19.343 INFO:teuthology.orchestra.run.smithi073.stderr:134750K .......... .......... .......... .......... .......... 79% 29.3M 1s 2024-03-29T04:09:19.343 INFO:teuthology.orchestra.run.smithi073.stderr:134800K .......... .......... .......... .......... .......... 79% 40.9M 1s 2024-03-29T04:09:19.343 INFO:teuthology.orchestra.run.smithi073.stderr:134850K .......... .......... .......... .......... .......... 80% 29.4M 1s 2024-03-29T04:09:19.343 INFO:teuthology.orchestra.run.smithi073.stderr:134900K .......... .......... .......... .......... .......... 80% 26.3M 1s 2024-03-29T04:09:19.343 INFO:teuthology.orchestra.run.smithi073.stderr:134950K .......... .......... .......... .......... .......... 80% 24.0M 1s 2024-03-29T04:09:19.343 INFO:teuthology.orchestra.run.smithi073.stderr:135000K .......... .......... .......... .......... .......... 80% 24.4M 1s 2024-03-29T04:09:19.343 INFO:teuthology.orchestra.run.smithi073.stderr:135050K .......... .......... .......... .......... .......... 80% 53.4M 1s 2024-03-29T04:09:19.344 INFO:teuthology.orchestra.run.smithi073.stderr:135100K .......... .......... .......... .......... .......... 80% 28.8M 1s 2024-03-29T04:09:19.344 INFO:teuthology.orchestra.run.smithi073.stderr:135150K .......... .......... .......... .......... .......... 80% 27.4M 1s 2024-03-29T04:09:19.344 INFO:teuthology.orchestra.run.smithi073.stderr:135200K .......... .......... .......... .......... .......... 80% 21.5M 1s 2024-03-29T04:09:19.344 INFO:teuthology.orchestra.run.smithi073.stderr:135250K .......... .......... .......... .......... .......... 80% 28.6M 1s 2024-03-29T04:09:19.344 INFO:teuthology.orchestra.run.smithi073.stderr:135300K .......... .......... .......... .......... .......... 80% 56.4M 1s 2024-03-29T04:09:19.344 INFO:teuthology.orchestra.run.smithi073.stderr:135350K .......... .......... .......... .......... .......... 80% 24.2M 1s 2024-03-29T04:09:19.344 INFO:teuthology.orchestra.run.smithi073.stderr:135400K .......... .......... .......... .......... .......... 80% 32.3M 1s 2024-03-29T04:09:19.344 INFO:teuthology.orchestra.run.smithi073.stderr:135450K .......... .......... .......... .......... .......... 80% 24.2M 1s 2024-03-29T04:09:19.344 INFO:teuthology.orchestra.run.smithi073.stderr:135500K .......... .......... .......... .......... .......... 80% 24.5M 1s 2024-03-29T04:09:19.344 INFO:teuthology.orchestra.run.smithi073.stderr:135550K .......... .......... .......... .......... .......... 80% 52.1M 1s 2024-03-29T04:09:19.344 INFO:teuthology.orchestra.run.smithi073.stderr:135600K .......... .......... .......... .......... .......... 80% 26.5M 1s 2024-03-29T04:09:19.344 INFO:teuthology.orchestra.run.smithi073.stderr:135650K .......... .......... .......... .......... .......... 80% 20.9M 1s 2024-03-29T04:09:19.344 INFO:teuthology.orchestra.run.smithi073.stderr:135700K .......... .......... .......... .......... .......... 80% 37.6M 1s 2024-03-29T04:09:19.345 INFO:teuthology.orchestra.run.smithi073.stderr:135750K .......... .......... .......... .......... .......... 80% 24.4M 1s 2024-03-29T04:09:19.345 INFO:teuthology.orchestra.run.smithi073.stderr:135800K .......... .......... .......... .......... .......... 80% 55.7M 1s 2024-03-29T04:09:19.345 INFO:teuthology.orchestra.run.smithi073.stderr:135850K .......... .......... .......... .......... .......... 80% 25.1M 1s 2024-03-29T04:09:19.345 INFO:teuthology.orchestra.run.smithi073.stderr:135900K .......... .......... .......... .......... .......... 80% 30.2M 1s 2024-03-29T04:09:19.345 INFO:teuthology.orchestra.run.smithi073.stderr:135950K .......... .......... .......... .......... .......... 80% 24.5M 1s 2024-03-29T04:09:19.345 INFO:teuthology.orchestra.run.smithi073.stderr:136000K .......... .......... .......... .......... .......... 80% 23.8M 1s 2024-03-29T04:09:19.345 INFO:teuthology.orchestra.run.smithi073.stderr:136050K .......... .......... .......... .......... .......... 80% 63.1M 1s 2024-03-29T04:09:19.345 INFO:teuthology.orchestra.run.smithi073.stderr:136100K .......... .......... .......... .......... .......... 80% 24.1M 1s 2024-03-29T04:09:19.345 INFO:teuthology.orchestra.run.smithi073.stderr:136150K .......... .......... .......... .......... .......... 80% 24.5M 1s 2024-03-29T04:09:19.345 INFO:teuthology.orchestra.run.smithi073.stderr:136200K .......... .......... .......... .......... .......... 80% 32.0M 1s 2024-03-29T04:09:19.345 INFO:teuthology.orchestra.run.smithi073.stderr:136250K .......... .......... .......... .......... .......... 80% 24.6M 1s 2024-03-29T04:09:19.345 INFO:teuthology.orchestra.run.smithi073.stderr:136300K .......... .......... .......... .......... .......... 80% 55.9M 1s 2024-03-29T04:09:19.345 INFO:teuthology.orchestra.run.smithi073.stderr:136350K .......... .......... .......... .......... .......... 80% 24.6M 1s 2024-03-29T04:09:19.346 INFO:teuthology.orchestra.run.smithi073.stderr:136400K .......... .......... .......... .......... .......... 80% 24.6M 1s 2024-03-29T04:09:19.346 INFO:teuthology.orchestra.run.smithi073.stderr:136450K .......... .......... .......... .......... .......... 80% 31.9M 1s 2024-03-29T04:09:19.346 INFO:teuthology.orchestra.run.smithi073.stderr:136500K .......... .......... .......... .......... .......... 81% 24.0M 1s 2024-03-29T04:09:19.346 INFO:teuthology.orchestra.run.smithi073.stderr:136550K .......... .......... .......... .......... .......... 81% 53.7M 1s 2024-03-29T04:09:19.346 INFO:teuthology.orchestra.run.smithi073.stderr:136600K .......... .......... .......... .......... .......... 81% 25.3M 1s 2024-03-29T04:09:19.346 INFO:teuthology.orchestra.run.smithi073.stderr:136650K .......... .......... .......... .......... .......... 81% 24.5M 1s 2024-03-29T04:09:19.346 INFO:teuthology.orchestra.run.smithi073.stderr:136700K .......... .......... .......... .......... .......... 81% 33.0M 1s 2024-03-29T04:09:19.346 INFO:teuthology.orchestra.run.smithi073.stderr:136750K .......... .......... .......... .......... .......... 81% 24.6M 1s 2024-03-29T04:09:19.346 INFO:teuthology.orchestra.run.smithi073.stderr:136800K .......... .......... .......... .......... .......... 81% 45.3M 1s 2024-03-29T04:09:19.346 INFO:teuthology.orchestra.run.smithi073.stderr:136850K .......... .......... .......... .......... .......... 81% 24.2M 1s 2024-03-29T04:09:19.346 INFO:teuthology.orchestra.run.smithi073.stderr:136900K .......... .......... .......... .......... .......... 81% 23.6M 1s 2024-03-29T04:09:19.346 INFO:teuthology.orchestra.run.smithi073.stderr:136950K .......... .......... .......... .......... .......... 81% 34.5M 1s 2024-03-29T04:09:19.347 INFO:teuthology.orchestra.run.smithi073.stderr:137000K .......... .......... .......... .......... .......... 81% 25.0M 1s 2024-03-29T04:09:19.347 INFO:teuthology.orchestra.run.smithi073.stderr:137050K .......... .......... .......... .......... .......... 81% 24.3M 1s 2024-03-29T04:09:19.347 INFO:teuthology.orchestra.run.smithi073.stderr:137100K .......... .......... .......... .......... .......... 81% 49.4M 1s 2024-03-29T04:09:19.347 INFO:teuthology.orchestra.run.smithi073.stderr:137150K .......... .......... .......... .......... .......... 81% 24.4M 1s 2024-03-29T04:09:19.347 INFO:teuthology.orchestra.run.smithi073.stderr:137200K .......... .......... .......... .......... .......... 81% 35.9M 1s 2024-03-29T04:09:19.347 INFO:teuthology.orchestra.run.smithi073.stderr:137250K .......... .......... .......... .......... .......... 81% 24.4M 1s 2024-03-29T04:09:19.347 INFO:teuthology.orchestra.run.smithi073.stderr:137300K .......... .......... .......... .......... .......... 81% 24.7M 1s 2024-03-29T04:09:19.347 INFO:teuthology.orchestra.run.smithi073.stderr:137350K .......... .......... .......... .......... .......... 81% 47.2M 1s 2024-03-29T04:09:19.347 INFO:teuthology.orchestra.run.smithi073.stderr:137400K .......... .......... .......... .......... .......... 81% 24.2M 1s 2024-03-29T04:09:19.347 INFO:teuthology.orchestra.run.smithi073.stderr:137450K .......... .......... .......... .......... .......... 81% 36.3M 1s 2024-03-29T04:09:19.347 INFO:teuthology.orchestra.run.smithi073.stderr:137500K .......... .......... .......... .......... .......... 81% 24.6M 1s 2024-03-29T04:09:19.347 INFO:teuthology.orchestra.run.smithi073.stderr:137550K .......... .......... .......... .......... .......... 81% 24.7M 1s 2024-03-29T04:09:19.348 INFO:teuthology.orchestra.run.smithi073.stderr:137600K .......... .......... .......... .......... .......... 81% 45.8M 1s 2024-03-29T04:09:19.348 INFO:teuthology.orchestra.run.smithi073.stderr:137650K .......... .......... .......... .......... .......... 81% 24.4M 1s 2024-03-29T04:09:19.348 INFO:teuthology.orchestra.run.smithi073.stderr:137700K .......... .......... .......... .......... .......... 81% 29.9M 1s 2024-03-29T04:09:19.348 INFO:teuthology.orchestra.run.smithi073.stderr:137750K .......... .......... .......... .......... .......... 81% 24.9M 1s 2024-03-29T04:09:19.348 INFO:teuthology.orchestra.run.smithi073.stderr:137800K .......... .......... .......... .......... .......... 81% 55.5M 1s 2024-03-29T04:09:19.348 INFO:teuthology.orchestra.run.smithi073.stderr:137850K .......... .......... .......... .......... .......... 81% 24.0M 1s 2024-03-29T04:09:19.348 INFO:teuthology.orchestra.run.smithi073.stderr:137900K .......... .......... .......... .......... .......... 81% 29.7M 1s 2024-03-29T04:09:19.348 INFO:teuthology.orchestra.run.smithi073.stderr:137950K .......... .......... .......... .......... .......... 81% 25.3M 1s 2024-03-29T04:09:19.348 INFO:teuthology.orchestra.run.smithi073.stderr:138000K .......... .......... .......... .......... .......... 81% 24.0M 1s 2024-03-29T04:09:19.348 INFO:teuthology.orchestra.run.smithi073.stderr:138050K .......... .......... .......... .......... .......... 81% 55.2M 1s 2024-03-29T04:09:19.348 INFO:teuthology.orchestra.run.smithi073.stderr:138100K .......... .......... .......... .......... .......... 81% 25.1M 1s 2024-03-29T04:09:19.348 INFO:teuthology.orchestra.run.smithi073.stderr:138150K .......... .......... .......... .......... .......... 81% 29.6M 1s 2024-03-29T04:09:19.349 INFO:teuthology.orchestra.run.smithi073.stderr:138200K .......... .......... .......... .......... .......... 82% 26.1M 1s 2024-03-29T04:09:19.349 INFO:teuthology.orchestra.run.smithi073.stderr:138250K .......... .......... .......... .......... .......... 82% 24.0M 1s 2024-03-29T04:09:19.349 INFO:teuthology.orchestra.run.smithi073.stderr:138300K .......... .......... .......... .......... .......... 82% 55.9M 1s 2024-03-29T04:09:19.349 INFO:teuthology.orchestra.run.smithi073.stderr:138350K .......... .......... .......... .......... .......... 82% 25.2M 1s 2024-03-29T04:09:19.349 INFO:teuthology.orchestra.run.smithi073.stderr:138400K .......... .......... .......... .......... .......... 82% 28.6M 1s 2024-03-29T04:09:19.349 INFO:teuthology.orchestra.run.smithi073.stderr:138450K .......... .......... .......... .......... .......... 82% 23.4M 1s 2024-03-29T04:09:19.349 INFO:teuthology.orchestra.run.smithi073.stderr:138500K .......... .......... .......... .......... .......... 82% 24.3M 1s 2024-03-29T04:09:19.349 INFO:teuthology.orchestra.run.smithi073.stderr:138550K .......... .......... .......... .......... .......... 82% 53.9M 1s 2024-03-29T04:09:19.349 INFO:teuthology.orchestra.run.smithi073.stderr:138600K .......... .......... .......... .......... .......... 82% 28.0M 1s 2024-03-29T04:09:19.349 INFO:teuthology.orchestra.run.smithi073.stderr:138650K .......... .......... .......... .......... .......... 82% 29.5M 1s 2024-03-29T04:09:19.349 INFO:teuthology.orchestra.run.smithi073.stderr:138700K .......... .......... .......... .......... .......... 82% 24.9M 1s 2024-03-29T04:09:19.349 INFO:teuthology.orchestra.run.smithi073.stderr:138750K .......... .......... .......... .......... .......... 82% 24.9M 1s 2024-03-29T04:09:19.350 INFO:teuthology.orchestra.run.smithi073.stderr:138800K .......... .......... .......... .......... .......... 82% 47.0M 1s 2024-03-29T04:09:19.350 INFO:teuthology.orchestra.run.smithi073.stderr:138850K .......... .......... .......... .......... .......... 82% 27.7M 1s 2024-03-29T04:09:19.350 INFO:teuthology.orchestra.run.smithi073.stderr:138900K .......... .......... .......... .......... .......... 82% 29.7M 1s 2024-03-29T04:09:19.350 INFO:teuthology.orchestra.run.smithi073.stderr:138950K .......... .......... .......... .......... .......... 82% 25.0M 1s 2024-03-29T04:09:19.350 INFO:teuthology.orchestra.run.smithi073.stderr:139000K .......... .......... .......... .......... .......... 82% 24.1M 1s 2024-03-29T04:09:19.350 INFO:teuthology.orchestra.run.smithi073.stderr:139050K .......... .......... .......... .......... .......... 82% 53.9M 1s 2024-03-29T04:09:19.350 INFO:teuthology.orchestra.run.smithi073.stderr:139100K .......... .......... .......... .......... .......... 82% 27.1M 1s 2024-03-29T04:09:19.350 INFO:teuthology.orchestra.run.smithi073.stderr:139150K .......... .......... .......... .......... .......... 82% 27.1M 1s 2024-03-29T04:09:19.350 INFO:teuthology.orchestra.run.smithi073.stderr:139200K .......... .......... .......... .......... .......... 82% 23.4M 1s 2024-03-29T04:09:19.350 INFO:teuthology.orchestra.run.smithi073.stderr:139250K .......... .......... .......... .......... .......... 82% 24.5M 1s 2024-03-29T04:09:19.350 INFO:teuthology.orchestra.run.smithi073.stderr:139300K .......... .......... .......... .......... .......... 82% 51.1M 1s 2024-03-29T04:09:19.350 INFO:teuthology.orchestra.run.smithi073.stderr:139350K .......... .......... .......... .......... .......... 82% 26.6M 1s 2024-03-29T04:09:19.351 INFO:teuthology.orchestra.run.smithi073.stderr:139400K .......... .......... .......... .......... .......... 82% 27.6M 1s 2024-03-29T04:09:19.351 INFO:teuthology.orchestra.run.smithi073.stderr:139450K .......... .......... .......... .......... .......... 82% 24.6M 1s 2024-03-29T04:09:19.351 INFO:teuthology.orchestra.run.smithi073.stderr:139500K .......... .......... .......... .......... .......... 82% 24.4M 1s 2024-03-29T04:09:19.351 INFO:teuthology.orchestra.run.smithi073.stderr:139550K .......... .......... .......... .......... .......... 82% 47.9M 1s 2024-03-29T04:09:19.351 INFO:teuthology.orchestra.run.smithi073.stderr:139600K .......... .......... .......... .......... .......... 82% 30.7M 1s 2024-03-29T04:09:19.351 INFO:teuthology.orchestra.run.smithi073.stderr:139650K .......... .......... .......... .......... .......... 82% 27.5M 1s 2024-03-29T04:09:19.351 INFO:teuthology.orchestra.run.smithi073.stderr:139700K .......... .......... .......... .......... .......... 82% 24.1M 1s 2024-03-29T04:09:19.351 INFO:teuthology.orchestra.run.smithi073.stderr:139750K .......... .......... .......... .......... .......... 82% 23.7M 1s 2024-03-29T04:09:19.351 INFO:teuthology.orchestra.run.smithi073.stderr:139800K .......... .......... .......... .......... .......... 82% 48.6M 1s 2024-03-29T04:09:19.351 INFO:teuthology.orchestra.run.smithi073.stderr:139850K .......... .......... .......... .......... .......... 82% 31.6M 1s 2024-03-29T04:09:19.351 INFO:teuthology.orchestra.run.smithi073.stderr:139900K .......... .......... .......... .......... .......... 83% 25.8M 1s 2024-03-29T04:09:19.351 INFO:teuthology.orchestra.run.smithi073.stderr:139950K .......... .......... .......... .......... .......... 83% 25.1M 1s 2024-03-29T04:09:19.351 INFO:teuthology.orchestra.run.smithi073.stderr:140000K .......... .......... .......... .......... .......... 83% 25.5M 1s 2024-03-29T04:09:19.352 INFO:teuthology.orchestra.run.smithi073.stderr:140050K .......... .......... .......... .......... .......... 83% 50.0M 1s 2024-03-29T04:09:19.352 INFO:teuthology.orchestra.run.smithi073.stderr:140100K .......... .......... .......... .......... .......... 83% 31.0M 1s 2024-03-29T04:09:19.352 INFO:teuthology.orchestra.run.smithi073.stderr:140150K .......... .......... .......... .......... .......... 83% 23.7M 1s 2024-03-29T04:09:19.352 INFO:teuthology.orchestra.run.smithi073.stderr:140200K .......... .......... .......... .......... .......... 83% 26.0M 1s 2024-03-29T04:09:19.352 INFO:teuthology.orchestra.run.smithi073.stderr:140250K .......... .......... .......... .......... .......... 83% 34.0M 1s 2024-03-29T04:09:19.352 INFO:teuthology.orchestra.run.smithi073.stderr:140300K .......... .......... .......... .......... .......... 83% 27.3M 1s 2024-03-29T04:09:19.352 INFO:teuthology.orchestra.run.smithi073.stderr:140350K .......... .......... .......... .......... .......... 83% 35.4M 1s 2024-03-29T04:09:19.352 INFO:teuthology.orchestra.run.smithi073.stderr:140400K .......... .......... .......... .......... .......... 83% 26.8M 1s 2024-03-29T04:09:19.352 INFO:teuthology.orchestra.run.smithi073.stderr:140450K .......... .......... .......... .......... .......... 83% 23.3M 1s 2024-03-29T04:09:19.352 INFO:teuthology.orchestra.run.smithi073.stderr:140500K .......... .......... .......... .......... .......... 83% 46.3M 1s 2024-03-29T04:09:19.352 INFO:teuthology.orchestra.run.smithi073.stderr:140550K .......... .......... .......... .......... .......... 83% 21.3M 1s 2024-03-29T04:09:19.352 INFO:teuthology.orchestra.run.smithi073.stderr:140600K .......... .......... .......... .......... .......... 83% 39.1M 1s 2024-03-29T04:09:19.352 INFO:teuthology.orchestra.run.smithi073.stderr:140650K .......... .......... .......... .......... .......... 83% 25.3M 1s 2024-03-29T04:09:19.352 INFO:teuthology.orchestra.run.smithi073.stderr:140700K .......... .......... .......... .......... .......... 83% 25.0M 1s 2024-03-29T04:09:19.353 INFO:teuthology.orchestra.run.smithi073.stderr:140750K .......... .......... .......... .......... .......... 83% 40.1M 1s 2024-03-29T04:09:19.353 INFO:teuthology.orchestra.run.smithi073.stderr:140800K .......... .......... .......... .......... .......... 83% 24.6M 1s 2024-03-29T04:09:19.353 INFO:teuthology.orchestra.run.smithi073.stderr:140850K .......... .......... .......... .......... .......... 83% 36.3M 1s 2024-03-29T04:09:19.353 INFO:teuthology.orchestra.run.smithi073.stderr:140900K .......... .......... .......... .......... .......... 83% 25.6M 1s 2024-03-29T04:09:19.353 INFO:teuthology.orchestra.run.smithi073.stderr:140950K .......... .......... .......... .......... .......... 83% 24.3M 1s 2024-03-29T04:09:19.353 INFO:teuthology.orchestra.run.smithi073.stderr:141000K .......... .......... .......... .......... .......... 83% 33.9M 1s 2024-03-29T04:09:19.353 INFO:teuthology.orchestra.run.smithi073.stderr:141050K .......... .......... .......... .......... .......... 83% 26.7M 1s 2024-03-29T04:09:19.353 INFO:teuthology.orchestra.run.smithi073.stderr:141100K .......... .......... .......... .......... .......... 83% 40.9M 1s 2024-03-29T04:09:19.353 INFO:teuthology.orchestra.run.smithi073.stderr:141150K .......... .......... .......... .......... .......... 83% 24.1M 1s 2024-03-29T04:09:19.353 INFO:teuthology.orchestra.run.smithi073.stderr:141200K .......... .......... .......... .......... .......... 83% 24.3M 1s 2024-03-29T04:09:19.353 INFO:teuthology.orchestra.run.smithi073.stderr:141250K .......... .......... .......... .......... .......... 83% 35.8M 1s 2024-03-29T04:09:19.353 INFO:teuthology.orchestra.run.smithi073.stderr:141300K .......... .......... .......... .......... .......... 83% 25.0M 1s 2024-03-29T04:09:19.353 INFO:teuthology.orchestra.run.smithi073.stderr:141350K .......... .......... .......... .......... .......... 83% 37.4M 1s 2024-03-29T04:09:19.354 INFO:teuthology.orchestra.run.smithi073.stderr:141400K .......... .......... .......... .......... .......... 83% 27.3M 1s 2024-03-29T04:09:19.354 INFO:teuthology.orchestra.run.smithi073.stderr:141450K .......... .......... .......... .......... .......... 83% 24.3M 1s 2024-03-29T04:09:19.354 INFO:teuthology.orchestra.run.smithi073.stderr:141500K .......... .......... .......... .......... .......... 83% 38.8M 1s 2024-03-29T04:09:19.354 INFO:teuthology.orchestra.run.smithi073.stderr:141550K .......... .......... .......... .......... .......... 84% 23.9M 1s 2024-03-29T04:09:19.354 INFO:teuthology.orchestra.run.smithi073.stderr:141600K .......... .......... .......... .......... .......... 84% 45.6M 1s 2024-03-29T04:09:19.354 INFO:teuthology.orchestra.run.smithi073.stderr:141650K .......... .......... .......... .......... .......... 84% 24.1M 1s 2024-03-29T04:09:19.354 INFO:teuthology.orchestra.run.smithi073.stderr:141700K .......... .......... .......... .......... .......... 84% 34.9M 1s 2024-03-29T04:09:19.354 INFO:teuthology.orchestra.run.smithi073.stderr:141750K .......... .......... .......... .......... .......... 84% 24.8M 1s 2024-03-29T04:09:19.354 INFO:teuthology.orchestra.run.smithi073.stderr:141800K .......... .......... .......... .......... .......... 84% 25.2M 1s 2024-03-29T04:09:19.354 INFO:teuthology.orchestra.run.smithi073.stderr:141850K .......... .......... .......... .......... .......... 84% 47.6M 1s 2024-03-29T04:09:19.354 INFO:teuthology.orchestra.run.smithi073.stderr:141900K .......... .......... .......... .......... .......... 84% 24.2M 1s 2024-03-29T04:09:19.354 INFO:teuthology.orchestra.run.smithi073.stderr:141950K .......... .......... .......... .......... .......... 84% 34.7M 1s 2024-03-29T04:09:19.354 INFO:teuthology.orchestra.run.smithi073.stderr:142000K .......... .......... .......... .......... .......... 84% 25.1M 1s 2024-03-29T04:09:19.355 INFO:teuthology.orchestra.run.smithi073.stderr:142050K .......... .......... .......... .......... .......... 84% 24.7M 1s 2024-03-29T04:09:19.355 INFO:teuthology.orchestra.run.smithi073.stderr:142100K .......... .......... .......... .......... .......... 84% 47.8M 1s 2024-03-29T04:09:19.355 INFO:teuthology.orchestra.run.smithi073.stderr:142150K .......... .......... .......... .......... .......... 84% 24.7M 1s 2024-03-29T04:09:19.355 INFO:teuthology.orchestra.run.smithi073.stderr:142200K .......... .......... .......... .......... .......... 84% 29.0M 1s 2024-03-29T04:09:19.355 INFO:teuthology.orchestra.run.smithi073.stderr:142250K .......... .......... .......... .......... .......... 84% 28.8M 1s 2024-03-29T04:09:19.355 INFO:teuthology.orchestra.run.smithi073.stderr:142300K .......... .......... .......... .......... .......... 84% 24.1M 1s 2024-03-29T04:09:19.355 INFO:teuthology.orchestra.run.smithi073.stderr:142350K .......... .......... .......... .......... .......... 84% 24.9M 1s 2024-03-29T04:09:19.355 INFO:teuthology.orchestra.run.smithi073.stderr:142400K .......... .......... .......... .......... .......... 84% 43.2M 1s 2024-03-29T04:09:19.355 INFO:teuthology.orchestra.run.smithi073.stderr:142450K .......... .......... .......... .......... .......... 84% 22.7M 1s 2024-03-29T04:09:19.355 INFO:teuthology.orchestra.run.smithi073.stderr:142500K .......... .......... .......... .......... .......... 84% 44.4M 1s 2024-03-29T04:09:19.355 INFO:teuthology.orchestra.run.smithi073.stderr:142550K .......... .......... .......... .......... .......... 84% 24.5M 1s 2024-03-29T04:09:19.355 INFO:teuthology.orchestra.run.smithi073.stderr:142600K .......... .......... .......... .......... .......... 84% 24.8M 1s 2024-03-29T04:09:19.355 INFO:teuthology.orchestra.run.smithi073.stderr:142650K .......... .......... .......... .......... .......... 84% 51.0M 1s 2024-03-29T04:09:19.356 INFO:teuthology.orchestra.run.smithi073.stderr:142700K .......... .......... .......... .......... .......... 84% 22.9M 1s 2024-03-29T04:09:19.356 INFO:teuthology.orchestra.run.smithi073.stderr:142750K .......... .......... .......... .......... .......... 84% 31.4M 1s 2024-03-29T04:09:19.356 INFO:teuthology.orchestra.run.smithi073.stderr:142800K .......... .......... .......... .......... .......... 84% 28.2M 1s 2024-03-29T04:09:19.356 INFO:teuthology.orchestra.run.smithi073.stderr:142850K .......... .......... .......... .......... .......... 84% 25.6M 1s 2024-03-29T04:09:19.356 INFO:teuthology.orchestra.run.smithi073.stderr:142900K .......... .......... .......... .......... .......... 84% 47.2M 1s 2024-03-29T04:09:19.356 INFO:teuthology.orchestra.run.smithi073.stderr:142950K .......... .......... .......... .......... .......... 84% 25.0M 1s 2024-03-29T04:09:19.356 INFO:teuthology.orchestra.run.smithi073.stderr:143000K .......... .......... .......... .......... .......... 84% 32.4M 1s 2024-03-29T04:09:19.356 INFO:teuthology.orchestra.run.smithi073.stderr:143050K .......... .......... .......... .......... .......... 84% 24.6M 1s 2024-03-29T04:09:19.356 INFO:teuthology.orchestra.run.smithi073.stderr:143100K .......... .......... .......... .......... .......... 84% 24.0M 1s 2024-03-29T04:09:19.356 INFO:teuthology.orchestra.run.smithi073.stderr:143150K .......... .......... .......... .......... .......... 84% 52.4M 1s 2024-03-29T04:09:19.356 INFO:teuthology.orchestra.run.smithi073.stderr:143200K .......... .......... .......... .......... .......... 84% 23.9M 1s 2024-03-29T04:09:19.356 INFO:teuthology.orchestra.run.smithi073.stderr:143250K .......... .......... .......... .......... .......... 85% 34.5M 1s 2024-03-29T04:09:19.356 INFO:teuthology.orchestra.run.smithi073.stderr:143300K .......... .......... .......... .......... .......... 85% 23.0M 1s 2024-03-29T04:09:19.357 INFO:teuthology.orchestra.run.smithi073.stderr:143350K .......... .......... .......... .......... .......... 85% 26.5M 1s 2024-03-29T04:09:19.357 INFO:teuthology.orchestra.run.smithi073.stderr:143400K .......... .......... .......... .......... .......... 85% 44.7M 1s 2024-03-29T04:09:19.357 INFO:teuthology.orchestra.run.smithi073.stderr:143450K .......... .......... .......... .......... .......... 85% 20.6M 1s 2024-03-29T04:09:19.357 INFO:teuthology.orchestra.run.smithi073.stderr:143500K .......... .......... .......... .......... .......... 85% 47.3M 1s 2024-03-29T04:09:19.357 INFO:teuthology.orchestra.run.smithi073.stderr:143550K .......... .......... .......... .......... .......... 85% 25.9M 1s 2024-03-29T04:09:19.357 INFO:teuthology.orchestra.run.smithi073.stderr:143600K .......... .......... .......... .......... .......... 85% 22.5M 1s 2024-03-29T04:09:19.357 INFO:teuthology.orchestra.run.smithi073.stderr:143650K .......... .......... .......... .......... .......... 85% 38.8M 1s 2024-03-29T04:09:19.357 INFO:teuthology.orchestra.run.smithi073.stderr:143700K .......... .......... .......... .......... .......... 85% 27.5M 1s 2024-03-29T04:09:19.357 INFO:teuthology.orchestra.run.smithi073.stderr:143750K .......... .......... .......... .......... .......... 85% 39.1M 1s 2024-03-29T04:09:19.357 INFO:teuthology.orchestra.run.smithi073.stderr:143800K .......... .......... .......... .......... .......... 85% 26.2M 1s 2024-03-29T04:09:19.357 INFO:teuthology.orchestra.run.smithi073.stderr:143850K .......... .......... .......... .......... .......... 85% 20.7M 1s 2024-03-29T04:09:19.357 INFO:teuthology.orchestra.run.smithi073.stderr:143900K .......... .......... .......... .......... .......... 85% 42.1M 1s 2024-03-29T04:09:19.357 INFO:teuthology.orchestra.run.smithi073.stderr:143950K .......... .......... .......... .......... .......... 85% 32.1M 1s 2024-03-29T04:09:19.358 INFO:teuthology.orchestra.run.smithi073.stderr:144000K .......... .......... .......... .......... .......... 85% 24.9M 1s 2024-03-29T04:09:19.358 INFO:teuthology.orchestra.run.smithi073.stderr:144050K .......... .......... .......... .......... .......... 85% 31.3M 1s 2024-03-29T04:09:19.358 INFO:teuthology.orchestra.run.smithi073.stderr:144100K .......... .......... .......... .......... .......... 85% 25.2M 1s 2024-03-29T04:09:19.358 INFO:teuthology.orchestra.run.smithi073.stderr:144150K .......... .......... .......... .......... .......... 85% 37.8M 1s 2024-03-29T04:09:19.358 INFO:teuthology.orchestra.run.smithi073.stderr:144200K .......... .......... .......... .......... .......... 85% 28.3M 1s 2024-03-29T04:09:19.358 INFO:teuthology.orchestra.run.smithi073.stderr:144250K .......... .......... .......... .......... .......... 85% 24.4M 1s 2024-03-29T04:09:19.358 INFO:teuthology.orchestra.run.smithi073.stderr:144300K .......... .......... .......... .......... .......... 85% 35.8M 1s 2024-03-29T04:09:19.358 INFO:teuthology.orchestra.run.smithi073.stderr:144350K .......... .......... .......... .......... .......... 85% 24.6M 1s 2024-03-29T04:09:19.358 INFO:teuthology.orchestra.run.smithi073.stderr:144400K .......... .......... .......... .......... .......... 85% 45.5M 1s 2024-03-29T04:09:19.358 INFO:teuthology.orchestra.run.smithi073.stderr:144450K .......... .......... .......... .......... .......... 85% 28.8M 1s 2024-03-29T04:09:19.358 INFO:teuthology.orchestra.run.smithi073.stderr:144500K .......... .......... .......... .......... .......... 85% 26.2M 1s 2024-03-29T04:09:19.358 INFO:teuthology.orchestra.run.smithi073.stderr:144550K .......... .......... .......... .......... .......... 85% 24.5M 1s 2024-03-29T04:09:19.358 INFO:teuthology.orchestra.run.smithi073.stderr:144600K .......... .......... .......... .......... .......... 85% 23.8M 1s 2024-03-29T04:09:19.359 INFO:teuthology.orchestra.run.smithi073.stderr:144650K .......... .......... .......... .......... .......... 85% 45.6M 1s 2024-03-29T04:09:19.359 INFO:teuthology.orchestra.run.smithi073.stderr:144700K .......... .......... .......... .......... .......... 85% 23.9M 1s 2024-03-29T04:09:19.359 INFO:teuthology.orchestra.run.smithi073.stderr:144750K .......... .......... .......... .......... .......... 85% 43.1M 1s 2024-03-29T04:09:19.359 INFO:teuthology.orchestra.run.smithi073.stderr:144800K .......... .......... .......... .......... .......... 85% 26.6M 1s 2024-03-29T04:09:19.359 INFO:teuthology.orchestra.run.smithi073.stderr:144850K .......... .......... .......... .......... .......... 85% 20.0M 1s 2024-03-29T04:09:19.359 INFO:teuthology.orchestra.run.smithi073.stderr:144900K .......... .......... .......... .......... .......... 85% 46.7M 1s 2024-03-29T04:09:19.359 INFO:teuthology.orchestra.run.smithi073.stderr:144950K .......... .......... .......... .......... .......... 86% 27.9M 1s 2024-03-29T04:09:19.359 INFO:teuthology.orchestra.run.smithi073.stderr:145000K .......... .......... .......... .......... .......... 86% 36.2M 1s 2024-03-29T04:09:19.359 INFO:teuthology.orchestra.run.smithi073.stderr:145050K .......... .......... .......... .......... .......... 86% 23.4M 1s 2024-03-29T04:09:19.359 INFO:teuthology.orchestra.run.smithi073.stderr:145100K .......... .......... .......... .......... .......... 86% 21.0M 1s 2024-03-29T04:09:19.359 INFO:teuthology.orchestra.run.smithi073.stderr:145150K .......... .......... .......... .......... .......... 86% 45.5M 1s 2024-03-29T04:09:19.359 INFO:teuthology.orchestra.run.smithi073.stderr:145200K .......... .......... .......... .......... .......... 86% 27.2M 1s 2024-03-29T04:09:19.359 INFO:teuthology.orchestra.run.smithi073.stderr:145250K .......... .......... .......... .......... .......... 86% 45.1M 1s 2024-03-29T04:09:19.359 INFO:teuthology.orchestra.run.smithi073.stderr:145300K .......... .......... .......... .......... .......... 86% 26.3M 1s 2024-03-29T04:09:19.360 INFO:teuthology.orchestra.run.smithi073.stderr:145350K .......... .......... .......... .......... .......... 86% 20.6M 1s 2024-03-29T04:09:19.360 INFO:teuthology.orchestra.run.smithi073.stderr:145400K .......... .......... .......... .......... .......... 86% 84.3M 1s 2024-03-29T04:09:19.360 INFO:teuthology.orchestra.run.smithi073.stderr:145450K .......... .......... .......... .......... .......... 86% 23.2M 1s 2024-03-29T04:09:19.360 INFO:teuthology.orchestra.run.smithi073.stderr:145500K .......... .......... .......... .......... .......... 86% 30.1M 1s 2024-03-29T04:09:19.360 INFO:teuthology.orchestra.run.smithi073.stderr:145550K .......... .......... .......... .......... .......... 86% 28.8M 1s 2024-03-29T04:09:19.360 INFO:teuthology.orchestra.run.smithi073.stderr:145600K .......... .......... .......... .......... .......... 86% 22.9M 1s 2024-03-29T04:09:19.360 INFO:teuthology.orchestra.run.smithi073.stderr:145650K .......... .......... .......... .......... .......... 86% 62.1M 1s 2024-03-29T04:09:19.360 INFO:teuthology.orchestra.run.smithi073.stderr:145700K .......... .......... .......... .......... .......... 86% 23.7M 1s 2024-03-29T04:09:19.360 INFO:teuthology.orchestra.run.smithi073.stderr:145750K .......... .......... .......... .......... .......... 86% 33.7M 1s 2024-03-29T04:09:19.360 INFO:teuthology.orchestra.run.smithi073.stderr:145800K .......... .......... .......... .......... .......... 86% 23.5M 1s 2024-03-29T04:09:19.360 INFO:teuthology.orchestra.run.smithi073.stderr:145850K .......... .......... .......... .......... .......... 86% 26.3M 1s 2024-03-29T04:09:19.360 INFO:teuthology.orchestra.run.smithi073.stderr:145900K .......... .......... .......... .......... .......... 86% 38.4M 1s 2024-03-29T04:09:19.360 INFO:teuthology.orchestra.run.smithi073.stderr:145950K .......... .......... .......... .......... .......... 86% 27.8M 1s 2024-03-29T04:09:19.361 INFO:teuthology.orchestra.run.smithi073.stderr:146000K .......... .......... .......... .......... .......... 86% 24.5M 1s 2024-03-29T04:09:19.361 INFO:teuthology.orchestra.run.smithi073.stderr:146050K .......... .......... .......... .......... .......... 86% 25.7M 1s 2024-03-29T04:09:19.361 INFO:teuthology.orchestra.run.smithi073.stderr:146100K .......... .......... .......... .......... .......... 86% 34.7M 1s 2024-03-29T04:09:19.361 INFO:teuthology.orchestra.run.smithi073.stderr:146150K .......... .......... .......... .......... .......... 86% 43.2M 1s 2024-03-29T04:09:19.361 INFO:teuthology.orchestra.run.smithi073.stderr:146200K .......... .......... .......... .......... .......... 86% 19.7M 1s 2024-03-29T04:09:19.361 INFO:teuthology.orchestra.run.smithi073.stderr:146250K .......... .......... .......... .......... .......... 86% 31.7M 1s 2024-03-29T04:09:19.361 INFO:teuthology.orchestra.run.smithi073.stderr:146300K .......... .......... .......... .......... .......... 86% 29.3M 1s 2024-03-29T04:09:19.361 INFO:teuthology.orchestra.run.smithi073.stderr:146350K .......... .......... .......... .......... .......... 86% 32.0M 1s 2024-03-29T04:09:19.361 INFO:teuthology.orchestra.run.smithi073.stderr:146400K .......... .......... .......... .......... .......... 86% 40.5M 1s 2024-03-29T04:09:19.361 INFO:teuthology.orchestra.run.smithi073.stderr:146450K .......... .......... .......... .......... .......... 86% 26.1M 1s 2024-03-29T04:09:19.361 INFO:teuthology.orchestra.run.smithi073.stderr:146500K .......... .......... .......... .......... .......... 86% 28.9M 1s 2024-03-29T04:09:19.361 INFO:teuthology.orchestra.run.smithi073.stderr:146550K .......... .......... .......... .......... .......... 86% 27.5M 1s 2024-03-29T04:09:19.361 INFO:teuthology.orchestra.run.smithi073.stderr:146600K .......... .......... .......... .......... .......... 86% 18.3M 1s 2024-03-29T04:09:19.362 INFO:teuthology.orchestra.run.smithi073.stderr:146650K .......... .......... .......... .......... .......... 87% 46.7M 1s 2024-03-29T04:09:19.362 INFO:teuthology.orchestra.run.smithi073.stderr:146700K .......... .......... .......... .......... .......... 87% 28.5M 1s 2024-03-29T04:09:19.362 INFO:teuthology.orchestra.run.smithi073.stderr:146750K .......... .......... .......... .......... .......... 87% 29.7M 1s 2024-03-29T04:09:19.362 INFO:teuthology.orchestra.run.smithi073.stderr:146800K .......... .......... .......... .......... .......... 87% 28.3M 1s 2024-03-29T04:09:19.362 INFO:teuthology.orchestra.run.smithi073.stderr:146850K .......... .......... .......... .......... .......... 87% 24.6M 1s 2024-03-29T04:09:19.362 INFO:teuthology.orchestra.run.smithi073.stderr:146900K .......... .......... .......... .......... .......... 87% 42.3M 1s 2024-03-29T04:09:19.362 INFO:teuthology.orchestra.run.smithi073.stderr:146950K .......... .......... .......... .......... .......... 87% 27.8M 1s 2024-03-29T04:09:19.362 INFO:teuthology.orchestra.run.smithi073.stderr:147000K .......... .......... .......... .......... .......... 87% 26.1M 1s 2024-03-29T04:09:19.362 INFO:teuthology.orchestra.run.smithi073.stderr:147050K .......... .......... .......... .......... .......... 87% 29.2M 1s 2024-03-29T04:09:19.362 INFO:teuthology.orchestra.run.smithi073.stderr:147100K .......... .......... .......... .......... .......... 87% 27.6M 1s 2024-03-29T04:09:19.362 INFO:teuthology.orchestra.run.smithi073.stderr:147150K .......... .......... .......... .......... .......... 87% 36.7M 1s 2024-03-29T04:09:19.362 INFO:teuthology.orchestra.run.smithi073.stderr:147200K .......... .......... .......... .......... .......... 87% 21.5M 1s 2024-03-29T04:09:19.363 INFO:teuthology.orchestra.run.smithi073.stderr:147250K .......... .......... .......... .......... .......... 87% 27.5M 1s 2024-03-29T04:09:19.363 INFO:teuthology.orchestra.run.smithi073.stderr:147300K .......... .......... .......... .......... .......... 87% 28.4M 1s 2024-03-29T04:09:19.363 INFO:teuthology.orchestra.run.smithi073.stderr:147350K .......... .......... .......... .......... .......... 87% 27.5M 1s 2024-03-29T04:09:19.363 INFO:teuthology.orchestra.run.smithi073.stderr:147400K .......... .......... .......... .......... .......... 87% 45.0M 1s 2024-03-29T04:09:19.363 INFO:teuthology.orchestra.run.smithi073.stderr:147450K .......... .......... .......... .......... .......... 87% 32.4M 1s 2024-03-29T04:09:19.363 INFO:teuthology.orchestra.run.smithi073.stderr:147500K .......... .......... .......... .......... .......... 87% 28.7M 1s 2024-03-29T04:09:19.363 INFO:teuthology.orchestra.run.smithi073.stderr:147550K .......... .......... .......... .......... .......... 87% 32.0M 1s 2024-03-29T04:09:19.363 INFO:teuthology.orchestra.run.smithi073.stderr:147600K .......... .......... .......... .......... .......... 87% 22.8M 1s 2024-03-29T04:09:19.363 INFO:teuthology.orchestra.run.smithi073.stderr:147650K .......... .......... .......... .......... .......... 87% 24.3M 1s 2024-03-29T04:09:19.363 INFO:teuthology.orchestra.run.smithi073.stderr:147700K .......... .......... .......... .......... .......... 87% 54.8M 1s 2024-03-29T04:09:19.363 INFO:teuthology.orchestra.run.smithi073.stderr:147750K .......... .......... .......... .......... .......... 87% 21.4M 1s 2024-03-29T04:09:19.363 INFO:teuthology.orchestra.run.smithi073.stderr:147800K .......... .......... .......... .......... .......... 87% 29.2M 1s 2024-03-29T04:09:19.363 INFO:teuthology.orchestra.run.smithi073.stderr:147850K .......... .......... .......... .......... .......... 87% 32.5M 1s 2024-03-29T04:09:19.363 INFO:teuthology.orchestra.run.smithi073.stderr:147900K .......... .......... .......... .......... .......... 87% 23.0M 1s 2024-03-29T04:09:19.364 INFO:teuthology.orchestra.run.smithi073.stderr:147950K .......... .......... .......... .......... .......... 87% 37.6M 1s 2024-03-29T04:09:19.364 INFO:teuthology.orchestra.run.smithi073.stderr:148000K .......... .......... .......... .......... .......... 87% 25.6M 1s 2024-03-29T04:09:19.364 INFO:teuthology.orchestra.run.smithi073.stderr:148050K .......... .......... .......... .......... .......... 87% 42.6M 1s 2024-03-29T04:09:19.364 INFO:teuthology.orchestra.run.smithi073.stderr:148100K .......... .......... .......... .......... .......... 87% 22.1M 1s 2024-03-29T04:09:19.364 INFO:teuthology.orchestra.run.smithi073.stderr:148150K .......... .......... .......... .......... .......... 87% 23.1M 1s 2024-03-29T04:09:19.364 INFO:teuthology.orchestra.run.smithi073.stderr:148200K .......... .......... .......... .......... .......... 87% 82.8M 1s 2024-03-29T04:09:19.364 INFO:teuthology.orchestra.run.smithi073.stderr:148250K .......... .......... .......... .......... .......... 87% 23.2M 1s 2024-03-29T04:09:19.364 INFO:teuthology.orchestra.run.smithi073.stderr:148300K .......... .......... .......... .......... .......... 88% 36.6M 1s 2024-03-29T04:09:19.364 INFO:teuthology.orchestra.run.smithi073.stderr:148350K .......... .......... .......... .......... .......... 88% 23.5M 1s 2024-03-29T04:09:19.364 INFO:teuthology.orchestra.run.smithi073.stderr:148400K .......... .......... .......... .......... .......... 88% 21.8M 1s 2024-03-29T04:09:19.364 INFO:teuthology.orchestra.run.smithi073.stderr:148450K .......... .......... .......... .......... .......... 88% 65.7M 1s 2024-03-29T04:09:19.364 INFO:teuthology.orchestra.run.smithi073.stderr:148500K .......... .......... .......... .......... .......... 88% 24.8M 1s 2024-03-29T04:09:19.364 INFO:teuthology.orchestra.run.smithi073.stderr:148550K .......... .......... .......... .......... .......... 88% 36.7M 1s 2024-03-29T04:09:19.365 INFO:teuthology.orchestra.run.smithi073.stderr:148600K .......... .......... .......... .......... .......... 88% 24.4M 1s 2024-03-29T04:09:19.365 INFO:teuthology.orchestra.run.smithi073.stderr:148650K .......... .......... .......... .......... .......... 88% 24.0M 1s 2024-03-29T04:09:19.365 INFO:teuthology.orchestra.run.smithi073.stderr:148700K .......... .......... .......... .......... .......... 88% 39.3M 1s 2024-03-29T04:09:19.365 INFO:teuthology.orchestra.run.smithi073.stderr:148750K .......... .......... .......... .......... .......... 88% 23.8M 1s 2024-03-29T04:09:19.365 INFO:teuthology.orchestra.run.smithi073.stderr:148800K .......... .......... .......... .......... .......... 88% 29.0M 1s 2024-03-29T04:09:19.365 INFO:teuthology.orchestra.run.smithi073.stderr:148850K .......... .......... .......... .......... .......... 88% 26.0M 1s 2024-03-29T04:09:19.365 INFO:teuthology.orchestra.run.smithi073.stderr:148900K .......... .......... .......... .......... .......... 88% 25.5M 1s 2024-03-29T04:09:19.365 INFO:teuthology.orchestra.run.smithi073.stderr:148950K .......... .......... .......... .......... .......... 88% 68.9M 1s 2024-03-29T04:09:19.365 INFO:teuthology.orchestra.run.smithi073.stderr:149000K .......... .......... .......... .......... .......... 88% 19.6M 1s 2024-03-29T04:09:19.365 INFO:teuthology.orchestra.run.smithi073.stderr:149050K .......... .......... .......... .......... .......... 88% 42.5M 1s 2024-03-29T04:09:19.365 INFO:teuthology.orchestra.run.smithi073.stderr:149100K .......... .......... .......... .......... .......... 88% 25.6M 1s 2024-03-29T04:09:19.365 INFO:teuthology.orchestra.run.smithi073.stderr:149150K .......... .......... .......... .......... .......... 88% 19.1M 1s 2024-03-29T04:09:19.365 INFO:teuthology.orchestra.run.smithi073.stderr:149200K .......... .......... .......... .......... .......... 88% 43.6M 1s 2024-03-29T04:09:19.366 INFO:teuthology.orchestra.run.smithi073.stderr:149250K .......... .......... .......... .......... .......... 88% 26.3M 1s 2024-03-29T04:09:19.366 INFO:teuthology.orchestra.run.smithi073.stderr:149300K .......... .......... .......... .......... .......... 88% 27.8M 1s 2024-03-29T04:09:19.366 INFO:teuthology.orchestra.run.smithi073.stderr:149350K .......... .......... .......... .......... .......... 88% 27.4M 1s 2024-03-29T04:09:19.366 INFO:teuthology.orchestra.run.smithi073.stderr:149400K .......... .......... .......... .......... .......... 88% 27.5M 1s 2024-03-29T04:09:19.366 INFO:teuthology.orchestra.run.smithi073.stderr:149450K .......... .......... .......... .......... .......... 88% 40.1M 1s 2024-03-29T04:09:19.366 INFO:teuthology.orchestra.run.smithi073.stderr:149500K .......... .......... .......... .......... .......... 88% 23.5M 1s 2024-03-29T04:09:19.366 INFO:teuthology.orchestra.run.smithi073.stderr:149550K .......... .......... .......... .......... .......... 88% 38.9M 1s 2024-03-29T04:09:19.366 INFO:teuthology.orchestra.run.smithi073.stderr:149600K .......... .......... .......... .......... .......... 88% 28.0M 1s 2024-03-29T04:09:19.366 INFO:teuthology.orchestra.run.smithi073.stderr:149650K .......... .......... .......... .......... .......... 88% 31.0M 1s 2024-03-29T04:09:19.369 INFO:teuthology.orchestra.run.smithi073.stderr:149700K .......... .......... .......... .......... .......... 88% 42.2M 1s 2024-03-29T04:09:19.369 INFO:teuthology.orchestra.run.smithi073.stderr:149750K .......... .......... .......... .......... .......... 88% 27.0M 1s 2024-03-29T04:09:19.369 INFO:teuthology.orchestra.run.smithi073.stderr:149800K .......... .......... .......... .......... .......... 88% 33.1M 1s 2024-03-29T04:09:19.369 INFO:teuthology.orchestra.run.smithi073.stderr:149850K .......... .......... .......... .......... .......... 88% 22.7M 1s 2024-03-29T04:09:19.369 INFO:teuthology.orchestra.run.smithi073.stderr:149900K .......... .......... .......... .......... .......... 88% 19.2M 1s 2024-03-29T04:09:19.369 INFO:teuthology.orchestra.run.smithi073.stderr:149950K .......... .......... .......... .......... .......... 88% 62.8M 1s 2024-03-29T04:09:19.370 INFO:teuthology.orchestra.run.smithi073.stderr:150000K .......... .......... .......... .......... .......... 89% 31.4M 1s 2024-03-29T04:09:19.370 INFO:teuthology.orchestra.run.smithi073.stderr:150050K .......... .......... .......... .......... .......... 89% 35.6M 1s 2024-03-29T04:09:19.370 INFO:teuthology.orchestra.run.smithi073.stderr:150100K .......... .......... .......... .......... .......... 89% 23.2M 1s 2024-03-29T04:09:19.370 INFO:teuthology.orchestra.run.smithi073.stderr:150150K .......... .......... .......... .......... .......... 89% 29.3M 1s 2024-03-29T04:09:19.370 INFO:teuthology.orchestra.run.smithi073.stderr:150200K .......... .......... .......... .......... .......... 89% 36.4M 1s 2024-03-29T04:09:19.370 INFO:teuthology.orchestra.run.smithi073.stderr:150250K .......... .......... .......... .......... .......... 89% 27.3M 1s 2024-03-29T04:09:19.370 INFO:teuthology.orchestra.run.smithi073.stderr:150300K .......... .......... .......... .......... .......... 89% 30.4M 1s 2024-03-29T04:09:19.370 INFO:teuthology.orchestra.run.smithi073.stderr:150350K .......... .......... .......... .......... .......... 89% 26.7M 1s 2024-03-29T04:09:19.370 INFO:teuthology.orchestra.run.smithi073.stderr:150400K .......... .......... .......... .......... .......... 89% 40.8M 1s 2024-03-29T04:09:19.370 INFO:teuthology.orchestra.run.smithi073.stderr:150450K .......... .......... .......... .......... .......... 89% 26.0M 1s 2024-03-29T04:09:19.370 INFO:teuthology.orchestra.run.smithi073.stderr:150500K .......... .......... .......... .......... .......... 89% 25.8M 1s 2024-03-29T04:09:19.371 INFO:teuthology.orchestra.run.smithi073.stderr:150550K .......... .......... .......... .......... .......... 89% 36.3M 1s 2024-03-29T04:09:19.371 INFO:teuthology.orchestra.run.smithi073.stderr:150600K .......... .......... .......... .......... .......... 89% 19.4M 1s 2024-03-29T04:09:19.371 INFO:teuthology.orchestra.run.smithi073.stderr:150650K .......... .......... .......... .......... .......... 89% 68.6M 1s 2024-03-29T04:09:19.371 INFO:teuthology.orchestra.run.smithi073.stderr:150700K .......... .......... .......... .......... .......... 89% 27.8M 1s 2024-03-29T04:09:19.371 INFO:teuthology.orchestra.run.smithi073.stderr:150750K .......... .......... .......... .......... .......... 89% 24.9M 1s 2024-03-29T04:09:19.371 INFO:teuthology.orchestra.run.smithi073.stderr:150800K .......... .......... .......... .......... .......... 89% 30.2M 1s 2024-03-29T04:09:19.371 INFO:teuthology.orchestra.run.smithi073.stderr:150850K .......... .......... .......... .......... .......... 89% 22.6M 1s 2024-03-29T04:09:19.371 INFO:teuthology.orchestra.run.smithi073.stderr:150900K .......... .......... .......... .......... .......... 89% 46.4M 1s 2024-03-29T04:09:19.371 INFO:teuthology.orchestra.run.smithi073.stderr:150950K .......... .......... .......... .......... .......... 89% 26.8M 1s 2024-03-29T04:09:19.371 INFO:teuthology.orchestra.run.smithi073.stderr:151000K .......... .......... .......... .......... .......... 89% 25.5M 1s 2024-03-29T04:09:19.371 INFO:teuthology.orchestra.run.smithi073.stderr:151050K .......... .......... .......... .......... .......... 89% 34.1M 1s 2024-03-29T04:09:19.371 INFO:teuthology.orchestra.run.smithi073.stderr:151100K .......... .......... .......... .......... .......... 89% 21.4M 1s 2024-03-29T04:09:19.371 INFO:teuthology.orchestra.run.smithi073.stderr:151150K .......... .......... .......... .......... .......... 89% 30.7M 1s 2024-03-29T04:09:19.372 INFO:teuthology.orchestra.run.smithi073.stderr:151200K .......... .......... .......... .......... .......... 89% 51.2M 1s 2024-03-29T04:09:19.372 INFO:teuthology.orchestra.run.smithi073.stderr:151250K .......... .......... .......... .......... .......... 89% 22.6M 1s 2024-03-29T04:09:19.372 INFO:teuthology.orchestra.run.smithi073.stderr:151300K .......... .......... .......... .......... .......... 89% 32.2M 1s 2024-03-29T04:09:19.372 INFO:teuthology.orchestra.run.smithi073.stderr:151350K .......... .......... .......... .......... .......... 89% 27.7M 1s 2024-03-29T04:09:19.372 INFO:teuthology.orchestra.run.smithi073.stderr:151400K .......... .......... .......... .......... .......... 89% 25.6M 1s 2024-03-29T04:09:19.372 INFO:teuthology.orchestra.run.smithi073.stderr:151450K .......... .......... .......... .......... .......... 89% 42.0M 1s 2024-03-29T04:09:19.372 INFO:teuthology.orchestra.run.smithi073.stderr:151500K .......... .......... .......... .......... .......... 89% 19.2M 1s 2024-03-29T04:09:19.372 INFO:teuthology.orchestra.run.smithi073.stderr:151550K .......... .......... .......... .......... .......... 89% 23.7M 1s 2024-03-29T04:09:19.372 INFO:teuthology.orchestra.run.smithi073.stderr:151600K .......... .......... .......... .......... .......... 89% 30.5M 1s 2024-03-29T04:09:19.372 INFO:teuthology.orchestra.run.smithi073.stderr:151650K .......... .......... .......... .......... .......... 89% 26.4M 1s 2024-03-29T04:09:19.372 INFO:teuthology.orchestra.run.smithi073.stderr:151700K .......... .......... .......... .......... .......... 90% 37.5M 1s 2024-03-29T04:09:19.373 INFO:teuthology.orchestra.run.smithi073.stderr:151750K .......... .......... .......... .......... .......... 90% 26.4M 1s 2024-03-29T04:09:19.373 INFO:teuthology.orchestra.run.smithi073.stderr:151800K .......... .......... .......... .......... .......... 90% 39.5M 1s 2024-03-29T04:09:19.373 INFO:teuthology.orchestra.run.smithi073.stderr:151850K .......... .......... .......... .......... .......... 90% 39.7M 1s 2024-03-29T04:09:19.373 INFO:teuthology.orchestra.run.smithi073.stderr:151900K .......... .......... .......... .......... .......... 90% 26.7M 1s 2024-03-29T04:09:19.373 INFO:teuthology.orchestra.run.smithi073.stderr:151950K .......... .......... .......... .......... .......... 90% 50.3M 1s 2024-03-29T04:09:19.373 INFO:teuthology.orchestra.run.smithi073.stderr:152000K .......... .......... .......... .......... .......... 90% 24.0M 1s 2024-03-29T04:09:19.373 INFO:teuthology.orchestra.run.smithi073.stderr:152050K .......... .......... .......... .......... .......... 90% 18.3M 1s 2024-03-29T04:09:19.373 INFO:teuthology.orchestra.run.smithi073.stderr:152100K .......... .......... .......... .......... .......... 90% 43.2M 1s 2024-03-29T04:09:19.373 INFO:teuthology.orchestra.run.smithi073.stderr:152150K .......... .......... .......... .......... .......... 90% 27.0M 1s 2024-03-29T04:09:19.373 INFO:teuthology.orchestra.run.smithi073.stderr:152200K .......... .......... .......... .......... .......... 90% 36.9M 1s 2024-03-29T04:09:19.373 INFO:teuthology.orchestra.run.smithi073.stderr:152250K .......... .......... .......... .......... .......... 90% 25.6M 1s 2024-03-29T04:09:19.373 INFO:teuthology.orchestra.run.smithi073.stderr:152300K .......... .......... .......... .......... .......... 90% 24.4M 1s 2024-03-29T04:09:19.374 INFO:teuthology.orchestra.run.smithi073.stderr:152350K .......... .......... .......... .......... .......... 90% 33.3M 1s 2024-03-29T04:09:19.374 INFO:teuthology.orchestra.run.smithi073.stderr:152400K .......... .......... .......... .......... .......... 90% 46.6M 1s 2024-03-29T04:09:19.374 INFO:teuthology.orchestra.run.smithi073.stderr:152450K .......... .......... .......... .......... .......... 90% 24.9M 1s 2024-03-29T04:09:19.374 INFO:teuthology.orchestra.run.smithi073.stderr:152500K .......... .......... .......... .......... .......... 90% 26.0M 1s 2024-03-29T04:09:19.374 INFO:teuthology.orchestra.run.smithi073.stderr:152550K .......... .......... .......... .......... .......... 90% 23.8M 1s 2024-03-29T04:09:19.374 INFO:teuthology.orchestra.run.smithi073.stderr:152600K .......... .......... .......... .......... .......... 90% 36.5M 1s 2024-03-29T04:09:19.374 INFO:teuthology.orchestra.run.smithi073.stderr:152650K .......... .......... .......... .......... .......... 90% 34.6M 1s 2024-03-29T04:09:19.374 INFO:teuthology.orchestra.run.smithi073.stderr:152700K .......... .......... .......... .......... .......... 90% 35.1M 1s 2024-03-29T04:09:19.374 INFO:teuthology.orchestra.run.smithi073.stderr:152750K .......... .......... .......... .......... .......... 90% 26.9M 1s 2024-03-29T04:09:19.374 INFO:teuthology.orchestra.run.smithi073.stderr:152800K .......... .......... .......... .......... .......... 90% 20.6M 1s 2024-03-29T04:09:19.374 INFO:teuthology.orchestra.run.smithi073.stderr:152850K .......... .......... .......... .......... .......... 90% 33.0M 1s 2024-03-29T04:09:19.374 INFO:teuthology.orchestra.run.smithi073.stderr:152900K .......... .......... .......... .......... .......... 90% 35.2M 1s 2024-03-29T04:09:19.375 INFO:teuthology.orchestra.run.smithi073.stderr:152950K .......... .......... .......... .......... .......... 90% 23.2M 1s 2024-03-29T04:09:19.375 INFO:teuthology.orchestra.run.smithi073.stderr:153000K .......... .......... .......... .......... .......... 90% 32.2M 1s 2024-03-29T04:09:19.375 INFO:teuthology.orchestra.run.smithi073.stderr:153050K .......... .......... .......... .......... .......... 90% 19.9M 1s 2024-03-29T04:09:19.375 INFO:teuthology.orchestra.run.smithi073.stderr:153100K .......... .......... .......... .......... .......... 90% 42.2M 1s 2024-03-29T04:09:19.375 INFO:teuthology.orchestra.run.smithi073.stderr:153150K .......... .......... .......... .......... .......... 90% 26.5M 1s 2024-03-29T04:09:19.375 INFO:teuthology.orchestra.run.smithi073.stderr:153200K .......... .......... .......... .......... .......... 90% 35.4M 1s 2024-03-29T04:09:19.375 INFO:teuthology.orchestra.run.smithi073.stderr:153250K .......... .......... .......... .......... .......... 90% 26.8M 1s 2024-03-29T04:09:19.375 INFO:teuthology.orchestra.run.smithi073.stderr:153300K .......... .......... .......... .......... .......... 90% 35.8M 1s 2024-03-29T04:09:19.375 INFO:teuthology.orchestra.run.smithi073.stderr:153350K .......... .......... .......... .......... .......... 91% 28.2M 1s 2024-03-29T04:09:19.375 INFO:teuthology.orchestra.run.smithi073.stderr:153400K .......... .......... .......... .......... .......... 91% 23.8M 1s 2024-03-29T04:09:19.375 INFO:teuthology.orchestra.run.smithi073.stderr:153450K .......... .......... .......... .......... .......... 91% 31.8M 1s 2024-03-29T04:09:19.376 INFO:teuthology.orchestra.run.smithi073.stderr:153500K .......... .......... .......... .......... .......... 91% 32.4M 1s 2024-03-29T04:09:19.376 INFO:teuthology.orchestra.run.smithi073.stderr:153550K .......... .......... .......... .......... .......... 91% 24.4M 1s 2024-03-29T04:09:19.376 INFO:teuthology.orchestra.run.smithi073.stderr:153600K .......... .......... .......... .......... .......... 91% 41.3M 1s 2024-03-29T04:09:19.376 INFO:teuthology.orchestra.run.smithi073.stderr:153650K .......... .......... .......... .......... .......... 91% 26.1M 1s 2024-03-29T04:09:19.376 INFO:teuthology.orchestra.run.smithi073.stderr:153700K .......... .......... .......... .......... .......... 91% 25.0M 1s 2024-03-29T04:09:19.376 INFO:teuthology.orchestra.run.smithi073.stderr:153750K .......... .......... .......... .......... .......... 91% 28.7M 1s 2024-03-29T04:09:19.376 INFO:teuthology.orchestra.run.smithi073.stderr:153800K .......... .......... .......... .......... .......... 91% 26.2M 1s 2024-03-29T04:09:19.376 INFO:teuthology.orchestra.run.smithi073.stderr:153850K .......... .......... .......... .......... .......... 91% 26.2M 1s 2024-03-29T04:09:19.376 INFO:teuthology.orchestra.run.smithi073.stderr:153900K .......... .......... .......... .......... .......... 91% 38.9M 1s 2024-03-29T04:09:19.376 INFO:teuthology.orchestra.run.smithi073.stderr:153950K .......... .......... .......... .......... .......... 91% 23.9M 1s 2024-03-29T04:09:19.376 INFO:teuthology.orchestra.run.smithi073.stderr:154000K .......... .......... .......... .......... .......... 91% 42.0M 1s 2024-03-29T04:09:19.376 INFO:teuthology.orchestra.run.smithi073.stderr:154050K .......... .......... .......... .......... .......... 91% 41.2M 1s 2024-03-29T04:09:19.377 INFO:teuthology.orchestra.run.smithi073.stderr:154100K .......... .......... .......... .......... .......... 91% 20.9M 1s 2024-03-29T04:09:19.377 INFO:teuthology.orchestra.run.smithi073.stderr:154150K .......... .......... .......... .......... .......... 91% 42.8M 1s 2024-03-29T04:09:19.377 INFO:teuthology.orchestra.run.smithi073.stderr:154200K .......... .......... .......... .......... .......... 91% 25.2M 0s 2024-03-29T04:09:19.377 INFO:teuthology.orchestra.run.smithi073.stderr:154250K .......... .......... .......... .......... .......... 91% 26.0M 0s 2024-03-29T04:09:19.377 INFO:teuthology.orchestra.run.smithi073.stderr:154300K .......... .......... .......... .......... .......... 91% 25.9M 0s 2024-03-29T04:09:19.377 INFO:teuthology.orchestra.run.smithi073.stderr:154350K .......... .......... .......... .......... .......... 91% 42.1M 0s 2024-03-29T04:09:19.377 INFO:teuthology.orchestra.run.smithi073.stderr:154400K .......... .......... .......... .......... .......... 91% 24.2M 0s 2024-03-29T04:09:19.377 INFO:teuthology.orchestra.run.smithi073.stderr:154450K .......... .......... .......... .......... .......... 91% 23.1M 0s 2024-03-29T04:09:19.377 INFO:teuthology.orchestra.run.smithi073.stderr:154500K .......... .......... .......... .......... .......... 91% 78.8M 0s 2024-03-29T04:09:19.377 INFO:teuthology.orchestra.run.smithi073.stderr:154550K .......... .......... .......... .......... .......... 91% 25.3M 0s 2024-03-29T04:09:19.377 INFO:teuthology.orchestra.run.smithi073.stderr:154600K .......... .......... .......... .......... .......... 91% 26.2M 0s 2024-03-29T04:09:19.377 INFO:teuthology.orchestra.run.smithi073.stderr:154650K .......... .......... .......... .......... .......... 91% 24.6M 0s 2024-03-29T04:09:19.377 INFO:teuthology.orchestra.run.smithi073.stderr:154700K .......... .......... .......... .......... .......... 91% 24.6M 0s 2024-03-29T04:09:19.378 INFO:teuthology.orchestra.run.smithi073.stderr:154750K .......... .......... .......... .......... .......... 91% 79.9M 0s 2024-03-29T04:09:19.378 INFO:teuthology.orchestra.run.smithi073.stderr:154800K .......... .......... .......... .......... .......... 91% 22.4M 0s 2024-03-29T04:09:19.378 INFO:teuthology.orchestra.run.smithi073.stderr:154850K .......... .......... .......... .......... .......... 91% 43.6M 0s 2024-03-29T04:09:19.378 INFO:teuthology.orchestra.run.smithi073.stderr:154900K .......... .......... .......... .......... .......... 91% 24.0M 0s 2024-03-29T04:09:19.378 INFO:teuthology.orchestra.run.smithi073.stderr:154950K .......... .......... .......... .......... .......... 91% 22.8M 0s 2024-03-29T04:09:19.378 INFO:teuthology.orchestra.run.smithi073.stderr:155000K .......... .......... .......... .......... .......... 91% 44.2M 0s 2024-03-29T04:09:19.378 INFO:teuthology.orchestra.run.smithi073.stderr:155050K .......... .......... .......... .......... .......... 92% 28.3M 0s 2024-03-29T04:09:19.378 INFO:teuthology.orchestra.run.smithi073.stderr:155100K .......... .......... .......... .......... .......... 92% 11.7M 0s 2024-03-29T04:09:19.378 INFO:teuthology.orchestra.run.smithi073.stderr:155150K .......... .......... .......... .......... .......... 92% 212M 0s 2024-03-29T04:09:19.378 INFO:teuthology.orchestra.run.smithi073.stderr:155200K .......... .......... .......... .......... .......... 92% 31.0M 0s 2024-03-29T04:09:19.378 INFO:teuthology.orchestra.run.smithi073.stderr:155250K .......... .......... .......... .......... .......... 92% 60.3M 0s 2024-03-29T04:09:19.378 INFO:teuthology.orchestra.run.smithi073.stderr:155300K .......... .......... .......... .......... .......... 92% 25.9M 0s 2024-03-29T04:09:19.379 INFO:teuthology.orchestra.run.smithi073.stderr:155350K .......... .......... .......... .......... .......... 92% 39.7M 0s 2024-03-29T04:09:19.379 INFO:teuthology.orchestra.run.smithi073.stderr:155400K .......... .......... .......... .......... .......... 92% 25.3M 0s 2024-03-29T04:09:19.379 INFO:teuthology.orchestra.run.smithi073.stderr:155450K .......... .......... .......... .......... .......... 92% 23.6M 0s 2024-03-29T04:09:19.379 INFO:teuthology.orchestra.run.smithi073.stderr:155500K .......... .......... .......... .......... .......... 92% 39.9M 0s 2024-03-29T04:09:19.379 INFO:teuthology.orchestra.run.smithi073.stderr:155550K .......... .......... .......... .......... .......... 92% 31.8M 0s 2024-03-29T04:09:19.379 INFO:teuthology.orchestra.run.smithi073.stderr:155600K .......... .......... .......... .......... .......... 92% 33.2M 0s 2024-03-29T04:09:19.379 INFO:teuthology.orchestra.run.smithi073.stderr:155650K .......... .......... .......... .......... .......... 92% 24.0M 0s 2024-03-29T04:09:19.379 INFO:teuthology.orchestra.run.smithi073.stderr:155700K .......... .......... .......... .......... .......... 92% 25.6M 0s 2024-03-29T04:09:19.379 INFO:teuthology.orchestra.run.smithi073.stderr:155750K .......... .......... .......... .......... .......... 92% 39.6M 0s 2024-03-29T04:09:19.379 INFO:teuthology.orchestra.run.smithi073.stderr:155800K .......... .......... .......... .......... .......... 92% 23.0M 0s 2024-03-29T04:09:19.379 INFO:teuthology.orchestra.run.smithi073.stderr:155850K .......... .......... .......... .......... .......... 92% 41.3M 0s 2024-03-29T04:09:19.379 INFO:teuthology.orchestra.run.smithi073.stderr:155900K .......... .......... .......... .......... .......... 92% 23.7M 0s 2024-03-29T04:09:19.379 INFO:teuthology.orchestra.run.smithi073.stderr:155950K .......... .......... .......... .......... .......... 92% 23.2M 0s 2024-03-29T04:09:19.380 INFO:teuthology.orchestra.run.smithi073.stderr:156000K .......... .......... .......... .......... .......... 92% 42.0M 0s 2024-03-29T04:09:19.380 INFO:teuthology.orchestra.run.smithi073.stderr:156050K .......... .......... .......... .......... .......... 92% 28.5M 0s 2024-03-29T04:09:19.380 INFO:teuthology.orchestra.run.smithi073.stderr:156100K .......... .......... .......... .......... .......... 92% 24.8M 0s 2024-03-29T04:09:19.380 INFO:teuthology.orchestra.run.smithi073.stderr:156150K .......... .......... .......... .......... .......... 92% 37.8M 0s 2024-03-29T04:09:19.380 INFO:teuthology.orchestra.run.smithi073.stderr:156200K .......... .......... .......... .......... .......... 92% 25.0M 0s 2024-03-29T04:09:19.380 INFO:teuthology.orchestra.run.smithi073.stderr:156250K .......... .......... .......... .......... .......... 92% 41.3M 0s 2024-03-29T04:09:19.380 INFO:teuthology.orchestra.run.smithi073.stderr:156300K .......... .......... .......... .......... .......... 92% 22.6M 0s 2024-03-29T04:09:19.380 INFO:teuthology.orchestra.run.smithi073.stderr:156350K .......... .......... .......... .......... .......... 92% 24.1M 0s 2024-03-29T04:09:19.380 INFO:teuthology.orchestra.run.smithi073.stderr:156400K .......... .......... .......... .......... .......... 92% 39.0M 0s 2024-03-29T04:09:19.380 INFO:teuthology.orchestra.run.smithi073.stderr:156450K .......... .......... .......... .......... .......... 92% 24.1M 0s 2024-03-29T04:09:19.380 INFO:teuthology.orchestra.run.smithi073.stderr:156500K .......... .......... .......... .......... .......... 92% 41.1M 0s 2024-03-29T04:09:19.380 INFO:teuthology.orchestra.run.smithi073.stderr:156550K .......... .......... .......... .......... .......... 92% 27.9M 0s 2024-03-29T04:09:19.380 INFO:teuthology.orchestra.run.smithi073.stderr:156600K .......... .......... .......... .......... .......... 92% 26.6M 0s 2024-03-29T04:09:19.381 INFO:teuthology.orchestra.run.smithi073.stderr:156650K .......... .......... .......... .......... .......... 92% 33.3M 0s 2024-03-29T04:09:19.381 INFO:teuthology.orchestra.run.smithi073.stderr:156700K .......... .......... .......... .......... .......... 92% 25.2M 0s 2024-03-29T04:09:19.381 INFO:teuthology.orchestra.run.smithi073.stderr:156750K .......... .......... .......... .......... .......... 93% 41.5M 0s 2024-03-29T04:09:19.381 INFO:teuthology.orchestra.run.smithi073.stderr:156800K .......... .......... .......... .......... .......... 93% 23.2M 0s 2024-03-29T04:09:19.381 INFO:teuthology.orchestra.run.smithi073.stderr:156850K .......... .......... .......... .......... .......... 93% 25.0M 0s 2024-03-29T04:09:19.381 INFO:teuthology.orchestra.run.smithi073.stderr:156900K .......... .......... .......... .......... .......... 93% 35.7M 0s 2024-03-29T04:09:19.381 INFO:teuthology.orchestra.run.smithi073.stderr:156950K .......... .......... .......... .......... .......... 93% 24.4M 0s 2024-03-29T04:09:19.381 INFO:teuthology.orchestra.run.smithi073.stderr:157000K .......... .......... .......... .......... .......... 93% 41.4M 0s 2024-03-29T04:09:19.381 INFO:teuthology.orchestra.run.smithi073.stderr:157050K .......... .......... .......... .......... .......... 93% 23.4M 0s 2024-03-29T04:09:19.381 INFO:teuthology.orchestra.run.smithi073.stderr:157100K .......... .......... .......... .......... .......... 93% 29.5M 0s 2024-03-29T04:09:19.381 INFO:teuthology.orchestra.run.smithi073.stderr:157150K .......... .......... .......... .......... .......... 93% 25.5M 0s 2024-03-29T04:09:19.381 INFO:teuthology.orchestra.run.smithi073.stderr:157200K .......... .......... .......... .......... .......... 93% 67.3M 0s 2024-03-29T04:09:19.381 INFO:teuthology.orchestra.run.smithi073.stderr:157250K .......... .......... .......... .......... .......... 93% 25.5M 0s 2024-03-29T04:09:19.381 INFO:teuthology.orchestra.run.smithi073.stderr:157300K .......... .......... .......... .......... .......... 93% 23.2M 0s 2024-03-29T04:09:19.382 INFO:teuthology.orchestra.run.smithi073.stderr:157350K .......... .......... .......... .......... .......... 93% 28.7M 0s 2024-03-29T04:09:19.382 INFO:teuthology.orchestra.run.smithi073.stderr:157400K .......... .......... .......... .......... .......... 93% 28.8M 0s 2024-03-29T04:09:19.382 INFO:teuthology.orchestra.run.smithi073.stderr:157450K .......... .......... .......... .......... .......... 93% 22.8M 0s 2024-03-29T04:09:19.382 INFO:teuthology.orchestra.run.smithi073.stderr:157500K .......... .......... .......... .......... .......... 93% 48.1M 0s 2024-03-29T04:09:19.382 INFO:teuthology.orchestra.run.smithi073.stderr:157550K .......... .......... .......... .......... .......... 93% 28.7M 0s 2024-03-29T04:09:19.382 INFO:teuthology.orchestra.run.smithi073.stderr:157600K .......... .......... .......... .......... .......... 93% 25.5M 0s 2024-03-29T04:09:19.382 INFO:teuthology.orchestra.run.smithi073.stderr:157650K .......... .......... .......... .......... .......... 93% 34.0M 0s 2024-03-29T04:09:19.382 INFO:teuthology.orchestra.run.smithi073.stderr:157700K .......... .......... .......... .......... .......... 93% 24.4M 0s 2024-03-29T04:09:19.382 INFO:teuthology.orchestra.run.smithi073.stderr:157750K .......... .......... .......... .......... .......... 93% 39.1M 0s 2024-03-29T04:09:19.382 INFO:teuthology.orchestra.run.smithi073.stderr:157800K .......... .......... .......... .......... .......... 93% 23.4M 0s 2024-03-29T04:09:19.382 INFO:teuthology.orchestra.run.smithi073.stderr:157850K .......... .......... .......... .......... .......... 93% 21.9M 0s 2024-03-29T04:09:19.382 INFO:teuthology.orchestra.run.smithi073.stderr:157900K .......... .......... .......... .......... .......... 93% 37.5M 0s 2024-03-29T04:09:19.383 INFO:teuthology.orchestra.run.smithi073.stderr:157950K .......... .......... .......... .......... .......... 93% 29.2M 0s 2024-03-29T04:09:19.383 INFO:teuthology.orchestra.run.smithi073.stderr:158000K .......... .......... .......... .......... .......... 93% 26.7M 0s 2024-03-29T04:09:19.383 INFO:teuthology.orchestra.run.smithi073.stderr:158050K .......... .......... .......... .......... .......... 93% 278K 0s 2024-03-29T04:09:19.383 INFO:teuthology.orchestra.run.smithi073.stderr:158100K .......... .......... .......... .......... .......... 93% 603M 0s 2024-03-29T04:09:19.383 INFO:teuthology.orchestra.run.smithi073.stderr:158150K .......... .......... .......... .......... .......... 93% 637M 0s 2024-03-29T04:09:19.383 INFO:teuthology.orchestra.run.smithi073.stderr:158200K .......... .......... .......... .......... .......... 93% 573M 0s 2024-03-29T04:09:19.383 INFO:teuthology.orchestra.run.smithi073.stderr:158250K .......... .......... .......... .......... .......... 93% 464M 0s 2024-03-29T04:09:19.383 INFO:teuthology.orchestra.run.smithi073.stderr:158300K .......... .......... .......... .......... .......... 93% 560M 0s 2024-03-29T04:09:19.383 INFO:teuthology.orchestra.run.smithi073.stderr:158350K .......... .......... .......... .......... .......... 93% 620M 0s 2024-03-29T04:09:19.383 INFO:teuthology.orchestra.run.smithi073.stderr:158400K .......... .......... .......... .......... .......... 93% 644M 0s 2024-03-29T04:09:19.383 INFO:teuthology.orchestra.run.smithi073.stderr:158450K .......... .......... .......... .......... .......... 94% 566M 0s 2024-03-29T04:09:19.383 INFO:teuthology.orchestra.run.smithi073.stderr:158500K .......... .......... .......... .......... .......... 94% 609M 0s 2024-03-29T04:09:19.383 INFO:teuthology.orchestra.run.smithi073.stderr:158550K .......... .......... .......... .......... .......... 94% 642M 0s 2024-03-29T04:09:19.384 INFO:teuthology.orchestra.run.smithi073.stderr:158600K .......... .......... .......... .......... .......... 94% 613M 0s 2024-03-29T04:09:19.384 INFO:teuthology.orchestra.run.smithi073.stderr:158650K .......... .......... .......... .......... .......... 94% 594M 0s 2024-03-29T04:09:19.384 INFO:teuthology.orchestra.run.smithi073.stderr:158700K .......... .......... .......... .......... .......... 94% 660M 0s 2024-03-29T04:09:19.384 INFO:teuthology.orchestra.run.smithi073.stderr:158750K .......... .......... .......... .......... .......... 94% 636M 0s 2024-03-29T04:09:19.384 INFO:teuthology.orchestra.run.smithi073.stderr:158800K .......... .......... .......... .......... .......... 94% 658M 0s 2024-03-29T04:09:19.384 INFO:teuthology.orchestra.run.smithi073.stderr:158850K .......... .......... .......... .......... .......... 94% 544M 0s 2024-03-29T04:09:19.384 INFO:teuthology.orchestra.run.smithi073.stderr:158900K .......... .......... .......... .......... .......... 94% 708M 0s 2024-03-29T04:09:19.384 INFO:teuthology.orchestra.run.smithi073.stderr:158950K .......... .......... .......... .......... .......... 94% 632M 0s 2024-03-29T04:09:19.384 INFO:teuthology.orchestra.run.smithi073.stderr:159000K .......... .......... .......... .......... .......... 94% 671M 0s 2024-03-29T04:09:19.384 INFO:teuthology.orchestra.run.smithi073.stderr:159050K .......... .......... .......... .......... .......... 94% 578M 0s 2024-03-29T04:09:19.384 INFO:teuthology.orchestra.run.smithi073.stderr:159100K .......... .......... .......... .......... .......... 94% 645M 0s 2024-03-29T04:09:19.384 INFO:teuthology.orchestra.run.smithi073.stderr:159150K .......... .......... .......... .......... .......... 94% 658M 0s 2024-03-29T04:09:19.384 INFO:teuthology.orchestra.run.smithi073.stderr:159200K .......... .......... .......... .......... .......... 94% 661M 0s 2024-03-29T04:09:19.385 INFO:teuthology.orchestra.run.smithi073.stderr:159250K .......... .......... .......... .......... .......... 94% 578M 0s 2024-03-29T04:09:19.385 INFO:teuthology.orchestra.run.smithi073.stderr:159300K .......... .......... .......... .......... .......... 94% 686M 0s 2024-03-29T04:09:19.385 INFO:teuthology.orchestra.run.smithi073.stderr:159350K .......... .......... .......... .......... .......... 94% 715M 0s 2024-03-29T04:09:19.385 INFO:teuthology.orchestra.run.smithi073.stderr:159400K .......... .......... .......... .......... .......... 94% 714M 0s 2024-03-29T04:09:19.385 INFO:teuthology.orchestra.run.smithi073.stderr:159450K .......... .......... .......... .......... .......... 94% 618M 0s 2024-03-29T04:09:19.385 INFO:teuthology.orchestra.run.smithi073.stderr:159500K .......... .......... .......... .......... .......... 94% 664M 0s 2024-03-29T04:09:19.385 INFO:teuthology.orchestra.run.smithi073.stderr:159550K .......... .......... .......... .......... .......... 94% 681M 0s 2024-03-29T04:09:19.385 INFO:teuthology.orchestra.run.smithi073.stderr:159600K .......... .......... .......... .......... .......... 94% 706M 0s 2024-03-29T04:09:19.385 INFO:teuthology.orchestra.run.smithi073.stderr:159650K .......... .......... .......... .......... .......... 94% 610M 0s 2024-03-29T04:09:19.385 INFO:teuthology.orchestra.run.smithi073.stderr:159700K .......... .......... .......... .......... .......... 94% 710M 0s 2024-03-29T04:09:19.385 INFO:teuthology.orchestra.run.smithi073.stderr:159750K .......... .......... .......... .......... .......... 94% 700M 0s 2024-03-29T04:09:19.385 INFO:teuthology.orchestra.run.smithi073.stderr:159800K .......... .......... .......... .......... .......... 94% 732M 0s 2024-03-29T04:09:19.385 INFO:teuthology.orchestra.run.smithi073.stderr:159850K .......... .......... .......... .......... .......... 94% 564M 0s 2024-03-29T04:09:19.385 INFO:teuthology.orchestra.run.smithi073.stderr:159900K .......... .......... .......... .......... .......... 94% 646M 0s 2024-03-29T04:09:19.386 INFO:teuthology.orchestra.run.smithi073.stderr:159950K .......... .......... .......... .......... .......... 94% 693M 0s 2024-03-29T04:09:19.386 INFO:teuthology.orchestra.run.smithi073.stderr:160000K .......... .......... .......... .......... .......... 94% 670M 0s 2024-03-29T04:09:19.386 INFO:teuthology.orchestra.run.smithi073.stderr:160050K .......... .......... .......... .......... .......... 94% 610M 0s 2024-03-29T04:09:19.386 INFO:teuthology.orchestra.run.smithi073.stderr:160100K .......... .......... .......... .......... .......... 95% 705M 0s 2024-03-29T04:09:19.386 INFO:teuthology.orchestra.run.smithi073.stderr:160150K .......... .......... .......... .......... .......... 95% 671M 0s 2024-03-29T04:09:19.386 INFO:teuthology.orchestra.run.smithi073.stderr:160200K .......... .......... .......... .......... .......... 95% 673M 0s 2024-03-29T04:09:19.386 INFO:teuthology.orchestra.run.smithi073.stderr:160250K .......... .......... .......... .......... .......... 95% 601M 0s 2024-03-29T04:09:19.386 INFO:teuthology.orchestra.run.smithi073.stderr:160300K .......... .......... .......... .......... .......... 95% 705M 0s 2024-03-29T04:09:19.386 INFO:teuthology.orchestra.run.smithi073.stderr:160350K .......... .......... .......... .......... .......... 95% 708M 0s 2024-03-29T04:09:19.386 INFO:teuthology.orchestra.run.smithi073.stderr:160400K .......... .......... .......... .......... .......... 95% 718M 0s 2024-03-29T04:09:19.386 INFO:teuthology.orchestra.run.smithi073.stderr:160450K .......... .......... .......... .......... .......... 95% 627M 0s 2024-03-29T04:09:19.386 INFO:teuthology.orchestra.run.smithi073.stderr:160500K .......... .......... .......... .......... .......... 95% 679M 0s 2024-03-29T04:09:19.387 INFO:teuthology.orchestra.run.smithi073.stderr:160550K .......... .......... .......... .......... .......... 95% 692M 0s 2024-03-29T04:09:19.387 INFO:teuthology.orchestra.run.smithi073.stderr:160600K .......... .......... .......... .......... .......... 95% 438M 0s 2024-03-29T04:09:19.387 INFO:teuthology.orchestra.run.smithi073.stderr:160650K .......... .......... .......... .......... .......... 95% 413M 0s 2024-03-29T04:09:19.387 INFO:teuthology.orchestra.run.smithi073.stderr:160700K .......... .......... .......... .......... .......... 95% 601M 0s 2024-03-29T04:09:19.387 INFO:teuthology.orchestra.run.smithi073.stderr:160750K .......... .......... .......... .......... .......... 95% 663M 0s 2024-03-29T04:09:19.387 INFO:teuthology.orchestra.run.smithi073.stderr:160800K .......... .......... .......... .......... .......... 95% 680M 0s 2024-03-29T04:09:19.387 INFO:teuthology.orchestra.run.smithi073.stderr:160850K .......... .......... .......... .......... .......... 95% 598M 0s 2024-03-29T04:09:19.387 INFO:teuthology.orchestra.run.smithi073.stderr:160900K .......... .......... .......... .......... .......... 95% 725M 0s 2024-03-29T04:09:19.387 INFO:teuthology.orchestra.run.smithi073.stderr:160950K .......... .......... .......... .......... .......... 95% 720M 0s 2024-03-29T04:09:19.387 INFO:teuthology.orchestra.run.smithi073.stderr:161000K .......... .......... .......... .......... .......... 95% 719M 0s 2024-03-29T04:09:19.387 INFO:teuthology.orchestra.run.smithi073.stderr:161050K .......... .......... .......... .......... .......... 95% 654M 0s 2024-03-29T04:09:19.387 INFO:teuthology.orchestra.run.smithi073.stderr:161100K .......... .......... .......... .......... .......... 95% 726M 0s 2024-03-29T04:09:19.387 INFO:teuthology.orchestra.run.smithi073.stderr:161150K .......... .......... .......... .......... .......... 95% 724M 0s 2024-03-29T04:09:19.388 INFO:teuthology.orchestra.run.smithi073.stderr:161200K .......... .......... .......... .......... .......... 95% 721M 0s 2024-03-29T04:09:19.388 INFO:teuthology.orchestra.run.smithi073.stderr:161250K .......... .......... .......... .......... .......... 95% 616M 0s 2024-03-29T04:09:19.388 INFO:teuthology.orchestra.run.smithi073.stderr:161300K .......... .......... .......... .......... .......... 95% 756M 0s 2024-03-29T04:09:19.388 INFO:teuthology.orchestra.run.smithi073.stderr:161350K .......... .......... .......... .......... .......... 95% 725M 0s 2024-03-29T04:09:19.388 INFO:teuthology.orchestra.run.smithi073.stderr:161400K .......... .......... .......... .......... .......... 95% 713M 0s 2024-03-29T04:09:19.388 INFO:teuthology.orchestra.run.smithi073.stderr:161450K .......... .......... .......... .......... .......... 95% 597M 0s 2024-03-29T04:09:19.388 INFO:teuthology.orchestra.run.smithi073.stderr:161500K .......... .......... .......... .......... .......... 95% 691M 0s 2024-03-29T04:09:19.388 INFO:teuthology.orchestra.run.smithi073.stderr:161550K .......... .......... .......... .......... .......... 95% 667M 0s 2024-03-29T04:09:19.388 INFO:teuthology.orchestra.run.smithi073.stderr:161600K .......... .......... .......... .......... .......... 95% 751M 0s 2024-03-29T04:09:19.388 INFO:teuthology.orchestra.run.smithi073.stderr:161650K .......... .......... .......... .......... .......... 95% 587M 0s 2024-03-29T04:09:19.388 INFO:teuthology.orchestra.run.smithi073.stderr:161700K .......... .......... .......... .......... .......... 95% 717M 0s 2024-03-29T04:09:19.388 INFO:teuthology.orchestra.run.smithi073.stderr:161750K .......... .......... .......... .......... .......... 95% 687M 0s 2024-03-29T04:09:19.388 INFO:teuthology.orchestra.run.smithi073.stderr:161800K .......... .......... .......... .......... .......... 96% 698M 0s 2024-03-29T04:09:19.389 INFO:teuthology.orchestra.run.smithi073.stderr:161850K .......... .......... .......... .......... .......... 96% 631M 0s 2024-03-29T04:09:19.389 INFO:teuthology.orchestra.run.smithi073.stderr:161900K .......... .......... .......... .......... .......... 96% 727M 0s 2024-03-29T04:09:19.389 INFO:teuthology.orchestra.run.smithi073.stderr:161950K .......... .......... .......... .......... .......... 96% 732M 0s 2024-03-29T04:09:19.389 INFO:teuthology.orchestra.run.smithi073.stderr:162000K .......... .......... .......... .......... .......... 96% 700M 0s 2024-03-29T04:09:19.389 INFO:teuthology.orchestra.run.smithi073.stderr:162050K .......... .......... .......... .......... .......... 96% 622M 0s 2024-03-29T04:09:19.389 INFO:teuthology.orchestra.run.smithi073.stderr:162100K .......... .......... .......... .......... .......... 96% 8.65M 0s 2024-03-29T04:09:19.389 INFO:teuthology.orchestra.run.smithi073.stderr:162150K .......... .......... .......... .......... .......... 96% 2.00M 0s 2024-03-29T04:09:19.389 INFO:teuthology.orchestra.run.smithi073.stderr:162200K .......... .......... .......... .......... .......... 96% 115M 0s 2024-03-29T04:09:19.389 INFO:teuthology.orchestra.run.smithi073.stderr:162250K .......... .......... .......... .......... .......... 96% 111M 0s 2024-03-29T04:09:19.389 INFO:teuthology.orchestra.run.smithi073.stderr:162300K .......... .......... .......... .......... .......... 96% 111M 0s 2024-03-29T04:09:19.389 INFO:teuthology.orchestra.run.smithi073.stderr:162350K .......... .......... .......... .......... .......... 96% 111M 0s 2024-03-29T04:09:19.389 INFO:teuthology.orchestra.run.smithi073.stderr:162400K .......... .......... .......... .......... .......... 96% 105M 0s 2024-03-29T04:09:19.389 INFO:teuthology.orchestra.run.smithi073.stderr:162450K .......... .......... .......... .......... .......... 96% 116M 0s 2024-03-29T04:09:19.390 INFO:teuthology.orchestra.run.smithi073.stderr:162500K .......... .......... .......... .......... .......... 96% 45.1M 0s 2024-03-29T04:09:19.390 INFO:teuthology.orchestra.run.smithi073.stderr:162550K .......... .......... .......... .......... .......... 96% 41.7M 0s 2024-03-29T04:09:19.390 INFO:teuthology.orchestra.run.smithi073.stderr:162600K .......... .......... .......... .......... .......... 96% 25.6M 0s 2024-03-29T04:09:19.390 INFO:teuthology.orchestra.run.smithi073.stderr:162650K .......... .......... .......... .......... .......... 96% 23.7M 0s 2024-03-29T04:09:19.390 INFO:teuthology.orchestra.run.smithi073.stderr:162700K .......... .......... .......... .......... .......... 96% 38.3M 0s 2024-03-29T04:09:19.390 INFO:teuthology.orchestra.run.smithi073.stderr:162750K .......... .......... .......... .......... .......... 96% 25.1M 0s 2024-03-29T04:09:19.390 INFO:teuthology.orchestra.run.smithi073.stderr:162800K .......... .......... .......... .......... .......... 96% 41.8M 0s 2024-03-29T04:09:19.390 INFO:teuthology.orchestra.run.smithi073.stderr:162850K .......... .......... .......... .......... .......... 96% 23.9M 0s 2024-03-29T04:09:19.390 INFO:teuthology.orchestra.run.smithi073.stderr:162900K .......... .......... .......... .......... .......... 96% 25.5M 0s 2024-03-29T04:09:19.390 INFO:teuthology.orchestra.run.smithi073.stderr:162950K .......... .......... .......... .......... .......... 96% 35.2M 0s 2024-03-29T04:09:19.390 INFO:teuthology.orchestra.run.smithi073.stderr:163000K .......... .......... .......... .......... .......... 96% 26.1M 0s 2024-03-29T04:09:19.390 INFO:teuthology.orchestra.run.smithi073.stderr:163050K .......... .......... .......... .......... .......... 96% 37.9M 0s 2024-03-29T04:09:19.391 INFO:teuthology.orchestra.run.smithi073.stderr:163100K .......... .......... .......... .......... .......... 96% 29.6M 0s 2024-03-29T04:09:19.391 INFO:teuthology.orchestra.run.smithi073.stderr:163150K .......... .......... .......... .......... .......... 96% 21.3M 0s 2024-03-29T04:09:19.391 INFO:teuthology.orchestra.run.smithi073.stderr:163200K .......... .......... .......... .......... .......... 96% 38.8M 0s 2024-03-29T04:09:19.391 INFO:teuthology.orchestra.run.smithi073.stderr:163250K .......... .......... .......... .......... .......... 96% 25.8M 0s 2024-03-29T04:09:19.391 INFO:teuthology.orchestra.run.smithi073.stderr:163300K .......... .......... .......... .......... .......... 96% 23.1M 0s 2024-03-29T04:09:19.391 INFO:teuthology.orchestra.run.smithi073.stderr:163350K .......... .......... .......... .......... .......... 96% 46.1M 0s 2024-03-29T04:09:19.391 INFO:teuthology.orchestra.run.smithi073.stderr:163400K .......... .......... .......... .......... .......... 96% 24.1M 0s 2024-03-29T04:09:19.391 INFO:teuthology.orchestra.run.smithi073.stderr:163450K .......... .......... .......... .......... .......... 96% 37.9M 0s 2024-03-29T04:09:19.391 INFO:teuthology.orchestra.run.smithi073.stderr:163500K .......... .......... .......... .......... .......... 97% 20.7M 0s 2024-03-29T04:09:19.391 INFO:teuthology.orchestra.run.smithi073.stderr:163550K .......... .......... .......... .......... .......... 97% 23.3M 0s 2024-03-29T04:09:19.391 INFO:teuthology.orchestra.run.smithi073.stderr:163600K .......... .......... .......... .......... .......... 97% 57.8M 0s 2024-03-29T04:09:19.391 INFO:teuthology.orchestra.run.smithi073.stderr:163650K .......... .......... .......... .......... .......... 97% 26.2M 0s 2024-03-29T04:09:19.391 INFO:teuthology.orchestra.run.smithi073.stderr:163700K .......... .......... .......... .......... .......... 97% 39.1M 0s 2024-03-29T04:09:19.392 INFO:teuthology.orchestra.run.smithi073.stderr:163750K .......... .......... .......... .......... .......... 97% 23.1M 0s 2024-03-29T04:09:19.392 INFO:teuthology.orchestra.run.smithi073.stderr:163800K .......... .......... .......... .......... .......... 97% 25.0M 0s 2024-03-29T04:09:19.392 INFO:teuthology.orchestra.run.smithi073.stderr:163850K .......... .......... .......... .......... .......... 97% 39.0M 0s 2024-03-29T04:09:19.392 INFO:teuthology.orchestra.run.smithi073.stderr:163900K .......... .......... .......... .......... .......... 97% 23.2M 0s 2024-03-29T04:09:19.392 INFO:teuthology.orchestra.run.smithi073.stderr:163950K .......... .......... .......... .......... .......... 97% 41.9M 0s 2024-03-29T04:09:19.392 INFO:teuthology.orchestra.run.smithi073.stderr:164000K .......... .......... .......... .......... .......... 97% 30.6M 0s 2024-03-29T04:09:19.392 INFO:teuthology.orchestra.run.smithi073.stderr:164050K .......... .......... .......... .......... .......... 97% 24.7M 0s 2024-03-29T04:09:19.392 INFO:teuthology.orchestra.run.smithi073.stderr:164100K .......... .......... .......... .......... .......... 97% 41.6M 0s 2024-03-29T04:09:19.392 INFO:teuthology.orchestra.run.smithi073.stderr:164150K .......... .......... .......... .......... .......... 97% 23.1M 0s 2024-03-29T04:09:19.392 INFO:teuthology.orchestra.run.smithi073.stderr:164200K .......... .......... .......... .......... .......... 97% 38.8M 0s 2024-03-29T04:09:19.392 INFO:teuthology.orchestra.run.smithi073.stderr:164250K .......... .......... .......... .......... .......... 97% 20.6M 0s 2024-03-29T04:09:19.392 INFO:teuthology.orchestra.run.smithi073.stderr:164300K .......... .......... .......... .......... .......... 97% 25.8M 0s 2024-03-29T04:09:19.392 INFO:teuthology.orchestra.run.smithi073.stderr:164350K .......... .......... .......... .......... .......... 97% 67.2M 0s 2024-03-29T04:09:19.393 INFO:teuthology.orchestra.run.smithi073.stderr:164400K .......... .......... .......... .......... .......... 97% 26.5M 0s 2024-03-29T04:09:19.393 INFO:teuthology.orchestra.run.smithi073.stderr:164450K .......... .......... .......... .......... .......... 97% 25.2M 0s 2024-03-29T04:09:19.393 INFO:teuthology.orchestra.run.smithi073.stderr:164500K .......... .......... .......... .......... .......... 97% 598K 0s 2024-03-29T04:09:19.393 INFO:teuthology.orchestra.run.smithi073.stderr:164550K .......... .......... .......... .......... .......... 97% 36.9M 0s 2024-03-29T04:09:19.393 INFO:teuthology.orchestra.run.smithi073.stderr:164600K .......... .......... .......... .......... .......... 97% 114M 0s 2024-03-29T04:09:19.393 INFO:teuthology.orchestra.run.smithi073.stderr:164650K .......... .......... .......... .......... .......... 97% 32.2M 0s 2024-03-29T04:09:19.393 INFO:teuthology.orchestra.run.smithi073.stderr:164700K .......... .......... .......... .......... .......... 97% 63.4M 0s 2024-03-29T04:09:19.393 INFO:teuthology.orchestra.run.smithi073.stderr:164750K .......... .......... .......... .......... .......... 97% 640M 0s 2024-03-29T04:09:19.393 INFO:teuthology.orchestra.run.smithi073.stderr:164800K .......... .......... .......... .......... .......... 97% 603M 0s 2024-03-29T04:09:19.393 INFO:teuthology.orchestra.run.smithi073.stderr:164850K .......... .......... .......... .......... .......... 97% 711M 0s 2024-03-29T04:09:19.393 INFO:teuthology.orchestra.run.smithi073.stderr:164900K .......... .......... .......... .......... .......... 97% 659M 0s 2024-03-29T04:09:19.393 INFO:teuthology.orchestra.run.smithi073.stderr:164950K .......... .......... .......... .......... .......... 97% 725M 0s 2024-03-29T04:09:19.393 INFO:teuthology.orchestra.run.smithi073.stderr:165000K .......... .......... .......... .......... .......... 97% 594M 0s 2024-03-29T04:09:19.394 INFO:teuthology.orchestra.run.smithi073.stderr:165050K .......... .......... .......... .......... .......... 97% 613M 0s 2024-03-29T04:09:19.394 INFO:teuthology.orchestra.run.smithi073.stderr:165100K .......... .......... .......... .......... .......... 97% 633M 0s 2024-03-29T04:09:19.394 INFO:teuthology.orchestra.run.smithi073.stderr:165150K .......... .......... .......... .......... .......... 98% 656M 0s 2024-03-29T04:09:19.394 INFO:teuthology.orchestra.run.smithi073.stderr:165200K .......... .......... .......... .......... .......... 98% 622M 0s 2024-03-29T04:09:19.394 INFO:teuthology.orchestra.run.smithi073.stderr:165250K .......... .......... .......... .......... .......... 98% 625M 0s 2024-03-29T04:09:19.394 INFO:teuthology.orchestra.run.smithi073.stderr:165300K .......... .......... .......... .......... .......... 98% 624M 0s 2024-03-29T04:09:19.394 INFO:teuthology.orchestra.run.smithi073.stderr:165350K .......... .......... .......... .......... .......... 98% 700M 0s 2024-03-29T04:09:19.394 INFO:teuthology.orchestra.run.smithi073.stderr:165400K .......... .......... .......... .......... .......... 98% 615M 0s 2024-03-29T04:09:19.394 INFO:teuthology.orchestra.run.smithi073.stderr:165450K .......... .......... .......... .......... .......... 98% 665M 0s 2024-03-29T04:09:19.394 INFO:teuthology.orchestra.run.smithi073.stderr:165500K .......... .......... .......... .......... .......... 98% 658M 0s 2024-03-29T04:09:19.394 INFO:teuthology.orchestra.run.smithi073.stderr:165550K .......... .......... .......... .......... .......... 98% 687M 0s 2024-03-29T04:09:19.394 INFO:teuthology.orchestra.run.smithi073.stderr:165600K .......... .......... .......... .......... .......... 98% 560M 0s 2024-03-29T04:09:19.394 INFO:teuthology.orchestra.run.smithi073.stderr:165650K .......... .......... .......... .......... .......... 98% 710M 0s 2024-03-29T04:09:19.395 INFO:teuthology.orchestra.run.smithi073.stderr:165700K .......... .......... .......... .......... .......... 98% 708M 0s 2024-03-29T04:09:19.395 INFO:teuthology.orchestra.run.smithi073.stderr:165750K .......... .......... .......... .......... .......... 98% 673M 0s 2024-03-29T04:09:19.395 INFO:teuthology.orchestra.run.smithi073.stderr:165800K .......... .......... .......... .......... .......... 98% 615M 0s 2024-03-29T04:09:19.395 INFO:teuthology.orchestra.run.smithi073.stderr:165850K .......... .......... .......... .......... .......... 98% 724M 0s 2024-03-29T04:09:19.395 INFO:teuthology.orchestra.run.smithi073.stderr:165900K .......... .......... .......... .......... .......... 98% 718M 0s 2024-03-29T04:09:19.395 INFO:teuthology.orchestra.run.smithi073.stderr:165950K .......... .......... .......... .......... .......... 98% 699M 0s 2024-03-29T04:09:19.395 INFO:teuthology.orchestra.run.smithi073.stderr:166000K .......... .......... .......... .......... .......... 98% 592M 0s 2024-03-29T04:09:19.395 INFO:teuthology.orchestra.run.smithi073.stderr:166050K .......... .......... .......... .......... .......... 98% 652M 0s 2024-03-29T04:09:19.395 INFO:teuthology.orchestra.run.smithi073.stderr:166100K .......... .......... .......... .......... .......... 98% 649M 0s 2024-03-29T04:09:19.395 INFO:teuthology.orchestra.run.smithi073.stderr:166150K .......... .......... .......... .......... .......... 98% 636M 0s 2024-03-29T04:09:19.395 INFO:teuthology.orchestra.run.smithi073.stderr:166200K .......... .......... .......... .......... .......... 98% 576M 0s 2024-03-29T04:09:19.395 INFO:teuthology.orchestra.run.smithi073.stderr:166250K .......... .......... .......... .......... .......... 98% 617M 0s 2024-03-29T04:09:19.395 INFO:teuthology.orchestra.run.smithi073.stderr:166300K .......... .......... .......... .......... .......... 98% 693M 0s 2024-03-29T04:09:19.396 INFO:teuthology.orchestra.run.smithi073.stderr:166350K .......... .......... .......... .......... .......... 98% 706M 0s 2024-03-29T04:09:19.396 INFO:teuthology.orchestra.run.smithi073.stderr:166400K .......... .......... .......... .......... .......... 98% 624M 0s 2024-03-29T04:09:19.396 INFO:teuthology.orchestra.run.smithi073.stderr:166450K .......... .......... .......... .......... .......... 98% 744M 0s 2024-03-29T04:09:19.396 INFO:teuthology.orchestra.run.smithi073.stderr:166500K .......... .......... .......... .......... .......... 98% 703M 0s 2024-03-29T04:09:19.396 INFO:teuthology.orchestra.run.smithi073.stderr:166550K .......... .......... .......... .......... .......... 98% 708M 0s 2024-03-29T04:09:19.396 INFO:teuthology.orchestra.run.smithi073.stderr:166600K .......... .......... .......... .......... .......... 98% 580M 0s 2024-03-29T04:09:19.396 INFO:teuthology.orchestra.run.smithi073.stderr:166650K .......... .......... .......... .......... .......... 98% 648M 0s 2024-03-29T04:09:19.396 INFO:teuthology.orchestra.run.smithi073.stderr:166700K .......... .......... .......... .......... .......... 98% 623M 0s 2024-03-29T04:09:19.396 INFO:teuthology.orchestra.run.smithi073.stderr:166750K .......... .......... .......... .......... .......... 98% 618M 0s 2024-03-29T04:09:19.396 INFO:teuthology.orchestra.run.smithi073.stderr:166800K .......... .......... .......... .......... .......... 98% 548M 0s 2024-03-29T04:09:19.396 INFO:teuthology.orchestra.run.smithi073.stderr:166850K .......... .......... .......... .......... .......... 99% 701M 0s 2024-03-29T04:09:19.396 INFO:teuthology.orchestra.run.smithi073.stderr:166900K .......... .......... .......... .......... .......... 99% 664M 0s 2024-03-29T04:09:19.396 INFO:teuthology.orchestra.run.smithi073.stderr:166950K .......... .......... .......... .......... .......... 99% 696M 0s 2024-03-29T04:09:19.397 INFO:teuthology.orchestra.run.smithi073.stderr:167000K .......... .......... .......... .......... .......... 99% 565M 0s 2024-03-29T04:09:19.397 INFO:teuthology.orchestra.run.smithi073.stderr:167050K .......... .......... .......... .......... .......... 99% 707M 0s 2024-03-29T04:09:19.397 INFO:teuthology.orchestra.run.smithi073.stderr:167100K .......... .......... .......... .......... .......... 99% 714M 0s 2024-03-29T04:09:19.397 INFO:teuthology.orchestra.run.smithi073.stderr:167150K .......... .......... .......... .......... .......... 99% 736M 0s 2024-03-29T04:09:19.397 INFO:teuthology.orchestra.run.smithi073.stderr:167200K .......... .......... .......... .......... .......... 99% 43.7M 0s 2024-03-29T04:09:19.397 INFO:teuthology.orchestra.run.smithi073.stderr:167250K .......... .......... .......... .......... .......... 99% 25.4M 0s 2024-03-29T04:09:19.397 INFO:teuthology.orchestra.run.smithi073.stderr:167300K .......... .......... .......... .......... .......... 99% 41.9M 0s 2024-03-29T04:09:19.397 INFO:teuthology.orchestra.run.smithi073.stderr:167350K .......... .......... .......... .......... .......... 99% 33.1M 0s 2024-03-29T04:09:19.397 INFO:teuthology.orchestra.run.smithi073.stderr:167400K .......... .......... .......... .......... .......... 99% 23.8M 0s 2024-03-29T04:09:19.397 INFO:teuthology.orchestra.run.smithi073.stderr:167450K .......... .......... .......... .......... .......... 99% 34.5M 0s 2024-03-29T04:09:19.397 INFO:teuthology.orchestra.run.smithi073.stderr:167500K .......... .......... .......... .......... .......... 99% 2.14M 0s 2024-03-29T04:09:19.397 INFO:teuthology.orchestra.run.smithi073.stderr:167550K .......... .......... .......... .......... .......... 99% 113M 0s 2024-03-29T04:09:19.397 INFO:teuthology.orchestra.run.smithi073.stderr:167600K .......... .......... .......... .......... .......... 99% 111M 0s 2024-03-29T04:09:19.397 INFO:teuthology.orchestra.run.smithi073.stderr:167650K .......... .......... .......... .......... .......... 99% 110M 0s 2024-03-29T04:09:19.398 INFO:teuthology.orchestra.run.smithi073.stderr:167700K .......... .......... .......... .......... .......... 99% 93.0M 0s 2024-03-29T04:09:19.398 INFO:teuthology.orchestra.run.smithi073.stderr:167750K .......... .......... .......... .......... .......... 99% 108M 0s 2024-03-29T04:09:19.398 INFO:teuthology.orchestra.run.smithi073.stderr:167800K .......... .......... .......... .......... .......... 99% 53.3M 0s 2024-03-29T04:09:19.398 INFO:teuthology.orchestra.run.smithi073.stderr:167850K .......... .......... .......... .......... .......... 99% 30.1M 0s 2024-03-29T04:09:19.398 INFO:teuthology.orchestra.run.smithi073.stderr:167900K .......... .......... .......... .......... .......... 99% 46.7M 0s 2024-03-29T04:09:19.398 INFO:teuthology.orchestra.run.smithi073.stderr:167950K .......... .......... .......... .......... .......... 99% 30.7M 0s 2024-03-29T04:09:19.398 INFO:teuthology.orchestra.run.smithi073.stderr:168000K .......... .......... .......... .......... .......... 99% 41.4M 0s 2024-03-29T04:09:19.398 INFO:teuthology.orchestra.run.smithi073.stderr:168050K .......... .......... .......... .......... .......... 99% 35.0M 0s 2024-03-29T04:09:19.398 INFO:teuthology.orchestra.run.smithi073.stderr:168100K .......... .......... .......... .......... .......... 99% 32.2M 0s 2024-03-29T04:09:19.398 INFO:teuthology.orchestra.run.smithi073.stderr:168150K .......... .......... .......... .......... .......... 99% 45.0M 0s 2024-03-29T04:09:19.398 INFO:teuthology.orchestra.run.smithi073.stderr:168200K .......... .......... .......... .......... .......... 99% 23.9M 0s 2024-03-29T04:09:19.398 INFO:teuthology.orchestra.run.smithi073.stderr:168250K .......... .......... .......... .......... .......... 99% 38.3M 0s 2024-03-29T04:09:19.398 INFO:teuthology.orchestra.run.smithi073.stderr:168300K .......... .......... .......... .......... .......... 99% 23.4M 0s 2024-03-29T04:09:19.399 INFO:teuthology.orchestra.run.smithi073.stderr:168350K .......... .......... .......... .......... .......... 99% 25.8M 0s 2024-03-29T04:09:19.399 INFO:teuthology.orchestra.run.smithi073.stderr:168400K .......... .......... .......... .......... .......... 99% 44.2M 0s 2024-03-29T04:09:19.399 INFO:teuthology.orchestra.run.smithi073.stderr:168450K .......... .......... .......... .......... .......... 99% 24.4M 0s 2024-03-29T04:09:19.399 INFO:teuthology.orchestra.run.smithi073.stderr:168500K .......... .......... .......... .......... .......... 99% 27.5M 0s 2024-03-29T04:09:19.399 INFO:teuthology.orchestra.run.smithi073.stderr:168550K .......... .......... . 100% 97.6M=5.9s 2024-03-29T04:09:19.399 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-03-29T04:09:19.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29 04:09:17 (27.7 MB/s) - ‘linux-5.4.tar.gz’ saved [172616875/172616875] 2024-03-29T04:09:19.399 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-03-29T04:09:19.399 INFO:tasks.cephfs.test_uninlining:Running Data Uninlining test with: without clearing cache, without unmount client, without mount.open_background, without multimds, without snapshots 2024-03-29T04:09:19.399 DEBUG:tasks.cephfs.test_uninlining:setting max_mds:1 2024-03-29T04:09:19.400 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2024-03-29T04:09:19.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.525+0000 7f9b0fcd9640 1 Processor -- start 2024-03-29T04:09:19.505 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.525+0000 7f9b0fcd9640 1 -- start start 2024-03-29T04:09:19.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.526+0000 7f9b0fcd9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b080ca950 0x7f9b080b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:19.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.526+0000 7f9b0fcd9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9b080b26f0 0x7f9b0815be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:19.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.526+0000 7f9b0fcd9640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b080cadb0 con 0x7f9b0815b3d0 2024-03-29T04:09:19.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.526+0000 7f9b0fcd9640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f9b080c6240 con 0x7f9b080b26f0 2024-03-29T04:09:19.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.526+0000 7f9b0fcd9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9b080c7080 con 0x7f9b080ca950 2024-03-29T04:09:19.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.526+0000 7f9b0da75640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9b0815b3d0 0x7f9b080b49f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56550/0 (socket says 172.21.15.73:56550) 2024-03-29T04:09:19.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.526+0000 7f9b0da75640 1 -- 172.21.15.73:0/770174772 learned_addr learned my addr 172.21.15.73:0/770174772 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:09:19.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.526+0000 7f9b0d274640 1 --2- 172.21.15.73:0/770174772 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b080ca950 0x7f9b080b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:19.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.526+0000 7f9b0e276640 1 --2- 172.21.15.73:0/770174772 >> v2:172.21.15.142:3300/0 conn(0x7f9b080b26f0 0x7f9b0815be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:19.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.526+0000 7f9b0ca73640 1 -- 172.21.15.73:0/770174772 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2583936579 0 0) 0x7f9b080cadb0 con 0x7f9b0815b3d0 2024-03-29T04:09:19.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.526+0000 7f9b0ca73640 1 -- 172.21.15.73:0/770174772 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9af4003520 con 0x7f9b0815b3d0 2024-03-29T04:09:19.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.526+0000 7f9b0ca73640 1 -- 172.21.15.73:0/770174772 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3401550569 0 0) 0x7f9af4003520 con 0x7f9b0815b3d0 2024-03-29T04:09:19.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.527+0000 7f9b0ca73640 1 -- 172.21.15.73:0/770174772 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b080ca950 msgr2=0x7f9b080b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:19.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.527+0000 7f9b0ca73640 1 --2- 172.21.15.73:0/770174772 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b080ca950 0x7f9b080b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:19.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.527+0000 7f9b0ca73640 1 -- 172.21.15.73:0/770174772 >> v2:172.21.15.142:3300/0 conn(0x7f9b080b26f0 msgr2=0x7f9b0815be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:19.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.527+0000 7f9b0ca73640 1 --2- 172.21.15.73:0/770174772 >> v2:172.21.15.142:3300/0 conn(0x7f9b080b26f0 0x7f9b0815be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:19.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.527+0000 7f9b0ca73640 1 -- 172.21.15.73:0/770174772 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b080c6470 con 0x7f9b0815b3d0 2024-03-29T04:09:19.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.527+0000 7f9b0ca73640 1 -- 172.21.15.73:0/770174772 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1290421750 0 0) 0x7f9af8001690 con 0x7f9b0815b3d0 2024-03-29T04:09:19.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.527+0000 7f9b0ca73640 1 -- 172.21.15.73:0/770174772 >> v1:172.21.15.73:6789/0 conn(0x7f9b0815b3d0 legacy=0x7f9b080b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:19.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.527+0000 7f9b0ca73640 1 --2- 172.21.15.73:0/770174772 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b080ca950 0x7f9af40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:19.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.527+0000 7f9b0ca73640 1 --2- 172.21.15.73:0/770174772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9af4003f30 0x7f9af4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:19.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.527+0000 7f9b0ca73640 1 --2- 172.21.15.73:0/770174772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9af4004d40 0x7f9af40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:19.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.527+0000 7f9b0ca73640 1 -- 172.21.15.73:0/770174772 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9b080c7080 con 0x7f9af4004d40 2024-03-29T04:09:19.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.527+0000 7f9b0ca73640 1 -- 172.21.15.73:0/770174772 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9af400b9c0 con 0x7f9af4003f30 2024-03-29T04:09:19.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.527+0000 7f9b0ca73640 1 -- 172.21.15.73:0/770174772 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9af400bb40 con 0x7f9b080ca950 2024-03-29T04:09:19.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.527+0000 7f9b0e276640 1 --2- 172.21.15.73:0/770174772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9af4004d40 0x7f9af40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:19.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.527+0000 7f9b0d274640 1 --2- 172.21.15.73:0/770174772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9af4003f30 0x7f9af4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:19.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.527+0000 7f9b0da75640 1 --2- 172.21.15.73:0/770174772 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b080ca950 0x7f9af40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:19.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.527+0000 7f9b0e276640 1 -- 172.21.15.73:0/770174772 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b080ca950 msgr2=0x7f9af40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:19.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.527+0000 7f9b0e276640 1 --2- 172.21.15.73:0/770174772 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b080ca950 0x7f9af40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:19.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.527+0000 7f9b0e276640 1 -- 172.21.15.73:0/770174772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9af4003f30 msgr2=0x7f9af4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:19.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.527+0000 7f9b0e276640 1 --2- 172.21.15.73:0/770174772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9af4003f30 0x7f9af4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:19.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.527+0000 7f9b0e276640 1 -- 172.21.15.73:0/770174772 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af4003520 con 0x7f9af4004d40 2024-03-29T04:09:19.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.528+0000 7f9b0e276640 1 --2- 172.21.15.73:0/770174772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9af4004d40 0x7f9af40051c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9b00009fc0 tx=0x7f9af4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3b7f79df6e622cc server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:19.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.528+0000 7f9b0ca73640 1 -- 172.21.15.73:0/770174772 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b00039070 con 0x7f9af4004d40 2024-03-29T04:09:19.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.528+0000 7f9b0ca73640 1 -- 172.21.15.73:0/770174772 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b0002cc40 con 0x7f9af4004d40 2024-03-29T04:09:19.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.528+0000 7f9b0ca73640 1 -- 172.21.15.73:0/770174772 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b00009c10 con 0x7f9af4004d40 2024-03-29T04:09:19.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.528+0000 7f9b0fcd9640 1 -- 172.21.15.73:0/770174772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9af4004d40 msgr2=0x7f9af40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:19.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.528+0000 7f9b0fcd9640 1 --2- 172.21.15.73:0/770174772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9af4004d40 0x7f9af40051c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9b00009fc0 tx=0x7f9af4005830 comp rx=0 tx=0).stop 2024-03-29T04:09:19.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.528+0000 7f9b0e276640 1 -- 172.21.15.73:0/770174772 reap_dead start 2024-03-29T04:09:19.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.528+0000 7f9b0fcd9640 1 -- 172.21.15.73:0/770174772 shutdown_connections 2024-03-29T04:09:19.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.528+0000 7f9b0fcd9640 1 -- 172.21.15.73:0/770174772 >> 172.21.15.73:0/770174772 conn(0x7f9b080d0450 msgr2=0x7f9b080d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:19.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.529+0000 7f9b0fcd9640 1 -- 172.21.15.73:0/770174772 shutdown_connections 2024-03-29T04:09:19.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.529+0000 7f9b0fcd9640 1 -- 172.21.15.73:0/770174772 wait complete. 2024-03-29T04:09:19.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.530+0000 7f9b0fcd9640 1 Processor -- start 2024-03-29T04:09:19.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.530+0000 7f9b0fcd9640 1 -- start start 2024-03-29T04:09:19.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.530+0000 7f9b0fcd9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9af4004d40 0x7f9b080ad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:19.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.530+0000 7f9b0fcd9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b081f5390 0x7f9b081f24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:19.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.530+0000 7f9b0fcd9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b08154770 0x7f9b080b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:19.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.531+0000 7f9b0fcd9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9b080c6a30 con 0x7f9b081f5390 2024-03-29T04:09:19.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.531+0000 7f9b0fcd9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9b080b2b30 con 0x7f9af4004d40 2024-03-29T04:09:19.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.531+0000 7f9b0fcd9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9b080c6d10 con 0x7f9b08154770 2024-03-29T04:09:19.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.531+0000 7f9b0d274640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b081f5390 0x7f9b081f24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:19.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.531+0000 7f9b0d274640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b081f5390 0x7f9b081f24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54618/0 (socket says 172.21.15.73:54618) 2024-03-29T04:09:19.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.531+0000 7f9b0d274640 1 -- 172.21.15.73:0/498936935 learned_addr learned my addr 172.21.15.73:0/498936935 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:19.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.531+0000 7f9b0da75640 1 --2- 172.21.15.73:0/498936935 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9af4004d40 0x7f9b080ad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:19.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.531+0000 7f9b0e276640 1 --2- 172.21.15.73:0/498936935 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b08154770 0x7f9b080b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:19.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.531+0000 7f9b0d274640 1 -- 172.21.15.73:0/498936935 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b08154770 msgr2=0x7f9b080b0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:19.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.531+0000 7f9b0d274640 1 --2- 172.21.15.73:0/498936935 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b08154770 0x7f9b080b0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:19.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.531+0000 7f9b0d274640 1 -- 172.21.15.73:0/498936935 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9af4004d40 msgr2=0x7f9b080ad1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:19.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.531+0000 7f9b0d274640 1 --2- 172.21.15.73:0/498936935 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9af4004d40 0x7f9b080ad1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:19.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.531+0000 7f9b0d274640 1 -- 172.21.15.73:0/498936935 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b080ae150 con 0x7f9b081f5390 2024-03-29T04:09:19.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.531+0000 7f9b0da75640 1 --2- 172.21.15.73:0/498936935 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9af4004d40 0x7f9b080ad1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:09:19.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.531+0000 7f9b0d274640 1 --2- 172.21.15.73:0/498936935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b081f5390 0x7f9b081f24b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9b040118e0 tx=0x7f9b04011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:19.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.531+0000 7f9afe7fc640 1 -- 172.21.15.73:0/498936935 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b0400faf0 con 0x7f9b081f5390 2024-03-29T04:09:19.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.531+0000 7f9afe7fc640 1 -- 172.21.15.73:0/498936935 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b0400fc90 con 0x7f9b081f5390 2024-03-29T04:09:19.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.531+0000 7f9b0fcd9640 1 -- 172.21.15.73:0/498936935 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b081f57f0 con 0x7f9b081f5390 2024-03-29T04:09:19.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.531+0000 7f9afe7fc640 1 -- 172.21.15.73:0/498936935 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b04014440 con 0x7f9b081f5390 2024-03-29T04:09:19.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.531+0000 7f9b0fcd9640 1 -- 172.21.15.73:0/498936935 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b080adb90 con 0x7f9b081f5390 2024-03-29T04:09:19.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.532+0000 7f9b0fcd9640 1 -- 172.21.15.73:0/498936935 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b0809e520 con 0x7f9b081f5390 2024-03-29T04:09:19.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.533+0000 7f9afe7fc640 1 -- 172.21.15.73:0/498936935 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f9b04012040 con 0x7f9b081f5390 2024-03-29T04:09:19.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.533+0000 7f9afe7fc640 1 --2- 172.21.15.73:0/498936935 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9aec06c560 0x7f9aec06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:19.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.534+0000 7f9afe7fc640 1 -- 172.21.15.73:0/498936935 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f9b0408bcf0 con 0x7f9b081f5390 2024-03-29T04:09:19.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.534+0000 7f9b0da75640 1 --2- 172.21.15.73:0/498936935 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9aec06c560 0x7f9aec06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:19.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.534+0000 7f9b0da75640 1 --2- 172.21.15.73:0/498936935 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9aec06c560 0x7f9aec06ea20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9b080caf80 tx=0x7f9af8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:19.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.538+0000 7f9afe7fc640 1 -- 172.21.15.73:0/498936935 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f9b04090070 con 0x7f9b081f5390 2024-03-29T04:09:19.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:19.889+0000 7f9b0fcd9640 1 -- 172.21.15.73:0/498936935 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) -- 0x7f9b0806e030 con 0x7f9b081f5390 2024-03-29T04:09:20.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:20.774+0000 7f9afe7fc640 1 -- 172.21.15.73:0/498936935 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v15) ==== 105+0+0 (secure 0 0 0) 0x7f9b04019030 con 0x7f9b081f5390 2024-03-29T04:09:20.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:20.776+0000 7f9b0fcd9640 1 -- 172.21.15.73:0/498936935 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9aec06c560 msgr2=0x7f9aec06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:20.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:20.776+0000 7f9b0fcd9640 1 --2- 172.21.15.73:0/498936935 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9aec06c560 0x7f9aec06ea20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9b080caf80 tx=0x7f9af8009040 comp rx=0 tx=0).stop 2024-03-29T04:09:20.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:20.776+0000 7f9b0fcd9640 1 -- 172.21.15.73:0/498936935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b081f5390 msgr2=0x7f9b081f24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:20.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:20.776+0000 7f9b0fcd9640 1 --2- 172.21.15.73:0/498936935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b081f5390 0x7f9b081f24b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9b040118e0 tx=0x7f9b04011da0 comp rx=0 tx=0).stop 2024-03-29T04:09:20.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:20.776+0000 7f9b0fcd9640 1 -- 172.21.15.73:0/498936935 shutdown_connections 2024-03-29T04:09:20.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:20.776+0000 7f9b0fcd9640 1 --2- 172.21.15.73:0/498936935 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b08154770 0x7f9b080b0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:20.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:20.776+0000 7f9b0fcd9640 1 --2- 172.21.15.73:0/498936935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b081f5390 0x7f9b081f24b0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:20.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:20.776+0000 7f9b0fcd9640 1 --2- 172.21.15.73:0/498936935 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9aec06c560 0x7f9aec06ea20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:20.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:20.776+0000 7f9b0fcd9640 1 --2- 172.21.15.73:0/498936935 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9af4004d40 0x7f9b080ad1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:20.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:20.776+0000 7f9b0fcd9640 1 -- 172.21.15.73:0/498936935 >> 172.21.15.73:0/498936935 conn(0x7f9b080d0450 msgr2=0x7f9b080b37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:20.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:20.776+0000 7f9b0fcd9640 1 -- 172.21.15.73:0/498936935 shutdown_connections 2024-03-29T04:09:20.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:20.776+0000 7f9b0fcd9640 1 -- 172.21.15.73:0/498936935 wait complete. 2024-03-29T04:09:20.766 DEBUG:tasks.cephfs.test_uninlining:getting client_max_inline_size 2024-03-29T04:09:20.767 DEBUG:tasks.cephfs.test_uninlining:got client_max_inline_size:4096 2024-03-29T04:09:20.767 DEBUG:tasks.cephfs.test_uninlining:extracting tarball 2024-03-29T04:09:20.767 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/mnt.0 && tar -x -z -f linux-5.4.tar.gz linux-5.4/fs/ceph linux-5.4/fs/orangefs linux-5.4/fs/ext2 2024-03-29T04:09:25.079 DEBUG:tasks.cephfs.test_uninlining:fetching dir list 2024-03-29T04:09:25.079 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/mnt.0 && find linux-5.4/ -mindepth 2 -maxdepth 2 -type d 2024-03-29T04:09:25.110 INFO:teuthology.orchestra.run.smithi073.stdout:linux-5.4/fs/ceph 2024-03-29T04:09:25.110 INFO:teuthology.orchestra.run.smithi073.stdout:linux-5.4/fs/ext2 2024-03-29T04:09:25.111 INFO:teuthology.orchestra.run.smithi073.stdout:linux-5.4/fs/orangefs 2024-03-29T04:09:25.111 DEBUG:tasks.cephfs.test_uninlining:distributing dir pins 2024-03-29T04:09:25.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:09:25.111 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 linux-5.4/fs/ceph) 2024-03-29T04:09:25.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:09:25.174 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 linux-5.4/fs/ext2) 2024-03-29T04:09:25.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:09:25.231 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 linux-5.4/fs/orangefs) 2024-03-29T04:09:25.286 DEBUG:tasks.cephfs.test_uninlining:listing files with size <= 4096 2024-03-29T04:09:25.286 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/mnt.0 && find linux-5.4/ -type f -size -4097c 2024-03-29T04:09:25.357 INFO:teuthology.orchestra.run.smithi073.stdout:linux-5.4/fs/ceph/Kconfig 2024-03-29T04:09:25.357 INFO:teuthology.orchestra.run.smithi073.stdout:linux-5.4/fs/ceph/Makefile 2024-03-29T04:09:25.357 INFO:teuthology.orchestra.run.smithi073.stdout:linux-5.4/fs/ceph/ceph_frag.c 2024-03-29T04:09:25.357 INFO:teuthology.orchestra.run.smithi073.stdout:linux-5.4/fs/ceph/io.h 2024-03-29T04:09:25.358 INFO:teuthology.orchestra.run.smithi073.stdout:linux-5.4/fs/ceph/ioctl.h 2024-03-29T04:09:25.358 INFO:teuthology.orchestra.run.smithi073.stdout:linux-5.4/fs/ext2/Kconfig 2024-03-29T04:09:25.358 INFO:teuthology.orchestra.run.smithi073.stdout:linux-5.4/fs/ext2/xattr_user.c 2024-03-29T04:09:25.358 INFO:teuthology.orchestra.run.smithi073.stdout:linux-5.4/fs/ext2/xattr_security.c 2024-03-29T04:09:25.358 INFO:teuthology.orchestra.run.smithi073.stdout:linux-5.4/fs/ext2/Makefile 2024-03-29T04:09:25.358 INFO:teuthology.orchestra.run.smithi073.stdout:linux-5.4/fs/ext2/symlink.c 2024-03-29T04:09:25.358 INFO:teuthology.orchestra.run.smithi073.stdout:linux-5.4/fs/ext2/acl.h 2024-03-29T04:09:25.358 INFO:teuthology.orchestra.run.smithi073.stdout:linux-5.4/fs/ext2/xattr_trusted.c 2024-03-29T04:09:25.358 INFO:teuthology.orchestra.run.smithi073.stdout:linux-5.4/fs/ext2/xattr.h 2024-03-29T04:09:25.358 INFO:teuthology.orchestra.run.smithi073.stdout:linux-5.4/fs/orangefs/Kconfig 2024-03-29T04:09:25.358 INFO:teuthology.orchestra.run.smithi073.stdout:linux-5.4/fs/orangefs/orangefs-debug.h 2024-03-29T04:09:25.358 INFO:teuthology.orchestra.run.smithi073.stdout:linux-5.4/fs/orangefs/orangefs-sysfs.h 2024-03-29T04:09:25.358 INFO:teuthology.orchestra.run.smithi073.stdout:linux-5.4/fs/orangefs/dcache.c 2024-03-29T04:09:25.358 INFO:teuthology.orchestra.run.smithi073.stdout:linux-5.4/fs/orangefs/orangefs-bufmap.h 2024-03-29T04:09:25.359 INFO:teuthology.orchestra.run.smithi073.stdout:linux-5.4/fs/orangefs/orangefs-debugfs.h 2024-03-29T04:09:25.359 INFO:teuthology.orchestra.run.smithi073.stdout:linux-5.4/fs/orangefs/orangefs-dev-proto.h 2024-03-29T04:09:25.359 INFO:teuthology.orchestra.run.smithi073.stdout:linux-5.4/fs/orangefs/Makefile 2024-03-29T04:09:25.359 INFO:teuthology.orchestra.run.smithi073.stdout:linux-5.4/fs/orangefs/symlink.c 2024-03-29T04:09:25.359 INFO:teuthology.orchestra.run.smithi073.stdout:linux-5.4/fs/orangefs/downcall.h 2024-03-29T04:09:25.359 INFO:tasks.cephfs.test_uninlining:Found 23 inlined files 2024-03-29T04:09:25.359 DEBUG:tasks.cephfs.test_uninlining:starting scrub 2024-03-29T04:09:25.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:09:25.359 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub start / recursive 2024-03-29T04:09:25.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.526+0000 7f47287e2640 1 Processor -- start 2024-03-29T04:09:25.506 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.526+0000 7f47287e2640 1 -- start start 2024-03-29T04:09:25.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.527+0000 7f47287e2640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f472015ab00 0x7f47200b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.527+0000 7f47287e2640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47200ad660 con 0x7f4720072870 2024-03-29T04:09:25.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.527+0000 7f47287e2640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47200b4ab0 con 0x7f472015e7b0 2024-03-29T04:09:25.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.527+0000 7f47287e2640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f472006d860 con 0x7f472015ab00 2024-03-29T04:09:25.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.527+0000 7f4726d7f640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f4720072870 0x7f472006e6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56566/0 (socket says 172.21.15.73:56566) 2024-03-29T04:09:25.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.527+0000 7f4726d7f640 1 -- 172.21.15.73:0/3441365548 learned_addr learned my addr 172.21.15.73:0/3441365548 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:09:25.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.527+0000 7f472557c640 1 -- 172.21.15.73:0/3441365548 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3665665073 0 0) 0x7f471c001490 con 0x7f4720072870 2024-03-29T04:09:25.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.528+0000 7f472557c640 1 -- 172.21.15.73:0/3441365548 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f470c003520 con 0x7f4720072870 2024-03-29T04:09:25.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.528+0000 7f472657e640 1 --2- 172.21.15.73:0/3441365548 >> v2:172.21.15.142:3300/0 conn(0x7f472015ab00 0x7f47200b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.528+0000 7f472557c640 1 -- 172.21.15.73:0/3441365548 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3640273995 0 0) 0x7f470c003520 con 0x7f4720072870 2024-03-29T04:09:25.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.528+0000 7f472557c640 1 -- 172.21.15.73:0/3441365548 >> v2:172.21.15.142:3300/0 conn(0x7f472015ab00 msgr2=0x7f47200b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:25.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.528+0000 7f472557c640 1 --2- 172.21.15.73:0/3441365548 >> v2:172.21.15.142:3300/0 conn(0x7f472015ab00 0x7f47200b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.528+0000 7f472557c640 1 -- 172.21.15.73:0/3441365548 >> v1:172.21.15.142:6789/0 conn(0x7f472015e7b0 legacy=0x7f472006dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:25.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.528+0000 7f472557c640 1 -- 172.21.15.73:0/3441365548 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47200b4d90 con 0x7f4720072870 2024-03-29T04:09:25.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.528+0000 7f472557c640 1 -- 172.21.15.73:0/3441365548 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1290421750 0 0) 0x7f471c001bc0 con 0x7f4720072870 2024-03-29T04:09:25.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.528+0000 7f472557c640 1 -- 172.21.15.73:0/3441365548 >> v1:172.21.15.73:6789/0 conn(0x7f4720072870 legacy=0x7f472006e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:25.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.528+0000 7f472557c640 1 --2- 172.21.15.73:0/3441365548 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f470c0039b0 0x7f470c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.528+0000 7f472557c640 1 --2- 172.21.15.73:0/3441365548 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f470c004800 0x7f470c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.528+0000 7f472557c640 1 --2- 172.21.15.73:0/3441365548 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f470c0051c0 0x7f470c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.528+0000 7f472557c640 1 -- 172.21.15.73:0/3441365548 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f472006d860 con 0x7f470c0039b0 2024-03-29T04:09:25.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.528+0000 7f472557c640 1 -- 172.21.15.73:0/3441365548 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f470c00bf00 con 0x7f470c004800 2024-03-29T04:09:25.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.528+0000 7f472557c640 1 -- 172.21.15.73:0/3441365548 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f470c00c100 con 0x7f470c0051c0 2024-03-29T04:09:25.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.528+0000 7f472657e640 1 --2- 172.21.15.73:0/3441365548 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f470c0039b0 0x7f470c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.528+0000 7f4725d7d640 1 --2- 172.21.15.73:0/3441365548 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f470c004800 0x7f470c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.528+0000 7f4726d7f640 1 --2- 172.21.15.73:0/3441365548 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f470c0051c0 0x7f470c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.528+0000 7f472657e640 1 -- 172.21.15.73:0/3441365548 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f470c0051c0 msgr2=0x7f470c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:25.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.528+0000 7f472657e640 1 --2- 172.21.15.73:0/3441365548 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f470c0051c0 0x7f470c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.528+0000 7f472657e640 1 -- 172.21.15.73:0/3441365548 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f470c004800 msgr2=0x7f470c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:25.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.528+0000 7f472657e640 1 --2- 172.21.15.73:0/3441365548 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f470c004800 0x7f470c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.528+0000 7f4726d7f640 1 -- 172.21.15.73:0/3441365548 reap_dead start 2024-03-29T04:09:25.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.528+0000 7f472657e640 1 -- 172.21.15.73:0/3441365548 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f470c003520 con 0x7f470c0039b0 2024-03-29T04:09:25.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.528+0000 7f4725d7d640 1 --2- 172.21.15.73:0/3441365548 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f470c004800 0x7f470c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:09:25.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.529+0000 7f472657e640 1 --2- 172.21.15.73:0/3441365548 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f470c0039b0 0x7f470c003dd0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f471800aa40 tx=0x7f470c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a42467c693a34870 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:25.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.530+0000 7f472557c640 1 -- 172.21.15.73:0/3441365548 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4718039070 con 0x7f470c0039b0 2024-03-29T04:09:25.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.530+0000 7f472557c640 1 -- 172.21.15.73:0/3441365548 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f471802cbb0 con 0x7f470c0039b0 2024-03-29T04:09:25.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.530+0000 7f472557c640 1 -- 172.21.15.73:0/3441365548 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f471800b040 con 0x7f470c0039b0 2024-03-29T04:09:25.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.530+0000 7f47287e2640 1 -- 172.21.15.73:0/3441365548 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f470c0039b0 msgr2=0x7f470c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:25.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.530+0000 7f47287e2640 1 --2- 172.21.15.73:0/3441365548 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f470c0039b0 0x7f470c003dd0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f471800aa40 tx=0x7f470c005830 comp rx=0 tx=0).stop 2024-03-29T04:09:25.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.530+0000 7f47287e2640 1 -- 172.21.15.73:0/3441365548 shutdown_connections 2024-03-29T04:09:25.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.530+0000 7f47287e2640 1 --2- 172.21.15.73:0/3441365548 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f470c0039b0 0x7f470c003dd0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.530+0000 7f47287e2640 1 -- 172.21.15.73:0/3441365548 >> 172.21.15.73:0/3441365548 conn(0x7f472006b6f0 msgr2=0x7f472006bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:25.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.530+0000 7f47287e2640 1 -- 172.21.15.73:0/3441365548 shutdown_connections 2024-03-29T04:09:25.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.530+0000 7f47287e2640 1 -- 172.21.15.73:0/3441365548 wait complete. 2024-03-29T04:09:25.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.531+0000 7f47287e2640 1 Processor -- start 2024-03-29T04:09:25.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.531+0000 7f47287e2640 1 -- start start 2024-03-29T04:09:25.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.532+0000 7f47287e2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f470c0039b0 0x7f47201503f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.532+0000 7f47287e2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4720150930 0x7f4720150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.532+0000 7f47287e2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47201512f0 0x7f47200cd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.532+0000 7f47287e2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f472015aee0 con 0x7f4720150930 2024-03-29T04:09:25.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.532+0000 7f47287e2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f472006db40 con 0x7f470c0039b0 2024-03-29T04:09:25.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.532+0000 7f47287e2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f472015b060 con 0x7f47201512f0 2024-03-29T04:09:25.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.532+0000 7f4725d7d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4720150930 0x7f4720150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.532+0000 7f4725d7d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4720150930 0x7f4720150db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54638/0 (socket says 172.21.15.73:54638) 2024-03-29T04:09:25.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.532+0000 7f4725d7d640 1 -- 172.21.15.73:0/3002589805 learned_addr learned my addr 172.21.15.73:0/3002589805 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:25.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.532+0000 7f4725d7d640 1 -- 172.21.15.73:0/3002589805 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47201512f0 msgr2=0x7f47200cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:25.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.532+0000 7f4726d7f640 1 --2- 172.21.15.73:0/3002589805 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47201512f0 0x7f47200cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.532+0000 7f472657e640 1 --2- 172.21.15.73:0/3002589805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f470c0039b0 0x7f47201503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.532+0000 7f4725d7d640 1 --2- 172.21.15.73:0/3002589805 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47201512f0 0x7f47200cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.532+0000 7f4725d7d640 1 -- 172.21.15.73:0/3002589805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f470c0039b0 msgr2=0x7f47201503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:25.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.532+0000 7f4725d7d640 1 --2- 172.21.15.73:0/3002589805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f470c0039b0 0x7f47201503f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.532+0000 7f4725d7d640 1 -- 172.21.15.73:0/3002589805 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4720151850 con 0x7f4720150930 2024-03-29T04:09:25.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.532+0000 7f4726d7f640 1 --2- 172.21.15.73:0/3002589805 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47201512f0 0x7f47200cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:09:25.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.533+0000 7f4725d7d640 1 --2- 172.21.15.73:0/3002589805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4720150930 0x7f4720150db0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f471000e4b0 tx=0x7f471000e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:25.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.533+0000 7f4716ffd640 1 -- 172.21.15.73:0/3002589805 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47100052e0 con 0x7f4720150930 2024-03-29T04:09:25.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.533+0000 7f4716ffd640 1 -- 172.21.15.73:0/3002589805 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4710007020 con 0x7f4720150930 2024-03-29T04:09:25.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.533+0000 7f47287e2640 1 -- 172.21.15.73:0/3002589805 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47200ccab0 con 0x7f4720150930 2024-03-29T04:09:25.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.533+0000 7f4716ffd640 1 -- 172.21.15.73:0/3002589805 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4710007210 con 0x7f4720150930 2024-03-29T04:09:25.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.533+0000 7f47287e2640 1 -- 172.21.15.73:0/3002589805 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47200cd070 con 0x7f4720150930 2024-03-29T04:09:25.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.534+0000 7f4716ffd640 1 -- 172.21.15.73:0/3002589805 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f471001a020 con 0x7f4720150930 2024-03-29T04:09:25.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.534+0000 7f4716ffd640 1 --2- 172.21.15.73:0/3002589805 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f470406c560 0x7f470406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.535+0000 7f472657e640 1 --2- 172.21.15.73:0/3002589805 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f470406c560 0x7f470406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.535+0000 7f4716ffd640 1 -- 172.21.15.73:0/3002589805 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f471008abd0 con 0x7f4720150930 2024-03-29T04:09:25.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.535+0000 7f472657e640 1 --2- 172.21.15.73:0/3002589805 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f470406c560 0x7f470406ea20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4718036000 tx=0x7f4718030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:25.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.536+0000 7f472b3d2740 1 Processor -- start 2024-03-29T04:09:25.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.536+0000 7f472b3d2740 1 -- start start 2024-03-29T04:09:25.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.537+0000 7f472b3d2740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a416c94b20 0x55a416c67ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.537+0000 7f472b3d2740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a416c94f00 0x55a416c978b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.537+0000 7f472b3d2740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a416c68000 0x55a416c97df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.537+0000 7f472b3d2740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55a416bd1410 con 0x55a416c94b20 2024-03-29T04:09:25.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.537+0000 7f472b3d2740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55a416b6fa80 con 0x55a416c94f00 2024-03-29T04:09:25.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.537+0000 7f472b3d2740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x55a416bcd3c0 con 0x55a416c68000 2024-03-29T04:09:25.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.537+0000 7f472657e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a416c94b20 0x55a416c67ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.537+0000 7f472657e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a416c94b20 0x55a416c67ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54642/0 (socket says 172.21.15.73:54642) 2024-03-29T04:09:25.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.537+0000 7f472657e640 1 -- 172.21.15.73:0/3941655626 learned_addr learned my addr 172.21.15.73:0/3941655626 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:25.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.537+0000 7f4725d7d640 1 --2- 172.21.15.73:0/3941655626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a416c94f00 0x55a416c978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.537+0000 7f4726d7f640 1 --2- 172.21.15.73:0/3941655626 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a416c68000 0x55a416c97df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.537+0000 7f472657e640 1 -- 172.21.15.73:0/3941655626 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a416c68000 msgr2=0x55a416c97df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:25.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.537+0000 7f472657e640 1 --2- 172.21.15.73:0/3941655626 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a416c68000 0x55a416c97df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.537+0000 7f472657e640 1 -- 172.21.15.73:0/3941655626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a416c94f00 msgr2=0x55a416c978b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:25.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.537+0000 7f472657e640 1 --2- 172.21.15.73:0/3941655626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a416c94f00 0x55a416c978b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.537+0000 7f472657e640 1 -- 172.21.15.73:0/3941655626 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4169b17b0 con 0x55a416c94b20 2024-03-29T04:09:25.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.537+0000 7f4726d7f640 1 --2- 172.21.15.73:0/3941655626 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a416c68000 0x55a416c97df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:09:25.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.538+0000 7f472657e640 1 --2- 172.21.15.73:0/3941655626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a416c94b20 0x55a416c67ac0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f471800ab30 tx=0x7f471802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5834826a5e15601 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:25.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.538+0000 7f4703fff640 1 -- 172.21.15.73:0/3941655626 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4718039040 con 0x55a416c94b20 2024-03-29T04:09:25.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.538+0000 7f4703fff640 1 -- 172.21.15.73:0/3941655626 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47180043e0 con 0x55a416c94b20 2024-03-29T04:09:25.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.538+0000 7f4703fff640 1 -- 172.21.15.73:0/3941655626 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4718003810 con 0x55a416c94b20 2024-03-29T04:09:25.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.538+0000 7f472b3d2740 1 -- 172.21.15.73:0/3941655626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a416c94b20 msgr2=0x55a416c67ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:25.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.538+0000 7f472b3d2740 1 --2- 172.21.15.73:0/3941655626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a416c94b20 0x55a416c67ac0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f471800ab30 tx=0x7f471802e000 comp rx=0 tx=0).stop 2024-03-29T04:09:25.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.538+0000 7f472b3d2740 1 -- 172.21.15.73:0/3941655626 shutdown_connections 2024-03-29T04:09:25.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.538+0000 7f472b3d2740 1 --2- 172.21.15.73:0/3941655626 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a416c68000 0x55a416c97df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.538+0000 7f472b3d2740 1 --2- 172.21.15.73:0/3941655626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a416c94f00 0x55a416c978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.538+0000 7f472b3d2740 1 --2- 172.21.15.73:0/3941655626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a416c94b20 0x55a416c67ac0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.538+0000 7f472b3d2740 1 -- 172.21.15.73:0/3941655626 >> 172.21.15.73:0/3941655626 conn(0x55a416c69d30 msgr2=0x55a416cb28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:25.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.539+0000 7f472b3d2740 1 -- 172.21.15.73:0/3941655626 shutdown_connections 2024-03-29T04:09:25.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.539+0000 7f472b3d2740 1 -- 172.21.15.73:0/3941655626 wait complete. 2024-03-29T04:09:25.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.539+0000 7f472b3d2740 1 -- start start 2024-03-29T04:09:25.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.539+0000 7f472b3d2740 1 Processor -- start 2024-03-29T04:09:25.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.540+0000 7f472b3d2740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a416c94b20 0x55a416c87f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.540+0000 7f472b3d2740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a416c94f00 0x55a416cb1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.540+0000 7f472b3d2740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a416cb1b80 0x55a416c9b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.540+0000 7f472b3d2740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55a416c6c3d0 con 0x55a416c94f00 2024-03-29T04:09:25.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.540+0000 7f472b3d2740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55a416b6d740 con 0x55a416cb1b80 2024-03-29T04:09:25.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.540+0000 7f472b3d2740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x55a416c6ec10 con 0x55a416c94b20 2024-03-29T04:09:25.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.540+0000 7f472b3d2740 10 client.0 _ll_register_callbacks cb 0x55a416b7ab10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-29T04:09:25.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.540+0000 7f4725d7d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a416c94f00 0x55a416cb1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.540+0000 7f4725d7d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a416c94f00 0x55a416cb1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54652/0 (socket says 172.21.15.73:54652) 2024-03-29T04:09:25.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.540+0000 7f4725d7d640 1 -- 172.21.15.73:0/2525248002 learned_addr learned my addr 172.21.15.73:0/2525248002 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:25.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.540+0000 7f472657e640 1 --2- 172.21.15.73:0/2525248002 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a416c94b20 0x55a416c87f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.540+0000 7f4726d7f640 1 --2- 172.21.15.73:0/2525248002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a416cb1b80 0x55a416c9b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.540+0000 7f4725d7d640 1 -- 172.21.15.73:0/2525248002 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a416c94b20 msgr2=0x55a416c87f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:25.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.540+0000 7f4725d7d640 1 --2- 172.21.15.73:0/2525248002 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a416c94b20 0x55a416c87f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.540+0000 7f4725d7d640 1 -- 172.21.15.73:0/2525248002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a416cb1b80 msgr2=0x55a416c9b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:25.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.540+0000 7f4725d7d640 1 --2- 172.21.15.73:0/2525248002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a416cb1b80 0x55a416c9b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.540+0000 7f4725d7d640 1 -- 172.21.15.73:0/2525248002 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a416a11f40 con 0x55a416c94f00 2024-03-29T04:09:25.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.540+0000 7f472657e640 1 --2- 172.21.15.73:0/2525248002 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a416c94b20 0x55a416c87f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:09:25.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.540+0000 7f4726d7f640 1 --2- 172.21.15.73:0/2525248002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a416cb1b80 0x55a416c9b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:09:25.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.541+0000 7f4725d7d640 1 --2- 172.21.15.73:0/2525248002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a416c94f00 0x55a416cb1640 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4710058b10 tx=0x7f471001a310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82e508af09a86165 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:25.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.541+0000 7f47017fa640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-03-29T04:09:25.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.541+0000 7f47017fa640 1 -- 172.21.15.73:0/2525248002 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4710072020 con 0x55a416c94f00 2024-03-29T04:09:25.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.541+0000 7f47017fa640 1 -- 172.21.15.73:0/2525248002 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f47100073b0 con 0x55a416c94f00 2024-03-29T04:09:25.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.541+0000 7f472b3d2740 1 -- 172.21.15.73:0/2525248002 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47180043e0 con 0x55a416c94f00 2024-03-29T04:09:25.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.541+0000 7f47017fa640 1 -- 172.21.15.73:0/2525248002 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f4710086020 con 0x55a416c94f00 2024-03-29T04:09:25.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.541+0000 7f472b3d2740 10 client.5307 fetch_fsmap learned FSMap version 15 2024-03-29T04:09:25.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.541+0000 7f472b3d2740 1 -- 172.21.15.73:0/2525248002 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55a4168a50a0 con 0x55a416c94f00 2024-03-29T04:09:25.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.541+0000 7f47017fa640 1 -- 172.21.15.73:0/2525248002 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47180043e0 con 0x55a416c94f00 2024-03-29T04:09:25.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.541+0000 7f47017fa640 1 -- 172.21.15.73:0/2525248002 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 15) ==== 3494+0+0 (secure 0 0 0) 0x7f4710057fd0 con 0x55a416c94f00 2024-03-29T04:09:25.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.541+0000 7f472b3d2740 10 client.5307 fetch_fsmap finished waiting for FSMap version 15 2024-03-29T04:09:25.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.541+0000 7f472b3d2740 10 client.5307 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-29T04:09:25.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.541+0000 7f472b3d2740 20 client.5307 populate_metadata read hostname 'smithi073' 2024-03-29T04:09:25.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.541+0000 7f472b3d2740 1 --2- 172.21.15.73:0/2525248002 >> [v2:172.21.15.73:6834/936189393,v1:172.21.15.73:6836/936189393] conn(0x55a416cc2c50 0x55a416cc3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.541+0000 7f472b3d2740 4 client.5307 mds_command: new command op to 5055 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-29T04:09:25.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.541+0000 7f472b3d2740 1 -- 172.21.15.73:0/2525248002 --> [v2:172.21.15.73:6834/936189393,v1:172.21.15.73:6836/936189393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a416bde950 con 0x55a416cc2c50 2024-03-29T04:09:25.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.541+0000 7f472657e640 1 --2- 172.21.15.73:0/2525248002 >> [v2:172.21.15.73:6834/936189393,v1:172.21.15.73:6836/936189393] conn(0x55a416cc2c50 0x55a416cc3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.542+0000 7f472657e640 1 --2- 172.21.15.73:0/2525248002 >> [v2:172.21.15.73:6834/936189393,v1:172.21.15.73:6836/936189393] conn(0x55a416cc2c50 0x55a416cc3070 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e04d26edd13c815d server_cookie=1a690e3764a4df49 in_seq=0 out_seq=0 2024-03-29T04:09:25.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.542+0000 7f47017fa640 10 client.5307 ms_handle_connect on v2:172.21.15.73:6834/936189393 2024-03-29T04:09:25.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.542+0000 7f47017fa640 1 -- 172.21.15.73:0/2525248002 <== mds.0 v2:172.21.15.73:6834/936189393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55a416bde950 con 0x55a416cc2c50 2024-03-29T04:09:25.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.542+0000 7f47017fa640 10 client.5307 handle_command_reply: tid=0 2024-03-29T04:09:25.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.542+0000 7f472b3d2740 1 client.5307 shutdown 2024-03-29T04:09:25.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.542+0000 7f472b3d2740 1 -- 172.21.15.73:0/2525248002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a416c94f00 msgr2=0x55a416cb1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:25.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.542+0000 7f472b3d2740 1 --2- 172.21.15.73:0/2525248002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a416c94f00 0x55a416cb1640 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4710058b10 tx=0x7f471001a310 comp rx=0 tx=0).stop 2024-03-29T04:09:25.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.542+0000 7f472b3d2740 1 -- 172.21.15.73:0/2525248002 shutdown_connections 2024-03-29T04:09:25.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.543+0000 7f472b3d2740 1 --2- 172.21.15.73:0/2525248002 >> [v2:172.21.15.73:6834/936189393,v1:172.21.15.73:6836/936189393] conn(0x55a416cc2c50 0x55a416cc3070 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.543+0000 7f472b3d2740 1 --2- 172.21.15.73:0/2525248002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a416cb1b80 0x55a416c9b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.543+0000 7f472b3d2740 1 --2- 172.21.15.73:0/2525248002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a416c94f00 0x55a416cb1640 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.543+0000 7f472b3d2740 1 --2- 172.21.15.73:0/2525248002 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a416c94b20 0x55a416c87f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.543+0000 7f472b3d2740 1 -- 172.21.15.73:0/2525248002 >> 172.21.15.73:0/2525248002 conn(0x55a416c68000 msgr2=0x55a416cb66b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:25.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.543+0000 7f47017fa640 0 client.5307 ms_handle_reset on v2:172.21.15.73:6834/936189393 2024-03-29T04:09:25.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.543+0000 7f472b3d2740 1 -- 172.21.15.73:0/2525248002 shutdown_connections 2024-03-29T04:09:25.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.543+0000 7f472b3d2740 1 -- 172.21.15.73:0/2525248002 wait complete. 2024-03-29T04:09:25.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.543+0000 7f472b3d2740 20 client.5307 trim_cache size 0 max 16384 2024-03-29T04:09:25.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.561+0000 7f472b3d2740 1 Processor -- start 2024-03-29T04:09:25.540 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.561+0000 7f472b3d2740 1 -- start start 2024-03-29T04:09:25.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.561+0000 7f472b3d2740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a416c94b20 0x55a416c93f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.561+0000 7f472b3d2740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a416c94f00 0x55a416c9c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.561+0000 7f472b3d2740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a416cb1b80 0x55a416c6d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.561+0000 7f472b3d2740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f47201fd200 con 0x55a416cb1b80 2024-03-29T04:09:25.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.561+0000 7f472b3d2740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f47201fc2a0 con 0x55a416c94b20 2024-03-29T04:09:25.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.561+0000 7f472b3d2740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f47201fb600 con 0x55a416c94f00 2024-03-29T04:09:25.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.562+0000 7f4726d7f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a416cb1b80 0x55a416c6d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.562+0000 7f4726d7f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a416cb1b80 0x55a416c6d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54668/0 (socket says 172.21.15.73:54668) 2024-03-29T04:09:25.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.562+0000 7f4726d7f640 1 -- 172.21.15.73:0/2472081447 learned_addr learned my addr 172.21.15.73:0/2472081447 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:25.543 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.562+0000 7f4725d7d640 1 --2- 172.21.15.73:0/2472081447 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a416c94f00 0x55a416c9c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.562+0000 7f472657e640 1 --2- 172.21.15.73:0/2472081447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a416c94b20 0x55a416c93f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.562+0000 7f4726d7f640 1 -- 172.21.15.73:0/2472081447 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a416c94f00 msgr2=0x55a416c9c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:25.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.562+0000 7f4726d7f640 1 --2- 172.21.15.73:0/2472081447 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a416c94f00 0x55a416c9c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.562+0000 7f4726d7f640 1 -- 172.21.15.73:0/2472081447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a416c94b20 msgr2=0x55a416c93f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:25.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.562+0000 7f4726d7f640 1 --2- 172.21.15.73:0/2472081447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a416c94b20 0x55a416c93f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.562+0000 7f4726d7f640 1 -- 172.21.15.73:0/2472081447 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a416c9ad50 con 0x55a416cb1b80 2024-03-29T04:09:25.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.562+0000 7f472657e640 1 --2- 172.21.15.73:0/2472081447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a416c94b20 0x55a416c93f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:09:25.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.562+0000 7f4726d7f640 1 --2- 172.21.15.73:0/2472081447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a416cb1b80 0x55a416c6d910 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f471c002230 tx=0x7f471c007420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb915220352ee21 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:25.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.562+0000 7f47037fe640 1 -- 172.21.15.73:0/2472081447 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f471c016680 con 0x55a416cb1b80 2024-03-29T04:09:25.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.562+0000 7f47037fe640 1 -- 172.21.15.73:0/2472081447 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f471c016840 con 0x55a416cb1b80 2024-03-29T04:09:25.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.562+0000 7f47037fe640 1 -- 172.21.15.73:0/2472081447 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f471c016c30 con 0x55a416cb1b80 2024-03-29T04:09:25.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.563+0000 7f472b3d2740 1 -- 172.21.15.73:0/2472081447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a416cb1b80 msgr2=0x55a416c6d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:25.544 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.563+0000 7f472b3d2740 1 --2- 172.21.15.73:0/2472081447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a416cb1b80 0x55a416c6d910 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f471c002230 tx=0x7f471c007420 comp rx=0 tx=0).stop 2024-03-29T04:09:25.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.563+0000 7f472b3d2740 1 -- 172.21.15.73:0/2472081447 shutdown_connections 2024-03-29T04:09:25.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.563+0000 7f472b3d2740 1 --2- 172.21.15.73:0/2472081447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a416cb1b80 0x55a416c6d910 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.563+0000 7f472b3d2740 1 --2- 172.21.15.73:0/2472081447 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a416c94f00 0x55a416c9c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.563+0000 7f472b3d2740 1 --2- 172.21.15.73:0/2472081447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a416c94b20 0x55a416c93f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.563+0000 7f472b3d2740 1 -- 172.21.15.73:0/2472081447 >> 172.21.15.73:0/2472081447 conn(0x55a416c68000 msgr2=0x55a416c87da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:25.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.563+0000 7f472b3d2740 1 -- 172.21.15.73:0/2472081447 shutdown_connections 2024-03-29T04:09:25.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.563+0000 7f472b3d2740 1 -- 172.21.15.73:0/2472081447 wait complete. 2024-03-29T04:09:25.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.564+0000 7f472b3d2740 1 -- start start 2024-03-29T04:09:25.545 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.564+0000 7f472b3d2740 1 Processor -- start 2024-03-29T04:09:25.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.565+0000 7f472b3d2740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a416c94b20 0x55a416cc0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.565+0000 7f472b3d2740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a416c94f00 0x55a416c988b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.565+0000 7f472b3d2740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a416cb1b80 0x55a416c98df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.565+0000 7f472b3d2740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55a416cb2470 con 0x55a416c94f00 2024-03-29T04:09:25.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.565+0000 7f472b3d2740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f47201fbc50 con 0x55a416cb1b80 2024-03-29T04:09:25.549 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.565+0000 7f472b3d2740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x55a416c5a910 con 0x55a416c94b20 2024-03-29T04:09:25.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.565+0000 7f472b3d2740 10 client.0 _ll_register_callbacks cb 0x7f4710054e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-29T04:09:25.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.565+0000 7f4725d7d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a416c94f00 0x55a416c988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.565+0000 7f4725d7d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a416c94f00 0x55a416c988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54674/0 (socket says 172.21.15.73:54674) 2024-03-29T04:09:25.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.565+0000 7f4725d7d640 1 -- 172.21.15.73:0/4120417957 learned_addr learned my addr 172.21.15.73:0/4120417957 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:25.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.565+0000 7f472657e640 1 --2- 172.21.15.73:0/4120417957 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a416c94b20 0x55a416cc0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.565+0000 7f4725d7d640 1 -- 172.21.15.73:0/4120417957 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a416c94b20 msgr2=0x55a416cc0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:25.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.565+0000 7f4726d7f640 1 --2- 172.21.15.73:0/4120417957 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a416cb1b80 0x55a416c98df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.565+0000 7f4725d7d640 1 --2- 172.21.15.73:0/4120417957 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a416c94b20 0x55a416cc0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.565+0000 7f4725d7d640 1 -- 172.21.15.73:0/4120417957 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a416cb1b80 msgr2=0x55a416c98df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:25.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.565+0000 7f4725d7d640 1 --2- 172.21.15.73:0/4120417957 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a416cb1b80 0x55a416c98df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.565+0000 7f4725d7d640 1 -- 172.21.15.73:0/4120417957 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a416c6dbc0 con 0x55a416c94f00 2024-03-29T04:09:25.550 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.566+0000 7f4725d7d640 1 --2- 172.21.15.73:0/4120417957 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a416c94f00 0x55a416c988b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f471001a4c0 tx=0x7f4710089060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fe41d3272e1aa76 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:25.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.566+0000 7f47017fa640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-03-29T04:09:25.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.566+0000 7f47017fa640 1 -- 172.21.15.73:0/4120417957 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4710072040 con 0x55a416c94f00 2024-03-29T04:09:25.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.566+0000 7f47017fa640 1 -- 172.21.15.73:0/4120417957 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f47100075b0 con 0x55a416c94f00 2024-03-29T04:09:25.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.566+0000 7f472b3d2740 1 -- 172.21.15.73:0/4120417957 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f471c016840 con 0x55a416c94f00 2024-03-29T04:09:25.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.566+0000 7f47017fa640 1 -- 172.21.15.73:0/4120417957 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f4710061760 con 0x55a416c94f00 2024-03-29T04:09:25.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.566+0000 7f472b3d2740 10 client.5313 fetch_fsmap learned FSMap version 15 2024-03-29T04:09:25.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.566+0000 7f472b3d2740 1 -- 172.21.15.73:0/4120417957 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55a416c9a070 con 0x55a416c94f00 2024-03-29T04:09:25.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.566+0000 7f47017fa640 1 -- 172.21.15.73:0/4120417957 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f471c016840 con 0x55a416c94f00 2024-03-29T04:09:25.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.566+0000 7f47017fa640 1 -- 172.21.15.73:0/4120417957 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 15) ==== 3494+0+0 (secure 0 0 0) 0x7f471005f130 con 0x55a416c94f00 2024-03-29T04:09:25.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.566+0000 7f472b3d2740 10 client.5313 fetch_fsmap finished waiting for FSMap version 15 2024-03-29T04:09:25.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.566+0000 7f472b3d2740 10 client.5313 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-29T04:09:25.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.566+0000 7f472b3d2740 20 client.5313 populate_metadata read hostname 'smithi073' 2024-03-29T04:09:25.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.566+0000 7f472b3d2740 1 --2- 172.21.15.73:0/4120417957 >> [v2:172.21.15.73:6834/936189393,v1:172.21.15.73:6836/936189393] conn(0x55a416d2e250 0x55a416d2e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.566+0000 7f472b3d2740 4 client.5313 mds_command: new command op to 5055 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}] 2024-03-29T04:09:25.551 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.566+0000 7f472b3d2740 1 -- 172.21.15.73:0/4120417957 --> [v2:172.21.15.73:6834/936189393,v1:172.21.15.73:6836/936189393] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}) -- 0x55a416bd8ca0 con 0x55a416d2e250 2024-03-29T04:09:25.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.566+0000 7f472657e640 1 --2- 172.21.15.73:0/4120417957 >> [v2:172.21.15.73:6834/936189393,v1:172.21.15.73:6836/936189393] conn(0x55a416d2e250 0x55a416d2e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.567+0000 7f47017fa640 10 client.5313 ms_handle_connect on v2:172.21.15.73:6834/936189393 2024-03-29T04:09:25.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.567+0000 7f472657e640 1 --2- 172.21.15.73:0/4120417957 >> [v2:172.21.15.73:6834/936189393,v1:172.21.15.73:6836/936189393] conn(0x55a416d2e250 0x55a416d2e670 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18c202636f4df64f server_cookie=76975dfabcda5d72 in_seq=0 out_seq=0 2024-03-29T04:09:25.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.568+0000 7f47017fa640 1 -- 172.21.15.73:0/4120417957 <== mds.0 v2:172.21.15.73:6834/936189393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a416bd8ca0 con 0x55a416d2e250 2024-03-29T04:09:25.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.568+0000 7f47017fa640 10 client.5313 handle_command_reply: tid=0 2024-03-29T04:09:25.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.568+0000 7f472b3d2740 1 client.5313 shutdown 2024-03-29T04:09:25.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.568+0000 7f472b3d2740 1 -- 172.21.15.73:0/4120417957 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a416c94f00 msgr2=0x55a416c988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:25.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.568+0000 7f472b3d2740 1 --2- 172.21.15.73:0/4120417957 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a416c94f00 0x55a416c988b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f471001a4c0 tx=0x7f4710089060 comp rx=0 tx=0).stop 2024-03-29T04:09:25.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.568+0000 7f472b3d2740 1 -- 172.21.15.73:0/4120417957 shutdown_connections 2024-03-29T04:09:25.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.568+0000 7f472b3d2740 1 --2- 172.21.15.73:0/4120417957 >> [v2:172.21.15.73:6834/936189393,v1:172.21.15.73:6836/936189393] conn(0x55a416d2e250 0x55a416d2e670 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.568+0000 7f472b3d2740 1 --2- 172.21.15.73:0/4120417957 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a416cb1b80 0x55a416c98df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.568+0000 7f472b3d2740 1 --2- 172.21.15.73:0/4120417957 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a416c94f00 0x55a416c988b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.568+0000 7f47017fa640 0 client.5313 ms_handle_reset on v2:172.21.15.73:6834/936189393 2024-03-29T04:09:25.552 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.568+0000 7f472b3d2740 1 --2- 172.21.15.73:0/4120417957 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55a416c94b20 0x55a416cc0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.568+0000 7f472b3d2740 1 -- 172.21.15.73:0/4120417957 >> 172.21.15.73:0/4120417957 conn(0x55a416c68000 msgr2=0x55a416c9cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:25.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.568+0000 7f472b3d2740 1 -- 172.21.15.73:0/4120417957 shutdown_connections 2024-03-29T04:09:25.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.568+0000 7f472b3d2740 1 -- 172.21.15.73:0/4120417957 wait complete. 2024-03-29T04:09:25.553 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.568+0000 7f472b3d2740 20 client.5313 trim_cache size 0 max 16384 2024-03-29T04:09:25.553 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-29T04:09:25.553 INFO:teuthology.orchestra.run.smithi073.stdout: "return_code": 0, 2024-03-29T04:09:25.553 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_tag": "7e193353-fdbe-4459-b4cb-b68b5e7e41cb", 2024-03-29T04:09:25.553 INFO:teuthology.orchestra.run.smithi073.stdout: "mode": "asynchronous" 2024-03-29T04:09:25.553 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-29T04:09:25.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.569+0000 7f47287e2640 1 -- 172.21.15.73:0/3002589805 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f470406c560 msgr2=0x7f470406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:25.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.570+0000 7f47287e2640 1 --2- 172.21.15.73:0/3002589805 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f470406c560 0x7f470406ea20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4718036000 tx=0x7f4718030000 comp rx=0 tx=0).stop 2024-03-29T04:09:25.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.570+0000 7f47287e2640 1 -- 172.21.15.73:0/3002589805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4720150930 msgr2=0x7f4720150db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:25.554 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.570+0000 7f47287e2640 1 --2- 172.21.15.73:0/3002589805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4720150930 0x7f4720150db0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f471000e4b0 tx=0x7f471000e970 comp rx=0 tx=0).stop 2024-03-29T04:09:25.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.570+0000 7f47287e2640 1 -- 172.21.15.73:0/3002589805 shutdown_connections 2024-03-29T04:09:25.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.570+0000 7f47287e2640 1 --2- 172.21.15.73:0/3002589805 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f47201512f0 0x7f47200cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.570+0000 7f47287e2640 1 --2- 172.21.15.73:0/3002589805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4720150930 0x7f4720150db0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.570+0000 7f47287e2640 1 --2- 172.21.15.73:0/3002589805 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f470406c560 0x7f470406ea20 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.570+0000 7f47287e2640 1 --2- 172.21.15.73:0/3002589805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f470c0039b0 0x7f47201503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.570+0000 7f47287e2640 1 -- 172.21.15.73:0/3002589805 >> 172.21.15.73:0/3002589805 conn(0x7f472006b6f0 msgr2=0x7f47200b00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:25.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.570+0000 7f47287e2640 1 -- 172.21.15.73:0/3002589805 shutdown_connections 2024-03-29T04:09:25.555 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.570+0000 7f47287e2640 1 -- 172.21.15.73:0/3002589805 wait complete. 2024-03-29T04:09:25.564 DEBUG:tasks.cephfs.test_uninlining:scrub start response: {'return_code': 0, 'scrub_tag': '7e193353-fdbe-4459-b4cb-b68b5e7e41cb', 'mode': 'asynchronous'} 2024-03-29T04:09:25.565 DEBUG:tasks.cephfs.test_uninlining:waiting for scrub to complete 2024-03-29T04:09:25.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:09:25.565 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-03-29T04:09:25.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.737+0000 7f5a107ef640 1 Processor -- start 2024-03-29T04:09:25.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.737+0000 7f5a107ef640 1 -- start start 2024-03-29T04:09:25.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.738+0000 7f5a107ef640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a080d3280 0x7f5a080d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.738+0000 7f5a107ef640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a0815ed00 con 0x7f5a080d14d0 2024-03-29T04:09:25.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.738+0000 7f5a107ef640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a080d21e0 con 0x7f5a0815e920 2024-03-29T04:09:25.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.738+0000 7f5a107ef640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f5a080d24c0 con 0x7f5a080d3280 2024-03-29T04:09:25.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.738+0000 7f5a0ed8c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f5a080d14d0 0x7f5a0806c6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:56572/0 (socket says 172.21.15.73:56572) 2024-03-29T04:09:25.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.738+0000 7f5a0ed8c640 1 -- 172.21.15.73:0/1968458287 learned_addr learned my addr 172.21.15.73:0/1968458287 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:09:25.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.738+0000 7f5a0dd8a640 1 --2- 172.21.15.73:0/1968458287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a080d3280 0x7f5a080d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.738+0000 7f5a0d589640 1 -- 172.21.15.73:0/1968458287 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2194733113 0 0) 0x7f5a0815ed00 con 0x7f5a080d14d0 2024-03-29T04:09:25.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.738+0000 7f5a0d589640 1 -- 172.21.15.73:0/1968458287 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59f4003520 con 0x7f5a080d14d0 2024-03-29T04:09:25.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.739+0000 7f5a0d589640 1 -- 172.21.15.73:0/1968458287 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2788473229 0 0) 0x7f5a080d21e0 con 0x7f5a0815e920 2024-03-29T04:09:25.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.739+0000 7f5a0d589640 1 -- 172.21.15.73:0/1968458287 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a0815ed00 con 0x7f5a0815e920 2024-03-29T04:09:25.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.739+0000 7f5a0dd8a640 1 -- 172.21.15.73:0/1968458287 >> v1:172.21.15.142:6789/0 conn(0x7f5a0815e920 legacy=0x7f5a080cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:25.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.739+0000 7f5a0dd8a640 1 -- 172.21.15.73:0/1968458287 >> v1:172.21.15.73:6789/0 conn(0x7f5a080d14d0 legacy=0x7f5a0806c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:25.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.739+0000 7f5a0dd8a640 1 -- 172.21.15.73:0/1968458287 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a080d27a0 con 0x7f5a080d3280 2024-03-29T04:09:25.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.740+0000 7f5a0dd8a640 1 --2- 172.21.15.73:0/1968458287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a080d3280 0x7f5a080d0f90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f59f80097d0 tx=0x7f59f802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=760df06cc21107d9 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:25.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.740+0000 7f5a0d589640 1 -- 172.21.15.73:0/1968458287 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f8035020 con 0x7f5a080d3280 2024-03-29T04:09:25.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.740+0000 7f5a0d589640 1 -- 172.21.15.73:0/1968458287 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59f8031890 con 0x7f5a080d3280 2024-03-29T04:09:25.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.740+0000 7f5a0d589640 1 -- 172.21.15.73:0/1968458287 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f8031c60 con 0x7f5a080d3280 2024-03-29T04:09:25.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.741+0000 7f5a107ef640 1 -- 172.21.15.73:0/1968458287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a080d3280 msgr2=0x7f5a080d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:25.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.741+0000 7f5a107ef640 1 --2- 172.21.15.73:0/1968458287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a080d3280 0x7f5a080d0f90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f59f80097d0 tx=0x7f59f802b930 comp rx=0 tx=0).stop 2024-03-29T04:09:25.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.742+0000 7f5a107ef640 1 -- 172.21.15.73:0/1968458287 shutdown_connections 2024-03-29T04:09:25.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.742+0000 7f5a107ef640 1 --2- 172.21.15.73:0/1968458287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a080d3280 0x7f5a080d0f90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.742+0000 7f5a107ef640 1 -- 172.21.15.73:0/1968458287 >> 172.21.15.73:0/1968458287 conn(0x7f5a0808bfc0 msgr2=0x7f5a080d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:25.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.742+0000 7f5a107ef640 1 -- 172.21.15.73:0/1968458287 shutdown_connections 2024-03-29T04:09:25.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.742+0000 7f5a107ef640 1 -- 172.21.15.73:0/1968458287 wait complete. 2024-03-29T04:09:25.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.744+0000 7f5a107ef640 1 Processor -- start 2024-03-29T04:09:25.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.744+0000 7f5a107ef640 1 -- start start 2024-03-29T04:09:25.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.744+0000 7f5a107ef640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a080d14d0 0x7f5a081e8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.744+0000 7f5a107ef640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a080d3280 0x7f5a080c9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.745+0000 7f5a107ef640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a0815e920 0x7f5a0814c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.745+0000 7f5a107ef640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5a080d4f50 con 0x7f5a080d3280 2024-03-29T04:09:25.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.745+0000 7f5a107ef640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5a080d2d60 con 0x7f5a0815e920 2024-03-29T04:09:25.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.745+0000 7f5a107ef640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f5a080d36e0 con 0x7f5a080d14d0 2024-03-29T04:09:25.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.745+0000 7f5a0e58b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a080d14d0 0x7f5a081e8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.745+0000 7f5a0e58b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a080d14d0 0x7f5a081e8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:56204/0 (socket says 172.21.15.73:56204) 2024-03-29T04:09:25.726 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.745+0000 7f5a0e58b640 1 -- 172.21.15.73:0/3955747257 learned_addr learned my addr 172.21.15.73:0/3955747257 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:25.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.745+0000 7f5a0dd8a640 1 --2- 172.21.15.73:0/3955747257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a080d3280 0x7f5a080c9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.745+0000 7f5a0ed8c640 1 --2- 172.21.15.73:0/3955747257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a0815e920 0x7f5a0814c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.745+0000 7f5a0ed8c640 1 -- 172.21.15.73:0/3955747257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a080d14d0 msgr2=0x7f5a081e8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:25.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.745+0000 7f5a0ed8c640 1 --2- 172.21.15.73:0/3955747257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a080d14d0 0x7f5a081e8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.745+0000 7f5a0ed8c640 1 -- 172.21.15.73:0/3955747257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a080d3280 msgr2=0x7f5a080c9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:25.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.745+0000 7f5a0ed8c640 1 --2- 172.21.15.73:0/3955747257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a080d3280 0x7f5a080c9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.745+0000 7f5a0ed8c640 1 -- 172.21.15.73:0/3955747257 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a080c9c90 con 0x7f5a0815e920 2024-03-29T04:09:25.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.745+0000 7f5a0ed8c640 1 --2- 172.21.15.73:0/3955747257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a0815e920 0x7f5a0814c9c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5a0000ca70 tx=0x7f5a0000cf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:25.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.746+0000 7f59feffd640 1 -- 172.21.15.73:0/3955747257 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a00017070 con 0x7f5a0815e920 2024-03-29T04:09:25.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.746+0000 7f5a107ef640 1 -- 172.21.15.73:0/3955747257 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a080c8120 con 0x7f5a0815e920 2024-03-29T04:09:25.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.746+0000 7f5a107ef640 1 -- 172.21.15.73:0/3955747257 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a080c86e0 con 0x7f5a0815e920 2024-03-29T04:09:25.727 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.746+0000 7f59feffd640 1 -- 172.21.15.73:0/3955747257 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a0000ab70 con 0x7f5a0815e920 2024-03-29T04:09:25.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.746+0000 7f59feffd640 1 -- 172.21.15.73:0/3955747257 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a00012400 con 0x7f5a0815e920 2024-03-29T04:09:25.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.748+0000 7f59feffd640 1 -- 172.21.15.73:0/3955747257 <== mon.1 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f5a0001a070 con 0x7f5a0815e920 2024-03-29T04:09:25.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.748+0000 7f59feffd640 1 --2- 172.21.15.73:0/3955747257 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f59ec06c530 0x7f59ec06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.748+0000 7f59feffd640 1 -- 172.21.15.73:0/3955747257 <== mon.1 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f5a0008b400 con 0x7f5a0815e920 2024-03-29T04:09:25.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.748+0000 7f5a0e58b640 1 --2- 172.21.15.73:0/3955747257 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f59ec06c530 0x7f59ec06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.749+0000 7f5a0e58b640 1 --2- 172.21.15.73:0/3955747257 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f59ec06c530 0x7f59ec06e9f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5a04007fd0 tx=0x7f5a04009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:25.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.749+0000 7f5a133d6740 1 Processor -- start 2024-03-29T04:09:25.729 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.750+0000 7f5a133d6740 1 -- start start 2024-03-29T04:09:25.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.750+0000 7f5a133d6740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555f3a98e200 0x555f3a9611a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.751+0000 7f5a133d6740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555f3a98e5e0 0x555f3a990f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.751+0000 7f5a133d6740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555f3a9616e0 0x555f3a9914d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.751+0000 7f5a133d6740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x555f3a8cb880 con 0x555f3a98e5e0 2024-03-29T04:09:25.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.751+0000 7f5a133d6740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x555f3a8738f0 con 0x555f3a98e200 2024-03-29T04:09:25.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.751+0000 7f5a133d6740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x555f3a8c7830 con 0x555f3a9616e0 2024-03-29T04:09:25.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.751+0000 7f5a0e58b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555f3a98e200 0x555f3a9611a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.751+0000 7f5a0e58b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555f3a98e200 0x555f3a9611a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.73:59582/0 (socket says 172.21.15.73:59582) 2024-03-29T04:09:25.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.751+0000 7f5a0e58b640 1 -- 172.21.15.73:0/3527971460 learned_addr learned my addr 172.21.15.73:0/3527971460 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:25.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.751+0000 7f5a0ed8c640 1 --2- 172.21.15.73:0/3527971460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555f3a9616e0 0x555f3a9914d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.751+0000 7f5a0dd8a640 1 --2- 172.21.15.73:0/3527971460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555f3a98e5e0 0x555f3a990f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.751+0000 7f5a0e58b640 1 -- 172.21.15.73:0/3527971460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555f3a9616e0 msgr2=0x555f3a9914d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:25.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.751+0000 7f5a0e58b640 1 --2- 172.21.15.73:0/3527971460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555f3a9616e0 0x555f3a9914d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.751+0000 7f5a0e58b640 1 -- 172.21.15.73:0/3527971460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555f3a98e5e0 msgr2=0x555f3a990f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:25.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.751+0000 7f5a0e58b640 1 --2- 172.21.15.73:0/3527971460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555f3a98e5e0 0x555f3a990f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.751+0000 7f5a0e58b640 1 -- 172.21.15.73:0/3527971460 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f3a87e140 con 0x555f3a98e200 2024-03-29T04:09:25.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.751+0000 7f5a0dd8a640 1 --2- 172.21.15.73:0/3527971460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555f3a98e5e0 0x555f3a990f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:09:25.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.751+0000 7f5a0e58b640 1 --2- 172.21.15.73:0/3527971460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555f3a98e200 0x555f3a9611a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5a0400fbd0 tx=0x7f5a04012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=408db398abde3c65 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:25.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.752+0000 7f59ebfff640 1 -- 172.21.15.73:0/3527971460 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a04025070 con 0x555f3a98e200 2024-03-29T04:09:25.734 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.752+0000 7f59ebfff640 1 -- 172.21.15.73:0/3527971460 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a0401b050 con 0x555f3a98e200 2024-03-29T04:09:25.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.752+0000 7f59ebfff640 1 -- 172.21.15.73:0/3527971460 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a04014e40 con 0x555f3a98e200 2024-03-29T04:09:25.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.752+0000 7f5a133d6740 1 -- 172.21.15.73:0/3527971460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555f3a98e200 msgr2=0x555f3a9611a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:25.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.752+0000 7f5a133d6740 1 --2- 172.21.15.73:0/3527971460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555f3a98e200 0x555f3a9611a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5a0400fbd0 tx=0x7f5a04012000 comp rx=0 tx=0).stop 2024-03-29T04:09:25.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.753+0000 7f5a133d6740 1 -- 172.21.15.73:0/3527971460 shutdown_connections 2024-03-29T04:09:25.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.753+0000 7f5a133d6740 1 --2- 172.21.15.73:0/3527971460 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555f3a9616e0 0x555f3a9914d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.753+0000 7f5a133d6740 1 --2- 172.21.15.73:0/3527971460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555f3a98e5e0 0x555f3a990f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.753+0000 7f5a133d6740 1 --2- 172.21.15.73:0/3527971460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555f3a98e200 0x555f3a9611a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.753+0000 7f5a133d6740 1 -- 172.21.15.73:0/3527971460 >> 172.21.15.73:0/3527971460 conn(0x555f3a963410 msgr2=0x555f3a9abf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:25.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.753+0000 7f5a133d6740 1 -- 172.21.15.73:0/3527971460 shutdown_connections 2024-03-29T04:09:25.735 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.753+0000 7f5a133d6740 1 -- 172.21.15.73:0/3527971460 wait complete. 2024-03-29T04:09:25.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.753+0000 7f5a133d6740 1 -- start start 2024-03-29T04:09:25.736 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.753+0000 7f5a133d6740 1 Processor -- start 2024-03-29T04:09:25.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.754+0000 7f5a133d6740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555f3a98e200 0x555f3a981420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.755+0000 7f5a133d6740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555f3a98e5e0 0x555f3a9aa550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.755+0000 7f5a0e58b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555f3a98e200 0x555f3a981420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.755+0000 7f5a0e58b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555f3a98e200 0x555f3a981420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54708/0 (socket says 172.21.15.73:54708) 2024-03-29T04:09:25.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.755+0000 7f5a133d6740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555f3a9944d0 0x555f3a994950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.755+0000 7f5a0e58b640 1 -- 172.21.15.73:0/2993811138 learned_addr learned my addr 172.21.15.73:0/2993811138 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:25.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.755+0000 7f5a133d6740 1 -- 172.21.15.73:0/2993811138 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x555f3a965ab0 con 0x555f3a98e200 2024-03-29T04:09:25.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.755+0000 7f5a133d6740 1 -- 172.21.15.73:0/2993811138 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x555f3a886cf0 con 0x555f3a98e5e0 2024-03-29T04:09:25.741 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.755+0000 7f5a133d6740 1 -- 172.21.15.73:0/2993811138 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x555f3a9682f0 con 0x555f3a9944d0 2024-03-29T04:09:25.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.755+0000 7f5a0ed8c640 1 --2- 172.21.15.73:0/2993811138 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555f3a9944d0 0x555f3a994950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.755+0000 7f5a0dd8a640 1 --2- 172.21.15.73:0/2993811138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555f3a98e5e0 0x555f3a9aa550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.755+0000 7f5a0e58b640 1 -- 172.21.15.73:0/2993811138 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555f3a9944d0 msgr2=0x555f3a994950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:25.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.755+0000 7f5a0e58b640 1 --2- 172.21.15.73:0/2993811138 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555f3a9944d0 0x555f3a994950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.755+0000 7f5a0e58b640 1 -- 172.21.15.73:0/2993811138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555f3a98e5e0 msgr2=0x555f3a9aa550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:25.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.755+0000 7f5a0e58b640 1 --2- 172.21.15.73:0/2993811138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555f3a98e5e0 0x555f3a9aa550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.755+0000 7f5a0e58b640 1 -- 172.21.15.73:0/2993811138 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f3a6a97d0 con 0x555f3a98e200 2024-03-29T04:09:25.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.756+0000 7f5a0e58b640 1 --2- 172.21.15.73:0/2993811138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555f3a98e200 0x555f3a981420 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5a040206c0 tx=0x7f5a04000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a829098f9bd7aaa server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:25.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.756+0000 7f5a133d6740 10 client.0 _ll_register_callbacks cb 0x555f3a878f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-29T04:09:25.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.756+0000 7f59e97fa640 10 client.5322 ms_handle_connect on v2:172.21.15.73:3300/0 2024-03-29T04:09:25.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.756+0000 7f5a133d6740 1 -- 172.21.15.73:0/2993811138 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a0401b050 con 0x555f3a98e200 2024-03-29T04:09:25.742 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.756+0000 7f59e97fa640 1 -- 172.21.15.73:0/2993811138 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a04030020 con 0x555f3a98e200 2024-03-29T04:09:25.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.756+0000 7f59e97fa640 1 -- 172.21.15.73:0/2993811138 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f5a04020a20 con 0x555f3a98e200 2024-03-29T04:09:25.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.756+0000 7f59e97fa640 1 -- 172.21.15.73:0/2993811138 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f5a04025040 con 0x555f3a98e200 2024-03-29T04:09:25.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.756+0000 7f5a133d6740 10 client.5322 fetch_fsmap learned FSMap version 15 2024-03-29T04:09:25.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.756+0000 7f5a133d6740 1 -- 172.21.15.73:0/2993811138 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({fsmap=15}) -- 0x555f3a5df3f0 con 0x555f3a98e200 2024-03-29T04:09:25.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.756+0000 7f59e97fa640 1 -- 172.21.15.73:0/2993811138 <== mon.0 v2:172.21.15.73:3300/0 4 ==== fsmap(e 15) ==== 3494+0+0 (secure 0 0 0) 0x7f5a0402b470 con 0x555f3a98e200 2024-03-29T04:09:25.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.756+0000 7f5a133d6740 10 client.5322 fetch_fsmap finished waiting for FSMap version 15 2024-03-29T04:09:25.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.756+0000 7f5a133d6740 10 client.5322 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-29T04:09:25.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.756+0000 7f5a133d6740 20 client.5322 populate_metadata read hostname 'smithi073' 2024-03-29T04:09:25.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.756+0000 7f5a133d6740 1 --2- 172.21.15.73:0/2993811138 >> [v2:172.21.15.73:6834/936189393,v1:172.21.15.73:6836/936189393] conn(0x555f3a992f30 0x555f3a9933e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.756+0000 7f5a133d6740 4 client.5322 mds_command: new command op to 5055 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-29T04:09:25.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.756+0000 7f5a133d6740 1 -- 172.21.15.73:0/2993811138 --> [v2:172.21.15.73:6834/936189393,v1:172.21.15.73:6836/936189393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555f3a8d8dc0 con 0x555f3a992f30 2024-03-29T04:09:25.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.757+0000 7f5a0dd8a640 1 --2- 172.21.15.73:0/2993811138 >> [v2:172.21.15.73:6834/936189393,v1:172.21.15.73:6836/936189393] conn(0x555f3a992f30 0x555f3a9933e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.757+0000 7f5a0dd8a640 1 --2- 172.21.15.73:0/2993811138 >> [v2:172.21.15.73:6834/936189393,v1:172.21.15.73:6836/936189393] conn(0x555f3a992f30 0x555f3a9933e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6423609d0ceac8 server_cookie=d34730e6809d7f56 in_seq=0 out_seq=0 2024-03-29T04:09:25.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.757+0000 7f59e97fa640 10 client.5322 ms_handle_connect on v2:172.21.15.73:6834/936189393 2024-03-29T04:09:25.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.758+0000 7f59e97fa640 1 -- 172.21.15.73:0/2993811138 <== mds.0 v2:172.21.15.73:6834/936189393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x555f3a8d8dc0 con 0x555f3a992f30 2024-03-29T04:09:25.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.758+0000 7f59e97fa640 10 client.5322 handle_command_reply: tid=0 2024-03-29T04:09:25.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.758+0000 7f5a133d6740 1 client.5322 shutdown 2024-03-29T04:09:25.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.759+0000 7f5a133d6740 1 -- 172.21.15.73:0/2993811138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555f3a98e200 msgr2=0x555f3a981420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:25.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.759+0000 7f5a133d6740 1 --2- 172.21.15.73:0/2993811138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555f3a98e200 0x555f3a981420 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5a040206c0 tx=0x7f5a04000ed0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.759+0000 7f5a133d6740 1 -- 172.21.15.73:0/2993811138 shutdown_connections 2024-03-29T04:09:25.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.759+0000 7f5a133d6740 1 --2- 172.21.15.73:0/2993811138 >> [v2:172.21.15.73:6834/936189393,v1:172.21.15.73:6836/936189393] conn(0x555f3a992f30 0x555f3a9933e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.759+0000 7f5a133d6740 1 --2- 172.21.15.73:0/2993811138 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555f3a9944d0 0x555f3a994950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.759+0000 7f59e97fa640 0 client.5322 ms_handle_reset on v2:172.21.15.73:6834/936189393 2024-03-29T04:09:25.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.759+0000 7f5a133d6740 1 --2- 172.21.15.73:0/2993811138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555f3a98e5e0 0x555f3a9aa550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.759+0000 7f5a133d6740 1 --2- 172.21.15.73:0/2993811138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555f3a98e200 0x555f3a981420 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.759+0000 7f5a133d6740 1 -- 172.21.15.73:0/2993811138 >> 172.21.15.73:0/2993811138 conn(0x555f3a9616e0 msgr2=0x555f3a965180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:25.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.759+0000 7f5a133d6740 1 -- 172.21.15.73:0/2993811138 shutdown_connections 2024-03-29T04:09:25.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.759+0000 7f5a133d6740 1 -- 172.21.15.73:0/2993811138 wait complete. 2024-03-29T04:09:25.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.759+0000 7f5a133d6740 20 client.5322 trim_cache size 0 max 16384 2024-03-29T04:09:25.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.785+0000 7f5a133d6740 1 Processor -- start 2024-03-29T04:09:25.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.785+0000 7f5a133d6740 1 -- start start 2024-03-29T04:09:25.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.786+0000 7f5a133d6740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555f3a98e200 0x555f3a964d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.786+0000 7f5a133d6740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555f3a98e5e0 0x555f3a965240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.786+0000 7f5a133d6740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555f3a992f30 0x555f3a993310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.786+0000 7f5a133d6740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5a08200e50 con 0x555f3a98e5e0 2024-03-29T04:09:25.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.786+0000 7f5a133d6740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5a081f5760 con 0x555f3a992f30 2024-03-29T04:09:25.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.786+0000 7f5a133d6740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f5a081f4ac0 con 0x555f3a98e200 2024-03-29T04:09:25.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.786+0000 7f5a0e58b640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555f3a98e200 0x555f3a964d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.786+0000 7f5a0dd8a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555f3a98e5e0 0x555f3a965240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.786+0000 7f5a0dd8a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555f3a98e5e0 0x555f3a965240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54720/0 (socket says 172.21.15.73:54720) 2024-03-29T04:09:25.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.786+0000 7f5a0dd8a640 1 -- 172.21.15.73:0/2117283923 learned_addr learned my addr 172.21.15.73:0/2117283923 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:25.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.786+0000 7f5a0ed8c640 1 --2- 172.21.15.73:0/2117283923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555f3a992f30 0x555f3a993310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.786+0000 7f5a0dd8a640 1 -- 172.21.15.73:0/2117283923 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555f3a98e200 msgr2=0x555f3a964d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:25.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.787+0000 7f5a0dd8a640 1 --2- 172.21.15.73:0/2117283923 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555f3a98e200 0x555f3a964d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.787+0000 7f5a0dd8a640 1 -- 172.21.15.73:0/2117283923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555f3a992f30 msgr2=0x555f3a993310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:25.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.787+0000 7f5a0dd8a640 1 --2- 172.21.15.73:0/2117283923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555f3a992f30 0x555f3a993310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.787+0000 7f5a0dd8a640 1 -- 172.21.15.73:0/2117283923 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f3a59f0f0 con 0x555f3a98e5e0 2024-03-29T04:09:25.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.787+0000 7f5a0ed8c640 1 --2- 172.21.15.73:0/2117283923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555f3a992f30 0x555f3a993310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:09:25.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.787+0000 7f5a0dd8a640 1 --2- 172.21.15.73:0/2117283923 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555f3a98e5e0 0x555f3a965240 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f59f80091d0 tx=0x7f59f8030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef90dd12e104685d server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:25.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.787+0000 7f59eb7fe640 1 -- 172.21.15.73:0/2117283923 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f8035040 con 0x555f3a98e5e0 2024-03-29T04:09:25.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.787+0000 7f59eb7fe640 1 -- 172.21.15.73:0/2117283923 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59f8031c90 con 0x555f3a98e5e0 2024-03-29T04:09:25.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.787+0000 7f59eb7fe640 1 -- 172.21.15.73:0/2117283923 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f804b270 con 0x555f3a98e5e0 2024-03-29T04:09:25.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.788+0000 7f5a133d6740 1 -- 172.21.15.73:0/2117283923 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555f3a98e5e0 msgr2=0x555f3a965240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:25.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.788+0000 7f5a133d6740 1 --2- 172.21.15.73:0/2117283923 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555f3a98e5e0 0x555f3a965240 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f59f80091d0 tx=0x7f59f8030000 comp rx=0 tx=0).stop 2024-03-29T04:09:25.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.788+0000 7f5a133d6740 1 -- 172.21.15.73:0/2117283923 shutdown_connections 2024-03-29T04:09:25.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.788+0000 7f5a133d6740 1 --2- 172.21.15.73:0/2117283923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555f3a992f30 0x555f3a993310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.788+0000 7f5a133d6740 1 --2- 172.21.15.73:0/2117283923 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555f3a98e5e0 0x555f3a965240 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.788+0000 7f5a133d6740 1 --2- 172.21.15.73:0/2117283923 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555f3a98e200 0x555f3a964d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.788+0000 7f5a133d6740 1 -- 172.21.15.73:0/2117283923 >> 172.21.15.73:0/2117283923 conn(0x555f3a9616e0 msgr2=0x555f3a981230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:25.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.788+0000 7f5a133d6740 1 -- 172.21.15.73:0/2117283923 shutdown_connections 2024-03-29T04:09:25.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.788+0000 7f5a133d6740 1 -- 172.21.15.73:0/2117283923 wait complete. 2024-03-29T04:09:25.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.789+0000 7f5a133d6740 1 -- start start 2024-03-29T04:09:25.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.789+0000 7f5a133d6740 1 Processor -- start 2024-03-29T04:09:25.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.791+0000 7f5a133d6740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555f3a98e200 0x555f3a9be1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.791+0000 7f5a133d6740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555f3a98e5e0 0x555f3a964d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.791+0000 7f5a133d6740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555f3a992f30 0x555f3a965240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.791+0000 7f5a133d6740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x555f3a9a8f80 con 0x555f3a98e200 2024-03-29T04:09:25.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.791+0000 7f5a0e58b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555f3a98e200 0x555f3a9be1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.791+0000 7f5a0e58b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555f3a98e200 0x555f3a9be1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54732/0 (socket says 172.21.15.73:54732) 2024-03-29T04:09:25.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.791+0000 7f5a0e58b640 1 -- 172.21.15.73:0/1036588407 learned_addr learned my addr 172.21.15.73:0/1036588407 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:25.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.791+0000 7f5a133d6740 1 -- 172.21.15.73:0/1036588407 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5a081f5110 con 0x555f3a992f30 2024-03-29T04:09:25.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.791+0000 7f5a0dd8a640 1 --2- 172.21.15.73:0/1036588407 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555f3a98e5e0 0x555f3a964d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.791+0000 7f5a0ed8c640 1 --2- 172.21.15.73:0/1036588407 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555f3a992f30 0x555f3a965240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.791+0000 7f5a133d6740 1 -- 172.21.15.73:0/1036588407 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x555f3a9958c0 con 0x555f3a98e5e0 2024-03-29T04:09:25.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.791+0000 7f5a133d6740 10 client.0 _ll_register_callbacks cb 0x7f5a04023070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-29T04:09:25.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.791+0000 7f5a0e58b640 1 -- 172.21.15.73:0/1036588407 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555f3a98e5e0 msgr2=0x555f3a964d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:25.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.791+0000 7f5a0e58b640 1 --2- 172.21.15.73:0/1036588407 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555f3a98e5e0 0x555f3a964d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.792+0000 7f5a0e58b640 1 -- 172.21.15.73:0/1036588407 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555f3a992f30 msgr2=0x555f3a965240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:25.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.792+0000 7f5a0e58b640 1 --2- 172.21.15.73:0/1036588407 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555f3a992f30 0x555f3a965240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.792+0000 7f5a0e58b640 1 -- 172.21.15.73:0/1036588407 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f3aa2aaa0 con 0x555f3a98e200 2024-03-29T04:09:25.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.792+0000 7f5a0ed8c640 1 --2- 172.21.15.73:0/1036588407 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555f3a992f30 0x555f3a965240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:09:25.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.792+0000 7f5a0e58b640 1 --2- 172.21.15.73:0/1036588407 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555f3a98e200 0x555f3a9be1f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5a04001380 tx=0x7f5a0400a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b54fbffa3869ec1 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:25.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.792+0000 7f59e97fa640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-03-29T04:09:25.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.792+0000 7f59e97fa640 1 -- 172.21.15.73:0/1036588407 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a04042020 con 0x555f3a98e200 2024-03-29T04:09:25.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.792+0000 7f5a133d6740 1 -- 172.21.15.73:0/1036588407 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59f8031c90 con 0x555f3a98e200 2024-03-29T04:09:25.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.792+0000 7f59e97fa640 1 -- 172.21.15.73:0/1036588407 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f5a040208f0 con 0x555f3a98e200 2024-03-29T04:09:25.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.792+0000 7f59e97fa640 1 -- 172.21.15.73:0/1036588407 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f5a0404c050 con 0x555f3a98e200 2024-03-29T04:09:25.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.792+0000 7f5a133d6740 10 client.5328 fetch_fsmap learned FSMap version 15 2024-03-29T04:09:25.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.792+0000 7f5a133d6740 1 -- 172.21.15.73:0/1036588407 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x555f3a9be730 con 0x555f3a98e200 2024-03-29T04:09:25.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.793+0000 7f59e97fa640 1 -- 172.21.15.73:0/1036588407 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59f8031c90 con 0x555f3a98e200 2024-03-29T04:09:25.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.793+0000 7f59e97fa640 1 -- 172.21.15.73:0/1036588407 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 15) ==== 3494+0+0 (secure 0 0 0) 0x7f5a0404f020 con 0x555f3a98e200 2024-03-29T04:09:25.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.793+0000 7f5a133d6740 10 client.5328 fetch_fsmap finished waiting for FSMap version 15 2024-03-29T04:09:25.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.793+0000 7f5a133d6740 10 client.5328 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-29T04:09:25.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.793+0000 7f5a133d6740 20 client.5328 populate_metadata read hostname 'smithi073' 2024-03-29T04:09:25.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.793+0000 7f5a133d6740 1 --2- 172.21.15.73:0/1036588407 >> [v2:172.21.15.73:6834/936189393,v1:172.21.15.73:6836/936189393] conn(0x555f3a9944d0 0x555f3a9c2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:25.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.793+0000 7f5a133d6740 4 client.5328 mds_command: new command op to 5055 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-29T04:09:25.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.793+0000 7f5a133d6740 1 -- 172.21.15.73:0/1036588407 --> [v2:172.21.15.73:6834/936189393,v1:172.21.15.73:6836/936189393] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555f3a8d3110 con 0x555f3a9944d0 2024-03-29T04:09:25.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.793+0000 7f5a0dd8a640 1 --2- 172.21.15.73:0/1036588407 >> [v2:172.21.15.73:6834/936189393,v1:172.21.15.73:6836/936189393] conn(0x555f3a9944d0 0x555f3a9c2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:25.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.794+0000 7f59e97fa640 10 client.5328 ms_handle_connect on v2:172.21.15.73:6834/936189393 2024-03-29T04:09:25.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.794+0000 7f5a0dd8a640 1 --2- 172.21.15.73:0/1036588407 >> [v2:172.21.15.73:6834/936189393,v1:172.21.15.73:6836/936189393] conn(0x555f3a9944d0 0x555f3a9c2b30 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=167b1cc47f4f3703 server_cookie=49c2923963130361 in_seq=0 out_seq=0 2024-03-29T04:09:25.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.796+0000 7f59e97fa640 1 -- 172.21.15.73:0/1036588407 <== mds.0 v2:172.21.15.73:6834/936189393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+564 (crc 0 0 0) 0x555f3a8d3110 con 0x555f3a9944d0 2024-03-29T04:09:25.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.796+0000 7f59e97fa640 10 client.5328 handle_command_reply: tid=0 2024-03-29T04:09:25.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.796+0000 7f5a133d6740 1 client.5328 shutdown 2024-03-29T04:09:25.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.797+0000 7f5a133d6740 1 -- 172.21.15.73:0/1036588407 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555f3a98e200 msgr2=0x555f3a9be1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:25.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.797+0000 7f5a133d6740 1 --2- 172.21.15.73:0/1036588407 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555f3a98e200 0x555f3a9be1f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5a04001380 tx=0x7f5a0400a000 comp rx=0 tx=0).stop 2024-03-29T04:09:25.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.797+0000 7f5a133d6740 1 -- 172.21.15.73:0/1036588407 shutdown_connections 2024-03-29T04:09:25.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.797+0000 7f5a133d6740 1 --2- 172.21.15.73:0/1036588407 >> [v2:172.21.15.73:6834/936189393,v1:172.21.15.73:6836/936189393] conn(0x555f3a9944d0 0x555f3a9c2b30 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.797+0000 7f5a133d6740 1 --2- 172.21.15.73:0/1036588407 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555f3a992f30 0x555f3a965240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.797+0000 7f59e97fa640 0 client.5328 ms_handle_reset on v2:172.21.15.73:6834/936189393 2024-03-29T04:09:25.780 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.797+0000 7f5a133d6740 1 --2- 172.21.15.73:0/1036588407 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x555f3a98e5e0 0x555f3a964d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.797+0000 7f5a133d6740 1 --2- 172.21.15.73:0/1036588407 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555f3a98e200 0x555f3a9be1f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.797+0000 7f5a133d6740 1 -- 172.21.15.73:0/1036588407 >> 172.21.15.73:0/1036588407 conn(0x555f3a9616e0 msgr2=0x555f3a95c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:25.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.797+0000 7f5a133d6740 1 -- 172.21.15.73:0/1036588407 shutdown_connections 2024-03-29T04:09:25.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.797+0000 7f5a133d6740 1 -- 172.21.15.73:0/1036588407 wait complete. 2024-03-29T04:09:25.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.797+0000 7f5a133d6740 20 client.5328 trim_cache size 0 max 16384 2024-03-29T04:09:25.781 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-29T04:09:25.781 INFO:teuthology.orchestra.run.smithi073.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-29T04:09:25.781 INFO:teuthology.orchestra.run.smithi073.stdout: "scrubs": { 2024-03-29T04:09:25.781 INFO:teuthology.orchestra.run.smithi073.stdout: "7e193353-fdbe-4459-b4cb-b68b5e7e41cb": { 2024-03-29T04:09:25.781 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/", 2024-03-29T04:09:25.782 INFO:teuthology.orchestra.run.smithi073.stdout: "tag": "7e193353-fdbe-4459-b4cb-b68b5e7e41cb", 2024-03-29T04:09:25.782 INFO:teuthology.orchestra.run.smithi073.stdout: "options": "recursive" 2024-03-29T04:09:25.782 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-29T04:09:25.782 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-03-29T04:09:25.782 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_stats": { 2024-03-29T04:09:25.782 INFO:teuthology.orchestra.run.smithi073.stdout: "7e193353-fdbe-4459-b4cb-b68b5e7e41cb": { 2024-03-29T04:09:25.782 INFO:teuthology.orchestra.run.smithi073.stdout: "start_time": "2024-03-29T04:09:25.567755+0000", 2024-03-29T04:09:25.782 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/", 2024-03-29T04:09:25.782 INFO:teuthology.orchestra.run.smithi073.stdout: "uninline_started": 0, 2024-03-29T04:09:25.782 INFO:teuthology.orchestra.run.smithi073.stdout: "uninline_passed": 0, 2024-03-29T04:09:25.782 INFO:teuthology.orchestra.run.smithi073.stdout: "uninline_failed": 0, 2024-03-29T04:09:25.782 INFO:teuthology.orchestra.run.smithi073.stdout: "uninline_skipped": 0 2024-03-29T04:09:25.782 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-29T04:09:25.783 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-29T04:09:25.783 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-29T04:09:25.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.798+0000 7f5a107ef640 1 -- 172.21.15.73:0/3955747257 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f59ec06c530 msgr2=0x7f59ec06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:25.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.798+0000 7f5a107ef640 1 --2- 172.21.15.73:0/3955747257 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f59ec06c530 0x7f59ec06e9f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5a04007fd0 tx=0x7f5a04009040 comp rx=0 tx=0).stop 2024-03-29T04:09:25.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.798+0000 7f5a107ef640 1 -- 172.21.15.73:0/3955747257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a0815e920 msgr2=0x7f5a0814c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:25.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.798+0000 7f5a107ef640 1 --2- 172.21.15.73:0/3955747257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a0815e920 0x7f5a0814c9c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5a0000ca70 tx=0x7f5a0000cf30 comp rx=0 tx=0).stop 2024-03-29T04:09:25.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.799+0000 7f5a107ef640 1 -- 172.21.15.73:0/3955747257 shutdown_connections 2024-03-29T04:09:25.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.799+0000 7f5a107ef640 1 --2- 172.21.15.73:0/3955747257 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f59ec06c530 0x7f59ec06e9f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.799+0000 7f5a107ef640 1 --2- 172.21.15.73:0/3955747257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a0815e920 0x7f5a0814c9c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.799+0000 7f5a107ef640 1 --2- 172.21.15.73:0/3955747257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a080d3280 0x7f5a080c9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.799+0000 7f5a107ef640 1 --2- 172.21.15.73:0/3955747257 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5a080d14d0 0x7f5a081e8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:25.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.799+0000 7f5a107ef640 1 -- 172.21.15.73:0/3955747257 >> 172.21.15.73:0/3955747257 conn(0x7f5a0808bfc0 msgr2=0x7f5a080b2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:25.784 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.799+0000 7f5a107ef640 1 -- 172.21.15.73:0/3955747257 shutdown_connections 2024-03-29T04:09:25.785 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:25.799+0000 7f5a107ef640 1 -- 172.21.15.73:0/3955747257 wait complete. 2024-03-29T04:09:25.791 INFO:tasks.cephfs.filesystem:scrub status for tag:7e193353-fdbe-4459-b4cb-b68b5e7e41cb - {'path': '/', 'tag': '7e193353-fdbe-4459-b4cb-b68b5e7e41cb', 'options': 'recursive'} 2024-03-29T04:09:36.189 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-29T04:09:36.192 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-29T04:09:55.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:09:55.793 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-03-29T04:09:55.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.945+0000 7f23e8740640 1 Processor -- start 2024-03-29T04:09:55.925 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.945+0000 7f23e8740640 1 -- start start 2024-03-29T04:09:55.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.946+0000 7f23e8740640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23e015b3d0 0x7f23e006f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:55.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.946+0000 7f23e8740640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23e0071f20 con 0x7f23e00d0410 2024-03-29T04:09:55.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.946+0000 7f23e8740640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23e0072200 con 0x7f23e0071860 2024-03-29T04:09:55.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.946+0000 7f23e8740640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f23e0071ce0 con 0x7f23e015b3d0 2024-03-29T04:09:55.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.947+0000 7f23e6cdd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f23e00d0410 0x7f23e00adf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:38784/0 (socket says 172.21.15.73:38784) 2024-03-29T04:09:55.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.947+0000 7f23e6cdd640 1 -- 172.21.15.73:0/1935060568 learned_addr learned my addr 172.21.15.73:0/1935060568 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:09:55.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.947+0000 7f23e64dc640 1 --2- 172.21.15.73:0/1935060568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23e015b3d0 0x7f23e006f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:55.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.947+0000 7f23e54da640 1 -- 172.21.15.73:0/1935060568 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2686643561 0 0) 0x7f23e0071f20 con 0x7f23e00d0410 2024-03-29T04:09:55.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.947+0000 7f23e54da640 1 -- 172.21.15.73:0/1935060568 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23cc003520 con 0x7f23e00d0410 2024-03-29T04:09:55.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.947+0000 7f23e54da640 1 -- 172.21.15.73:0/1935060568 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 433017268 0 0) 0x7f23cc003520 con 0x7f23e00d0410 2024-03-29T04:09:55.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.947+0000 7f23e54da640 1 -- 172.21.15.73:0/1935060568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23e015b3d0 msgr2=0x7f23e006f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:55.929 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.947+0000 7f23e54da640 1 --2- 172.21.15.73:0/1935060568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23e015b3d0 0x7f23e006f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:55.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.947+0000 7f23e54da640 1 -- 172.21.15.73:0/1935060568 >> v1:172.21.15.142:6789/0 conn(0x7f23e0071860 legacy=0x7f23e00b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:55.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.947+0000 7f23e54da640 1 -- 172.21.15.73:0/1935060568 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e00724e0 con 0x7f23e00d0410 2024-03-29T04:09:55.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.947+0000 7f23e54da640 1 -- 172.21.15.73:0/1935060568 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1290421750 0 0) 0x7f23dc001670 con 0x7f23e00d0410 2024-03-29T04:09:55.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.947+0000 7f23e54da640 1 -- 172.21.15.73:0/1935060568 >> v1:172.21.15.73:6789/0 conn(0x7f23e00d0410 legacy=0x7f23e00adf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:55.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.947+0000 7f23e54da640 1 --2- 172.21.15.73:0/1935060568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23cc0039e0 0x7f23cc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:55.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.947+0000 7f23e54da640 1 --2- 172.21.15.73:0/1935060568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23cc004390 0x7f23cc004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:55.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.947+0000 7f23e54da640 1 --2- 172.21.15.73:0/1935060568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23e015b3d0 0x7f23cc0050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:55.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.947+0000 7f23e54da640 1 -- 172.21.15.73:0/1935060568 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f23e0071ce0 con 0x7f23cc0039e0 2024-03-29T04:09:55.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.947+0000 7f23e54da640 1 -- 172.21.15.73:0/1935060568 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f23cc00b9c0 con 0x7f23cc004390 2024-03-29T04:09:55.930 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.947+0000 7f23e54da640 1 -- 172.21.15.73:0/1935060568 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f23cc00bbc0 con 0x7f23e015b3d0 2024-03-29T04:09:55.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.947+0000 7f23e64dc640 1 --2- 172.21.15.73:0/1935060568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23cc0039e0 0x7f23cc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:55.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.947+0000 7f23e5cdb640 1 --2- 172.21.15.73:0/1935060568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23cc004390 0x7f23cc004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:55.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.947+0000 7f23e6cdd640 1 --2- 172.21.15.73:0/1935060568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23e015b3d0 0x7f23cc0050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:55.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.948+0000 7f23e64dc640 1 -- 172.21.15.73:0/1935060568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23e015b3d0 msgr2=0x7f23cc0050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:55.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.948+0000 7f23e64dc640 1 --2- 172.21.15.73:0/1935060568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23e015b3d0 0x7f23cc0050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:55.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.948+0000 7f23e64dc640 1 -- 172.21.15.73:0/1935060568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23cc004390 msgr2=0x7f23cc004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:55.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.948+0000 7f23e64dc640 1 --2- 172.21.15.73:0/1935060568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23cc004390 0x7f23cc004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:55.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.948+0000 7f23e64dc640 1 -- 172.21.15.73:0/1935060568 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23cc003520 con 0x7f23cc0039e0 2024-03-29T04:09:55.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.948+0000 7f23e6cdd640 1 --2- 172.21.15.73:0/1935060568 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23e015b3d0 0x7f23cc0050c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:09:55.931 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.948+0000 7f23e5cdb640 1 --2- 172.21.15.73:0/1935060568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23cc004390 0x7f23cc004860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:09:55.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.948+0000 7f23e64dc640 1 --2- 172.21.15.73:0/1935060568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23cc0039e0 0x7f23cc003dc0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f23d8009fc0 tx=0x7f23cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=710e7b0617255df2 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:55.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.948+0000 7f23e54da640 1 -- 172.21.15.73:0/1935060568 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d8039070 con 0x7f23cc0039e0 2024-03-29T04:09:55.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.948+0000 7f23e54da640 1 -- 172.21.15.73:0/1935060568 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23d802cc20 con 0x7f23cc0039e0 2024-03-29T04:09:55.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.948+0000 7f23e54da640 1 -- 172.21.15.73:0/1935060568 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d8009c10 con 0x7f23cc0039e0 2024-03-29T04:09:55.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.949+0000 7f23e8740640 1 -- 172.21.15.73:0/1935060568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23cc0039e0 msgr2=0x7f23cc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:55.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.949+0000 7f23e8740640 1 --2- 172.21.15.73:0/1935060568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23cc0039e0 0x7f23cc003dc0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f23d8009fc0 tx=0x7f23cc005830 comp rx=0 tx=0).stop 2024-03-29T04:09:55.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.949+0000 7f23e6cdd640 1 -- 172.21.15.73:0/1935060568 reap_dead start 2024-03-29T04:09:55.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.949+0000 7f23e8740640 1 -- 172.21.15.73:0/1935060568 shutdown_connections 2024-03-29T04:09:55.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.949+0000 7f23e8740640 1 -- 172.21.15.73:0/1935060568 >> 172.21.15.73:0/1935060568 conn(0x7f23e006b6f0 msgr2=0x7f23e006bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:55.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.949+0000 7f23e8740640 1 -- 172.21.15.73:0/1935060568 shutdown_connections 2024-03-29T04:09:55.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.949+0000 7f23e8740640 1 -- 172.21.15.73:0/1935060568 wait complete. 2024-03-29T04:09:55.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.950+0000 7f23e8740640 1 Processor -- start 2024-03-29T04:09:55.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.950+0000 7f23e8740640 1 -- start start 2024-03-29T04:09:55.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.951+0000 7f23e8740640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23cc0039e0 0x7f23e006daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:55.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.951+0000 7f23e8740640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23e00ceff0 0x7f23e0148150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:55.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.951+0000 7f23e8740640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23e0152050 0x7f23e0148690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:55.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.951+0000 7f23e8740640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f23e00b3f70 con 0x7f23e0152050 2024-03-29T04:09:55.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.951+0000 7f23e8740640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f23e015b7b0 con 0x7f23e00ceff0 2024-03-29T04:09:55.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.951+0000 7f23e8740640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f23e00b40f0 con 0x7f23cc0039e0 2024-03-29T04:09:55.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.951+0000 7f23e6cdd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23e0152050 0x7f23e0148690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:55.943 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.951+0000 7f23e6cdd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23e0152050 0x7f23e0148690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53052/0 (socket says 172.21.15.73:53052) 2024-03-29T04:09:55.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.951+0000 7f23e6cdd640 1 -- 172.21.15.73:0/1323846731 learned_addr learned my addr 172.21.15.73:0/1323846731 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:55.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.951+0000 7f23e64dc640 1 --2- 172.21.15.73:0/1323846731 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23cc0039e0 0x7f23e006daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:55.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.951+0000 7f23e6cdd640 1 -- 172.21.15.73:0/1323846731 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23cc0039e0 msgr2=0x7f23e006daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:55.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.951+0000 7f23e5cdb640 1 --2- 172.21.15.73:0/1323846731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23e00ceff0 0x7f23e0148150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:55.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.951+0000 7f23e6cdd640 1 --2- 172.21.15.73:0/1323846731 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23cc0039e0 0x7f23e006daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:55.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.951+0000 7f23e6cdd640 1 -- 172.21.15.73:0/1323846731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23e00ceff0 msgr2=0x7f23e0148150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:55.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.951+0000 7f23e6cdd640 1 --2- 172.21.15.73:0/1323846731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23e00ceff0 0x7f23e0148150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:55.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.951+0000 7f23e6cdd640 1 -- 172.21.15.73:0/1323846731 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e0152e80 con 0x7f23e0152050 2024-03-29T04:09:55.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.952+0000 7f23e6cdd640 1 --2- 172.21.15.73:0/1323846731 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23e0152050 0x7f23e0148690 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f23e00d10d0 tx=0x7f23dc00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:55.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.952+0000 7f23d6ffd640 1 -- 172.21.15.73:0/1323846731 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23dc00c590 con 0x7f23e0152050 2024-03-29T04:09:55.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.952+0000 7f23d6ffd640 1 -- 172.21.15.73:0/1323846731 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23dc018070 con 0x7f23e0152050 2024-03-29T04:09:55.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.952+0000 7f23e8740640 1 -- 172.21.15.73:0/1323846731 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23e01525e0 con 0x7f23e0152050 2024-03-29T04:09:55.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.952+0000 7f23d6ffd640 1 -- 172.21.15.73:0/1323846731 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23dc00c970 con 0x7f23e0152050 2024-03-29T04:09:55.944 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.952+0000 7f23e8740640 1 -- 172.21.15.73:0/1323846731 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23e0152ba0 con 0x7f23e0152050 2024-03-29T04:09:55.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.954+0000 7f23d6ffd640 1 -- 172.21.15.73:0/1323846731 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f23dc00cb10 con 0x7f23e0152050 2024-03-29T04:09:55.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.954+0000 7f23d6ffd640 1 --2- 172.21.15.73:0/1323846731 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f23c406c560 0x7f23c406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:55.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.954+0000 7f23d6ffd640 1 -- 172.21.15.73:0/1323846731 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f23dc08add0 con 0x7f23e0152050 2024-03-29T04:09:55.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.954+0000 7f23e64dc640 1 --2- 172.21.15.73:0/1323846731 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f23c406c560 0x7f23c406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:55.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.955+0000 7f23e64dc640 1 --2- 172.21.15.73:0/1323846731 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f23c406c560 0x7f23c406ea20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f23d802cfd0 tx=0x7f23d802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:55.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.955+0000 7f23eb40a740 1 Processor -- start 2024-03-29T04:09:55.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.955+0000 7f23eb40a740 1 -- start start 2024-03-29T04:09:55.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.956+0000 7f23eb40a740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e380b79200 0x55e380b4c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:55.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.956+0000 7f23eb40a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e380b795e0 0x55e380b7bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:55.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.956+0000 7f23eb40a740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e380b4c6e0 0x55e380b7c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:55.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.956+0000 7f23eb40a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55e380ab6880 con 0x55e380b795e0 2024-03-29T04:09:55.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.956+0000 7f23eb40a740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55e380a5e8f0 con 0x55e380b79200 2024-03-29T04:09:55.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.956+0000 7f23eb40a740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x55e380ab2830 con 0x55e380b4c6e0 2024-03-29T04:09:55.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.956+0000 7f23e5cdb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e380b795e0 0x55e380b7bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:55.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.956+0000 7f23e5cdb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e380b795e0 0x55e380b7bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53064/0 (socket says 172.21.15.73:53064) 2024-03-29T04:09:55.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.956+0000 7f23e5cdb640 1 -- 172.21.15.73:0/2673282131 learned_addr learned my addr 172.21.15.73:0/2673282131 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:55.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.956+0000 7f23e64dc640 1 --2- 172.21.15.73:0/2673282131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e380b79200 0x55e380b4c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:55.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.956+0000 7f23e6cdd640 1 --2- 172.21.15.73:0/2673282131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e380b4c6e0 0x55e380b7c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:55.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.956+0000 7f23e5cdb640 1 -- 172.21.15.73:0/2673282131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e380b4c6e0 msgr2=0x55e380b7c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:55.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.956+0000 7f23e5cdb640 1 --2- 172.21.15.73:0/2673282131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e380b4c6e0 0x55e380b7c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:55.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.956+0000 7f23e5cdb640 1 -- 172.21.15.73:0/2673282131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e380b79200 msgr2=0x55e380b4c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:55.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.956+0000 7f23e5cdb640 1 --2- 172.21.15.73:0/2673282131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e380b79200 0x55e380b4c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:55.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.956+0000 7f23e5cdb640 1 -- 172.21.15.73:0/2673282131 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e380a69140 con 0x55e380b795e0 2024-03-29T04:09:55.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.956+0000 7f23e5cdb640 1 --2- 172.21.15.73:0/2673282131 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e380b795e0 0x55e380b7bf90 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f23d0001940 tx=0x7f23d0001e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6561b928d000ef71 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:55.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.956+0000 7f23c3fff640 1 -- 172.21.15.73:0/2673282131 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d00052e0 con 0x55e380b795e0 2024-03-29T04:09:55.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.956+0000 7f23c3fff640 1 -- 172.21.15.73:0/2673282131 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23d0018070 con 0x55e380b795e0 2024-03-29T04:09:55.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.956+0000 7f23c3fff640 1 -- 172.21.15.73:0/2673282131 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d000fad0 con 0x55e380b795e0 2024-03-29T04:09:55.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.957+0000 7f23eb40a740 1 -- 172.21.15.73:0/2673282131 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e380b795e0 msgr2=0x55e380b7bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:55.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.957+0000 7f23eb40a740 1 --2- 172.21.15.73:0/2673282131 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e380b795e0 0x55e380b7bf90 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f23d0001940 tx=0x7f23d0001e00 comp rx=0 tx=0).stop 2024-03-29T04:09:55.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.957+0000 7f23eb40a740 1 -- 172.21.15.73:0/2673282131 shutdown_connections 2024-03-29T04:09:55.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.957+0000 7f23eb40a740 1 --2- 172.21.15.73:0/2673282131 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e380b4c6e0 0x55e380b7c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:55.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.957+0000 7f23eb40a740 1 --2- 172.21.15.73:0/2673282131 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e380b795e0 0x55e380b7bf90 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:55.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.957+0000 7f23eb40a740 1 --2- 172.21.15.73:0/2673282131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e380b79200 0x55e380b4c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:55.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.957+0000 7f23eb40a740 1 -- 172.21.15.73:0/2673282131 >> 172.21.15.73:0/2673282131 conn(0x55e380b4e410 msgr2=0x55e380b96f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:55.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.957+0000 7f23eb40a740 1 -- 172.21.15.73:0/2673282131 shutdown_connections 2024-03-29T04:09:55.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.957+0000 7f23eb40a740 1 -- 172.21.15.73:0/2673282131 wait complete. 2024-03-29T04:09:55.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.958+0000 7f23eb40a740 1 -- start start 2024-03-29T04:09:55.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.958+0000 7f23eb40a740 1 Processor -- start 2024-03-29T04:09:55.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.959+0000 7f23eb40a740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e380b79200 0x55e380b94470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:55.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.959+0000 7f23eb40a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e380b795e0 0x55e380b7fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:55.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.959+0000 7f23eb40a740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e380b7b6b0 0x55e380b7daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:55.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.959+0000 7f23eb40a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55e380b50ab0 con 0x55e380b795e0 2024-03-29T04:09:55.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.959+0000 7f23eb40a740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55e380a71cf0 con 0x55e380b79200 2024-03-29T04:09:55.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.959+0000 7f23eb40a740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x55e380b532f0 con 0x55e380b7b6b0 2024-03-29T04:09:55.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.959+0000 7f23eb40a740 10 client.0 _ll_register_callbacks cb 0x55e380a63f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-29T04:09:55.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.959+0000 7f23e5cdb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e380b795e0 0x55e380b7fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:55.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.959+0000 7f23e5cdb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e380b795e0 0x55e380b7fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53074/0 (socket says 172.21.15.73:53074) 2024-03-29T04:09:55.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.959+0000 7f23e5cdb640 1 -- 172.21.15.73:0/3389588608 learned_addr learned my addr 172.21.15.73:0/3389588608 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:55.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.959+0000 7f23e64dc640 1 --2- 172.21.15.73:0/3389588608 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e380b79200 0x55e380b94470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:55.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.959+0000 7f23e6cdd640 1 --2- 172.21.15.73:0/3389588608 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e380b7b6b0 0x55e380b7daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:55.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.959+0000 7f23e5cdb640 1 -- 172.21.15.73:0/3389588608 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e380b7b6b0 msgr2=0x55e380b7daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:55.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.959+0000 7f23e5cdb640 1 --2- 172.21.15.73:0/3389588608 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e380b7b6b0 0x55e380b7daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:55.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.959+0000 7f23e5cdb640 1 -- 172.21.15.73:0/3389588608 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e380b79200 msgr2=0x55e380b94470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:55.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.959+0000 7f23e5cdb640 1 --2- 172.21.15.73:0/3389588608 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e380b79200 0x55e380b94470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:55.948 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.959+0000 7f23e5cdb640 1 -- 172.21.15.73:0/3389588608 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3808947d0 con 0x55e380b795e0 2024-03-29T04:09:55.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.959+0000 7f23e5cdb640 1 --2- 172.21.15.73:0/3389588608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e380b795e0 0x55e380b7fc30 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f23d0014000 tx=0x7f23d0001320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd3c15f0929bcc07 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:55.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.959+0000 7f23c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-03-29T04:09:55.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.959+0000 7f23c17fa640 1 -- 172.21.15.73:0/3389588608 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d0010d90 con 0x55e380b795e0 2024-03-29T04:09:55.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.959+0000 7f23c17fa640 1 -- 172.21.15.73:0/3389588608 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f23d0028ae0 con 0x55e380b795e0 2024-03-29T04:09:55.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.959+0000 7f23eb40a740 1 -- 172.21.15.73:0/3389588608 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23d0018070 con 0x55e380b795e0 2024-03-29T04:09:55.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.960+0000 7f23c17fa640 1 -- 172.21.15.73:0/3389588608 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f23d002f050 con 0x55e380b795e0 2024-03-29T04:09:55.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.960+0000 7f23eb40a740 10 client.5340 fetch_fsmap learned FSMap version 15 2024-03-29T04:09:55.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.960+0000 7f23eb40a740 1 -- 172.21.15.73:0/3389588608 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55e3807ca3f0 con 0x55e380b795e0 2024-03-29T04:09:55.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.960+0000 7f23c17fa640 1 -- 172.21.15.73:0/3389588608 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23d0018070 con 0x55e380b795e0 2024-03-29T04:09:55.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.960+0000 7f23c17fa640 1 -- 172.21.15.73:0/3389588608 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 15) ==== 3494+0+0 (secure 0 0 0) 0x7f23d0028ce0 con 0x55e380b795e0 2024-03-29T04:09:55.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.960+0000 7f23eb40a740 10 client.5340 fetch_fsmap finished waiting for FSMap version 15 2024-03-29T04:09:55.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.960+0000 7f23eb40a740 10 client.5340 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-29T04:09:55.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.960+0000 7f23eb40a740 20 client.5340 populate_metadata read hostname 'smithi073' 2024-03-29T04:09:55.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.960+0000 7f23eb40a740 1 --2- 172.21.15.73:0/3389588608 >> [v2:172.21.15.73:6834/936189393,v1:172.21.15.73:6836/936189393] conn(0x55e380baad40 0x55e380bab1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:55.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.960+0000 7f23eb40a740 4 client.5340 mds_command: new command op to 5055 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-29T04:09:55.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.960+0000 7f23eb40a740 1 -- 172.21.15.73:0/3389588608 --> [v2:172.21.15.73:6834/936189393,v1:172.21.15.73:6836/936189393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e380ac3dc0 con 0x55e380baad40 2024-03-29T04:09:55.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.960+0000 7f23e64dc640 1 --2- 172.21.15.73:0/3389588608 >> [v2:172.21.15.73:6834/936189393,v1:172.21.15.73:6836/936189393] conn(0x55e380baad40 0x55e380bab1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:55.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.960+0000 7f23c17fa640 10 client.5340 ms_handle_connect on v2:172.21.15.73:6834/936189393 2024-03-29T04:09:55.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.960+0000 7f23e64dc640 1 --2- 172.21.15.73:0/3389588608 >> [v2:172.21.15.73:6834/936189393,v1:172.21.15.73:6836/936189393] conn(0x55e380baad40 0x55e380bab1b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c87097d40e40bd5f server_cookie=107233e3b190bcc8 in_seq=0 out_seq=0 2024-03-29T04:09:55.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.961+0000 7f23c17fa640 1 -- 172.21.15.73:0/3389588608 <== mds.0 v2:172.21.15.73:6834/936189393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23239 (crc 0 0 0) 0x55e380ac3dc0 con 0x55e380baad40 2024-03-29T04:09:55.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.961+0000 7f23c17fa640 10 client.5340 handle_command_reply: tid=0 2024-03-29T04:09:55.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.961+0000 7f23eb40a740 1 client.5340 shutdown 2024-03-29T04:09:55.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.961+0000 7f23eb40a740 1 -- 172.21.15.73:0/3389588608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e380b795e0 msgr2=0x55e380b7fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:55.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.961+0000 7f23eb40a740 1 --2- 172.21.15.73:0/3389588608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e380b795e0 0x55e380b7fc30 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f23d0014000 tx=0x7f23d0001320 comp rx=0 tx=0).stop 2024-03-29T04:09:55.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.961+0000 7f23eb40a740 1 -- 172.21.15.73:0/3389588608 shutdown_connections 2024-03-29T04:09:55.950 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.961+0000 7f23eb40a740 1 --2- 172.21.15.73:0/3389588608 >> [v2:172.21.15.73:6834/936189393,v1:172.21.15.73:6836/936189393] conn(0x55e380baad40 0x55e380bab1b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:55.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.961+0000 7f23eb40a740 1 --2- 172.21.15.73:0/3389588608 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e380b7b6b0 0x55e380b7daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:55.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.961+0000 7f23c17fa640 0 client.5340 ms_handle_reset on v2:172.21.15.73:6834/936189393 2024-03-29T04:09:55.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.961+0000 7f23eb40a740 1 --2- 172.21.15.73:0/3389588608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e380b795e0 0x55e380b7fc30 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:55.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.961+0000 7f23eb40a740 1 --2- 172.21.15.73:0/3389588608 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e380b79200 0x55e380b94470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:55.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.961+0000 7f23eb40a740 1 -- 172.21.15.73:0/3389588608 >> 172.21.15.73:0/3389588608 conn(0x55e380b4c6e0 msgr2=0x55e380b9a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:55.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.961+0000 7f23eb40a740 1 -- 172.21.15.73:0/3389588608 shutdown_connections 2024-03-29T04:09:55.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.961+0000 7f23eb40a740 1 -- 172.21.15.73:0/3389588608 wait complete. 2024-03-29T04:09:55.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.961+0000 7f23eb40a740 20 client.5340 trim_cache size 0 max 16384 2024-03-29T04:09:55.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.979+0000 7f23eb40a740 1 Processor -- start 2024-03-29T04:09:55.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.979+0000 7f23eb40a740 1 -- start start 2024-03-29T04:09:55.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.979+0000 7f23eb40a740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e380b79200 0x55e380b9ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:55.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.979+0000 7f23eb40a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e380b795e0 0x55e380b7d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:55.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.979+0000 7f23eb40a740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e380b7b6b0 0x55e380b69a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:55.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.979+0000 7f23eb40a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f23e0201050 con 0x55e380b795e0 2024-03-29T04:09:55.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.979+0000 7f23eb40a740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f23e00caea0 con 0x55e380b7b6b0 2024-03-29T04:09:55.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.979+0000 7f23eb40a740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f23e01f8c70 con 0x55e380b79200 2024-03-29T04:09:55.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.979+0000 7f23e5cdb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e380b795e0 0x55e380b7d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:55.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.979+0000 7f23e5cdb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e380b795e0 0x55e380b7d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53080/0 (socket says 172.21.15.73:53080) 2024-03-29T04:09:55.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.979+0000 7f23e5cdb640 1 -- 172.21.15.73:0/2028933183 learned_addr learned my addr 172.21.15.73:0/2028933183 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:55.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.980+0000 7f23e5cdb640 1 -- 172.21.15.73:0/2028933183 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e380b79200 msgr2=0x55e380b9ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:55.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.980+0000 7f23e5cdb640 1 --2- 172.21.15.73:0/2028933183 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e380b79200 0x55e380b9ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:55.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.980+0000 7f23e5cdb640 1 -- 172.21.15.73:0/2028933183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e380b7b6b0 msgr2=0x55e380b69a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:55.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.980+0000 7f23e5cdb640 1 --2- 172.21.15.73:0/2028933183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e380b7b6b0 0x55e380b69a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:55.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.980+0000 7f23e5cdb640 1 -- 172.21.15.73:0/2028933183 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e38078a0f0 con 0x55e380b795e0 2024-03-29T04:09:55.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.980+0000 7f23e5cdb640 1 --2- 172.21.15.73:0/2028933183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e380b795e0 0x55e380b7d550 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f23d0001520 tx=0x7f23d0020070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c555935bd527844 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:55.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.980+0000 7f23c37fe640 1 -- 172.21.15.73:0/2028933183 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d0010cf0 con 0x55e380b795e0 2024-03-29T04:09:55.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.980+0000 7f23c37fe640 1 -- 172.21.15.73:0/2028933183 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23d0018070 con 0x55e380b795e0 2024-03-29T04:09:55.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.980+0000 7f23c37fe640 1 -- 172.21.15.73:0/2028933183 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d0007500 con 0x55e380b795e0 2024-03-29T04:09:55.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.981+0000 7f23eb40a740 1 -- 172.21.15.73:0/2028933183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e380b795e0 msgr2=0x55e380b7d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:55.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.981+0000 7f23eb40a740 1 --2- 172.21.15.73:0/2028933183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e380b795e0 0x55e380b7d550 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f23d0001520 tx=0x7f23d0020070 comp rx=0 tx=0).stop 2024-03-29T04:09:55.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.981+0000 7f23eb40a740 1 -- 172.21.15.73:0/2028933183 shutdown_connections 2024-03-29T04:09:55.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.981+0000 7f23eb40a740 1 --2- 172.21.15.73:0/2028933183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e380b7b6b0 0x55e380b69a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:55.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.981+0000 7f23eb40a740 1 --2- 172.21.15.73:0/2028933183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e380b795e0 0x55e380b7d550 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:55.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.981+0000 7f23eb40a740 1 --2- 172.21.15.73:0/2028933183 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e380b79200 0x55e380b9ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:55.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.981+0000 7f23eb40a740 1 -- 172.21.15.73:0/2028933183 >> 172.21.15.73:0/2028933183 conn(0x55e380b4c6e0 msgr2=0x55e380b94280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:55.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.981+0000 7f23eb40a740 1 -- 172.21.15.73:0/2028933183 shutdown_connections 2024-03-29T04:09:55.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.981+0000 7f23eb40a740 1 -- 172.21.15.73:0/2028933183 wait complete. 2024-03-29T04:09:55.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.982+0000 7f23eb40a740 1 -- start start 2024-03-29T04:09:55.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.982+0000 7f23eb40a740 1 Processor -- start 2024-03-29T04:09:55.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.983+0000 7f23eb40a740 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e380b79200 0x55e380bb9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:55.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.983+0000 7f23eb40a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e380b795e0 0x55e380b935a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:55.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.983+0000 7f23eb40a740 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e380b7b6b0 0x55e380c12300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:55.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.983+0000 7f23eb40a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f23e00ca850 con 0x55e380b795e0 2024-03-29T04:09:55.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.983+0000 7f23eb40a740 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55e380b52550 con 0x55e380b79200 2024-03-29T04:09:55.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.983+0000 7f23eb40a740 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x55e380b95ef0 con 0x55e380b7b6b0 2024-03-29T04:09:55.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.983+0000 7f23eb40a740 10 client.0 _ll_register_callbacks cb 0x7f23d00017c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-29T04:09:55.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.983+0000 7f23e5cdb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e380b795e0 0x55e380b935a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:55.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.983+0000 7f23e5cdb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e380b795e0 0x55e380b935a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53092/0 (socket says 172.21.15.73:53092) 2024-03-29T04:09:55.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.983+0000 7f23e5cdb640 1 -- 172.21.15.73:0/2582322183 learned_addr learned my addr 172.21.15.73:0/2582322183 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:55.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.983+0000 7f23e5cdb640 1 -- 172.21.15.73:0/2582322183 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e380b7b6b0 msgr2=0x55e380c12300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:55.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.983+0000 7f23e5cdb640 1 --2- 172.21.15.73:0/2582322183 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e380b7b6b0 0x55e380c12300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:55.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.983+0000 7f23e5cdb640 1 -- 172.21.15.73:0/2582322183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e380b79200 msgr2=0x55e380bb9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:55.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.983+0000 7f23e5cdb640 1 --2- 172.21.15.73:0/2582322183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e380b79200 0x55e380bb9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:55.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.983+0000 7f23e5cdb640 1 -- 172.21.15.73:0/2582322183 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e380ba5410 con 0x55e380b795e0 2024-03-29T04:09:55.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.984+0000 7f23e5cdb640 1 --2- 172.21.15.73:0/2582322183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e380b795e0 0x55e380b935a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f23d0001520 tx=0x7f23d0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=367ed32aa6b8c6a1 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:55.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.984+0000 7f23c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-03-29T04:09:55.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.984+0000 7f23c17fa640 1 -- 172.21.15.73:0/2582322183 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d0041060 con 0x55e380b795e0 2024-03-29T04:09:55.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.984+0000 7f23c17fa640 1 -- 172.21.15.73:0/2582322183 <== mon.0 v2:172.21.15.73:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f23d0006ca0 con 0x55e380b795e0 2024-03-29T04:09:55.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.984+0000 7f23eb40a740 1 -- 172.21.15.73:0/2582322183 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23d0018070 con 0x55e380b795e0 2024-03-29T04:09:55.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.984+0000 7f23c17fa640 1 -- 172.21.15.73:0/2582322183 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f23d0047050 con 0x55e380b795e0 2024-03-29T04:09:55.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.984+0000 7f23eb40a740 10 client.5346 fetch_fsmap learned FSMap version 15 2024-03-29T04:09:55.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.984+0000 7f23eb40a740 1 -- 172.21.15.73:0/2582322183 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55e380ba5a30 con 0x55e380b795e0 2024-03-29T04:09:55.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.984+0000 7f23c17fa640 1 -- 172.21.15.73:0/2582322183 <== mon.0 v2:172.21.15.73:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23d0018070 con 0x55e380b795e0 2024-03-29T04:09:55.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.984+0000 7f23c17fa640 1 -- 172.21.15.73:0/2582322183 <== mon.0 v2:172.21.15.73:3300/0 5 ==== fsmap(e 15) ==== 3494+0+0 (secure 0 0 0) 0x7f23d004a020 con 0x55e380b795e0 2024-03-29T04:09:55.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.984+0000 7f23eb40a740 10 client.5346 fetch_fsmap finished waiting for FSMap version 15 2024-03-29T04:09:55.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.984+0000 7f23eb40a740 10 client.5346 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-03-29T04:09:55.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.984+0000 7f23eb40a740 20 client.5346 populate_metadata read hostname 'smithi073' 2024-03-29T04:09:55.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.984+0000 7f23eb40a740 1 --2- 172.21.15.73:0/2582322183 >> [v2:172.21.15.73:6834/936189393,v1:172.21.15.73:6836/936189393] conn(0x55e380b6a3a0 0x55e380b6a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:55.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.984+0000 7f23eb40a740 4 client.5346 mds_command: new command op to 5055 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-29T04:09:55.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.984+0000 7f23eb40a740 1 -- 172.21.15.73:0/2582322183 --> [v2:172.21.15.73:6834/936189393,v1:172.21.15.73:6836/936189393] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e380abe110 con 0x55e380b6a3a0 2024-03-29T04:09:55.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.984+0000 7f23e64dc640 1 --2- 172.21.15.73:0/2582322183 >> [v2:172.21.15.73:6834/936189393,v1:172.21.15.73:6836/936189393] conn(0x55e380b6a3a0 0x55e380b6a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:55.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.984+0000 7f23c17fa640 10 client.5346 ms_handle_connect on v2:172.21.15.73:6834/936189393 2024-03-29T04:09:55.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.985+0000 7f23e64dc640 1 --2- 172.21.15.73:0/2582322183 >> [v2:172.21.15.73:6834/936189393,v1:172.21.15.73:6836/936189393] conn(0x55e380b6a3a0 0x55e380b6a7c0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5109947653bee77a server_cookie=c47d649e76bf8b5b in_seq=0 out_seq=0 2024-03-29T04:09:55.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.985+0000 7f23c17fa640 1 -- 172.21.15.73:0/2582322183 <== mds.0 v2:172.21.15.73:6834/936189393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+376 (crc 0 0 0) 0x55e380abe110 con 0x55e380b6a3a0 2024-03-29T04:09:55.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.985+0000 7f23c17fa640 10 client.5346 handle_command_reply: tid=0 2024-03-29T04:09:55.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.985+0000 7f23eb40a740 1 client.5346 shutdown 2024-03-29T04:09:55.969 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.985+0000 7f23eb40a740 1 -- 172.21.15.73:0/2582322183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e380b795e0 msgr2=0x55e380b935a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:55.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.985+0000 7f23eb40a740 1 --2- 172.21.15.73:0/2582322183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e380b795e0 0x55e380b935a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f23d0001520 tx=0x7f23d0009040 comp rx=0 tx=0).stop 2024-03-29T04:09:55.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.985+0000 7f23eb40a740 1 -- 172.21.15.73:0/2582322183 shutdown_connections 2024-03-29T04:09:55.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.985+0000 7f23eb40a740 1 --2- 172.21.15.73:0/2582322183 >> [v2:172.21.15.73:6834/936189393,v1:172.21.15.73:6836/936189393] conn(0x55e380b6a3a0 0x55e380b6a7c0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:55.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.985+0000 7f23eb40a740 1 --2- 172.21.15.73:0/2582322183 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x55e380b7b6b0 0x55e380c12300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:55.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.985+0000 7f23c17fa640 0 client.5346 ms_handle_reset on v2:172.21.15.73:6834/936189393 2024-03-29T04:09:55.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.985+0000 7f23eb40a740 1 --2- 172.21.15.73:0/2582322183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e380b795e0 0x55e380b935a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:55.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.985+0000 7f23eb40a740 1 --2- 172.21.15.73:0/2582322183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e380b79200 0x55e380bb9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:55.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.985+0000 7f23eb40a740 1 -- 172.21.15.73:0/2582322183 >> 172.21.15.73:0/2582322183 conn(0x55e380b4c6e0 msgr2=0x55e380b518a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:55.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.985+0000 7f23eb40a740 1 -- 172.21.15.73:0/2582322183 shutdown_connections 2024-03-29T04:09:55.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.985+0000 7f23eb40a740 1 -- 172.21.15.73:0/2582322183 wait complete. 2024-03-29T04:09:55.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.985+0000 7f23eb40a740 20 client.5346 trim_cache size 0 max 16384 2024-03-29T04:09:55.971 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-29T04:09:55.971 INFO:teuthology.orchestra.run.smithi073.stdout: "status": "no active scrubs running", 2024-03-29T04:09:55.971 INFO:teuthology.orchestra.run.smithi073.stdout: "scrubs": {}, 2024-03-29T04:09:55.971 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_stats": { 2024-03-29T04:09:55.971 INFO:teuthology.orchestra.run.smithi073.stdout: "7e193353-fdbe-4459-b4cb-b68b5e7e41cb": { 2024-03-29T04:09:55.971 INFO:teuthology.orchestra.run.smithi073.stdout: "start_time": "2024-03-29T04:09:25.567755+0000", 2024-03-29T04:09:55.971 INFO:teuthology.orchestra.run.smithi073.stdout: "path": "/", 2024-03-29T04:09:55.971 INFO:teuthology.orchestra.run.smithi073.stdout: "uninline_started": 75, 2024-03-29T04:09:55.971 INFO:teuthology.orchestra.run.smithi073.stdout: "uninline_passed": 75, 2024-03-29T04:09:55.971 INFO:teuthology.orchestra.run.smithi073.stdout: "uninline_failed": 0, 2024-03-29T04:09:55.971 INFO:teuthology.orchestra.run.smithi073.stdout: "uninline_skipped": 0 2024-03-29T04:09:55.971 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-29T04:09:55.971 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-03-29T04:09:55.971 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-29T04:09:55.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.986+0000 7f23e8740640 1 -- 172.21.15.73:0/1323846731 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f23c406c560 msgr2=0x7f23c406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:55.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.986+0000 7f23e8740640 1 --2- 172.21.15.73:0/1323846731 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f23c406c560 0x7f23c406ea20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f23d802cfd0 tx=0x7f23d802e000 comp rx=0 tx=0).stop 2024-03-29T04:09:55.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.986+0000 7f23e8740640 1 -- 172.21.15.73:0/1323846731 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23e0152050 msgr2=0x7f23e0148690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:55.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.986+0000 7f23e8740640 1 --2- 172.21.15.73:0/1323846731 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23e0152050 0x7f23e0148690 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f23e00d10d0 tx=0x7f23dc00eb90 comp rx=0 tx=0).stop 2024-03-29T04:09:55.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.986+0000 7f23e8740640 1 -- 172.21.15.73:0/1323846731 shutdown_connections 2024-03-29T04:09:55.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.986+0000 7f23e8740640 1 --2- 172.21.15.73:0/1323846731 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23e0152050 0x7f23e0148690 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:55.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.986+0000 7f23e8740640 1 --2- 172.21.15.73:0/1323846731 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f23c406c560 0x7f23c406ea20 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:55.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.986+0000 7f23e8740640 1 --2- 172.21.15.73:0/1323846731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f23e00ceff0 0x7f23e0148150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:55.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.986+0000 7f23e8740640 1 --2- 172.21.15.73:0/1323846731 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f23cc0039e0 0x7f23e006daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:55.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.986+0000 7f23e8740640 1 -- 172.21.15.73:0/1323846731 >> 172.21.15.73:0/1323846731 conn(0x7f23e006b6f0 msgr2=0x7f23e00b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:55.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.986+0000 7f23e8740640 1 -- 172.21.15.73:0/1323846731 shutdown_connections 2024-03-29T04:09:55.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:55.986+0000 7f23e8740640 1 -- 172.21.15.73:0/1323846731 wait complete. 2024-03-29T04:09:55.979 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-29T04:09:55.980 DEBUG:tasks.cephfs.test_uninlining:extracting inodes 2024-03-29T04:09:55.980 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ceph/Kconfig 2024-03-29T04:09:55.980 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ceph/Kconfig 2024-03-29T04:09:55.995 INFO:teuthology.orchestra.run.smithi073.stdout:1099511627780 linux-5.4/fs/ceph/Kconfig 2024-03-29T04:09:55.995 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ceph/Makefile 2024-03-29T04:09:55.995 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ceph/Makefile 2024-03-29T04:09:56.049 INFO:teuthology.orchestra.run.smithi073.stdout:1099511628281 linux-5.4/fs/ceph/Makefile 2024-03-29T04:09:56.050 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ceph/ceph_frag.c 2024-03-29T04:09:56.050 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ceph/ceph_frag.c 2024-03-29T04:09:56.105 INFO:teuthology.orchestra.run.smithi073.stdout:1099511628287 linux-5.4/fs/ceph/ceph_frag.c 2024-03-29T04:09:56.105 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ceph/io.h 2024-03-29T04:09:56.105 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ceph/io.h 2024-03-29T04:09:56.159 INFO:teuthology.orchestra.run.smithi073.stdout:1099511628294 linux-5.4/fs/ceph/io.h 2024-03-29T04:09:56.159 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ceph/ioctl.h 2024-03-29T04:09:56.159 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ceph/ioctl.h 2024-03-29T04:09:56.213 INFO:teuthology.orchestra.run.smithi073.stdout:1099511628296 linux-5.4/fs/ceph/ioctl.h 2024-03-29T04:09:56.214 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/Kconfig 2024-03-29T04:09:56.214 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/Kconfig 2024-03-29T04:09:56.268 INFO:teuthology.orchestra.run.smithi073.stdout:1099511628308 linux-5.4/fs/ext2/Kconfig 2024-03-29T04:09:56.268 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/xattr_user.c 2024-03-29T04:09:56.269 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/xattr_user.c 2024-03-29T04:09:56.322 INFO:teuthology.orchestra.run.smithi073.stdout:1099511628326 linux-5.4/fs/ext2/xattr_user.c 2024-03-29T04:09:56.322 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/xattr_security.c 2024-03-29T04:09:56.323 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/xattr_security.c 2024-03-29T04:09:56.377 INFO:teuthology.orchestra.run.smithi073.stdout:1099511628324 linux-5.4/fs/ext2/xattr_security.c 2024-03-29T04:09:56.377 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/Makefile 2024-03-29T04:09:56.377 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/Makefile 2024-03-29T04:09:56.432 INFO:teuthology.orchestra.run.smithi073.stdout:1099511628309 linux-5.4/fs/ext2/Makefile 2024-03-29T04:09:56.432 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/symlink.c 2024-03-29T04:09:56.432 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/symlink.c 2024-03-29T04:09:56.487 INFO:teuthology.orchestra.run.smithi073.stdout:1099511628321 linux-5.4/fs/ext2/symlink.c 2024-03-29T04:09:56.487 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/acl.h 2024-03-29T04:09:56.487 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/acl.h 2024-03-29T04:09:56.541 INFO:teuthology.orchestra.run.smithi073.stdout:1099511628311 linux-5.4/fs/ext2/acl.h 2024-03-29T04:09:56.542 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/xattr_trusted.c 2024-03-29T04:09:56.542 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/xattr_trusted.c 2024-03-29T04:09:56.597 INFO:teuthology.orchestra.run.smithi073.stdout:1099511628325 linux-5.4/fs/ext2/xattr_trusted.c 2024-03-29T04:09:56.597 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/ext2/xattr.h 2024-03-29T04:09:56.598 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/ext2/xattr.h 2024-03-29T04:09:56.651 INFO:teuthology.orchestra.run.smithi073.stdout:1099511628323 linux-5.4/fs/ext2/xattr.h 2024-03-29T04:09:56.652 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/Kconfig 2024-03-29T04:09:56.652 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/Kconfig 2024-03-29T04:09:56.707 INFO:teuthology.orchestra.run.smithi073.stdout:1099511628328 linux-5.4/fs/orangefs/Kconfig 2024-03-29T04:09:56.707 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/orangefs-debug.h 2024-03-29T04:09:56.707 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/orangefs-debug.h 2024-03-29T04:09:56.762 INFO:teuthology.orchestra.run.smithi073.stdout:1099511628341 linux-5.4/fs/orangefs/orangefs-debug.h 2024-03-29T04:09:56.762 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/orangefs-sysfs.h 2024-03-29T04:09:56.762 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/orangefs-sysfs.h 2024-03-29T04:09:56.817 INFO:teuthology.orchestra.run.smithi073.stdout:1099511628348 linux-5.4/fs/orangefs/orangefs-sysfs.h 2024-03-29T04:09:56.817 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/dcache.c 2024-03-29T04:09:56.817 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/dcache.c 2024-03-29T04:09:56.872 INFO:teuthology.orchestra.run.smithi073.stdout:1099511628331 linux-5.4/fs/orangefs/dcache.c 2024-03-29T04:09:56.873 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/orangefs-bufmap.h 2024-03-29T04:09:56.873 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/orangefs-bufmap.h 2024-03-29T04:09:56.927 INFO:teuthology.orchestra.run.smithi073.stdout:1099511628339 linux-5.4/fs/orangefs/orangefs-bufmap.h 2024-03-29T04:09:56.927 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/orangefs-debugfs.h 2024-03-29T04:09:56.928 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/orangefs-debugfs.h 2024-03-29T04:09:56.982 INFO:teuthology.orchestra.run.smithi073.stdout:1099511628343 linux-5.4/fs/orangefs/orangefs-debugfs.h 2024-03-29T04:09:56.983 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/orangefs-dev-proto.h 2024-03-29T04:09:56.983 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/orangefs-dev-proto.h 2024-03-29T04:09:57.037 INFO:teuthology.orchestra.run.smithi073.stdout:1099511628344 linux-5.4/fs/orangefs/orangefs-dev-proto.h 2024-03-29T04:09:57.037 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/Makefile 2024-03-29T04:09:57.037 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/Makefile 2024-03-29T04:09:57.094 INFO:teuthology.orchestra.run.smithi073.stdout:1099511628329 linux-5.4/fs/orangefs/Makefile 2024-03-29T04:09:57.094 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/symlink.c 2024-03-29T04:09:57.094 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/symlink.c 2024-03-29T04:09:57.149 INFO:teuthology.orchestra.run.smithi073.stdout:1099511628352 linux-5.4/fs/orangefs/symlink.c 2024-03-29T04:09:57.149 DEBUG:tasks.cephfs.test_uninlining:getting inode for:linux-5.4/fs/orangefs/downcall.h 2024-03-29T04:09:57.149 DEBUG:teuthology.orchestra.run.smithi073:> cd /home/ubuntu/cephtest/mnt.0 && ls -i linux-5.4/fs/orangefs/downcall.h 2024-03-29T04:09:57.204 INFO:teuthology.orchestra.run.smithi073.stdout:1099511628334 linux-5.4/fs/orangefs/downcall.h 2024-03-29T04:09:57.204 DEBUG:tasks.cephfs.test_uninlining:getting inline data info 2024-03-29T04:09:57.204 DEBUG:tasks.cephfs.test_uninlining:getting inode info #1 of 23:1099511627780 2024-03-29T04:09:57.204 DEBUG:tasks.cephfs.test_uninlining:try #1 - dump inode 1099511627780 2024-03-29T04:09:57.205 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-29T04:09:57.205 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-29T04:09:57.285 DEBUG:teuthology.orchestra.run.smithi142:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-29T04:09:57.333 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-29T04:09:57.334 INFO:tasks.cephfs.mount:Terminating background process 2024-03-29T04:09:57.334 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-29T04:09:57.334 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-29T04:09:57.349 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-29T04:09:57.350 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-29T04:09:57.404 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-29T04:09:57.582 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.602+0000 7fadddd82640 1 Processor -- start 2024-03-29T04:09:57.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.602+0000 7fadddd82640 1 -- start start 2024-03-29T04:09:57.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.603+0000 7fadddd82640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fadd815b370 0x7fadd80b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:57.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.603+0000 7fadddd82640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadd8071ae0 con 0x7fadd806f3f0 2024-03-29T04:09:57.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.603+0000 7fadddd82640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadd8071dc0 con 0x7fadd8073290 2024-03-29T04:09:57.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.603+0000 7fadddd82640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fadd80720a0 con 0x7fadd815b370 2024-03-29T04:09:57.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.603+0000 7fadd6ffd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fadd806f3f0 0x7fadd8072b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52432/0 (socket says 172.21.15.73:52432) 2024-03-29T04:09:57.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.603+0000 7fadd6ffd640 1 -- 172.21.15.73:0/1957627296 learned_addr learned my addr 172.21.15.73:0/1957627296 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:09:57.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.603+0000 7fadd67fc640 1 -- 172.21.15.73:0/1957627296 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1282927977 0 0) 0x7fadd8071ae0 con 0x7fadd806f3f0 2024-03-29T04:09:57.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.603+0000 7fadd77fe640 1 --2- 172.21.15.73:0/1957627296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fadd815b370 0x7fadd80b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:57.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.603+0000 7fadd67fc640 1 -- 172.21.15.73:0/1957627296 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadc0005730 con 0x7fadd806f3f0 2024-03-29T04:09:57.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.603+0000 7fadd67fc640 1 -- 172.21.15.73:0/1957627296 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 582898176 0 0) 0x7fadc0005730 con 0x7fadd806f3f0 2024-03-29T04:09:57.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.603+0000 7fadd67fc640 1 -- 172.21.15.73:0/1957627296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fadd815b370 msgr2=0x7fadd80b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:57.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.603+0000 7fadd67fc640 1 --2- 172.21.15.73:0/1957627296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fadd815b370 0x7fadd80b32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:57.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.603+0000 7fadd67fc640 1 -- 172.21.15.73:0/1957627296 >> v1:172.21.15.142:6789/0 conn(0x7fadd8073290 legacy=0x7fadd815f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:57.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.603+0000 7fadd67fc640 1 -- 172.21.15.73:0/1957627296 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd8072380 con 0x7fadd806f3f0 2024-03-29T04:09:57.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.603+0000 7fadd67fc640 1 -- 172.21.15.73:0/1957627296 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1290421750 0 0) 0x7fadcc001670 con 0x7fadd806f3f0 2024-03-29T04:09:57.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.603+0000 7fadd67fc640 1 -- 172.21.15.73:0/1957627296 >> v1:172.21.15.73:6789/0 conn(0x7fadd806f3f0 legacy=0x7fadd8072b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:57.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.603+0000 7fadd67fc640 1 --2- 172.21.15.73:0/1957627296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fadd815b370 0x7fadc0005bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:57.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.603+0000 7fadd67fc640 1 --2- 172.21.15.73:0/1957627296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadc0006130 0x7fadc0006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:57.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.603+0000 7fadd67fc640 1 --2- 172.21.15.73:0/1957627296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadc0006f50 0x7fadc00073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:57.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.603+0000 7fadd67fc640 1 -- 172.21.15.73:0/1957627296 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fadd80720a0 con 0x7fadc0006f50 2024-03-29T04:09:57.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.603+0000 7fadd67fc640 1 -- 172.21.15.73:0/1957627296 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fadc000dc30 con 0x7fadc0006130 2024-03-29T04:09:57.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.603+0000 7fadd67fc640 1 -- 172.21.15.73:0/1957627296 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fadc000de30 con 0x7fadd815b370 2024-03-29T04:09:57.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.603+0000 7fadd7fff640 1 --2- 172.21.15.73:0/1957627296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadc0006f50 0x7fadc00073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:57.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.604+0000 7fadd77fe640 1 --2- 172.21.15.73:0/1957627296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fadd815b370 0x7fadc0005bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:57.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.604+0000 7fadd6ffd640 1 --2- 172.21.15.73:0/1957627296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadc0006130 0x7fadc0006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:57.587 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.604+0000 7fadd7fff640 1 -- 172.21.15.73:0/1957627296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fadd815b370 msgr2=0x7fadc0005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:57.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.604+0000 7fadd7fff640 1 --2- 172.21.15.73:0/1957627296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fadd815b370 0x7fadc0005bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:57.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.604+0000 7fadd7fff640 1 -- 172.21.15.73:0/1957627296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadc0006130 msgr2=0x7fadc0006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:57.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.604+0000 7fadd7fff640 1 --2- 172.21.15.73:0/1957627296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadc0006130 0x7fadc0006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:57.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.604+0000 7fadd7fff640 1 -- 172.21.15.73:0/1957627296 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc0005730 con 0x7fadc0006f50 2024-03-29T04:09:57.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.604+0000 7fadd77fe640 1 --2- 172.21.15.73:0/1957627296 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fadd815b370 0x7fadc0005bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:09:57.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.604+0000 7fadd6ffd640 1 --2- 172.21.15.73:0/1957627296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadc0006130 0x7fadc0006a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:09:57.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.604+0000 7fadd7fff640 1 --2- 172.21.15.73:0/1957627296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadc0006f50 0x7fadc00073d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fadd0001f60 tx=0x7fadc0007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545dc0c85cc1b098 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:57.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.605+0000 7fadd67fc640 1 -- 172.21.15.73:0/1957627296 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd0001b30 con 0x7fadc0006f50 2024-03-29T04:09:57.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.605+0000 7fadd67fc640 1 -- 172.21.15.73:0/1957627296 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadd002d710 con 0x7fadc0006f50 2024-03-29T04:09:57.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.605+0000 7fadd67fc640 1 -- 172.21.15.73:0/1957627296 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd002db00 con 0x7fadc0006f50 2024-03-29T04:09:57.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.605+0000 7fadddd82640 1 -- 172.21.15.73:0/1957627296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadc0006f50 msgr2=0x7fadc00073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:57.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.605+0000 7fadddd82640 1 --2- 172.21.15.73:0/1957627296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadc0006f50 0x7fadc00073d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fadd0001f60 tx=0x7fadc0007a40 comp rx=0 tx=0).stop 2024-03-29T04:09:57.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.605+0000 7fadd7fff640 1 -- 172.21.15.73:0/1957627296 reap_dead start 2024-03-29T04:09:57.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.605+0000 7fadddd82640 1 -- 172.21.15.73:0/1957627296 shutdown_connections 2024-03-29T04:09:57.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.605+0000 7fadddd82640 1 -- 172.21.15.73:0/1957627296 >> 172.21.15.73:0/1957627296 conn(0x7fadd806b510 msgr2=0x7fadd806b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:57.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.605+0000 7fadddd82640 1 -- 172.21.15.73:0/1957627296 shutdown_connections 2024-03-29T04:09:57.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.605+0000 7fadddd82640 1 -- 172.21.15.73:0/1957627296 wait complete. 2024-03-29T04:09:57.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.606+0000 7fadddd82640 1 Processor -- start 2024-03-29T04:09:57.591 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.607+0000 7fadddd82640 1 -- start start 2024-03-29T04:09:57.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.607+0000 7fadddd82640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadd8145440 0x7fadd80ce750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:57.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.607+0000 7fadddd82640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fadd80cec90 0x7fadd8150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:57.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.607+0000 7fadddd82640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadd8145b30 0x7fadd81508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:57.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.607+0000 7fadddd82640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fadd815b8d0 con 0x7fadd8145440 2024-03-29T04:09:57.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.607+0000 7fadddd82640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fadd815b750 con 0x7fadd8145b30 2024-03-29T04:09:57.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.607+0000 7fadddd82640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fadd80b32c0 con 0x7fadd80cec90 2024-03-29T04:09:57.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.607+0000 7fadd77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadd8145440 0x7fadd80ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:57.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.607+0000 7fadd77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadd8145440 0x7fadd80ce750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51464/0 (socket says 172.21.15.73:51464) 2024-03-29T04:09:57.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.607+0000 7fadd77fe640 1 -- 172.21.15.73:0/2821431562 learned_addr learned my addr 172.21.15.73:0/2821431562 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:57.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.608+0000 7fadd7fff640 1 --2- 172.21.15.73:0/2821431562 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadd8145b30 0x7fadd81508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:57.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.608+0000 7fadd77fe640 1 -- 172.21.15.73:0/2821431562 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fadd80cec90 msgr2=0x7fadd8150390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:57.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.608+0000 7fadd6ffd640 1 --2- 172.21.15.73:0/2821431562 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fadd80cec90 0x7fadd8150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:57.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.608+0000 7fadd77fe640 1 --2- 172.21.15.73:0/2821431562 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fadd80cec90 0x7fadd8150390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:57.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.608+0000 7fadd77fe640 1 -- 172.21.15.73:0/2821431562 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadd8145b30 msgr2=0x7fadd81508d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:57.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.608+0000 7fadd77fe640 1 --2- 172.21.15.73:0/2821431562 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadd8145b30 0x7fadd81508d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:57.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.608+0000 7fadd77fe640 1 -- 172.21.15.73:0/2821431562 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd80cf130 con 0x7fadd8145440 2024-03-29T04:09:57.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.608+0000 7fadd77fe640 1 --2- 172.21.15.73:0/2821431562 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadd8145440 0x7fadd80ce750 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fadc80116d0 tx=0x7fadc8011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:57.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.608+0000 7fadbffff640 1 -- 172.21.15.73:0/2821431562 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc800f9c0 con 0x7fadd8145440 2024-03-29T04:09:57.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.608+0000 7fadbffff640 1 -- 172.21.15.73:0/2821431562 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadc800fb60 con 0x7fadd8145440 2024-03-29T04:09:57.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.608+0000 7fadddd82640 1 -- 172.21.15.73:0/2821431562 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadd80cf410 con 0x7fadd8145440 2024-03-29T04:09:57.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.608+0000 7fadbffff640 1 -- 172.21.15.73:0/2821431562 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc8015460 con 0x7fadd8145440 2024-03-29T04:09:57.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.608+0000 7fadddd82640 1 -- 172.21.15.73:0/2821431562 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadd815c4f0 con 0x7fadd8145440 2024-03-29T04:09:57.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.609+0000 7fadddd82640 1 -- 172.21.15.73:0/2821431562 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadd8068640 con 0x7fadd8145440 2024-03-29T04:09:57.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.609+0000 7fadbffff640 1 -- 172.21.15.73:0/2821431562 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fadc8015600 con 0x7fadd8145440 2024-03-29T04:09:57.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.610+0000 7fadbffff640 1 --2- 172.21.15.73:0/2821431562 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fadc406c560 0x7fadc406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:57.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.610+0000 7fadd6ffd640 1 --2- 172.21.15.73:0/2821431562 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fadc406c560 0x7fadc406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:57.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.610+0000 7fadbffff640 1 -- 172.21.15.73:0/2821431562 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fadc808c100 con 0x7fadd8145440 2024-03-29T04:09:57.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.610+0000 7fadd6ffd640 1 --2- 172.21.15.73:0/2821431562 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fadc406c560 0x7fadc406ea20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fadcc000fd0 tx=0x7fadcc001170 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:57.595 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.615+0000 7fadbffff640 1 -- 172.21.15.73:0/2821431562 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fadc8019030 con 0x7fadd8145440 2024-03-29T04:09:57.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.792+0000 7fadddd82640 1 -- 172.21.15.73:0/2821431562 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fadd806f1b0 con 0x7fadd8145440 2024-03-29T04:09:57.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.793+0000 7fadbffff640 1 -- 172.21.15.73:0/2821431562 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16669 (secure 0 0 0) 0x7fadc805a720 con 0x7fadd8145440 2024-03-29T04:09:57.774 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:09:57.774 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":32,"fsid":"6bff1617-b138-4517-acca-3ecaae3f2bb3","created":"2024-03-29T04:07:47.346864+0000","modified":"2024-03-29T04:09:00.732697+0000","last_up_change":"2024-03-29T04:07:58.507139+0000","last_in_change":"2024-03-29T04:07:49.637816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-29T04:07:59.537301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-29T04:08:57.521498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-29T04:08:58.027631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"925d7de1-14ab-48c0-aebd-7bded108f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6820","nonce":2387335359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6824","nonce":2387335359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6831","nonce":2387335359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6828","nonce":2387335359}]},"public_addr":"172.21.15.73:6820/2387335359","cluster_addr":"172.21.15.73:6824/2387335359","heartbeat_back_addr":"172.21.15.73:6831/2387335359","heartbeat_front_addr":"172.21.15.73:6828/2387335359","state":["exists","up"]},{"osd":1,"uuid":"6b182102-882a-4e0c-99db-0afae5cfb38b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6801","nonce":2431315515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6803","nonce":2431315515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6807","nonce":2431315515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6805","nonce":2431315515}]},"public_addr":"172.21.15.73:6801/2431315515","cluster_addr":"172.21.15.73:6803/2431315515","heartbeat_back_addr":"172.21.15.73:6807/2431315515","heartbeat_front_addr":"172.21.15.73:6805/2431315515","state":["exists","up"]},{"osd":2,"uuid":"8040902e-b0b8-4a21-bf64-ce1c222115ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6809","nonce":407236597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6811","nonce":407236597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6815","nonce":407236597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6813","nonce":407236597}]},"public_addr":"172.21.15.73:6809/407236597","cluster_addr":"172.21.15.73:6811/407236597","heartbeat_back_addr":"172.21.15.73:6815/407236597","heartbeat_front_addr":"172.21.15.73:6813/407236597","state":["exists","up"]},{"osd":3,"uuid":"1bab19ee-3775-4ce1-a4ce-cf7cda3bbbf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6817","nonce":4291100709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6821","nonce":4291100709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6829","nonce":4291100709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6825","nonce":4291100709}]},"public_addr":"172.21.15.73:6817/4291100709","cluster_addr":"172.21.15.73:6821/4291100709","heartbeat_back_addr":"172.21.15.73:6829/4291100709","heartbeat_front_addr":"172.21.15.73:6825/4291100709","state":["exists","up"]},{"osd":4,"uuid":"b0c74337-8fe4-47dc-b3da-2d07591b1f6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6817","nonce":3703256194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6819","nonce":3703256194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6823","nonce":3703256194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6821","nonce":3703256194}]},"public_addr":"172.21.15.142:6817/3703256194","cluster_addr":"172.21.15.142:6819/3703256194","heartbeat_back_addr":"172.21.15.142:6823/3703256194","heartbeat_front_addr":"172.21.15.142:6821/3703256194","state":["exists","up"]},{"osd":5,"uuid":"9ce36410-a29a-42c6-99f4-f95d4afdd7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6825","nonce":4271575803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6827","nonce":4271575803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6831","nonce":4271575803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6829","nonce":4271575803}]},"public_addr":"172.21.15.142:6825/4271575803","cluster_addr":"172.21.15.142:6827/4271575803","heartbeat_back_addr":"172.21.15.142:6831/4271575803","heartbeat_front_addr":"172.21.15.142:6829/4271575803","state":["exists","up"]},{"osd":6,"uuid":"aec4264a-64ac-428e-a860-d2920a304019","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6801","nonce":1772722570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6803","nonce":1772722570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6807","nonce":1772722570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6805","nonce":1772722570}]},"public_addr":"172.21.15.142:6801/1772722570","cluster_addr":"172.21.15.142:6803/1772722570","heartbeat_back_addr":"172.21.15.142:6807/1772722570","heartbeat_front_addr":"172.21.15.142:6805/1772722570","state":["exists","up"]},{"osd":7,"uuid":"fe599052-8e5a-4c7a-91e7-52d1bae24a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6809","nonce":3910589675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6811","nonce":3910589675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6815","nonce":3910589675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6813","nonce":3910589675}]},"public_addr":"172.21.15.142:6809/3910589675","cluster_addr":"172.21.15.142:6811/3910589675","heartbeat_back_addr":"172.21.15.142:6815/3910589675","heartbeat_front_addr":"172.21.15.142:6813/3910589675","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.835096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.587210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.786547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.778004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.843740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.791160+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.837992+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.718722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:09:57.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.795+0000 7fadddd82640 1 -- 172.21.15.73:0/2821431562 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fadc406c560 msgr2=0x7fadc406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:57.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.795+0000 7fadddd82640 1 --2- 172.21.15.73:0/2821431562 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fadc406c560 0x7fadc406ea20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fadcc000fd0 tx=0x7fadcc001170 comp rx=0 tx=0).stop 2024-03-29T04:09:57.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.795+0000 7fadddd82640 1 -- 172.21.15.73:0/2821431562 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadd8145440 msgr2=0x7fadd80ce750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:57.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.795+0000 7fadddd82640 1 --2- 172.21.15.73:0/2821431562 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadd8145440 0x7fadd80ce750 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fadc80116d0 tx=0x7fadc8011b90 comp rx=0 tx=0).stop 2024-03-29T04:09:57.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.795+0000 7fadddd82640 1 -- 172.21.15.73:0/2821431562 shutdown_connections 2024-03-29T04:09:57.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.795+0000 7fadddd82640 1 --2- 172.21.15.73:0/2821431562 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fadc406c560 0x7fadc406ea20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:57.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.795+0000 7fadddd82640 1 --2- 172.21.15.73:0/2821431562 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fadd8145b30 0x7fadd81508d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:57.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.795+0000 7fadddd82640 1 --2- 172.21.15.73:0/2821431562 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fadd80cec90 0x7fadd8150390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:57.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.795+0000 7fadddd82640 1 --2- 172.21.15.73:0/2821431562 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadd8145440 0x7fadd80ce750 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:57.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.795+0000 7fadddd82640 1 -- 172.21.15.73:0/2821431562 >> 172.21.15.73:0/2821431562 conn(0x7fadd806b510 msgr2=0x7fadd80ae830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:57.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.795+0000 7fadddd82640 1 -- 172.21.15.73:0/2821431562 shutdown_connections 2024-03-29T04:09:57.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.795+0000 7fadddd82640 1 -- 172.21.15.73:0/2821431562 wait complete. 2024-03-29T04:09:57.787 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-29T04:07:59.537301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-29T04:08:57.521498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-29T04:08:58.027631+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-29T04:09:57.787 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-29T04:09:57.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.913+0000 7fd50eb0e640 1 Processor -- start 2024-03-29T04:09:57.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.913+0000 7fd50eb0e640 1 -- start start 2024-03-29T04:09:57.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.913+0000 7fd50eb0e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5080ce470 0x7fd5080d10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:57.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.913+0000 7fd50eb0e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd5080d1600 0x7fd508070390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:57.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.913+0000 7fd50eb0e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd5080708d0 0x7fd508162610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:57.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.913+0000 7fd50eb0e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fd508070d40 con 0x7fd5080d1600 2024-03-29T04:09:57.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.913+0000 7fd50eb0e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd50809aa30 con 0x7fd5080708d0 2024-03-29T04:09:57.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.913+0000 7fd50eb0e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd50809ac60 con 0x7fd5080ce470 2024-03-29T04:09:57.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.914+0000 7fd4fffff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd5080d1600 0x7fd508070390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:57.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.914+0000 7fd4fffff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd5080d1600 0x7fd508070390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51466/0 (socket says 172.21.15.73:51466) 2024-03-29T04:09:57.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.914+0000 7fd4fffff640 1 -- 172.21.15.73:0/2987483142 learned_addr learned my addr 172.21.15.73:0/2987483142 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:57.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.914+0000 7fd50c8aa640 1 --2- 172.21.15.73:0/2987483142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5080ce470 0x7fd5080d10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:57.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.914+0000 7fd50d0ab640 1 --2- 172.21.15.73:0/2987483142 >> v2:172.21.15.142:3300/0 conn(0x7fd5080708d0 0x7fd508162610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:57.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.914+0000 7fd4fffff640 1 -- 172.21.15.73:0/2987483142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5080ce470 msgr2=0x7fd5080d10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:57.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.914+0000 7fd4fffff640 1 --2- 172.21.15.73:0/2987483142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5080ce470 0x7fd5080d10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:57.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.914+0000 7fd4fffff640 1 -- 172.21.15.73:0/2987483142 >> v2:172.21.15.142:3300/0 conn(0x7fd5080708d0 msgr2=0x7fd508162610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:57.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.914+0000 7fd4fffff640 1 --2- 172.21.15.73:0/2987483142 >> v2:172.21.15.142:3300/0 conn(0x7fd5080708d0 0x7fd508162610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:57.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.914+0000 7fd4fffff640 1 -- 172.21.15.73:0/2987483142 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd50809af40 con 0x7fd5080d1600 2024-03-29T04:09:57.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.915+0000 7fd4fffff640 1 --2- 172.21.15.73:0/2987483142 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5080d1600 0x7fd508070390 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd508072dd0 tx=0x7fd4f802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ca1c6676f4f3cc server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:57.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.915+0000 7fd4ff7fe640 1 -- 172.21.15.73:0/2987483142 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f8034070 con 0x7fd5080d1600 2024-03-29T04:09:57.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.915+0000 7fd4ff7fe640 1 -- 172.21.15.73:0/2987483142 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4f8030860 con 0x7fd5080d1600 2024-03-29T04:09:57.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.915+0000 7fd4ff7fe640 1 -- 172.21.15.73:0/2987483142 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f8030c30 con 0x7fd5080d1600 2024-03-29T04:09:57.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.915+0000 7fd50eb0e640 1 -- 172.21.15.73:0/2987483142 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5080d1600 msgr2=0x7fd508070390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:57.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.915+0000 7fd50eb0e640 1 --2- 172.21.15.73:0/2987483142 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5080d1600 0x7fd508070390 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd508072dd0 tx=0x7fd4f802b9a0 comp rx=0 tx=0).stop 2024-03-29T04:09:57.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.915+0000 7fd50eb0e640 1 -- 172.21.15.73:0/2987483142 shutdown_connections 2024-03-29T04:09:57.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.915+0000 7fd50eb0e640 1 --2- 172.21.15.73:0/2987483142 >> v2:172.21.15.142:3300/0 conn(0x7fd5080708d0 0x7fd508162610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:57.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.915+0000 7fd50eb0e640 1 --2- 172.21.15.73:0/2987483142 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5080d1600 0x7fd508070390 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:57.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.915+0000 7fd50eb0e640 1 --2- 172.21.15.73:0/2987483142 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5080ce470 0x7fd5080d10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:57.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.915+0000 7fd50eb0e640 1 -- 172.21.15.73:0/2987483142 >> 172.21.15.73:0/2987483142 conn(0x7fd5080b3f40 msgr2=0x7fd5080b4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:57.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.915+0000 7fd50eb0e640 1 -- 172.21.15.73:0/2987483142 shutdown_connections 2024-03-29T04:09:57.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.915+0000 7fd50eb0e640 1 -- 172.21.15.73:0/2987483142 wait complete. 2024-03-29T04:09:57.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.916+0000 7fd50eb0e640 1 Processor -- start 2024-03-29T04:09:57.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.917+0000 7fd50eb0e640 1 -- start start 2024-03-29T04:09:57.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.917+0000 7fd50eb0e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5080708d0 0x7fd5080c70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:57.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.917+0000 7fd50eb0e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5080ce470 0x7fd5080b7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:57.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.917+0000 7fd50eb0e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5080d1600 0x7fd5081d61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:57.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.917+0000 7fd50eb0e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd50809b7e0 con 0x7fd5080d1600 2024-03-29T04:09:57.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.917+0000 7fd50eb0e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd50809b500 con 0x7fd5080ce470 2024-03-29T04:09:57.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.917+0000 7fd50eb0e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd5080ce850 con 0x7fd5080708d0 2024-03-29T04:09:57.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.917+0000 7fd50d0ab640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5080d1600 0x7fd5081d61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:57.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.918+0000 7fd50d0ab640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5080d1600 0x7fd5081d61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51478/0 (socket says 172.21.15.73:51478) 2024-03-29T04:09:57.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.918+0000 7fd50d0ab640 1 -- 172.21.15.73:0/1613794574 learned_addr learned my addr 172.21.15.73:0/1613794574 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:57.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.918+0000 7fd4fffff640 1 --2- 172.21.15.73:0/1613794574 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5080ce470 0x7fd5080b7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:57.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.918+0000 7fd50c8aa640 1 --2- 172.21.15.73:0/1613794574 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5080708d0 0x7fd5080c70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:57.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.918+0000 7fd50d0ab640 1 -- 172.21.15.73:0/1613794574 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5080708d0 msgr2=0x7fd5080c70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:57.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.918+0000 7fd50d0ab640 1 --2- 172.21.15.73:0/1613794574 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5080708d0 0x7fd5080c70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:57.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.918+0000 7fd50d0ab640 1 -- 172.21.15.73:0/1613794574 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5080ce470 msgr2=0x7fd5080b7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:57.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.918+0000 7fd50d0ab640 1 --2- 172.21.15.73:0/1613794574 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5080ce470 0x7fd5080b7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:57.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.918+0000 7fd50d0ab640 1 -- 172.21.15.73:0/1613794574 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5080c6020 con 0x7fd5080d1600 2024-03-29T04:09:57.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.918+0000 7fd4fffff640 1 --2- 172.21.15.73:0/1613794574 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5080ce470 0x7fd5080b7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:09:57.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.918+0000 7fd50c8aa640 1 --2- 172.21.15.73:0/1613794574 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5080708d0 0x7fd5080c70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:09:57.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.918+0000 7fd50d0ab640 1 --2- 172.21.15.73:0/1613794574 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5080d1600 0x7fd5081d61c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd50000cb80 tx=0x7fd50000a4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:57.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.918+0000 7fd4fd7fa640 1 -- 172.21.15.73:0/1613794574 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd500015070 con 0x7fd5080d1600 2024-03-29T04:09:57.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.918+0000 7fd4fd7fa640 1 -- 172.21.15.73:0/1613794574 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd50000ab70 con 0x7fd5080d1600 2024-03-29T04:09:57.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.918+0000 7fd50eb0e640 1 -- 172.21.15.73:0/1613794574 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5080c62e0 con 0x7fd5080d1600 2024-03-29T04:09:57.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.918+0000 7fd4fd7fa640 1 -- 172.21.15.73:0/1613794574 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50000d040 con 0x7fd5080d1600 2024-03-29T04:09:57.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.918+0000 7fd50eb0e640 1 -- 172.21.15.73:0/1613794574 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5080c68a0 con 0x7fd5080d1600 2024-03-29T04:09:57.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.919+0000 7fd50eb0e640 1 -- 172.21.15.73:0/1613794574 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5080a0520 con 0x7fd5080d1600 2024-03-29T04:09:57.901 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.920+0000 7fd4fd7fa640 1 -- 172.21.15.73:0/1613794574 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fd500018070 con 0x7fd5080d1600 2024-03-29T04:09:57.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.920+0000 7fd4fd7fa640 1 --2- 172.21.15.73:0/1613794574 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd4f406c530 0x7fd4f406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:57.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.920+0000 7fd50c8aa640 1 --2- 172.21.15.73:0/1613794574 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd4f406c530 0x7fd4f406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:57.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.920+0000 7fd4fd7fa640 1 -- 172.21.15.73:0/1613794574 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fd50008b220 con 0x7fd5080d1600 2024-03-29T04:09:57.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.921+0000 7fd50c8aa640 1 --2- 172.21.15.73:0/1613794574 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd4f406c530 0x7fd4f406e9f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd50400a9d0 tx=0x7fd504008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:57.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:57.924+0000 7fd4fd7fa640 1 -- 172.21.15.73:0/1613794574 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fd5000598d0 con 0x7fd5080d1600 2024-03-29T04:09:58.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.100+0000 7fd50eb0e640 1 -- 172.21.15.73:0/1613794574 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd5080b4ba0 con 0x7fd5080d1600 2024-03-29T04:09:58.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.100+0000 7fd4fd7fa640 1 -- 172.21.15.73:0/1613794574 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) ==== 93+0+10 (secure 0 0 0) 0x7fd5000591d0 con 0x7fd5080d1600 2024-03-29T04:09:58.081 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-03-29T04:09:58.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.102+0000 7fd50eb0e640 1 -- 172.21.15.73:0/1613794574 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd4f406c530 msgr2=0x7fd4f406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:58.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.102+0000 7fd50eb0e640 1 --2- 172.21.15.73:0/1613794574 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd4f406c530 0x7fd4f406e9f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd50400a9d0 tx=0x7fd504008040 comp rx=0 tx=0).stop 2024-03-29T04:09:58.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.102+0000 7fd50eb0e640 1 -- 172.21.15.73:0/1613794574 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5080d1600 msgr2=0x7fd5081d61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:58.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.102+0000 7fd50eb0e640 1 --2- 172.21.15.73:0/1613794574 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5080d1600 0x7fd5081d61c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd50000cb80 tx=0x7fd50000a4c0 comp rx=0 tx=0).stop 2024-03-29T04:09:58.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.103+0000 7fd50eb0e640 1 -- 172.21.15.73:0/1613794574 shutdown_connections 2024-03-29T04:09:58.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.103+0000 7fd50eb0e640 1 --2- 172.21.15.73:0/1613794574 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5080d1600 0x7fd5081d61c0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:58.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.103+0000 7fd50eb0e640 1 --2- 172.21.15.73:0/1613794574 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd4f406c530 0x7fd4f406e9f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:58.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.103+0000 7fd50eb0e640 1 --2- 172.21.15.73:0/1613794574 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5080ce470 0x7fd5080b7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:58.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.103+0000 7fd50eb0e640 1 --2- 172.21.15.73:0/1613794574 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd5080708d0 0x7fd5080c70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:58.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.103+0000 7fd50eb0e640 1 -- 172.21.15.73:0/1613794574 >> 172.21.15.73:0/1613794574 conn(0x7fd5080b3f40 msgr2=0x7fd50806db20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:58.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.103+0000 7fd50eb0e640 1 -- 172.21.15.73:0/1613794574 shutdown_connections 2024-03-29T04:09:58.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.103+0000 7fd50eb0e640 1 -- 172.21.15.73:0/1613794574 wait complete. 2024-03-29T04:09:58.094 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-29T04:09:58.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.218+0000 7fab9b990640 1 Processor -- start 2024-03-29T04:09:58.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.218+0000 7fab9b990640 1 -- start start 2024-03-29T04:09:58.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.219+0000 7fab9b990640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab9415e920 0x7fab940d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:58.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.219+0000 7fab9b990640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fab940d16a0 0x7fab940d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:58.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.219+0000 7fab9b990640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab940d3780 con 0x7fab940cfde0 2024-03-29T04:09:58.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.219+0000 7fab9b990640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fab9415ed00 con 0x7fab940d16a0 2024-03-29T04:09:58.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.219+0000 7fab9b990640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fab940d21e0 con 0x7fab9415e920 2024-03-29T04:09:58.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.219+0000 7fab99f2d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fab940d16a0 0x7fab940d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:58.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.219+0000 7fab98f2b640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fab940cfde0 0x7fab940d0f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52440/0 (socket says 172.21.15.73:52440) 2024-03-29T04:09:58.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.219+0000 7fab98f2b640 1 -- 172.21.15.73:0/1752458310 learned_addr learned my addr 172.21.15.73:0/1752458310 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:09:58.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.219+0000 7fab9972c640 1 --2- 172.21.15.73:0/1752458310 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab9415e920 0x7fab940d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:58.201 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.219+0000 7fab99f2d640 1 -- 172.21.15.73:0/1752458310 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab9415e920 msgr2=0x7fab940d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:58.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.219+0000 7fab99f2d640 1 --2- 172.21.15.73:0/1752458310 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab9415e920 0x7fab940d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:58.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.219+0000 7fab99f2d640 1 -- 172.21.15.73:0/1752458310 >> v1:172.21.15.73:6789/0 conn(0x7fab940cfde0 legacy=0x7fab940d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:58.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.219+0000 7fab99f2d640 1 -- 172.21.15.73:0/1752458310 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab940d2480 con 0x7fab940d16a0 2024-03-29T04:09:58.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.219+0000 7fab8bfff640 1 -- 172.21.15.73:0/1752458310 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1616948181 0 0) 0x7fab84001110 con 0x7fab940cfde0 2024-03-29T04:09:58.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.219+0000 7fab9972c640 1 --2- 172.21.15.73:0/1752458310 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab9415e920 0x7fab940d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:09:58.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.220+0000 7fab99f2d640 1 --2- 172.21.15.73:0/1752458310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab940d16a0 0x7fab940d0240 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fab8c0097a0 tx=0x7fab8c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc2bd7661402096 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:58.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.220+0000 7fab8bfff640 1 -- 172.21.15.73:0/1752458310 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab8c035020 con 0x7fab940d16a0 2024-03-29T04:09:58.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.220+0000 7fab8bfff640 1 -- 172.21.15.73:0/1752458310 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab8c031830 con 0x7fab940d16a0 2024-03-29T04:09:58.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.220+0000 7fab8bfff640 1 -- 172.21.15.73:0/1752458310 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab8c031c00 con 0x7fab940d16a0 2024-03-29T04:09:58.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.220+0000 7fab9b990640 1 -- 172.21.15.73:0/1752458310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab940d16a0 msgr2=0x7fab940d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:58.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.220+0000 7fab9b990640 1 --2- 172.21.15.73:0/1752458310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab940d16a0 0x7fab940d0240 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fab8c0097a0 tx=0x7fab8c02b8d0 comp rx=0 tx=0).stop 2024-03-29T04:09:58.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.221+0000 7fab9b990640 1 -- 172.21.15.73:0/1752458310 shutdown_connections 2024-03-29T04:09:58.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.221+0000 7fab9b990640 1 --2- 172.21.15.73:0/1752458310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab940d16a0 0x7fab940d0240 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:58.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.221+0000 7fab9b990640 1 --2- 172.21.15.73:0/1752458310 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab9415e920 0x7fab940d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:58.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.221+0000 7fab9b990640 1 -- 172.21.15.73:0/1752458310 >> 172.21.15.73:0/1752458310 conn(0x7fab9408bfc0 msgr2=0x7fab940d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:58.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.221+0000 7fab9b990640 1 -- 172.21.15.73:0/1752458310 shutdown_connections 2024-03-29T04:09:58.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.221+0000 7fab9b990640 1 -- 172.21.15.73:0/1752458310 wait complete. 2024-03-29T04:09:58.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.222+0000 7fab9b990640 1 Processor -- start 2024-03-29T04:09:58.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.222+0000 7fab9b990640 1 -- start start 2024-03-29T04:09:58.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.222+0000 7fab9b990640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab940cfde0 0x7fab940c8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:58.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.222+0000 7fab9b990640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab940d16a0 0x7fab9414b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:58.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.222+0000 7fab9b990640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab9415e920 0x7fab940cda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:58.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.222+0000 7fab9b990640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fab940d2d20 con 0x7fab940d16a0 2024-03-29T04:09:58.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.222+0000 7fab9b990640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fab940d2a40 con 0x7fab940cfde0 2024-03-29T04:09:58.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.222+0000 7fab9b990640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fab940d4ef0 con 0x7fab9415e920 2024-03-29T04:09:58.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.223+0000 7fab98f2b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab940d16a0 0x7fab9414b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:58.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.223+0000 7fab98f2b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab940d16a0 0x7fab9414b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51504/0 (socket says 172.21.15.73:51504) 2024-03-29T04:09:58.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.223+0000 7fab98f2b640 1 -- 172.21.15.73:0/1490562941 learned_addr learned my addr 172.21.15.73:0/1490562941 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:58.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.223+0000 7fab9972c640 1 --2- 172.21.15.73:0/1490562941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab940cfde0 0x7fab940c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:58.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.223+0000 7fab99f2d640 1 --2- 172.21.15.73:0/1490562941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab9415e920 0x7fab940cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:58.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.223+0000 7fab98f2b640 1 -- 172.21.15.73:0/1490562941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab9415e920 msgr2=0x7fab940cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:58.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.223+0000 7fab98f2b640 1 --2- 172.21.15.73:0/1490562941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab9415e920 0x7fab940cda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:58.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.223+0000 7fab98f2b640 1 -- 172.21.15.73:0/1490562941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab940cfde0 msgr2=0x7fab940c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:58.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.223+0000 7fab98f2b640 1 --2- 172.21.15.73:0/1490562941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab940cfde0 0x7fab940c8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:58.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.223+0000 7fab98f2b640 1 -- 172.21.15.73:0/1490562941 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab940cc980 con 0x7fab940d16a0 2024-03-29T04:09:58.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.223+0000 7fab9972c640 1 --2- 172.21.15.73:0/1490562941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab940cfde0 0x7fab940c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:09:58.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.223+0000 7fab98f2b640 1 --2- 172.21.15.73:0/1490562941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab940d16a0 0x7fab9414b2c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fab8400c430 tx=0x7fab8400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:58.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.223+0000 7fab89ffb640 1 -- 172.21.15.73:0/1490562941 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab840074e0 con 0x7fab940d16a0 2024-03-29T04:09:58.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.223+0000 7fab89ffb640 1 -- 172.21.15.73:0/1490562941 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab840047e0 con 0x7fab940d16a0 2024-03-29T04:09:58.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.223+0000 7fab9b990640 1 -- 172.21.15.73:0/1490562941 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab940ccc60 con 0x7fab940d16a0 2024-03-29T04:09:58.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.223+0000 7fab89ffb640 1 -- 172.21.15.73:0/1490562941 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab84004bd0 con 0x7fab940d16a0 2024-03-29T04:09:58.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.223+0000 7fab9b990640 1 -- 172.21.15.73:0/1490562941 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab940cd220 con 0x7fab940d16a0 2024-03-29T04:09:58.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.224+0000 7fab9b990640 1 -- 172.21.15.73:0/1490562941 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab940a2560 con 0x7fab940d16a0 2024-03-29T04:09:58.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.225+0000 7fab89ffb640 1 -- 172.21.15.73:0/1490562941 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fab84011070 con 0x7fab940d16a0 2024-03-29T04:09:58.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.225+0000 7fab89ffb640 1 --2- 172.21.15.73:0/1490562941 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fab7806c530 0x7fab7806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:58.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.225+0000 7fab9972c640 1 --2- 172.21.15.73:0/1490562941 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fab7806c530 0x7fab7806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:58.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.225+0000 7fab89ffb640 1 -- 172.21.15.73:0/1490562941 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fab8408b440 con 0x7fab940d16a0 2024-03-29T04:09:58.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.226+0000 7fab9972c640 1 --2- 172.21.15.73:0/1490562941 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fab7806c530 0x7fab7806e9f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fab90003fd0 tx=0x7fab90003990 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:58.210 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.230+0000 7fab89ffb640 1 -- 172.21.15.73:0/1490562941 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fab940d3780 con 0x7fab940d16a0 2024-03-29T04:09:58.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.423+0000 7fab9b990640 1 -- 172.21.15.73:0/1490562941 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fab9404f9d0 con 0x7fab940d16a0 2024-03-29T04:09:58.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.423+0000 7fab89ffb640 1 -- 172.21.15.73:0/1490562941 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) ==== 104+0+11 (secure 0 0 0) 0x7fab840599d0 con 0x7fab940d16a0 2024-03-29T04:09:58.404 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-03-29T04:09:58.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.425+0000 7fab9b990640 1 -- 172.21.15.73:0/1490562941 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fab7806c530 msgr2=0x7fab7806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:58.405 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.425+0000 7fab9b990640 1 --2- 172.21.15.73:0/1490562941 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fab7806c530 0x7fab7806e9f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fab90003fd0 tx=0x7fab90003990 comp rx=0 tx=0).stop 2024-03-29T04:09:58.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.425+0000 7fab9b990640 1 -- 172.21.15.73:0/1490562941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab940d16a0 msgr2=0x7fab9414b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:58.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.425+0000 7fab9b990640 1 --2- 172.21.15.73:0/1490562941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab940d16a0 0x7fab9414b2c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fab8400c430 tx=0x7fab8400c8f0 comp rx=0 tx=0).stop 2024-03-29T04:09:58.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.425+0000 7fab9b990640 1 -- 172.21.15.73:0/1490562941 shutdown_connections 2024-03-29T04:09:58.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.425+0000 7fab9b990640 1 --2- 172.21.15.73:0/1490562941 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fab9415e920 0x7fab940cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:58.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.425+0000 7fab9b990640 1 --2- 172.21.15.73:0/1490562941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab940d16a0 0x7fab9414b2c0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:58.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.425+0000 7fab9b990640 1 --2- 172.21.15.73:0/1490562941 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fab7806c530 0x7fab7806e9f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:58.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.425+0000 7fab9b990640 1 --2- 172.21.15.73:0/1490562941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab940cfde0 0x7fab940c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:58.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.425+0000 7fab9b990640 1 -- 172.21.15.73:0/1490562941 >> 172.21.15.73:0/1490562941 conn(0x7fab9408bfc0 msgr2=0x7fab9406c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:58.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.425+0000 7fab9b990640 1 -- 172.21.15.73:0/1490562941 shutdown_connections 2024-03-29T04:09:58.406 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.425+0000 7fab9b990640 1 -- 172.21.15.73:0/1490562941 wait complete. 2024-03-29T04:09:58.416 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-29T04:09:58.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.541+0000 7fd038d82640 1 Processor -- start 2024-03-29T04:09:58.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.541+0000 7fd038d82640 1 -- start start 2024-03-29T04:09:58.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.542+0000 7fd038d82640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0340c7120 0x7fd0340cf430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:58.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.542+0000 7fd038d82640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0340b73f0 con 0x7fd03415b8e0 2024-03-29T04:09:58.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.542+0000 7fd038d82640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0340d09c0 con 0x7fd0340d0450 2024-03-29T04:09:58.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.542+0000 7fd038d82640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd0340cba90 con 0x7fd0340c7120 2024-03-29T04:09:58.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.542+0000 7fd03259c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd03415b8e0 0x7fd0340c6a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52452/0 (socket says 172.21.15.73:52452) 2024-03-29T04:09:58.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.542+0000 7fd03259c640 1 -- 172.21.15.73:0/912463197 learned_addr learned my addr 172.21.15.73:0/912463197 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:09:58.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.543+0000 7fd031d9b640 1 --2- 172.21.15.73:0/912463197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0340c7120 0x7fd0340cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:58.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.543+0000 7fd03159a640 1 -- 172.21.15.73:0/912463197 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3456822760 0 0) 0x7fd0340b73f0 con 0x7fd03415b8e0 2024-03-29T04:09:58.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.543+0000 7fd03159a640 1 -- 172.21.15.73:0/912463197 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd01c003520 con 0x7fd03415b8e0 2024-03-29T04:09:58.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.543+0000 7fd03159a640 1 -- 172.21.15.73:0/912463197 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 86535984 0 0) 0x7fd01c003520 con 0x7fd03415b8e0 2024-03-29T04:09:58.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.543+0000 7fd03159a640 1 -- 172.21.15.73:0/912463197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0340c7120 msgr2=0x7fd0340cf430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:58.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.543+0000 7fd03159a640 1 --2- 172.21.15.73:0/912463197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0340c7120 0x7fd0340cf430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:58.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.543+0000 7fd03159a640 1 -- 172.21.15.73:0/912463197 >> v1:172.21.15.142:6789/0 conn(0x7fd0340d0450 legacy=0x7fd0340cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:58.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.543+0000 7fd03159a640 1 -- 172.21.15.73:0/912463197 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0340cbd70 con 0x7fd03415b8e0 2024-03-29T04:09:58.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.543+0000 7fd03159a640 1 -- 172.21.15.73:0/912463197 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1290421750 0 0) 0x7fd024001670 con 0x7fd03415b8e0 2024-03-29T04:09:58.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.543+0000 7fd03159a640 1 -- 172.21.15.73:0/912463197 >> v1:172.21.15.73:6789/0 conn(0x7fd03415b8e0 legacy=0x7fd0340c6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:58.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.543+0000 7fd03159a640 1 --2- 172.21.15.73:0/912463197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd01c0039e0 0x7fd01c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:58.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.543+0000 7fd03159a640 1 --2- 172.21.15.73:0/912463197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd01c004800 0x7fd01c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:58.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.543+0000 7fd03159a640 1 --2- 172.21.15.73:0/912463197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0340c7120 0x7fd01c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:58.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.543+0000 7fd03159a640 1 -- 172.21.15.73:0/912463197 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd0340cba90 con 0x7fd01c004800 2024-03-29T04:09:58.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.543+0000 7fd03159a640 1 -- 172.21.15.73:0/912463197 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd01c00dc80 con 0x7fd01c0039e0 2024-03-29T04:09:58.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.543+0000 7fd03159a640 1 -- 172.21.15.73:0/912463197 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd01c00de80 con 0x7fd0340c7120 2024-03-29T04:09:58.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.543+0000 7fd031d9b640 1 --2- 172.21.15.73:0/912463197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd01c004800 0x7fd01c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:58.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.543+0000 7fd03259c640 1 --2- 172.21.15.73:0/912463197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd01c0039e0 0x7fd01c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:58.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.543+0000 7fd032d9d640 1 --2- 172.21.15.73:0/912463197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0340c7120 0x7fd01c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:58.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.543+0000 7fd031d9b640 1 -- 172.21.15.73:0/912463197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0340c7120 msgr2=0x7fd01c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:58.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.543+0000 7fd031d9b640 1 --2- 172.21.15.73:0/912463197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0340c7120 0x7fd01c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:58.528 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.543+0000 7fd031d9b640 1 -- 172.21.15.73:0/912463197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd01c0039e0 msgr2=0x7fd01c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:58.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.543+0000 7fd031d9b640 1 --2- 172.21.15.73:0/912463197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd01c0039e0 0x7fd01c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:58.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.543+0000 7fd031d9b640 1 -- 172.21.15.73:0/912463197 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd01c003520 con 0x7fd01c004800 2024-03-29T04:09:58.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.543+0000 7fd032d9d640 1 --2- 172.21.15.73:0/912463197 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd0340c7120 0x7fd01c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:09:58.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.544+0000 7fd031d9b640 1 --2- 172.21.15.73:0/912463197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd01c004800 0x7fd01c004c80 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd028009a90 tx=0x7fd01c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9827e01a6336bec7 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:58.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.544+0000 7fd03159a640 1 -- 172.21.15.73:0/912463197 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd028039070 con 0x7fd01c004800 2024-03-29T04:09:58.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.544+0000 7fd03159a640 1 -- 172.21.15.73:0/912463197 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd02802c680 con 0x7fd01c004800 2024-03-29T04:09:58.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.544+0000 7fd03159a640 1 -- 172.21.15.73:0/912463197 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd028009690 con 0x7fd01c004800 2024-03-29T04:09:58.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.545+0000 7fd038d82640 1 -- 172.21.15.73:0/912463197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd01c004800 msgr2=0x7fd01c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:58.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.545+0000 7fd038d82640 1 --2- 172.21.15.73:0/912463197 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd01c004800 0x7fd01c004c80 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd028009a90 tx=0x7fd01c005830 comp rx=0 tx=0).stop 2024-03-29T04:09:58.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.545+0000 7fd032d9d640 1 -- 172.21.15.73:0/912463197 reap_dead start 2024-03-29T04:09:58.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.545+0000 7fd038d82640 1 -- 172.21.15.73:0/912463197 shutdown_connections 2024-03-29T04:09:58.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.545+0000 7fd038d82640 1 -- 172.21.15.73:0/912463197 >> 172.21.15.73:0/912463197 conn(0x7fd0340b2fd0 msgr2=0x7fd0340b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:58.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.545+0000 7fd038d82640 1 -- 172.21.15.73:0/912463197 shutdown_connections 2024-03-29T04:09:58.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.545+0000 7fd038d82640 1 -- 172.21.15.73:0/912463197 wait complete. 2024-03-29T04:09:58.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.547+0000 7fd038d82640 1 Processor -- start 2024-03-29T04:09:58.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.547+0000 7fd038d82640 1 -- start start 2024-03-29T04:09:58.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.547+0000 7fd038d82640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd01c004800 0x7fd0340cace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:58.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.547+0000 7fd038d82640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd03414cd40 0x7fd03415d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:58.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.547+0000 7fd038d82640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd03414d180 0x7fd03415db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:58.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.547+0000 7fd038d82640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd0340b42d0 con 0x7fd03414cd40 2024-03-29T04:09:58.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.547+0000 7fd038d82640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd0340cc330 con 0x7fd01c004800 2024-03-29T04:09:58.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.547+0000 7fd038d82640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd03415e0a0 con 0x7fd03414d180 2024-03-29T04:09:58.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.547+0000 7fd031d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd03414cd40 0x7fd03415d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:58.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.547+0000 7fd031d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd03414cd40 0x7fd03415d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51524/0 (socket says 172.21.15.73:51524) 2024-03-29T04:09:58.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.547+0000 7fd031d9b640 1 -- 172.21.15.73:0/1441085706 learned_addr learned my addr 172.21.15.73:0/1441085706 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:58.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.548+0000 7fd03259c640 1 --2- 172.21.15.73:0/1441085706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd01c004800 0x7fd0340cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:58.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.548+0000 7fd032d9d640 1 --2- 172.21.15.73:0/1441085706 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd03414d180 0x7fd03415db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:58.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.548+0000 7fd031d9b640 1 -- 172.21.15.73:0/1441085706 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd03414d180 msgr2=0x7fd03415db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:58.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.548+0000 7fd031d9b640 1 --2- 172.21.15.73:0/1441085706 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd03414d180 0x7fd03415db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:58.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.548+0000 7fd031d9b640 1 -- 172.21.15.73:0/1441085706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd01c004800 msgr2=0x7fd0340cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:58.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.548+0000 7fd031d9b640 1 --2- 172.21.15.73:0/1441085706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd01c004800 0x7fd0340cace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:58.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.548+0000 7fd031d9b640 1 -- 172.21.15.73:0/1441085706 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd034153380 con 0x7fd03414cd40 2024-03-29T04:09:58.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.548+0000 7fd031d9b640 1 --2- 172.21.15.73:0/1441085706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd03414cd40 0x7fd03415d620 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd028037040 tx=0x7fd028004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:58.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.548+0000 7fd022ffd640 1 -- 172.21.15.73:0/1441085706 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd028042020 con 0x7fd03414cd40 2024-03-29T04:09:58.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.548+0000 7fd022ffd640 1 -- 172.21.15.73:0/1441085706 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd02803a040 con 0x7fd03414cd40 2024-03-29T04:09:58.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.548+0000 7fd022ffd640 1 -- 172.21.15.73:0/1441085706 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd028039070 con 0x7fd03414cd40 2024-03-29T04:09:58.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.548+0000 7fd038d82640 1 -- 172.21.15.73:0/1441085706 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0340b5f70 con 0x7fd03414cd40 2024-03-29T04:09:58.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.548+0000 7fd038d82640 1 -- 172.21.15.73:0/1441085706 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0340b5c90 con 0x7fd03414cd40 2024-03-29T04:09:58.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.549+0000 7fd038d82640 1 -- 172.21.15.73:0/1441085706 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd03409f630 con 0x7fd03414cd40 2024-03-29T04:09:58.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.550+0000 7fd022ffd640 1 -- 172.21.15.73:0/1441085706 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fd028045020 con 0x7fd03414cd40 2024-03-29T04:09:58.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.550+0000 7fd022ffd640 1 --2- 172.21.15.73:0/1441085706 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd01406c530 0x7fd01406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:58.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.550+0000 7fd022ffd640 1 -- 172.21.15.73:0/1441085706 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fd0280acac0 con 0x7fd03414cd40 2024-03-29T04:09:58.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.550+0000 7fd03259c640 1 --2- 172.21.15.73:0/1441085706 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd01406c530 0x7fd01406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:58.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.551+0000 7fd03259c640 1 --2- 172.21.15.73:0/1441085706 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd01406c530 0x7fd01406e9f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd0240011e0 tx=0x7fd024001150 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:58.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.554+0000 7fd022ffd640 1 -- 172.21.15.73:0/1441085706 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fd02804c070 con 0x7fd03414cd40 2024-03-29T04:09:58.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.729+0000 7fd038d82640 1 -- 172.21.15.73:0/1441085706 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd03404f9d0 con 0x7fd03414cd40 2024-03-29T04:09:58.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.729+0000 7fd022ffd640 1 -- 172.21.15.73:0/1441085706 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) ==== 100+0+11 (secure 0 0 0) 0x7fd02807b110 con 0x7fd03414cd40 2024-03-29T04:09:58.710 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-29T04:09:58.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.731+0000 7fd038d82640 1 -- 172.21.15.73:0/1441085706 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd01406c530 msgr2=0x7fd01406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:58.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.731+0000 7fd038d82640 1 --2- 172.21.15.73:0/1441085706 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd01406c530 0x7fd01406e9f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd0240011e0 tx=0x7fd024001150 comp rx=0 tx=0).stop 2024-03-29T04:09:58.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.731+0000 7fd038d82640 1 -- 172.21.15.73:0/1441085706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd03414cd40 msgr2=0x7fd03415d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:58.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.731+0000 7fd038d82640 1 --2- 172.21.15.73:0/1441085706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd03414cd40 0x7fd03415d620 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd028037040 tx=0x7fd028004730 comp rx=0 tx=0).stop 2024-03-29T04:09:58.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.731+0000 7fd038d82640 1 -- 172.21.15.73:0/1441085706 shutdown_connections 2024-03-29T04:09:58.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.731+0000 7fd038d82640 1 --2- 172.21.15.73:0/1441085706 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd03414d180 0x7fd03415db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:58.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.731+0000 7fd038d82640 1 --2- 172.21.15.73:0/1441085706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd03414cd40 0x7fd03415d620 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:58.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.731+0000 7fd038d82640 1 --2- 172.21.15.73:0/1441085706 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd01406c530 0x7fd01406e9f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:58.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.731+0000 7fd038d82640 1 --2- 172.21.15.73:0/1441085706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd01c004800 0x7fd0340cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:58.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.731+0000 7fd038d82640 1 -- 172.21.15.73:0/1441085706 >> 172.21.15.73:0/1441085706 conn(0x7fd0340b2fd0 msgr2=0x7fd0340d1850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:58.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.731+0000 7fd038d82640 1 -- 172.21.15.73:0/1441085706 shutdown_connections 2024-03-29T04:09:58.713 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.731+0000 7fd038d82640 1 -- 172.21.15.73:0/1441085706 wait complete. 2024-03-29T04:09:58.723 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-29T04:09:58.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.850+0000 7fa734b59640 1 Processor -- start 2024-03-29T04:09:58.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.850+0000 7fa734b59640 1 -- start start 2024-03-29T04:09:58.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.850+0000 7fa734b59640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa730071270 0x7fa7300cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:58.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.850+0000 7fa734b59640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa730071650 0x7fa730162250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:58.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.850+0000 7fa734b59640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7300d14a0 con 0x7fa7300cff70 2024-03-29T04:09:58.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.850+0000 7fa734b59640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fa7300d1010 con 0x7fa730071650 2024-03-29T04:09:58.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.850+0000 7fa734b59640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa7300d0400 con 0x7fa730071270 2024-03-29T04:09:58.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.850+0000 7fa72dd9b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa730071650 0x7fa730162250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:58.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.850+0000 7fa72dd9b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa730071650 0x7fa730162250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51534/0 (socket says 172.21.15.73:51534) 2024-03-29T04:09:58.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.850+0000 7fa72dd9b640 1 -- 172.21.15.73:0/2204159719 learned_addr learned my addr 172.21.15.73:0/2204159719 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:58.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.850+0000 7fa72ed9d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa7300cff70 0x7fa73015e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52466/0 (socket says 172.21.15.73:52466) 2024-03-29T04:09:58.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.850+0000 7fa72dd9b640 1 -- 172.21.15.73:0/2204159719 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa730071270 msgr2=0x7fa7300cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:58.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.850+0000 7fa72e59c640 1 --2- 172.21.15.73:0/2204159719 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa730071270 0x7fa7300cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:58.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.850+0000 7fa72d59a640 1 -- 172.21.15.73:0/2204159719 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 448733338 0 0) 0x7fa7300d14a0 con 0x7fa7300cff70 2024-03-29T04:09:58.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.850+0000 7fa72dd9b640 1 --2- 172.21.15.73:0/2204159719 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa730071270 0x7fa7300cdc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:58.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.850+0000 7fa72dd9b640 1 -- 172.21.15.73:0/2204159719 >> v1:172.21.15.73:6789/0 conn(0x7fa7300cff70 legacy=0x7fa73015e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:58.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.850+0000 7fa72dd9b640 1 -- 172.21.15.73:0/2204159719 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7300d06e0 con 0x7fa730071650 2024-03-29T04:09:58.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.851+0000 7fa72dd9b640 1 --2- 172.21.15.73:0/2204159719 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa730071650 0x7fa730162250 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa724009870 tx=0x7fa72402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3632e72136fdaf14 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:58.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.851+0000 7fa72d59a640 1 -- 172.21.15.73:0/2204159719 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa724034070 con 0x7fa730071650 2024-03-29T04:09:58.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.851+0000 7fa72d59a640 1 -- 172.21.15.73:0/2204159719 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa724030840 con 0x7fa730071650 2024-03-29T04:09:58.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.851+0000 7fa72d59a640 1 -- 172.21.15.73:0/2204159719 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa724030c10 con 0x7fa730071650 2024-03-29T04:09:58.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.852+0000 7fa734b59640 1 -- 172.21.15.73:0/2204159719 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa730071650 msgr2=0x7fa730162250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:58.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.852+0000 7fa734b59640 1 --2- 172.21.15.73:0/2204159719 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa730071650 0x7fa730162250 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa724009870 tx=0x7fa72402b980 comp rx=0 tx=0).stop 2024-03-29T04:09:58.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.852+0000 7fa734b59640 1 -- 172.21.15.73:0/2204159719 shutdown_connections 2024-03-29T04:09:58.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.852+0000 7fa734b59640 1 --2- 172.21.15.73:0/2204159719 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa730071650 0x7fa730162250 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:58.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.852+0000 7fa734b59640 1 --2- 172.21.15.73:0/2204159719 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa730071270 0x7fa7300cdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:58.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.852+0000 7fa734b59640 1 -- 172.21.15.73:0/2204159719 >> 172.21.15.73:0/2204159719 conn(0x7fa7300b3e90 msgr2=0x7fa7300b42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:58.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.852+0000 7fa734b59640 1 -- 172.21.15.73:0/2204159719 shutdown_connections 2024-03-29T04:09:58.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.852+0000 7fa734b59640 1 -- 172.21.15.73:0/2204159719 wait complete. 2024-03-29T04:09:58.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.854+0000 7fa734b59640 1 Processor -- start 2024-03-29T04:09:58.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.854+0000 7fa734b59640 1 -- start start 2024-03-29T04:09:58.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.855+0000 7fa734b59640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa730071270 0x7fa7300b5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:58.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.855+0000 7fa734b59640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa730071650 0x7fa7301541e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:58.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.855+0000 7fa734b59640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7300b78e0 0x7fa7300c9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:58.837 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.855+0000 7fa734b59640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa7300ce1d0 con 0x7fa7300b78e0 2024-03-29T04:09:58.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.855+0000 7fa734b59640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa7300d0ca0 con 0x7fa730071270 2024-03-29T04:09:58.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.855+0000 7fa734b59640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa7300ce350 con 0x7fa730071650 2024-03-29T04:09:58.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.855+0000 7fa72ed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7300b78e0 0x7fa7300c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:58.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.855+0000 7fa72ed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7300b78e0 0x7fa7300c9470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51546/0 (socket says 172.21.15.73:51546) 2024-03-29T04:09:58.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.855+0000 7fa72ed9d640 1 -- 172.21.15.73:0/2824595202 learned_addr learned my addr 172.21.15.73:0/2824595202 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:58.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.856+0000 7fa72dd9b640 1 --2- 172.21.15.73:0/2824595202 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa730071650 0x7fa7301541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:58.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.856+0000 7fa72e59c640 1 --2- 172.21.15.73:0/2824595202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa730071270 0x7fa7300b5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:58.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.856+0000 7fa72ed9d640 1 -- 172.21.15.73:0/2824595202 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa730071650 msgr2=0x7fa7301541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:58.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.856+0000 7fa72ed9d640 1 --2- 172.21.15.73:0/2824595202 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa730071650 0x7fa7301541e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:58.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.856+0000 7fa72ed9d640 1 -- 172.21.15.73:0/2824595202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa730071270 msgr2=0x7fa7300b5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:58.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.856+0000 7fa72ed9d640 1 --2- 172.21.15.73:0/2824595202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa730071270 0x7fa7300b5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:58.838 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.856+0000 7fa72ed9d640 1 -- 172.21.15.73:0/2824595202 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa730154720 con 0x7fa7300b78e0 2024-03-29T04:09:58.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.856+0000 7fa72e59c640 1 --2- 172.21.15.73:0/2824595202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa730071270 0x7fa7300b5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:09:58.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.856+0000 7fa72ed9d640 1 --2- 172.21.15.73:0/2824595202 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7300b78e0 0x7fa7300c9470 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa72000c3e0 tx=0x7fa72000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:58.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.856+0000 7fa71effd640 1 -- 172.21.15.73:0/2824595202 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7200074e0 con 0x7fa7300b78e0 2024-03-29T04:09:58.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.856+0000 7fa71effd640 1 -- 172.21.15.73:0/2824595202 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7200047e0 con 0x7fa7300b78e0 2024-03-29T04:09:58.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.856+0000 7fa734b59640 1 -- 172.21.15.73:0/2824595202 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa730155480 con 0x7fa7300b78e0 2024-03-29T04:09:58.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.856+0000 7fa71effd640 1 -- 172.21.15.73:0/2824595202 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa720004bd0 con 0x7fa7300b78e0 2024-03-29T04:09:58.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.856+0000 7fa734b59640 1 -- 172.21.15.73:0/2824595202 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa730155a40 con 0x7fa7300b78e0 2024-03-29T04:09:58.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.858+0000 7fa734b59640 1 -- 172.21.15.73:0/2824595202 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7300690b0 con 0x7fa7300b78e0 2024-03-29T04:09:58.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.858+0000 7fa71effd640 1 -- 172.21.15.73:0/2824595202 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fa720011070 con 0x7fa7300b78e0 2024-03-29T04:09:58.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.858+0000 7fa71effd640 1 --2- 172.21.15.73:0/2824595202 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa71006c530 0x7fa71006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:58.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.859+0000 7fa71effd640 1 -- 172.21.15.73:0/2824595202 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fa72008b290 con 0x7fa7300b78e0 2024-03-29T04:09:58.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.859+0000 7fa72e59c640 1 --2- 172.21.15.73:0/2824595202 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa71006c530 0x7fa71006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:58.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.859+0000 7fa72e59c640 1 --2- 172.21.15.73:0/2824595202 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa71006c530 0x7fa71006e9f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa728007f50 tx=0x7fa7280074a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:58.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:58.864+0000 7fa71effd640 1 -- 172.21.15.73:0/2824595202 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fa7300690b0 con 0x7fa7300b78e0 2024-03-29T04:09:59.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.051+0000 7fa734b59640 1 -- 172.21.15.73:0/2824595202 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa730068640 con 0x7fa7300b78e0 2024-03-29T04:09:59.031 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.052+0000 7fa71effd640 1 -- 172.21.15.73:0/2824595202 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v32) ==== 80+0+0 (secure 0 0 0) 0x7fa720059820 con 0x7fa7300b78e0 2024-03-29T04:09:59.031 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-03-29T04:09:59.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.054+0000 7fa734b59640 1 -- 172.21.15.73:0/2824595202 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa71006c530 msgr2=0x7fa71006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:59.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.054+0000 7fa734b59640 1 --2- 172.21.15.73:0/2824595202 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa71006c530 0x7fa71006e9f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa728007f50 tx=0x7fa7280074a0 comp rx=0 tx=0).stop 2024-03-29T04:09:59.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.054+0000 7fa734b59640 1 -- 172.21.15.73:0/2824595202 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7300b78e0 msgr2=0x7fa7300c9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:59.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.054+0000 7fa734b59640 1 --2- 172.21.15.73:0/2824595202 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7300b78e0 0x7fa7300c9470 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa72000c3e0 tx=0x7fa72000c8a0 comp rx=0 tx=0).stop 2024-03-29T04:09:59.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.054+0000 7fa734b59640 1 -- 172.21.15.73:0/2824595202 shutdown_connections 2024-03-29T04:09:59.034 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.054+0000 7fa734b59640 1 --2- 172.21.15.73:0/2824595202 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7300b78e0 0x7fa7300c9470 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:59.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.054+0000 7fa734b59640 1 --2- 172.21.15.73:0/2824595202 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa730071650 0x7fa7301541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:59.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.054+0000 7fa734b59640 1 --2- 172.21.15.73:0/2824595202 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa71006c530 0x7fa71006e9f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:59.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.054+0000 7fa734b59640 1 --2- 172.21.15.73:0/2824595202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa730071270 0x7fa7300b5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:59.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.054+0000 7fa734b59640 1 -- 172.21.15.73:0/2824595202 >> 172.21.15.73:0/2824595202 conn(0x7fa7300b3e90 msgr2=0x7fa7300b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:59.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.054+0000 7fa734b59640 1 -- 172.21.15.73:0/2824595202 shutdown_connections 2024-03-29T04:09:59.035 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.054+0000 7fa734b59640 1 -- 172.21.15.73:0/2824595202 wait complete. 2024-03-29T04:09:59.045 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-29T04:09:59.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:09:59.045 DEBUG:teuthology.orchestra.run.smithi073:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-03-29T04:09:59.089 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2024-03-29T04:09:59.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:09:59.089 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-29T04:09:59.144 INFO:tasks.cephfs.mount:Terminating background process 2024-03-29T04:09:59.144 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-03-29T04:09:59.145 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-29T04:09:59.162 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-03-29T04:09:59.162 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-29T04:09:59.219 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-29T04:09:59.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.341+0000 7fae72724640 1 Processor -- start 2024-03-29T04:09:59.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.341+0000 7fae72724640 1 -- start start 2024-03-29T04:09:59.322 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.343+0000 7fae72724640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fae6c06b510 0x7fae6c06b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:59.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.343+0000 7fae72724640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae6c0b17e0 0x7fae6c0b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:59.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.343+0000 7fae72724640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae6c06be30 con 0x7fae6c0afcc0 2024-03-29T04:09:59.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.343+0000 7fae72724640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fae6c0b2d30 con 0x7fae6c06b510 2024-03-29T04:09:59.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.343+0000 7fae72724640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fae6c0b1da0 con 0x7fae6c0b17e0 2024-03-29T04:09:59.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.343+0000 7fae6bfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fae6c06b510 0x7fae6c06b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:59.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.343+0000 7fae70cc1640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fae6c0afcc0 0x7fae6c0b0150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52476/0 (socket says 172.21.15.73:52476) 2024-03-29T04:09:59.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.343+0000 7fae70cc1640 1 -- 172.21.15.73:0/1315668341 learned_addr learned my addr 172.21.15.73:0/1315668341 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:09:59.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.343+0000 7fae6bfff640 1 -- 172.21.15.73:0/1315668341 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae6c0b17e0 msgr2=0x7fae6c0b27f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-29T04:09:59.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.343+0000 7fae6bfff640 1 --2- 172.21.15.73:0/1315668341 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae6c0b17e0 0x7fae6c0b27f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:59.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.343+0000 7fae6bfff640 1 -- 172.21.15.73:0/1315668341 >> v1:172.21.15.73:6789/0 conn(0x7fae6c0afcc0 legacy=0x7fae6c0b0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:59.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.343+0000 7fae6affd640 1 -- 172.21.15.73:0/1315668341 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4200116320 0 0) 0x7fae6c06be30 con 0x7fae6c0afcc0 2024-03-29T04:09:59.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.343+0000 7fae6bfff640 1 -- 172.21.15.73:0/1315668341 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae6c0b2080 con 0x7fae6c06b510 2024-03-29T04:09:59.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.344+0000 7fae6bfff640 1 --2- 172.21.15.73:0/1315668341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae6c06b510 0x7fae6c06b8f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fae5c0097a0 tx=0x7fae5c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e25396c9b2566d09 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:59.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.344+0000 7fae6affd640 1 -- 172.21.15.73:0/1315668341 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae5c0315a0 con 0x7fae6c06b510 2024-03-29T04:09:59.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.344+0000 7fae6affd640 1 -- 172.21.15.73:0/1315668341 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae5c037070 con 0x7fae6c06b510 2024-03-29T04:09:59.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.344+0000 7fae6affd640 1 -- 172.21.15.73:0/1315668341 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae5c031960 con 0x7fae6c06b510 2024-03-29T04:09:59.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.344+0000 7fae72724640 1 -- 172.21.15.73:0/1315668341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae6c06b510 msgr2=0x7fae6c06b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:59.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.344+0000 7fae72724640 1 --2- 172.21.15.73:0/1315668341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae6c06b510 0x7fae6c06b8f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fae5c0097a0 tx=0x7fae5c02b840 comp rx=0 tx=0).stop 2024-03-29T04:09:59.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.344+0000 7fae72724640 1 -- 172.21.15.73:0/1315668341 shutdown_connections 2024-03-29T04:09:59.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.345+0000 7fae72724640 1 --2- 172.21.15.73:0/1315668341 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae6c0b17e0 0x7fae6c0b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:59.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.345+0000 7fae72724640 1 --2- 172.21.15.73:0/1315668341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae6c06b510 0x7fae6c06b8f0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:59.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.345+0000 7fae72724640 1 -- 172.21.15.73:0/1315668341 >> 172.21.15.73:0/1315668341 conn(0x7fae6c0b6780 msgr2=0x7fae6c0b6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:59.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.345+0000 7fae72724640 1 -- 172.21.15.73:0/1315668341 shutdown_connections 2024-03-29T04:09:59.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.345+0000 7fae72724640 1 -- 172.21.15.73:0/1315668341 wait complete. 2024-03-29T04:09:59.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.346+0000 7fae72724640 1 Processor -- start 2024-03-29T04:09:59.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.346+0000 7fae72724640 1 -- start start 2024-03-29T04:09:59.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.346+0000 7fae72724640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae6c06b510 0x7fae6c156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:59.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.347+0000 7fae72724640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae6c0afcc0 0x7fae6c1567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:59.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.347+0000 7fae72724640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae6c0b17e0 0x7fae6c134b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:59.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.347+0000 7fae72724640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fae6c143190 con 0x7fae6c0afcc0 2024-03-29T04:09:59.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.347+0000 7fae72724640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fae6c1439b0 con 0x7fae6c06b510 2024-03-29T04:09:59.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.347+0000 7fae72724640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fae6c143310 con 0x7fae6c0b17e0 2024-03-29T04:09:59.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.347+0000 7fae6b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae6c0afcc0 0x7fae6c1567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:59.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.347+0000 7fae6b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae6c0afcc0 0x7fae6c1567d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51572/0 (socket says 172.21.15.73:51572) 2024-03-29T04:09:59.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.347+0000 7fae6b7fe640 1 -- 172.21.15.73:0/2559584049 learned_addr learned my addr 172.21.15.73:0/2559584049 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:59.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.347+0000 7fae6b7fe640 1 -- 172.21.15.73:0/2559584049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae6c0b17e0 msgr2=0x7fae6c134b90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-29T04:09:59.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.347+0000 7fae6b7fe640 1 --2- 172.21.15.73:0/2559584049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae6c0b17e0 0x7fae6c134b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:59.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.347+0000 7fae6b7fe640 1 -- 172.21.15.73:0/2559584049 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae6c06b510 msgr2=0x7fae6c156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:59.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.347+0000 7fae6b7fe640 1 --2- 172.21.15.73:0/2559584049 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae6c06b510 0x7fae6c156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:59.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.347+0000 7fae6b7fe640 1 -- 172.21.15.73:0/2559584049 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae6c1565b0 con 0x7fae6c0afcc0 2024-03-29T04:09:59.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.347+0000 7fae6b7fe640 1 --2- 172.21.15.73:0/2559584049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae6c0afcc0 0x7fae6c1567d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fae6000b410 tx=0x7fae6000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:59.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.347+0000 7fae68ff9640 1 -- 172.21.15.73:0/2559584049 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae60015020 con 0x7fae6c0afcc0 2024-03-29T04:09:59.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.347+0000 7fae68ff9640 1 -- 172.21.15.73:0/2559584049 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae60011830 con 0x7fae6c0afcc0 2024-03-29T04:09:59.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.347+0000 7fae68ff9640 1 -- 172.21.15.73:0/2559584049 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae60011c20 con 0x7fae6c0afcc0 2024-03-29T04:09:59.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.347+0000 7fae72724640 1 -- 172.21.15.73:0/2559584049 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae6c159110 con 0x7fae6c0afcc0 2024-03-29T04:09:59.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.347+0000 7fae72724640 1 -- 172.21.15.73:0/2559584049 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae6c1596d0 con 0x7fae6c0afcc0 2024-03-29T04:09:59.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.349+0000 7fae72724640 1 -- 172.21.15.73:0/2559584049 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae6c068d50 con 0x7fae6c0afcc0 2024-03-29T04:09:59.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.349+0000 7fae68ff9640 1 -- 172.21.15.73:0/2559584049 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fae60018020 con 0x7fae6c0afcc0 2024-03-29T04:09:59.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.349+0000 7fae68ff9640 1 --2- 172.21.15.73:0/2559584049 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fae5806c530 0x7fae5806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:59.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.349+0000 7fae68ff9640 1 -- 172.21.15.73:0/2559584049 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fae6008b5e0 con 0x7fae6c0afcc0 2024-03-29T04:09:59.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.349+0000 7fae6bfff640 1 --2- 172.21.15.73:0/2559584049 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fae5806c530 0x7fae5806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:59.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.350+0000 7fae6bfff640 1 --2- 172.21.15.73:0/2559584049 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fae5806c530 0x7fae5806e9f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fae5c036000 tx=0x7fae5c030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:59.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.353+0000 7fae68ff9640 1 -- 172.21.15.73:0/2559584049 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fae6001f020 con 0x7fae6c0afcc0 2024-03-29T04:09:59.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.535+0000 7fae72724640 1 -- 172.21.15.73:0/2559584049 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fae6c06c2f0 con 0x7fae6c0afcc0 2024-03-29T04:09:59.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.536+0000 7fae68ff9640 1 -- 172.21.15.73:0/2559584049 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16669 (secure 0 0 0) 0x7fae600172c0 con 0x7fae6c0afcc0 2024-03-29T04:09:59.515 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:09:59.516 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":32,"fsid":"6bff1617-b138-4517-acca-3ecaae3f2bb3","created":"2024-03-29T04:07:47.346864+0000","modified":"2024-03-29T04:09:00.732697+0000","last_up_change":"2024-03-29T04:07:58.507139+0000","last_in_change":"2024-03-29T04:07:49.637816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-29T04:07:59.537301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-29T04:08:57.521498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-29T04:08:58.027631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"925d7de1-14ab-48c0-aebd-7bded108f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6820","nonce":2387335359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6824","nonce":2387335359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6831","nonce":2387335359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6828","nonce":2387335359}]},"public_addr":"172.21.15.73:6820/2387335359","cluster_addr":"172.21.15.73:6824/2387335359","heartbeat_back_addr":"172.21.15.73:6831/2387335359","heartbeat_front_addr":"172.21.15.73:6828/2387335359","state":["exists","up"]},{"osd":1,"uuid":"6b182102-882a-4e0c-99db-0afae5cfb38b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6801","nonce":2431315515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6803","nonce":2431315515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6807","nonce":2431315515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6805","nonce":2431315515}]},"public_addr":"172.21.15.73:6801/2431315515","cluster_addr":"172.21.15.73:6803/2431315515","heartbeat_back_addr":"172.21.15.73:6807/2431315515","heartbeat_front_addr":"172.21.15.73:6805/2431315515","state":["exists","up"]},{"osd":2,"uuid":"8040902e-b0b8-4a21-bf64-ce1c222115ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6809","nonce":407236597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6811","nonce":407236597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6815","nonce":407236597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6813","nonce":407236597}]},"public_addr":"172.21.15.73:6809/407236597","cluster_addr":"172.21.15.73:6811/407236597","heartbeat_back_addr":"172.21.15.73:6815/407236597","heartbeat_front_addr":"172.21.15.73:6813/407236597","state":["exists","up"]},{"osd":3,"uuid":"1bab19ee-3775-4ce1-a4ce-cf7cda3bbbf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6817","nonce":4291100709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6821","nonce":4291100709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6829","nonce":4291100709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6825","nonce":4291100709}]},"public_addr":"172.21.15.73:6817/4291100709","cluster_addr":"172.21.15.73:6821/4291100709","heartbeat_back_addr":"172.21.15.73:6829/4291100709","heartbeat_front_addr":"172.21.15.73:6825/4291100709","state":["exists","up"]},{"osd":4,"uuid":"b0c74337-8fe4-47dc-b3da-2d07591b1f6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6817","nonce":3703256194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6819","nonce":3703256194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6823","nonce":3703256194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6821","nonce":3703256194}]},"public_addr":"172.21.15.142:6817/3703256194","cluster_addr":"172.21.15.142:6819/3703256194","heartbeat_back_addr":"172.21.15.142:6823/3703256194","heartbeat_front_addr":"172.21.15.142:6821/3703256194","state":["exists","up"]},{"osd":5,"uuid":"9ce36410-a29a-42c6-99f4-f95d4afdd7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6825","nonce":4271575803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6827","nonce":4271575803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6831","nonce":4271575803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6829","nonce":4271575803}]},"public_addr":"172.21.15.142:6825/4271575803","cluster_addr":"172.21.15.142:6827/4271575803","heartbeat_back_addr":"172.21.15.142:6831/4271575803","heartbeat_front_addr":"172.21.15.142:6829/4271575803","state":["exists","up"]},{"osd":6,"uuid":"aec4264a-64ac-428e-a860-d2920a304019","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6801","nonce":1772722570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6803","nonce":1772722570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6807","nonce":1772722570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6805","nonce":1772722570}]},"public_addr":"172.21.15.142:6801/1772722570","cluster_addr":"172.21.15.142:6803/1772722570","heartbeat_back_addr":"172.21.15.142:6807/1772722570","heartbeat_front_addr":"172.21.15.142:6805/1772722570","state":["exists","up"]},{"osd":7,"uuid":"fe599052-8e5a-4c7a-91e7-52d1bae24a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6809","nonce":3910589675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6811","nonce":3910589675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6815","nonce":3910589675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6813","nonce":3910589675}]},"public_addr":"172.21.15.142:6809/3910589675","cluster_addr":"172.21.15.142:6811/3910589675","heartbeat_back_addr":"172.21.15.142:6815/3910589675","heartbeat_front_addr":"172.21.15.142:6813/3910589675","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.835096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.587210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.786547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.778004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.843740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.791160+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.837992+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.718722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:09:59.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.538+0000 7fae72724640 1 -- 172.21.15.73:0/2559584049 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fae5806c530 msgr2=0x7fae5806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:59.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.538+0000 7fae72724640 1 --2- 172.21.15.73:0/2559584049 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fae5806c530 0x7fae5806e9f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fae5c036000 tx=0x7fae5c030000 comp rx=0 tx=0).stop 2024-03-29T04:09:59.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.538+0000 7fae72724640 1 -- 172.21.15.73:0/2559584049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae6c0afcc0 msgr2=0x7fae6c1567d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:59.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.538+0000 7fae72724640 1 --2- 172.21.15.73:0/2559584049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae6c0afcc0 0x7fae6c1567d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fae6000b410 tx=0x7fae6000b8d0 comp rx=0 tx=0).stop 2024-03-29T04:09:59.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.538+0000 7fae72724640 1 -- 172.21.15.73:0/2559584049 shutdown_connections 2024-03-29T04:09:59.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.538+0000 7fae72724640 1 --2- 172.21.15.73:0/2559584049 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fae6c0b17e0 0x7fae6c134b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:59.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.538+0000 7fae72724640 1 --2- 172.21.15.73:0/2559584049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae6c0afcc0 0x7fae6c1567d0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:59.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.538+0000 7fae72724640 1 --2- 172.21.15.73:0/2559584049 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fae5806c530 0x7fae5806e9f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:59.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.538+0000 7fae72724640 1 --2- 172.21.15.73:0/2559584049 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae6c06b510 0x7fae6c156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:59.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.538+0000 7fae72724640 1 -- 172.21.15.73:0/2559584049 >> 172.21.15.73:0/2559584049 conn(0x7fae6c0b6780 msgr2=0x7fae6c06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:59.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.538+0000 7fae72724640 1 -- 172.21.15.73:0/2559584049 shutdown_connections 2024-03-29T04:09:59.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.538+0000 7fae72724640 1 -- 172.21.15.73:0/2559584049 wait complete. 2024-03-29T04:09:59.530 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-29T04:07:59.537301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-29T04:08:57.521498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-29T04:08:58.027631+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-29T04:09:59.530 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-29T04:09:59.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.655+0000 7fa66604a640 1 Processor -- start 2024-03-29T04:09:59.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.655+0000 7fa66604a640 1 -- start start 2024-03-29T04:09:59.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.655+0000 7fa66604a640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa66009b140 0x7fa660167870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:59.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.655+0000 7fa66604a640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6600cde40 con 0x7fa6600cea60 2024-03-29T04:09:59.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.656+0000 7fa66604a640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6600d0c80 con 0x7fa6600ce680 2024-03-29T04:09:59.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.656+0000 7fa66604a640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fa6600d0a30 con 0x7fa66009b140 2024-03-29T04:09:59.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.656+0000 7fa65f7fe640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fa6600ce680 0x7fa66009b770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.73:58206/0 (socket says 172.21.15.73:58206) 2024-03-29T04:09:59.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.656+0000 7fa65ffff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa66009b140 0x7fa660167870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:59.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.656+0000 7fa65f7fe640 1 -- 172.21.15.73:0/836780512 learned_addr learned my addr 172.21.15.73:0/836780512 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:09:59.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.656+0000 7fa65effd640 1 -- 172.21.15.73:0/836780512 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 996015137 0 0) 0x7fa6600d0c80 con 0x7fa6600ce680 2024-03-29T04:09:59.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.656+0000 7fa65effd640 1 -- 172.21.15.73:0/836780512 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa64c003520 con 0x7fa6600ce680 2024-03-29T04:09:59.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.656+0000 7fa65effd640 1 -- 172.21.15.73:0/836780512 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2848602550 0 0) 0x7fa6600cde40 con 0x7fa6600cea60 2024-03-29T04:09:59.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.656+0000 7fa65effd640 1 -- 172.21.15.73:0/836780512 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6600d0c80 con 0x7fa6600cea60 2024-03-29T04:09:59.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.656+0000 7fa65ffff640 1 -- 172.21.15.73:0/836780512 >> v1:172.21.15.142:6789/0 conn(0x7fa6600ce680 legacy=0x7fa66009b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:59.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.656+0000 7fa65ffff640 1 -- 172.21.15.73:0/836780512 >> v1:172.21.15.73:6789/0 conn(0x7fa6600cea60 legacy=0x7fa66009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:59.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.656+0000 7fa65ffff640 1 -- 172.21.15.73:0/836780512 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6600d0f60 con 0x7fa66009b140 2024-03-29T04:09:59.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.657+0000 7fa65ffff640 1 --2- 172.21.15.73:0/836780512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa66009b140 0x7fa660167870 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa658009d90 tx=0x7fa65802beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fff971c4a370f47 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:59.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.657+0000 7fa65effd640 1 -- 172.21.15.73:0/836780512 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa658039070 con 0x7fa66009b140 2024-03-29T04:09:59.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.657+0000 7fa65effd640 1 -- 172.21.15.73:0/836780512 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa65802cc60 con 0x7fa66009b140 2024-03-29T04:09:59.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.657+0000 7fa65effd640 1 -- 172.21.15.73:0/836780512 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa658034640 con 0x7fa66009b140 2024-03-29T04:09:59.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.658+0000 7fa66604a640 1 -- 172.21.15.73:0/836780512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa66009b140 msgr2=0x7fa660167870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:59.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.658+0000 7fa66604a640 1 --2- 172.21.15.73:0/836780512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa66009b140 0x7fa660167870 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa658009d90 tx=0x7fa65802beb0 comp rx=0 tx=0).stop 2024-03-29T04:09:59.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.658+0000 7fa66604a640 1 -- 172.21.15.73:0/836780512 shutdown_connections 2024-03-29T04:09:59.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.658+0000 7fa66604a640 1 --2- 172.21.15.73:0/836780512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa66009b140 0x7fa660167870 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:59.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.658+0000 7fa66604a640 1 -- 172.21.15.73:0/836780512 >> 172.21.15.73:0/836780512 conn(0x7fa6600b3f40 msgr2=0x7fa6600b4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:59.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.658+0000 7fa66604a640 1 -- 172.21.15.73:0/836780512 shutdown_connections 2024-03-29T04:09:59.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.658+0000 7fa66604a640 1 -- 172.21.15.73:0/836780512 wait complete. 2024-03-29T04:09:59.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.659+0000 7fa66604a640 1 Processor -- start 2024-03-29T04:09:59.639 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.659+0000 7fa66604a640 1 -- start start 2024-03-29T04:09:59.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.660+0000 7fa66604a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa66009b140 0x7fa66006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:59.640 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.660+0000 7fa66604a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6600ce680 0x7fa6600b6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:59.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.660+0000 7fa66604a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6600cea60 0x7fa6601599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:59.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.660+0000 7fa66604a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa660070ae0 con 0x7fa66009b140 2024-03-29T04:09:59.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.660+0000 7fa66604a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa660070650 con 0x7fa6600cea60 2024-03-29T04:09:59.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.660+0000 7fa66604a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa660070c60 con 0x7fa6600ce680 2024-03-29T04:09:59.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.660+0000 7fa65f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa66009b140 0x7fa66006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:59.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.660+0000 7fa65f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa66009b140 0x7fa66006d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51578/0 (socket says 172.21.15.73:51578) 2024-03-29T04:09:59.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.660+0000 7fa65f7fe640 1 -- 172.21.15.73:0/3780716919 learned_addr learned my addr 172.21.15.73:0/3780716919 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:59.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.660+0000 7fa657fff640 1 --2- 172.21.15.73:0/3780716919 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6600ce680 0x7fa6600b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:59.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.660+0000 7fa65ffff640 1 --2- 172.21.15.73:0/3780716919 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6600cea60 0x7fa6601599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:59.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.660+0000 7fa65f7fe640 1 -- 172.21.15.73:0/3780716919 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6600ce680 msgr2=0x7fa6600b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:59.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.660+0000 7fa65f7fe640 1 --2- 172.21.15.73:0/3780716919 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6600ce680 0x7fa6600b6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:59.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.660+0000 7fa65f7fe640 1 -- 172.21.15.73:0/3780716919 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6600cea60 msgr2=0x7fa6601599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:59.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.660+0000 7fa65f7fe640 1 --2- 172.21.15.73:0/3780716919 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6600cea60 0x7fa6601599f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:59.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.660+0000 7fa65f7fe640 1 -- 172.21.15.73:0/3780716919 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6600b69e0 con 0x7fa66009b140 2024-03-29T04:09:59.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.660+0000 7fa65f7fe640 1 --2- 172.21.15.73:0/3780716919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa66009b140 0x7fa66006d1c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa65000c500 tx=0x7fa65000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:59.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.660+0000 7fa65cff9640 1 -- 172.21.15.73:0/3780716919 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa650017070 con 0x7fa66009b140 2024-03-29T04:09:59.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.661+0000 7fa65cff9640 1 -- 172.21.15.73:0/3780716919 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa650005ce0 con 0x7fa66009b140 2024-03-29T04:09:59.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.661+0000 7fa66604a640 1 -- 172.21.15.73:0/3780716919 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6600b6cc0 con 0x7fa66009b140 2024-03-29T04:09:59.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.661+0000 7fa65cff9640 1 -- 172.21.15.73:0/3780716919 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6500072f0 con 0x7fa66009b140 2024-03-29T04:09:59.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.661+0000 7fa66604a640 1 -- 172.21.15.73:0/3780716919 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6600b7280 con 0x7fa66009b140 2024-03-29T04:09:59.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.662+0000 7fa66604a640 1 -- 172.21.15.73:0/3780716919 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6600a0520 con 0x7fa66009b140 2024-03-29T04:09:59.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.662+0000 7fa65cff9640 1 -- 172.21.15.73:0/3780716919 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fa65001a070 con 0x7fa66009b140 2024-03-29T04:09:59.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.662+0000 7fa65cff9640 1 --2- 172.21.15.73:0/3780716919 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa64006c530 0x7fa64006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:59.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.663+0000 7fa65cff9640 1 -- 172.21.15.73:0/3780716919 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fa65008a9e0 con 0x7fa66009b140 2024-03-29T04:09:59.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.663+0000 7fa657fff640 1 --2- 172.21.15.73:0/3780716919 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa64006c530 0x7fa64006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:59.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.663+0000 7fa657fff640 1 --2- 172.21.15.73:0/3780716919 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa64006c530 0x7fa64006e9f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa6600cdf40 tx=0x7fa648009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:59.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.667+0000 7fa65cff9640 1 -- 172.21.15.73:0/3780716919 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fa650058a40 con 0x7fa66009b140 2024-03-29T04:09:59.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.848+0000 7fa66604a640 1 -- 172.21.15.73:0/3780716919 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa66004f9d0 con 0x7fa66009b140 2024-03-29T04:09:59.828 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.849+0000 7fa65cff9640 1 -- 172.21.15.73:0/3780716919 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) ==== 93+0+10 (secure 0 0 0) 0x7fa65005cd40 con 0x7fa66009b140 2024-03-29T04:09:59.828 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-03-29T04:09:59.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.851+0000 7fa66604a640 1 -- 172.21.15.73:0/3780716919 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa64006c530 msgr2=0x7fa64006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:59.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.851+0000 7fa66604a640 1 --2- 172.21.15.73:0/3780716919 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa64006c530 0x7fa64006e9f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa6600cdf40 tx=0x7fa648009040 comp rx=0 tx=0).stop 2024-03-29T04:09:59.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.851+0000 7fa66604a640 1 -- 172.21.15.73:0/3780716919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa66009b140 msgr2=0x7fa66006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:59.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.851+0000 7fa66604a640 1 --2- 172.21.15.73:0/3780716919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa66009b140 0x7fa66006d1c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa65000c500 tx=0x7fa65000c9c0 comp rx=0 tx=0).stop 2024-03-29T04:09:59.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.851+0000 7fa66604a640 1 -- 172.21.15.73:0/3780716919 shutdown_connections 2024-03-29T04:09:59.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.851+0000 7fa66604a640 1 --2- 172.21.15.73:0/3780716919 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa64006c530 0x7fa64006e9f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:59.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.851+0000 7fa66604a640 1 --2- 172.21.15.73:0/3780716919 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6600cea60 0x7fa6601599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:59.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.851+0000 7fa66604a640 1 --2- 172.21.15.73:0/3780716919 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa6600ce680 0x7fa6600b6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:59.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.851+0000 7fa66604a640 1 --2- 172.21.15.73:0/3780716919 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa66009b140 0x7fa66006d1c0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:59.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.851+0000 7fa66604a640 1 -- 172.21.15.73:0/3780716919 >> 172.21.15.73:0/3780716919 conn(0x7fa6600b3f40 msgr2=0x7fa66006fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:59.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.851+0000 7fa66604a640 1 -- 172.21.15.73:0/3780716919 shutdown_connections 2024-03-29T04:09:59.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.851+0000 7fa66604a640 1 -- 172.21.15.73:0/3780716919 wait complete. 2024-03-29T04:09:59.841 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-29T04:09:59.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.966+0000 7f6decf00640 1 Processor -- start 2024-03-29T04:09:59.945 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.966+0000 7f6decf00640 1 -- start start 2024-03-29T04:09:59.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.966+0000 7f6decf00640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6de815e920 0x7f6de80d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:59.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.966+0000 7f6decf00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6de80d16a0 0x7f6de80d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:59.946 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.966+0000 7f6decf00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6de80d3780 con 0x7f6de80cfde0 2024-03-29T04:09:59.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.966+0000 7f6decf00640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f6de815ed00 con 0x7f6de815e920 2024-03-29T04:09:59.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.966+0000 7f6decf00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f6de80d21e0 con 0x7f6de80d16a0 2024-03-29T04:09:59.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.967+0000 7f6de659c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6de815e920 0x7f6de80d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:59.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.967+0000 7f6de659c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6de815e920 0x7f6de80d3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51580/0 (socket says 172.21.15.73:51580) 2024-03-29T04:09:59.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.967+0000 7f6de659c640 1 -- 172.21.15.73:0/2945805035 learned_addr learned my addr 172.21.15.73:0/2945805035 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:59.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.967+0000 7f6de659c640 1 -- 172.21.15.73:0/2945805035 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6de80d16a0 msgr2=0x7f6de80d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:59.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.967+0000 7f6de659c640 1 --2- 172.21.15.73:0/2945805035 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6de80d16a0 0x7f6de80d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:59.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.967+0000 7f6de659c640 1 -- 172.21.15.73:0/2945805035 >> v1:172.21.15.142:6789/0 conn(0x7f6de80cfde0 legacy=0x7f6de80d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:09:59.947 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.967+0000 7f6de659c640 1 -- 172.21.15.73:0/2945805035 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6de80d2480 con 0x7f6de815e920 2024-03-29T04:09:59.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.968+0000 7f6de659c640 1 --2- 172.21.15.73:0/2945805035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6de815e920 0x7f6de80d3240 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6de0009e50 tx=0x7f6de002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=569fb372c2ff17b2 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:59.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.968+0000 7f6de559a640 1 -- 172.21.15.73:0/2945805035 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de002ca70 con 0x7f6de815e920 2024-03-29T04:09:59.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.968+0000 7f6de559a640 1 -- 172.21.15.73:0/2945805035 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6de002cc10 con 0x7f6de815e920 2024-03-29T04:09:59.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.968+0000 7f6de559a640 1 -- 172.21.15.73:0/2945805035 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de00343f0 con 0x7f6de815e920 2024-03-29T04:09:59.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.968+0000 7f6decf00640 1 -- 172.21.15.73:0/2945805035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6de815e920 msgr2=0x7f6de80d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:59.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.968+0000 7f6decf00640 1 --2- 172.21.15.73:0/2945805035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6de815e920 0x7f6de80d3240 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6de0009e50 tx=0x7f6de002bed0 comp rx=0 tx=0).stop 2024-03-29T04:09:59.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.968+0000 7f6decf00640 1 -- 172.21.15.73:0/2945805035 shutdown_connections 2024-03-29T04:09:59.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.968+0000 7f6decf00640 1 --2- 172.21.15.73:0/2945805035 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6de80d16a0 0x7f6de80d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:59.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.968+0000 7f6decf00640 1 --2- 172.21.15.73:0/2945805035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6de815e920 0x7f6de80d3240 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:59.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.968+0000 7f6decf00640 1 -- 172.21.15.73:0/2945805035 >> 172.21.15.73:0/2945805035 conn(0x7f6de808bfc0 msgr2=0x7f6de80d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:09:59.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.969+0000 7f6decf00640 1 -- 172.21.15.73:0/2945805035 shutdown_connections 2024-03-29T04:09:59.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.969+0000 7f6decf00640 1 -- 172.21.15.73:0/2945805035 wait complete. 2024-03-29T04:09:59.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.970+0000 7f6decf00640 1 Processor -- start 2024-03-29T04:09:59.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.970+0000 7f6decf00640 1 -- start start 2024-03-29T04:09:59.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.970+0000 7f6decf00640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6de80cfde0 0x7f6de80c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:59.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.970+0000 7f6decf00640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6de80d16a0 0x7f6de81599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:59.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.970+0000 7f6decf00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6de815e920 0x7f6de80cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:59.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.970+0000 7f6decf00640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6de80d2d20 con 0x7f6de80d16a0 2024-03-29T04:09:59.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.970+0000 7f6decf00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6de80d2a40 con 0x7f6de815e920 2024-03-29T04:09:59.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.970+0000 7f6decf00640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f6de80d4ef0 con 0x7f6de80cfde0 2024-03-29T04:09:59.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.971+0000 7f6de5d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6de80d16a0 0x7f6de81599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:59.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.971+0000 7f6de5d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6de80d16a0 0x7f6de81599d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51594/0 (socket says 172.21.15.73:51594) 2024-03-29T04:09:59.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.971+0000 7f6de5d9b640 1 -- 172.21.15.73:0/560163178 learned_addr learned my addr 172.21.15.73:0/560163178 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:09:59.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.971+0000 7f6de5d9b640 1 -- 172.21.15.73:0/560163178 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6de80cfde0 msgr2=0x7f6de80c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:59.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.971+0000 7f6de5d9b640 1 --2- 172.21.15.73:0/560163178 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6de80cfde0 0x7f6de80c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:59.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.971+0000 7f6de5d9b640 1 -- 172.21.15.73:0/560163178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6de815e920 msgr2=0x7f6de80cb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:09:59.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.971+0000 7f6de5d9b640 1 --2- 172.21.15.73:0/560163178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6de815e920 0x7f6de80cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:09:59.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.971+0000 7f6de5d9b640 1 -- 172.21.15.73:0/560163178 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6de80c9070 con 0x7f6de80d16a0 2024-03-29T04:09:59.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.971+0000 7f6de5d9b640 1 --2- 172.21.15.73:0/560163178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6de80d16a0 0x7f6de81599d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6dd000b3e0 tx=0x7f6dd000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:59.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.971+0000 7f6ddeffd640 1 -- 172.21.15.73:0/560163178 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd0015020 con 0x7f6de80d16a0 2024-03-29T04:09:59.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.971+0000 7f6ddeffd640 1 -- 172.21.15.73:0/560163178 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dd0011850 con 0x7f6de80d16a0 2024-03-29T04:09:59.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.971+0000 7f6decf00640 1 -- 172.21.15.73:0/560163178 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6de80c9310 con 0x7f6de80d16a0 2024-03-29T04:09:59.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.971+0000 7f6ddeffd640 1 -- 172.21.15.73:0/560163178 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd0011c40 con 0x7f6de80d16a0 2024-03-29T04:09:59.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.971+0000 7f6decf00640 1 -- 172.21.15.73:0/560163178 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6de80c98d0 con 0x7f6de80d16a0 2024-03-29T04:09:59.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.972+0000 7f6decf00640 1 -- 172.21.15.73:0/560163178 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6de80a2560 con 0x7f6de80d16a0 2024-03-29T04:09:59.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.973+0000 7f6ddeffd640 1 -- 172.21.15.73:0/560163178 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f6dd0018020 con 0x7f6de80d16a0 2024-03-29T04:09:59.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.973+0000 7f6ddeffd640 1 --2- 172.21.15.73:0/560163178 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f6dc806c530 0x7f6dc806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:09:59.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.973+0000 7f6de659c640 1 --2- 172.21.15.73:0/560163178 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f6dc806c530 0x7f6dc806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:09:59.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.973+0000 7f6ddeffd640 1 -- 172.21.15.73:0/560163178 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f6dd008b5f0 con 0x7f6de80d16a0 2024-03-29T04:09:59.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.974+0000 7f6de659c640 1 --2- 172.21.15.73:0/560163178 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f6dc806c530 0x7f6dc806e9f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6de0035000 tx=0x7f6de002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:09:59.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:09:59.978+0000 7f6ddeffd640 1 -- 172.21.15.73:0/560163178 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f6dd001f020 con 0x7f6de80d16a0 2024-03-29T04:10:00.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.158+0000 7f6decf00640 1 -- 172.21.15.73:0/560163178 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6de80d1c50 con 0x7f6de80d16a0 2024-03-29T04:10:00.138 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.159+0000 7f6ddeffd640 1 -- 172.21.15.73:0/560163178 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) ==== 104+0+11 (secure 0 0 0) 0x7f6dd00172c0 con 0x7f6de80d16a0 2024-03-29T04:10:00.138 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-03-29T04:10:00.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.160+0000 7f6decf00640 1 -- 172.21.15.73:0/560163178 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f6dc806c530 msgr2=0x7f6dc806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:00.140 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.160+0000 7f6decf00640 1 --2- 172.21.15.73:0/560163178 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f6dc806c530 0x7f6dc806e9f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6de0035000 tx=0x7f6de002e000 comp rx=0 tx=0).stop 2024-03-29T04:10:00.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.160+0000 7f6decf00640 1 -- 172.21.15.73:0/560163178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6de80d16a0 msgr2=0x7f6de81599d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:00.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.160+0000 7f6decf00640 1 --2- 172.21.15.73:0/560163178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6de80d16a0 0x7f6de81599d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6dd000b3e0 tx=0x7f6dd000b8a0 comp rx=0 tx=0).stop 2024-03-29T04:10:00.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.160+0000 7f6decf00640 1 -- 172.21.15.73:0/560163178 shutdown_connections 2024-03-29T04:10:00.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.160+0000 7f6decf00640 1 --2- 172.21.15.73:0/560163178 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f6dc806c530 0x7f6dc806e9f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:00.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.160+0000 7f6decf00640 1 --2- 172.21.15.73:0/560163178 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6de815e920 0x7f6de80cb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:00.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.160+0000 7f6decf00640 1 --2- 172.21.15.73:0/560163178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6de80d16a0 0x7f6de81599d0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:00.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.160+0000 7f6decf00640 1 --2- 172.21.15.73:0/560163178 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f6de80cfde0 0x7f6de80c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:00.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.161+0000 7f6decf00640 1 -- 172.21.15.73:0/560163178 >> 172.21.15.73:0/560163178 conn(0x7f6de808bfc0 msgr2=0x7f6de80cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:00.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.161+0000 7f6decf00640 1 -- 172.21.15.73:0/560163178 shutdown_connections 2024-03-29T04:10:00.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.161+0000 7f6decf00640 1 -- 172.21.15.73:0/560163178 wait complete. 2024-03-29T04:10:00.151 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-29T04:10:00.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.280+0000 7f805df7c640 1 Processor -- start 2024-03-29T04:10:00.260 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.280+0000 7f805df7c640 1 -- start start 2024-03-29T04:10:00.261 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.281+0000 7f805df7c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f805815b4f0 0x7f80580c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:00.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.281+0000 7f805df7c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f805815b8d0 0x7f80580ca950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:00.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.281+0000 7f805df7c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80580b2100 0x7f80580b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:00.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.281+0000 7f805df7c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f805815bd30 con 0x7f805815b4f0 2024-03-29T04:10:00.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.281+0000 7f805df7c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f805815bfa0 con 0x7f805815b8d0 2024-03-29T04:10:00.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.281+0000 7f805df7c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f805815c280 con 0x7f80580b2100 2024-03-29T04:10:00.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.281+0000 7f80577fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f805815b4f0 0x7f80580c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:00.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.281+0000 7f80577fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f805815b4f0 0x7f80580c6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51606/0 (socket says 172.21.15.73:51606) 2024-03-29T04:10:00.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.281+0000 7f80577fe640 1 -- 172.21.15.73:0/2894086065 learned_addr learned my addr 172.21.15.73:0/2894086065 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:00.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.281+0000 7f8057fff640 1 --2- 172.21.15.73:0/2894086065 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80580b2100 0x7f80580b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:00.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.281+0000 7f804effd640 1 --2- 172.21.15.73:0/2894086065 >> v2:172.21.15.142:3300/0 conn(0x7f805815b8d0 0x7f80580ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:00.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.281+0000 7f80577fe640 1 -- 172.21.15.73:0/2894086065 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80580b2100 msgr2=0x7f80580b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:00.262 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.281+0000 7f80577fe640 1 --2- 172.21.15.73:0/2894086065 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80580b2100 0x7f80580b2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:00.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.282+0000 7f80577fe640 1 -- 172.21.15.73:0/2894086065 >> v2:172.21.15.142:3300/0 conn(0x7f805815b8d0 msgr2=0x7f80580ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:00.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.282+0000 7f80577fe640 1 --2- 172.21.15.73:0/2894086065 >> v2:172.21.15.142:3300/0 conn(0x7f805815b8d0 0x7f80580ca950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:00.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.282+0000 7f80577fe640 1 -- 172.21.15.73:0/2894086065 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f805815c560 con 0x7f805815b4f0 2024-03-29T04:10:00.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.282+0000 7f8057fff640 1 --2- 172.21.15.73:0/2894086065 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80580b2100 0x7f80580b2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:10:00.263 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.282+0000 7f804effd640 1 --2- 172.21.15.73:0/2894086065 >> v2:172.21.15.142:3300/0 conn(0x7f805815b8d0 0x7f80580ca950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:10:00.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.283+0000 7f80577fe640 1 --2- 172.21.15.73:0/2894086065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f805815b4f0 0x7f80580c6c50 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f805806c090 tx=0x7f804802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc33c875668fe74c server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:00.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.283+0000 7f8056ffd640 1 -- 172.21.15.73:0/2894086065 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8048035020 con 0x7f805815b4f0 2024-03-29T04:10:00.264 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.283+0000 7f8056ffd640 1 -- 172.21.15.73:0/2894086065 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8048031870 con 0x7f805815b4f0 2024-03-29T04:10:00.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.283+0000 7f8056ffd640 1 -- 172.21.15.73:0/2894086065 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8048031c40 con 0x7f805815b4f0 2024-03-29T04:10:00.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.284+0000 7f805df7c640 1 -- 172.21.15.73:0/2894086065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f805815b4f0 msgr2=0x7f80580c6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:00.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.284+0000 7f805df7c640 1 --2- 172.21.15.73:0/2894086065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f805815b4f0 0x7f80580c6c50 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f805806c090 tx=0x7f804802b910 comp rx=0 tx=0).stop 2024-03-29T04:10:00.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.284+0000 7f805df7c640 1 -- 172.21.15.73:0/2894086065 shutdown_connections 2024-03-29T04:10:00.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.284+0000 7f805df7c640 1 --2- 172.21.15.73:0/2894086065 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f80580b2100 0x7f80580b2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:00.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.284+0000 7f805df7c640 1 --2- 172.21.15.73:0/2894086065 >> v2:172.21.15.142:3300/0 conn(0x7f805815b8d0 0x7f80580ca950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:00.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.284+0000 7f805df7c640 1 --2- 172.21.15.73:0/2894086065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f805815b4f0 0x7f80580c6c50 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:00.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.284+0000 7f805df7c640 1 -- 172.21.15.73:0/2894086065 >> 172.21.15.73:0/2894086065 conn(0x7f80580d0450 msgr2=0x7f80580d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:00.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.284+0000 7f805df7c640 1 -- 172.21.15.73:0/2894086065 shutdown_connections 2024-03-29T04:10:00.265 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.284+0000 7f805df7c640 1 -- 172.21.15.73:0/2894086065 wait complete. 2024-03-29T04:10:00.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.286+0000 7f805df7c640 1 Processor -- start 2024-03-29T04:10:00.266 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.286+0000 7f805df7c640 1 -- start start 2024-03-29T04:10:00.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.287+0000 7f805df7c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80580b2100 0x7f805814ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:00.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.287+0000 7f805df7c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f805815b4f0 0x7f8058149990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:00.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.287+0000 7f805df7c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f805815b8d0 0x7f80580c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:00.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.287+0000 7f805df7c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f80580b4bd0 con 0x7f80580b2100 2024-03-29T04:10:00.268 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.287+0000 7f805df7c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f80580cae90 con 0x7f805815b8d0 2024-03-29T04:10:00.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.287+0000 7f805df7c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f80580b4d50 con 0x7f805815b4f0 2024-03-29T04:10:00.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.287+0000 7f80577fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80580b2100 0x7f805814ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:00.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.288+0000 7f80577fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80580b2100 0x7f805814ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51618/0 (socket says 172.21.15.73:51618) 2024-03-29T04:10:00.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.288+0000 7f80577fe640 1 -- 172.21.15.73:0/55848243 learned_addr learned my addr 172.21.15.73:0/55848243 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:00.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.288+0000 7f804effd640 1 --2- 172.21.15.73:0/55848243 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f805815b4f0 0x7f8058149990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:00.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.288+0000 7f8057fff640 1 --2- 172.21.15.73:0/55848243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f805815b8d0 0x7f80580c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:00.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.288+0000 7f80577fe640 1 -- 172.21.15.73:0/55848243 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f805815b4f0 msgr2=0x7f8058149990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:00.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.288+0000 7f80577fe640 1 --2- 172.21.15.73:0/55848243 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f805815b4f0 0x7f8058149990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:00.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.288+0000 7f80577fe640 1 -- 172.21.15.73:0/55848243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f805815b8d0 msgr2=0x7f80580c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:00.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.288+0000 7f80577fe640 1 --2- 172.21.15.73:0/55848243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f805815b8d0 0x7f80580c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:00.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.288+0000 7f80577fe640 1 -- 172.21.15.73:0/55848243 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8058149ed0 con 0x7f80580b2100 2024-03-29T04:10:00.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.288+0000 7f8057fff640 1 --2- 172.21.15.73:0/55848243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f805815b8d0 0x7f80580c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:10:00.269 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.288+0000 7f80577fe640 1 --2- 172.21.15.73:0/55848243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80580b2100 0x7f805814ce50 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f804802b950 tx=0x7f80480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:00.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.288+0000 7f8054ff9640 1 -- 172.21.15.73:0/55848243 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8048040070 con 0x7f80580b2100 2024-03-29T04:10:00.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.288+0000 7f8054ff9640 1 -- 172.21.15.73:0/55848243 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8048030d00 con 0x7f80580b2100 2024-03-29T04:10:00.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.288+0000 7f805df7c640 1 -- 172.21.15.73:0/55848243 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80580c6490 con 0x7f80580b2100 2024-03-29T04:10:00.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.288+0000 7f8054ff9640 1 -- 172.21.15.73:0/55848243 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8048035040 con 0x7f80580b2100 2024-03-29T04:10:00.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.288+0000 7f805df7c640 1 -- 172.21.15.73:0/55848243 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80580c7590 con 0x7f80580b2100 2024-03-29T04:10:00.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.290+0000 7f805df7c640 1 -- 172.21.15.73:0/55848243 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80580b0520 con 0x7f80580b2100 2024-03-29T04:10:00.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.290+0000 7f8054ff9640 1 -- 172.21.15.73:0/55848243 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f804804b060 con 0x7f80580b2100 2024-03-29T04:10:00.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.290+0000 7f8054ff9640 1 --2- 172.21.15.73:0/55848243 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f803806c530 0x7f803806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:00.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.290+0000 7f8054ff9640 1 -- 172.21.15.73:0/55848243 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f80480ad3a0 con 0x7f80580b2100 2024-03-29T04:10:00.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.290+0000 7f804effd640 1 --2- 172.21.15.73:0/55848243 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f803806c530 0x7f803806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:00.271 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.291+0000 7f804effd640 1 --2- 172.21.15.73:0/55848243 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f803806c530 0x7f803806e9f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f80580cc110 tx=0x7f8040008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:00.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.299+0000 7f8054ff9640 1 -- 172.21.15.73:0/55848243 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f80580b0520 con 0x7f80580b2100 2024-03-29T04:10:00.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.481+0000 7f805df7c640 1 -- 172.21.15.73:0/55848243 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f805806bdf0 con 0x7f80580b2100 2024-03-29T04:10:00.460 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.481+0000 7f8054ff9640 1 -- 172.21.15.73:0/55848243 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) ==== 100+0+11 (secure 0 0 0) 0x7f804807b9c0 con 0x7f80580b2100 2024-03-29T04:10:00.460 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-29T04:10:00.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.483+0000 7f805df7c640 1 -- 172.21.15.73:0/55848243 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f803806c530 msgr2=0x7f803806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:00.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.483+0000 7f805df7c640 1 --2- 172.21.15.73:0/55848243 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f803806c530 0x7f803806e9f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f80580cc110 tx=0x7f8040008040 comp rx=0 tx=0).stop 2024-03-29T04:10:00.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.483+0000 7f805df7c640 1 -- 172.21.15.73:0/55848243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80580b2100 msgr2=0x7f805814ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:00.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.483+0000 7f805df7c640 1 --2- 172.21.15.73:0/55848243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80580b2100 0x7f805814ce50 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f804802b950 tx=0x7f80480046c0 comp rx=0 tx=0).stop 2024-03-29T04:10:00.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.483+0000 7f805df7c640 1 -- 172.21.15.73:0/55848243 shutdown_connections 2024-03-29T04:10:00.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.483+0000 7f805df7c640 1 --2- 172.21.15.73:0/55848243 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f803806c530 0x7f803806e9f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:00.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.483+0000 7f805df7c640 1 --2- 172.21.15.73:0/55848243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f805815b8d0 0x7f80580c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:00.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.483+0000 7f805df7c640 1 --2- 172.21.15.73:0/55848243 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f805815b4f0 0x7f8058149990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:00.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.483+0000 7f805df7c640 1 --2- 172.21.15.73:0/55848243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80580b2100 0x7f805814ce50 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:00.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.483+0000 7f805df7c640 1 -- 172.21.15.73:0/55848243 >> 172.21.15.73:0/55848243 conn(0x7f80580d0450 msgr2=0x7f80580afe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:00.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.483+0000 7f805df7c640 1 -- 172.21.15.73:0/55848243 shutdown_connections 2024-03-29T04:10:00.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.483+0000 7f805df7c640 1 -- 172.21.15.73:0/55848243 wait complete. 2024-03-29T04:10:00.474 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-29T04:10:00.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.599+0000 7efc0ddcd640 1 Processor -- start 2024-03-29T04:10:00.578 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.599+0000 7efc0ddcd640 1 -- start start 2024-03-29T04:10:00.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.600+0000 7efc0ddcd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7efc0815e780 0x7efc080cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:00.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.600+0000 7efc0ddcd640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc080cfe70 con 0x7efc080ba000 2024-03-29T04:10:00.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.600+0000 7efc0ddcd640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc080b7f50 con 0x7efc0815eb60 2024-03-29T04:10:00.579 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.600+0000 7efc0ddcd640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7efc080b8230 con 0x7efc0815e780 2024-03-29T04:10:00.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.600+0000 7efc07fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7efc080ba000 0x7efc080d2570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52492/0 (socket says 172.21.15.73:52492) 2024-03-29T04:10:00.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.600+0000 7efc07fff640 1 -- 172.21.15.73:0/1711144572 learned_addr learned my addr 172.21.15.73:0/1711144572 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:10:00.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.601+0000 7efc077fe640 1 --2- 172.21.15.73:0/1711144572 >> v2:172.21.15.142:3300/0 conn(0x7efc0815e780 0x7efc080cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:00.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.601+0000 7efc067fc640 1 -- 172.21.15.73:0/1711144572 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2401283477 0 0) 0x7efc080cfe70 con 0x7efc080ba000 2024-03-29T04:10:00.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.601+0000 7efc067fc640 1 -- 172.21.15.73:0/1711144572 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efbf0003520 con 0x7efc080ba000 2024-03-29T04:10:00.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.601+0000 7efc067fc640 1 -- 172.21.15.73:0/1711144572 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 228982904 0 0) 0x7efbf0003520 con 0x7efc080ba000 2024-03-29T04:10:00.583 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.601+0000 7efc067fc640 1 -- 172.21.15.73:0/1711144572 >> v2:172.21.15.142:3300/0 conn(0x7efc0815e780 msgr2=0x7efc080cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:00.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.601+0000 7efc067fc640 1 --2- 172.21.15.73:0/1711144572 >> v2:172.21.15.142:3300/0 conn(0x7efc0815e780 0x7efc080cebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:00.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.601+0000 7efc067fc640 1 -- 172.21.15.73:0/1711144572 >> v1:172.21.15.142:6789/0 conn(0x7efc0815eb60 legacy=0x7efc080cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:00.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.601+0000 7efc067fc640 1 -- 172.21.15.73:0/1711144572 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc080b8510 con 0x7efc080ba000 2024-03-29T04:10:00.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.601+0000 7efc067fc640 1 -- 172.21.15.73:0/1711144572 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1290421750 0 0) 0x7efc000019f0 con 0x7efc080ba000 2024-03-29T04:10:00.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.601+0000 7efc067fc640 1 -- 172.21.15.73:0/1711144572 >> v1:172.21.15.73:6789/0 conn(0x7efc080ba000 legacy=0x7efc080d2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:00.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.601+0000 7efc067fc640 1 --2- 172.21.15.73:0/1711144572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efbf00039b0 0x7efbf0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:00.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.601+0000 7efc067fc640 1 --2- 172.21.15.73:0/1711144572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efbf0004800 0x7efbf0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:00.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.601+0000 7efc067fc640 1 --2- 172.21.15.73:0/1711144572 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efbf00051c0 0x7efbf000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:00.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.601+0000 7efc067fc640 1 -- 172.21.15.73:0/1711144572 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7efc080b8230 con 0x7efbf0004800 2024-03-29T04:10:00.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.601+0000 7efc067fc640 1 -- 172.21.15.73:0/1711144572 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7efbf000c060 con 0x7efbf00039b0 2024-03-29T04:10:00.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.601+0000 7efc067fc640 1 -- 172.21.15.73:0/1711144572 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7efbf000c260 con 0x7efbf00051c0 2024-03-29T04:10:00.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.601+0000 7efc06ffd640 1 --2- 172.21.15.73:0/1711144572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efbf0004800 0x7efbf0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:00.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.601+0000 7efc077fe640 1 --2- 172.21.15.73:0/1711144572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efbf00039b0 0x7efbf0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:00.584 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.601+0000 7efc07fff640 1 --2- 172.21.15.73:0/1711144572 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efbf00051c0 0x7efbf000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.601+0000 7efc06ffd640 1 -- 172.21.15.73:0/1711144572 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efbf00051c0 msgr2=0x7efbf000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.601+0000 7efc06ffd640 1 --2- 172.21.15.73:0/1711144572 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efbf00051c0 0x7efbf000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.601+0000 7efc06ffd640 1 -- 172.21.15.73:0/1711144572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efbf00039b0 msgr2=0x7efbf0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.601+0000 7efc06ffd640 1 --2- 172.21.15.73:0/1711144572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efbf00039b0 0x7efbf0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.601+0000 7efc06ffd640 1 -- 172.21.15.73:0/1711144572 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbf0003520 con 0x7efbf0004800 2024-03-29T04:10:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.601+0000 7efc07fff640 1 -- 172.21.15.73:0/1711144572 reap_dead start 2024-03-29T04:10:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.602+0000 7efc06ffd640 1 --2- 172.21.15.73:0/1711144572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efbf0004800 0x7efbf0004c80 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7efbfc001750 tx=0x7efbf0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcfc7eeb55f30836 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.602+0000 7efc067fc640 1 -- 172.21.15.73:0/1711144572 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbfc001370 con 0x7efbf0004800 2024-03-29T04:10:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.602+0000 7efc067fc640 1 -- 172.21.15.73:0/1711144572 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbfc0052d0 con 0x7efbf0004800 2024-03-29T04:10:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.602+0000 7efc067fc640 1 -- 172.21.15.73:0/1711144572 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbfc003830 con 0x7efbf0004800 2024-03-29T04:10:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.603+0000 7efc0ddcd640 1 -- 172.21.15.73:0/1711144572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efbf0004800 msgr2=0x7efbf0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.603+0000 7efc0ddcd640 1 --2- 172.21.15.73:0/1711144572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efbf0004800 0x7efbf0004c80 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7efbfc001750 tx=0x7efbf0005830 comp rx=0 tx=0).stop 2024-03-29T04:10:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.603+0000 7efc0ddcd640 1 -- 172.21.15.73:0/1711144572 shutdown_connections 2024-03-29T04:10:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.603+0000 7efc0ddcd640 1 --2- 172.21.15.73:0/1711144572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efbf0004800 0x7efbf0004c80 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:00.585 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.603+0000 7efc0ddcd640 1 -- 172.21.15.73:0/1711144572 >> 172.21.15.73:0/1711144572 conn(0x7efc0808bfc0 msgr2=0x7efc080d4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:00.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.603+0000 7efc0ddcd640 1 -- 172.21.15.73:0/1711144572 shutdown_connections 2024-03-29T04:10:00.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.603+0000 7efc0ddcd640 1 -- 172.21.15.73:0/1711144572 wait complete. 2024-03-29T04:10:00.586 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.604+0000 7efc0ddcd640 1 Processor -- start 2024-03-29T04:10:00.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.604+0000 7efc0ddcd640 1 -- start start 2024-03-29T04:10:00.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.605+0000 7efc0ddcd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efbf0004800 0x7efc081536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:00.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.605+0000 7efc0ddcd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc08156710 0x7efc08156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:00.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.605+0000 7efc0ddcd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc08160700 0x7efc08160b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:00.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.605+0000 7efc0ddcd640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7efc080cebc0 con 0x7efbf0004800 2024-03-29T04:10:00.588 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.605+0000 7efc0ddcd640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7efc080b8ad0 con 0x7efc08160700 2024-03-29T04:10:00.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.605+0000 7efc0ddcd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7efc080ced40 con 0x7efc08156710 2024-03-29T04:10:00.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.605+0000 7efc077fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efbf0004800 0x7efc081536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:00.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.605+0000 7efc077fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efbf0004800 0x7efc081536b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51634/0 (socket says 172.21.15.73:51634) 2024-03-29T04:10:00.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.605+0000 7efc077fe640 1 -- 172.21.15.73:0/2441971504 learned_addr learned my addr 172.21.15.73:0/2441971504 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:00.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.606+0000 7efc07fff640 1 --2- 172.21.15.73:0/2441971504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc08160700 0x7efc08160b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:00.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.606+0000 7efc077fe640 1 -- 172.21.15.73:0/2441971504 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc08156710 msgr2=0x7efc08156b90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-29T04:10:00.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.606+0000 7efc077fe640 1 --2- 172.21.15.73:0/2441971504 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc08156710 0x7efc08156b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:00.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.606+0000 7efc077fe640 1 -- 172.21.15.73:0/2441971504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc08160700 msgr2=0x7efc08160b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:00.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.606+0000 7efc077fe640 1 --2- 172.21.15.73:0/2441971504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc08160700 0x7efc08160b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:00.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.606+0000 7efc077fe640 1 -- 172.21.15.73:0/2441971504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc08153ff0 con 0x7efbf0004800 2024-03-29T04:10:00.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.606+0000 7efc077fe640 1 --2- 172.21.15.73:0/2441971504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efbf0004800 0x7efc081536b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7efbf80116d0 tx=0x7efbf8011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:00.589 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.606+0000 7efbeffff640 1 -- 172.21.15.73:0/2441971504 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf800f960 con 0x7efbf0004800 2024-03-29T04:10:00.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.606+0000 7efbeffff640 1 -- 172.21.15.73:0/2441971504 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbf800fb00 con 0x7efbf0004800 2024-03-29T04:10:00.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.606+0000 7efc0ddcd640 1 -- 172.21.15.73:0/2441971504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc0815eff0 con 0x7efbf0004800 2024-03-29T04:10:00.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.606+0000 7efbeffff640 1 -- 172.21.15.73:0/2441971504 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf8015460 con 0x7efbf0004800 2024-03-29T04:10:00.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.606+0000 7efc0ddcd640 1 -- 172.21.15.73:0/2441971504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc0815f290 con 0x7efbf0004800 2024-03-29T04:10:00.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.607+0000 7efc0ddcd640 1 -- 172.21.15.73:0/2441971504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc081570d0 con 0x7efbf0004800 2024-03-29T04:10:00.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.608+0000 7efbeffff640 1 -- 172.21.15.73:0/2441971504 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7efbf8015600 con 0x7efbf0004800 2024-03-29T04:10:00.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.608+0000 7efbeffff640 1 --2- 172.21.15.73:0/2441971504 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7efbf406c560 0x7efbf406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:00.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.608+0000 7efbeffff640 1 -- 172.21.15.73:0/2441971504 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7efbf808c080 con 0x7efbf0004800 2024-03-29T04:10:00.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.608+0000 7efc06ffd640 1 --2- 172.21.15.73:0/2441971504 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7efbf406c560 0x7efbf406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:00.590 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.609+0000 7efc06ffd640 1 --2- 172.21.15.73:0/2441971504 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7efbf406c560 0x7efbf406ea20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7efbfc033000 tx=0x7efbfc009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:00.592 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.613+0000 7efbeffff640 1 -- 172.21.15.73:0/2441971504 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7efc08153ff0 con 0x7efbf0004800 2024-03-29T04:10:00.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.802+0000 7efc0ddcd640 1 -- 172.21.15.73:0/2441971504 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7efc08068640 con 0x7efbf0004800 2024-03-29T04:10:00.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.802+0000 7efbeffff640 1 -- 172.21.15.73:0/2441971504 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v32) ==== 80+0+0 (secure 0 0 0) 0x7efbf8019030 con 0x7efbf0004800 2024-03-29T04:10:00.782 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-03-29T04:10:00.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.805+0000 7efc0ddcd640 1 -- 172.21.15.73:0/2441971504 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7efbf406c560 msgr2=0x7efbf406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:00.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.805+0000 7efc0ddcd640 1 --2- 172.21.15.73:0/2441971504 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7efbf406c560 0x7efbf406ea20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7efbfc033000 tx=0x7efbfc009030 comp rx=0 tx=0).stop 2024-03-29T04:10:00.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.805+0000 7efc0ddcd640 1 -- 172.21.15.73:0/2441971504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efbf0004800 msgr2=0x7efc081536b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:00.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.805+0000 7efc0ddcd640 1 --2- 172.21.15.73:0/2441971504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efbf0004800 0x7efc081536b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7efbf80116d0 tx=0x7efbf8011b90 comp rx=0 tx=0).stop 2024-03-29T04:10:00.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.805+0000 7efc0ddcd640 1 -- 172.21.15.73:0/2441971504 shutdown_connections 2024-03-29T04:10:00.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.805+0000 7efc0ddcd640 1 --2- 172.21.15.73:0/2441971504 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7efbf406c560 0x7efbf406ea20 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:00.786 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.805+0000 7efc0ddcd640 1 --2- 172.21.15.73:0/2441971504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efc08160700 0x7efc08160b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:00.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.805+0000 7efc0ddcd640 1 --2- 172.21.15.73:0/2441971504 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7efc08156710 0x7efc08156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:00.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.805+0000 7efc0ddcd640 1 --2- 172.21.15.73:0/2441971504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efbf0004800 0x7efc081536b0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:00.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.805+0000 7efc0ddcd640 1 -- 172.21.15.73:0/2441971504 >> 172.21.15.73:0/2441971504 conn(0x7efc0808bfc0 msgr2=0x7efc0806d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:00.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.805+0000 7efc0ddcd640 1 -- 172.21.15.73:0/2441971504 shutdown_connections 2024-03-29T04:10:00.787 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:00.805+0000 7efc0ddcd640 1 -- 172.21.15.73:0/2441971504 wait complete. 2024-03-29T04:10:00.799 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-03-29T04:10:00.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:10:00.799 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-03-29T04:10:00.835 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2024-03-29T04:10:00.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:10:00.835 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-29T04:10:00.893 INFO:tasks.cephfs.mount:Terminating background process 2024-03-29T04:10:00.893 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-29T04:10:00.893 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-29T04:10:00.909 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056354,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497668k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18846 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248832k,nr_inodes=812208,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497668k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-29T04:10:00.909 INFO:tasks.cephfs.mount:Terminating background process 2024-03-29T04:10:00.910 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-03-29T04:10:00.910 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-29T04:10:00.951 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056360,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20876 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-29T04:10:00.951 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-29T04:10:01.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.073+0000 7f03939fd640 1 Processor -- start 2024-03-29T04:10:01.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.074+0000 7f03939fd640 1 -- start start 2024-03-29T04:10:01.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.074+0000 7f03939fd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f038c15e6e0 0x7f038c09b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:01.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.074+0000 7f03939fd640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f038c0d1a10 con 0x7f038c0d0660 2024-03-29T04:10:01.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.074+0000 7f03939fd640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f038c0d0e90 con 0x7f038c162ab0 2024-03-29T04:10:01.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.074+0000 7f03939fd640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f038c0d1170 con 0x7f038c15e6e0 2024-03-29T04:10:01.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.075+0000 7f0390f98640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f038c0d0660 0x7f038c1623a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52506/0 (socket says 172.21.15.73:52506) 2024-03-29T04:10:01.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.075+0000 7f0390f98640 1 -- 172.21.15.73:0/2173243657 learned_addr learned my addr 172.21.15.73:0/2173243657 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:10:01.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.075+0000 7f0391799640 1 --2- 172.21.15.73:0/2173243657 >> v2:172.21.15.142:3300/0 conn(0x7f038c15e6e0 0x7f038c09b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:01.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.075+0000 7f0383fff640 1 -- 172.21.15.73:0/2173243657 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2444297486 0 0) 0x7f038c0d1a10 con 0x7f038c0d0660 2024-03-29T04:10:01.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.075+0000 7f0383fff640 1 -- 172.21.15.73:0/2173243657 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0378003520 con 0x7f038c0d0660 2024-03-29T04:10:01.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.075+0000 7f0391799640 1 -- 172.21.15.73:0/2173243657 >> v1:172.21.15.142:6789/0 conn(0x7f038c162ab0 legacy=0x7f038c0b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:01.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.075+0000 7f0391799640 1 -- 172.21.15.73:0/2173243657 >> v1:172.21.15.73:6789/0 conn(0x7f038c0d0660 legacy=0x7f038c1623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:01.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.075+0000 7f0383fff640 1 -- 172.21.15.73:0/2173243657 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1250682035 0 0) 0x7f038c0d0e90 con 0x7f038c162ab0 2024-03-29T04:10:01.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.075+0000 7f0391799640 1 -- 172.21.15.73:0/2173243657 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f038c0d1450 con 0x7f038c15e6e0 2024-03-29T04:10:01.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.076+0000 7f0391799640 1 --2- 172.21.15.73:0/2173243657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f038c15e6e0 0x7f038c09b6e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0384009d90 tx=0x7f038402bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=493294ef0ad6abc4 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:01.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.076+0000 7f0383fff640 1 -- 172.21.15.73:0/2173243657 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0384039070 con 0x7f038c15e6e0 2024-03-29T04:10:01.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.076+0000 7f0383fff640 1 -- 172.21.15.73:0/2173243657 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f038402cd00 con 0x7f038c15e6e0 2024-03-29T04:10:01.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.076+0000 7f0383fff640 1 -- 172.21.15.73:0/2173243657 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0384034640 con 0x7f038c15e6e0 2024-03-29T04:10:01.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.076+0000 7f03939fd640 1 -- 172.21.15.73:0/2173243657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f038c15e6e0 msgr2=0x7f038c09b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:01.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.076+0000 7f03939fd640 1 --2- 172.21.15.73:0/2173243657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f038c15e6e0 0x7f038c09b6e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0384009d90 tx=0x7f038402bf50 comp rx=0 tx=0).stop 2024-03-29T04:10:01.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.077+0000 7f03939fd640 1 -- 172.21.15.73:0/2173243657 shutdown_connections 2024-03-29T04:10:01.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.077+0000 7f03939fd640 1 --2- 172.21.15.73:0/2173243657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f038c15e6e0 0x7f038c09b6e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:01.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.077+0000 7f03939fd640 1 -- 172.21.15.73:0/2173243657 >> 172.21.15.73:0/2173243657 conn(0x7f038c0b3f10 msgr2=0x7f038c0b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:01.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.077+0000 7f03939fd640 1 -- 172.21.15.73:0/2173243657 shutdown_connections 2024-03-29T04:10:01.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.077+0000 7f03939fd640 1 -- 172.21.15.73:0/2173243657 wait complete. 2024-03-29T04:10:01.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.078+0000 7f03939fd640 1 Processor -- start 2024-03-29T04:10:01.058 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.078+0000 7f03939fd640 1 -- start start 2024-03-29T04:10:01.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.079+0000 7f03939fd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f038c0d0660 0x7f038c0c73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:01.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.079+0000 7f03939fd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f038c15e6e0 0x7f038c0b5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:01.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.079+0000 7f03939fd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f038c162ab0 0x7f038c15b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:01.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.079+0000 7f03939fd640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f038c06d910 con 0x7f038c0d0660 2024-03-29T04:10:01.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.079+0000 7f03939fd640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f038c0b1d80 con 0x7f038c15e6e0 2024-03-29T04:10:01.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.079+0000 7f03939fd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f038c0c7920 con 0x7f038c162ab0 2024-03-29T04:10:01.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.079+0000 7f0391799640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f038c0d0660 0x7f038c0c73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:01.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.079+0000 7f0391799640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f038c0d0660 0x7f038c0c73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51640/0 (socket says 172.21.15.73:51640) 2024-03-29T04:10:01.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.079+0000 7f0391799640 1 -- 172.21.15.73:0/2946135597 learned_addr learned my addr 172.21.15.73:0/2946135597 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:01.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.079+0000 7f0390f98640 1 --2- 172.21.15.73:0/2946135597 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f038c15e6e0 0x7f038c0b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:01.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.079+0000 7f0391f9a640 1 --2- 172.21.15.73:0/2946135597 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f038c162ab0 0x7f038c15b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:01.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.079+0000 7f0391799640 1 -- 172.21.15.73:0/2946135597 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f038c162ab0 msgr2=0x7f038c15b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:01.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.079+0000 7f0391799640 1 --2- 172.21.15.73:0/2946135597 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f038c162ab0 0x7f038c15b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:01.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.079+0000 7f0391799640 1 -- 172.21.15.73:0/2946135597 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f038c15e6e0 msgr2=0x7f038c0b5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:01.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.079+0000 7f0391799640 1 --2- 172.21.15.73:0/2946135597 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f038c15e6e0 0x7f038c0b5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:01.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.079+0000 7f0391799640 1 -- 172.21.15.73:0/2946135597 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f038c159eb0 con 0x7f038c0d0660 2024-03-29T04:10:01.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.079+0000 7f0390f98640 1 --2- 172.21.15.73:0/2946135597 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f038c15e6e0 0x7f038c0b5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:10:01.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.079+0000 7f0391799640 1 --2- 172.21.15.73:0/2946135597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f038c0d0660 0x7f038c0c73e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f0384000f80 tx=0x7f0384004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:01.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.080+0000 7f0381ffb640 1 -- 172.21.15.73:0/2946135597 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0384039050 con 0x7f038c0d0660 2024-03-29T04:10:01.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.080+0000 7f0381ffb640 1 -- 172.21.15.73:0/2946135597 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0384045070 con 0x7f038c0d0660 2024-03-29T04:10:01.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.080+0000 7f03939fd640 1 -- 172.21.15.73:0/2946135597 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f038c1f7e90 con 0x7f038c0d0660 2024-03-29T04:10:01.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.080+0000 7f0381ffb640 1 -- 172.21.15.73:0/2946135597 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f038403e870 con 0x7f038c0d0660 2024-03-29T04:10:01.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.080+0000 7f03939fd640 1 -- 172.21.15.73:0/2946135597 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f038c1f8450 con 0x7f038c0d0660 2024-03-29T04:10:01.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.081+0000 7f03939fd640 1 -- 172.21.15.73:0/2946135597 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f038c068640 con 0x7f038c0d0660 2024-03-29T04:10:01.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.081+0000 7f0381ffb640 1 -- 172.21.15.73:0/2946135597 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f038403ea10 con 0x7f038c0d0660 2024-03-29T04:10:01.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.082+0000 7f0381ffb640 1 --2- 172.21.15.73:0/2946135597 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f037006c530 0x7f037006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:01.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.082+0000 7f0390f98640 1 --2- 172.21.15.73:0/2946135597 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f037006c530 0x7f037006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:01.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.082+0000 7f0381ffb640 1 -- 172.21.15.73:0/2946135597 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f03840ae3c0 con 0x7f038c0d0660 2024-03-29T04:10:01.063 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.082+0000 7f0390f98640 1 --2- 172.21.15.73:0/2946135597 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f037006c530 0x7f037006e9f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f037c007fd0 tx=0x7f037c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:01.065 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.086+0000 7f0381ffb640 1 -- 172.21.15.73:0/2946135597 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f038407ca70 con 0x7f038c0d0660 2024-03-29T04:10:01.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.298+0000 7f03939fd640 1 -- 172.21.15.73:0/2946135597 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f038c0d1e40 con 0x7f038c0d0660 2024-03-29T04:10:01.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.299+0000 7f0381ffb640 1 -- 172.21.15.73:0/2946135597 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5181 (secure 0 0 0) 0x7f038407c370 con 0x7f038c0d0660 2024-03-29T04:10:01.279 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:10:01.279 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4739,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1125143848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1125143848},{"type":"v1","addr":"172.21.15.73:6837","nonce":1125143848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4742,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2988261972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2988261972},{"type":"v1","addr":"172.21.15.142:6835","nonce":2988261972}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5029,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/510984531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":510984531},{"type":"v1","addr":"172.21.15.142:6834","nonce":510984531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-29T04:08:59.079178+0000","modified":"2024-03-29T04:09:19.890401+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5055},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5055":{"gid":5055,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6836/936189393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":936189393},{"type":"v1","addr":"172.21.15.73:6836","nonce":936189393}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5055,"qdb_cluster":[5055]},"id":2}]} 2024-03-29T04:10:01.279 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 15 2024-03-29T04:10:01.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.301+0000 7f03939fd640 1 -- 172.21.15.73:0/2946135597 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f037006c530 msgr2=0x7f037006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:01.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.301+0000 7f03939fd640 1 --2- 172.21.15.73:0/2946135597 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f037006c530 0x7f037006e9f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f037c007fd0 tx=0x7f037c009040 comp rx=0 tx=0).stop 2024-03-29T04:10:01.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.301+0000 7f03939fd640 1 -- 172.21.15.73:0/2946135597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f038c0d0660 msgr2=0x7f038c0c73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:01.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.301+0000 7f03939fd640 1 --2- 172.21.15.73:0/2946135597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f038c0d0660 0x7f038c0c73e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f0384000f80 tx=0x7f0384004a40 comp rx=0 tx=0).stop 2024-03-29T04:10:01.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.301+0000 7f03939fd640 1 -- 172.21.15.73:0/2946135597 shutdown_connections 2024-03-29T04:10:01.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.301+0000 7f03939fd640 1 --2- 172.21.15.73:0/2946135597 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f038c162ab0 0x7f038c15b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:01.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.301+0000 7f03939fd640 1 --2- 172.21.15.73:0/2946135597 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f037006c530 0x7f037006e9f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:01.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.301+0000 7f03939fd640 1 --2- 172.21.15.73:0/2946135597 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f038c15e6e0 0x7f038c0b5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:01.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.301+0000 7f03939fd640 1 --2- 172.21.15.73:0/2946135597 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f038c0d0660 0x7f038c0c73e0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:01.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.301+0000 7f03939fd640 1 -- 172.21.15.73:0/2946135597 >> 172.21.15.73:0/2946135597 conn(0x7f038c0b3f10 msgr2=0x7f038c0ceea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:01.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.301+0000 7f03939fd640 1 -- 172.21.15.73:0/2946135597 shutdown_connections 2024-03-29T04:10:01.282 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.301+0000 7f03939fd640 1 -- 172.21.15.73:0/2946135597 wait complete. 2024-03-29T04:10:01.292 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-29T04:10:01.429 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.450+0000 7fa4d437c640 1 Processor -- start 2024-03-29T04:10:01.430 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.450+0000 7fa4d437c640 1 -- start start 2024-03-29T04:10:01.432 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.451+0000 7fa4d437c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4cc15b370 0x7fa4cc0b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:01.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.451+0000 7fa4d437c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa4cc073290 0x7fa4cc15f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:01.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.451+0000 7fa4d437c640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4cc071ae0 con 0x7fa4cc06f3f0 2024-03-29T04:10:01.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.451+0000 7fa4d437c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fa4cc071dc0 con 0x7fa4cc073290 2024-03-29T04:10:01.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.451+0000 7fa4d437c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa4cc0720a0 con 0x7fa4cc15b370 2024-03-29T04:10:01.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.451+0000 7fa4d2919640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa4cc073290 0x7fa4cc15f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:01.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.451+0000 7fa4d2919640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa4cc073290 0x7fa4cc15f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51644/0 (socket says 172.21.15.73:51644) 2024-03-29T04:10:01.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.451+0000 7fa4d1917640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa4cc06f3f0 0x7fa4cc072b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52508/0 (socket says 172.21.15.73:52508) 2024-03-29T04:10:01.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.451+0000 7fa4d2919640 1 -- 172.21.15.73:0/440513475 learned_addr learned my addr 172.21.15.73:0/440513475 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:01.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.451+0000 7fa4d2118640 1 --2- 172.21.15.73:0/440513475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4cc15b370 0x7fa4cc0b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:01.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.451+0000 7fa4d2919640 1 -- 172.21.15.73:0/440513475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4cc15b370 msgr2=0x7fa4cc0b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:01.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.451+0000 7fa4d2919640 1 --2- 172.21.15.73:0/440513475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4cc15b370 0x7fa4cc0b32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:01.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.451+0000 7fa4d2919640 1 -- 172.21.15.73:0/440513475 >> v1:172.21.15.73:6789/0 conn(0x7fa4cc06f3f0 legacy=0x7fa4cc072b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:01.433 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.451+0000 7fa4d2919640 1 -- 172.21.15.73:0/440513475 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4cc072380 con 0x7fa4cc073290 2024-03-29T04:10:01.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.451+0000 7fa4d1116640 1 -- 172.21.15.73:0/440513475 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 87252655 0 0) 0x7fa4cc071ae0 con 0x7fa4cc06f3f0 2024-03-29T04:10:01.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.452+0000 7fa4d2919640 1 --2- 172.21.15.73:0/440513475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4cc073290 0x7fa4cc15f0a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4009e50 tx=0x7fa4c402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdf0bd26986578e4 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:01.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.452+0000 7fa4d1116640 1 -- 172.21.15.73:0/440513475 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c402cb00 con 0x7fa4cc073290 2024-03-29T04:10:01.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.452+0000 7fa4d1116640 1 -- 172.21.15.73:0/440513475 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4c402cca0 con 0x7fa4cc073290 2024-03-29T04:10:01.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.452+0000 7fa4d1116640 1 -- 172.21.15.73:0/440513475 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4034610 con 0x7fa4cc073290 2024-03-29T04:10:01.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.453+0000 7fa4d437c640 1 -- 172.21.15.73:0/440513475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4cc073290 msgr2=0x7fa4cc15f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:01.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.453+0000 7fa4d437c640 1 --2- 172.21.15.73:0/440513475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4cc073290 0x7fa4cc15f0a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4009e50 tx=0x7fa4c402bf60 comp rx=0 tx=0).stop 2024-03-29T04:10:01.434 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.453+0000 7fa4d437c640 1 -- 172.21.15.73:0/440513475 shutdown_connections 2024-03-29T04:10:01.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.453+0000 7fa4d437c640 1 --2- 172.21.15.73:0/440513475 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4cc073290 0x7fa4cc15f0a0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:01.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.453+0000 7fa4d437c640 1 --2- 172.21.15.73:0/440513475 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4cc15b370 0x7fa4cc0b32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:01.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.453+0000 7fa4d437c640 1 -- 172.21.15.73:0/440513475 >> 172.21.15.73:0/440513475 conn(0x7fa4cc06b510 msgr2=0x7fa4cc06b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:01.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.453+0000 7fa4d437c640 1 -- 172.21.15.73:0/440513475 shutdown_connections 2024-03-29T04:10:01.435 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.453+0000 7fa4d437c640 1 -- 172.21.15.73:0/440513475 wait complete. 2024-03-29T04:10:01.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.454+0000 7fa4d437c640 1 Processor -- start 2024-03-29T04:10:01.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.454+0000 7fa4d437c640 1 -- start start 2024-03-29T04:10:01.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.455+0000 7fa4d437c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4cc06f3f0 0x7fa4cc145810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:01.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.455+0000 7fa4d437c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4cc073290 0x7fa4cc157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:01.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.455+0000 7fa4d437c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4cc15b370 0x7fa4cc1e8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:01.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.455+0000 7fa4d437c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc0b3980 con 0x7fa4cc06f3f0 2024-03-29T04:10:01.438 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.455+0000 7fa4d437c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc0b3800 con 0x7fa4cc073290 2024-03-29T04:10:01.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.455+0000 7fa4d437c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa4cc15b750 con 0x7fa4cc15b370 2024-03-29T04:10:01.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.455+0000 7fa4d2118640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4cc06f3f0 0x7fa4cc145810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:01.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.455+0000 7fa4d2118640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4cc06f3f0 0x7fa4cc145810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51650/0 (socket says 172.21.15.73:51650) 2024-03-29T04:10:01.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.455+0000 7fa4d2118640 1 -- 172.21.15.73:0/3548878858 learned_addr learned my addr 172.21.15.73:0/3548878858 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:01.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.455+0000 7fa4d2118640 1 -- 172.21.15.73:0/3548878858 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4cc15b370 msgr2=0x7fa4cc1e8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:01.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.455+0000 7fa4d2118640 1 --2- 172.21.15.73:0/3548878858 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4cc15b370 0x7fa4cc1e8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:01.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.455+0000 7fa4d2118640 1 -- 172.21.15.73:0/3548878858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4cc073290 msgr2=0x7fa4cc157030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:01.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.455+0000 7fa4d2118640 1 --2- 172.21.15.73:0/3548878858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4cc073290 0x7fa4cc157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:01.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.455+0000 7fa4d2118640 1 -- 172.21.15.73:0/3548878858 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4cc0cdd90 con 0x7fa4cc06f3f0 2024-03-29T04:10:01.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.455+0000 7fa4d2118640 1 --2- 172.21.15.73:0/3548878858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4cc06f3f0 0x7fa4cc145810 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa4c000e960 tx=0x7fa4c000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:01.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.455+0000 7fa4beffd640 1 -- 172.21.15.73:0/3548878858 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c0017070 con 0x7fa4cc06f3f0 2024-03-29T04:10:01.439 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.456+0000 7fa4beffd640 1 -- 172.21.15.73:0/3548878858 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4c000ca00 con 0x7fa4cc06f3f0 2024-03-29T04:10:01.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.456+0000 7fa4beffd640 1 -- 172.21.15.73:0/3548878858 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c000cdf0 con 0x7fa4cc06f3f0 2024-03-29T04:10:01.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.456+0000 7fa4d437c640 1 -- 172.21.15.73:0/3548878858 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4cc0ce030 con 0x7fa4cc06f3f0 2024-03-29T04:10:01.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.456+0000 7fa4d437c640 1 -- 172.21.15.73:0/3548878858 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4cc1541e0 con 0x7fa4cc06f3f0 2024-03-29T04:10:01.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.457+0000 7fa4d437c640 1 -- 172.21.15.73:0/3548878858 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4cc068640 con 0x7fa4cc06f3f0 2024-03-29T04:10:01.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.458+0000 7fa4beffd640 1 -- 172.21.15.73:0/3548878858 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fa4c001a070 con 0x7fa4cc06f3f0 2024-03-29T04:10:01.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.458+0000 7fa4beffd640 1 --2- 172.21.15.73:0/3548878858 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa4b006c530 0x7fa4b006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:01.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.458+0000 7fa4beffd640 1 -- 172.21.15.73:0/3548878858 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fa4c008bae0 con 0x7fa4cc06f3f0 2024-03-29T04:10:01.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.458+0000 7fa4d1917640 1 --2- 172.21.15.73:0/3548878858 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa4b006c530 0x7fa4b006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:01.440 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.458+0000 7fa4d1917640 1 --2- 172.21.15.73:0/3548878858 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa4b006c530 0x7fa4b006e9f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8007fd0 tx=0x7fa4c8007960 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:01.441 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.462+0000 7fa4beffd640 1 -- 172.21.15.73:0/3548878858 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fa4c005a100 con 0x7fa4cc06f3f0 2024-03-29T04:10:01.625 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.645+0000 7fa4d437c640 1 -- 172.21.15.73:0/3548878858 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa4cc0d0000 con 0x7fa4cc06f3f0 2024-03-29T04:10:01.626 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.647+0000 7fa4beffd640 1 -- 172.21.15.73:0/3548878858 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16669 (secure 0 0 0) 0x7fa4c0059a00 con 0x7fa4cc06f3f0 2024-03-29T04:10:01.626 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:10:01.627 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":32,"fsid":"6bff1617-b138-4517-acca-3ecaae3f2bb3","created":"2024-03-29T04:07:47.346864+0000","modified":"2024-03-29T04:09:00.732697+0000","last_up_change":"2024-03-29T04:07:58.507139+0000","last_in_change":"2024-03-29T04:07:49.637816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-29T04:07:59.537301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-29T04:08:57.521498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-29T04:08:58.027631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"925d7de1-14ab-48c0-aebd-7bded108f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6820","nonce":2387335359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6824","nonce":2387335359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6831","nonce":2387335359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6828","nonce":2387335359}]},"public_addr":"172.21.15.73:6820/2387335359","cluster_addr":"172.21.15.73:6824/2387335359","heartbeat_back_addr":"172.21.15.73:6831/2387335359","heartbeat_front_addr":"172.21.15.73:6828/2387335359","state":["exists","up"]},{"osd":1,"uuid":"6b182102-882a-4e0c-99db-0afae5cfb38b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6801","nonce":2431315515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6803","nonce":2431315515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6807","nonce":2431315515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6805","nonce":2431315515}]},"public_addr":"172.21.15.73:6801/2431315515","cluster_addr":"172.21.15.73:6803/2431315515","heartbeat_back_addr":"172.21.15.73:6807/2431315515","heartbeat_front_addr":"172.21.15.73:6805/2431315515","state":["exists","up"]},{"osd":2,"uuid":"8040902e-b0b8-4a21-bf64-ce1c222115ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6809","nonce":407236597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6811","nonce":407236597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6815","nonce":407236597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6813","nonce":407236597}]},"public_addr":"172.21.15.73:6809/407236597","cluster_addr":"172.21.15.73:6811/407236597","heartbeat_back_addr":"172.21.15.73:6815/407236597","heartbeat_front_addr":"172.21.15.73:6813/407236597","state":["exists","up"]},{"osd":3,"uuid":"1bab19ee-3775-4ce1-a4ce-cf7cda3bbbf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6817","nonce":4291100709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6821","nonce":4291100709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6829","nonce":4291100709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6825","nonce":4291100709}]},"public_addr":"172.21.15.73:6817/4291100709","cluster_addr":"172.21.15.73:6821/4291100709","heartbeat_back_addr":"172.21.15.73:6829/4291100709","heartbeat_front_addr":"172.21.15.73:6825/4291100709","state":["exists","up"]},{"osd":4,"uuid":"b0c74337-8fe4-47dc-b3da-2d07591b1f6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6817","nonce":3703256194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6819","nonce":3703256194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6823","nonce":3703256194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6821","nonce":3703256194}]},"public_addr":"172.21.15.142:6817/3703256194","cluster_addr":"172.21.15.142:6819/3703256194","heartbeat_back_addr":"172.21.15.142:6823/3703256194","heartbeat_front_addr":"172.21.15.142:6821/3703256194","state":["exists","up"]},{"osd":5,"uuid":"9ce36410-a29a-42c6-99f4-f95d4afdd7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6825","nonce":4271575803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6827","nonce":4271575803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6831","nonce":4271575803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6829","nonce":4271575803}]},"public_addr":"172.21.15.142:6825/4271575803","cluster_addr":"172.21.15.142:6827/4271575803","heartbeat_back_addr":"172.21.15.142:6831/4271575803","heartbeat_front_addr":"172.21.15.142:6829/4271575803","state":["exists","up"]},{"osd":6,"uuid":"aec4264a-64ac-428e-a860-d2920a304019","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6801","nonce":1772722570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6803","nonce":1772722570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6807","nonce":1772722570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6805","nonce":1772722570}]},"public_addr":"172.21.15.142:6801/1772722570","cluster_addr":"172.21.15.142:6803/1772722570","heartbeat_back_addr":"172.21.15.142:6807/1772722570","heartbeat_front_addr":"172.21.15.142:6805/1772722570","state":["exists","up"]},{"osd":7,"uuid":"fe599052-8e5a-4c7a-91e7-52d1bae24a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6809","nonce":3910589675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6811","nonce":3910589675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6815","nonce":3910589675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6813","nonce":3910589675}]},"public_addr":"172.21.15.142:6809/3910589675","cluster_addr":"172.21.15.142:6811/3910589675","heartbeat_back_addr":"172.21.15.142:6815/3910589675","heartbeat_front_addr":"172.21.15.142:6813/3910589675","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.835096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.587210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.786547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.778004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.843740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.791160+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.837992+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.718722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:10:01.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.648+0000 7fa4d437c640 1 -- 172.21.15.73:0/3548878858 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa4b006c530 msgr2=0x7fa4b006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:01.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.648+0000 7fa4d437c640 1 --2- 172.21.15.73:0/3548878858 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa4b006c530 0x7fa4b006e9f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8007fd0 tx=0x7fa4c8007960 comp rx=0 tx=0).stop 2024-03-29T04:10:01.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.648+0000 7fa4d437c640 1 -- 172.21.15.73:0/3548878858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4cc06f3f0 msgr2=0x7fa4cc145810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:01.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.648+0000 7fa4d437c640 1 --2- 172.21.15.73:0/3548878858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4cc06f3f0 0x7fa4cc145810 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa4c000e960 tx=0x7fa4c000ee20 comp rx=0 tx=0).stop 2024-03-29T04:10:01.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.648+0000 7fa4d437c640 1 -- 172.21.15.73:0/3548878858 shutdown_connections 2024-03-29T04:10:01.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.648+0000 7fa4d437c640 1 --2- 172.21.15.73:0/3548878858 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa4cc15b370 0x7fa4cc1e8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:01.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.648+0000 7fa4d437c640 1 --2- 172.21.15.73:0/3548878858 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa4b006c530 0x7fa4b006e9f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:01.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.648+0000 7fa4d437c640 1 --2- 172.21.15.73:0/3548878858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4cc073290 0x7fa4cc157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:01.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.648+0000 7fa4d437c640 1 --2- 172.21.15.73:0/3548878858 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4cc06f3f0 0x7fa4cc145810 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:01.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.649+0000 7fa4d437c640 1 -- 172.21.15.73:0/3548878858 >> 172.21.15.73:0/3548878858 conn(0x7fa4cc06b510 msgr2=0x7fa4cc0b3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:01.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.649+0000 7fa4d437c640 1 -- 172.21.15.73:0/3548878858 shutdown_connections 2024-03-29T04:10:01.629 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.649+0000 7fa4d437c640 1 -- 172.21.15.73:0/3548878858 wait complete. 2024-03-29T04:10:01.639 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-29T04:07:59.537301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-29T04:08:57.521498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-29T04:08:58.027631+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-29T04:10:01.640 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-29T04:10:01.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.765+0000 7fa2a9293640 1 Processor -- start 2024-03-29T04:10:01.745 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.765+0000 7fa2a9293640 1 -- start start 2024-03-29T04:10:01.746 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.766+0000 7fa2a9293640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa2a40cea60 0x7fa2a409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:01.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.766+0000 7fa2a9293640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa2a4070ee0 0x7fa2a409af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:01.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.766+0000 7fa2a9293640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2a40d0c80 con 0x7fa2a40ce680 2024-03-29T04:10:01.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.766+0000 7fa2a9293640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fa2a40d0a30 con 0x7fa2a40cea60 2024-03-29T04:10:01.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.766+0000 7fa2a9293640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fa2a4070650 con 0x7fa2a4070ee0 2024-03-29T04:10:01.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.766+0000 7fa29bfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa2a40cea60 0x7fa2a409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:01.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.766+0000 7fa2a2ffd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa2a40ce680 0x7fa2a409b770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52516/0 (socket says 172.21.15.73:52516) 2024-03-29T04:10:01.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.766+0000 7fa2a2ffd640 1 -- 172.21.15.73:0/2826155716 learned_addr learned my addr 172.21.15.73:0/2826155716 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:10:01.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.766+0000 7fa29bfff640 1 -- 172.21.15.73:0/2826155716 >> v2:172.21.15.142:3300/0 conn(0x7fa2a4070ee0 msgr2=0x7fa2a409af70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-29T04:10:01.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.767+0000 7fa29bfff640 1 --2- 172.21.15.73:0/2826155716 >> v2:172.21.15.142:3300/0 conn(0x7fa2a4070ee0 0x7fa2a409af70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:01.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.767+0000 7fa29bfff640 1 -- 172.21.15.73:0/2826155716 >> v1:172.21.15.73:6789/0 conn(0x7fa2a40ce680 legacy=0x7fa2a409b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:01.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.767+0000 7fa2a27fc640 1 -- 172.21.15.73:0/2826155716 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3952376883 0 0) 0x7fa2a40d0c80 con 0x7fa2a40ce680 2024-03-29T04:10:01.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.767+0000 7fa29bfff640 1 -- 172.21.15.73:0/2826155716 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a40cde40 con 0x7fa2a40cea60 2024-03-29T04:10:01.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.767+0000 7fa29bfff640 1 --2- 172.21.15.73:0/2826155716 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2a40cea60 0x7fa2a409aa30 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa2a40d18e0 tx=0x7fa28c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e1dac3863b618f8 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:01.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.767+0000 7fa2a27fc640 1 -- 172.21.15.73:0/2826155716 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c0317c0 con 0x7fa2a40cea60 2024-03-29T04:10:01.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.767+0000 7fa2a27fc640 1 -- 172.21.15.73:0/2826155716 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa28c037070 con 0x7fa2a40cea60 2024-03-29T04:10:01.748 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.767+0000 7fa2a27fc640 1 -- 172.21.15.73:0/2826155716 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c031b80 con 0x7fa2a40cea60 2024-03-29T04:10:01.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.768+0000 7fa2a9293640 1 -- 172.21.15.73:0/2826155716 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2a40cea60 msgr2=0x7fa2a409aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:01.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.768+0000 7fa2a9293640 1 --2- 172.21.15.73:0/2826155716 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2a40cea60 0x7fa2a409aa30 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa2a40d18e0 tx=0x7fa28c02b860 comp rx=0 tx=0).stop 2024-03-29T04:10:01.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.768+0000 7fa2a9293640 1 -- 172.21.15.73:0/2826155716 shutdown_connections 2024-03-29T04:10:01.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.768+0000 7fa2a9293640 1 --2- 172.21.15.73:0/2826155716 >> v2:172.21.15.142:3300/0 conn(0x7fa2a4070ee0 0x7fa2a409af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:01.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.768+0000 7fa2a9293640 1 --2- 172.21.15.73:0/2826155716 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2a40cea60 0x7fa2a409aa30 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:01.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.768+0000 7fa2a9293640 1 -- 172.21.15.73:0/2826155716 >> 172.21.15.73:0/2826155716 conn(0x7fa2a40b3f40 msgr2=0x7fa2a40b4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:01.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.768+0000 7fa2a9293640 1 -- 172.21.15.73:0/2826155716 shutdown_connections 2024-03-29T04:10:01.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.768+0000 7fa2a9293640 1 -- 172.21.15.73:0/2826155716 wait complete. 2024-03-29T04:10:01.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.769+0000 7fa2a9293640 1 Processor -- start 2024-03-29T04:10:01.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.769+0000 7fa2a9293640 1 -- start start 2024-03-29T04:10:01.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.770+0000 7fa2a9293640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2a4070ee0 0x7fa2a40b5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:01.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.770+0000 7fa2a9293640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2a40ce680 0x7fa2a40b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:01.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.770+0000 7fa2a9293640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2a40cea60 0x7fa2a40c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:01.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.770+0000 7fa2a9293640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a4070ae0 con 0x7fa2a4070ee0 2024-03-29T04:10:01.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.770+0000 7fa2a9293640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a40d1240 con 0x7fa2a40cea60 2024-03-29T04:10:01.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.770+0000 7fa2a9293640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fa2a4070c60 con 0x7fa2a40ce680 2024-03-29T04:10:01.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.770+0000 7fa2a2ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2a4070ee0 0x7fa2a40b5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:01.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.770+0000 7fa2a2ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2a4070ee0 0x7fa2a40b5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51668/0 (socket says 172.21.15.73:51668) 2024-03-29T04:10:01.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.770+0000 7fa2a2ffd640 1 -- 172.21.15.73:0/1777864975 learned_addr learned my addr 172.21.15.73:0/1777864975 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:01.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.770+0000 7fa2a2ffd640 1 -- 172.21.15.73:0/1777864975 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2a40ce680 msgr2=0x7fa2a40b7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:01.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.770+0000 7fa2a2ffd640 1 --2- 172.21.15.73:0/1777864975 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2a40ce680 0x7fa2a40b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:01.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.770+0000 7fa2a2ffd640 1 -- 172.21.15.73:0/1777864975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2a40cea60 msgr2=0x7fa2a40c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:01.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.770+0000 7fa2a2ffd640 1 --2- 172.21.15.73:0/1777864975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2a40cea60 0x7fa2a40c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:01.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.770+0000 7fa2a2ffd640 1 -- 172.21.15.73:0/1777864975 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a40c7290 con 0x7fa2a4070ee0 2024-03-29T04:10:01.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.770+0000 7fa2a2ffd640 1 --2- 172.21.15.73:0/1777864975 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2a4070ee0 0x7fa2a40b5c40 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa29400c430 tx=0x7fa29400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:01.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.771+0000 7fa29b7fe640 1 -- 172.21.15.73:0/1777864975 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2940074e0 con 0x7fa2a4070ee0 2024-03-29T04:10:01.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.771+0000 7fa29b7fe640 1 -- 172.21.15.73:0/1777864975 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2940047e0 con 0x7fa2a4070ee0 2024-03-29T04:10:01.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.771+0000 7fa2a9293640 1 -- 172.21.15.73:0/1777864975 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2a40c7820 con 0x7fa2a4070ee0 2024-03-29T04:10:01.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.771+0000 7fa29b7fe640 1 -- 172.21.15.73:0/1777864975 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa294004bd0 con 0x7fa2a4070ee0 2024-03-29T04:10:01.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.771+0000 7fa2a9293640 1 -- 172.21.15.73:0/1777864975 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2a40c7de0 con 0x7fa2a4070ee0 2024-03-29T04:10:01.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.772+0000 7fa2a9293640 1 -- 172.21.15.73:0/1777864975 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2a409bbf0 con 0x7fa2a4070ee0 2024-03-29T04:10:01.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.772+0000 7fa29b7fe640 1 -- 172.21.15.73:0/1777864975 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fa294011070 con 0x7fa2a4070ee0 2024-03-29T04:10:01.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.773+0000 7fa29b7fe640 1 --2- 172.21.15.73:0/1777864975 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa28406c530 0x7fa28406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:01.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.773+0000 7fa29b7fe640 1 -- 172.21.15.73:0/1777864975 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fa29408b350 con 0x7fa2a4070ee0 2024-03-29T04:10:01.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.773+0000 7fa29bfff640 1 --2- 172.21.15.73:0/1777864975 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa28406c530 0x7fa28406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:01.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.773+0000 7fa29bfff640 1 --2- 172.21.15.73:0/1777864975 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa28406c530 0x7fa28406e9f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa28c036000 tx=0x7fa28c030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:01.756 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.777+0000 7fa29b7fe640 1 -- 172.21.15.73:0/1777864975 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fa2a409bbf0 con 0x7fa2a4070ee0 2024-03-29T04:10:01.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.952+0000 7fa2a9293640 1 -- 172.21.15.73:0/1777864975 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa2a40a0520 con 0x7fa2a4070ee0 2024-03-29T04:10:01.932 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.953+0000 7fa29b7fe640 1 -- 172.21.15.73:0/1777864975 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) ==== 93+0+10 (secure 0 0 0) 0x7fa294059970 con 0x7fa2a4070ee0 2024-03-29T04:10:01.932 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-03-29T04:10:01.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.955+0000 7fa2a9293640 1 -- 172.21.15.73:0/1777864975 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa28406c530 msgr2=0x7fa28406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:01.934 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.955+0000 7fa2a9293640 1 --2- 172.21.15.73:0/1777864975 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa28406c530 0x7fa28406e9f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa28c036000 tx=0x7fa28c030000 comp rx=0 tx=0).stop 2024-03-29T04:10:01.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.955+0000 7fa2a9293640 1 -- 172.21.15.73:0/1777864975 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2a4070ee0 msgr2=0x7fa2a40b5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:01.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.955+0000 7fa2a9293640 1 --2- 172.21.15.73:0/1777864975 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2a4070ee0 0x7fa2a40b5c40 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa29400c430 tx=0x7fa29400c8f0 comp rx=0 tx=0).stop 2024-03-29T04:10:01.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.955+0000 7fa2a9293640 1 -- 172.21.15.73:0/1777864975 shutdown_connections 2024-03-29T04:10:01.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.955+0000 7fa2a9293640 1 --2- 172.21.15.73:0/1777864975 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fa28406c530 0x7fa28406e9f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:01.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.955+0000 7fa2a9293640 1 --2- 172.21.15.73:0/1777864975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2a40cea60 0x7fa2a40c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:01.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.955+0000 7fa2a9293640 1 --2- 172.21.15.73:0/1777864975 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fa2a40ce680 0x7fa2a40b7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:01.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.955+0000 7fa2a9293640 1 --2- 172.21.15.73:0/1777864975 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa2a4070ee0 0x7fa2a40b5c40 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:01.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.955+0000 7fa2a9293640 1 -- 172.21.15.73:0/1777864975 >> 172.21.15.73:0/1777864975 conn(0x7fa2a40b3f40 msgr2=0x7fa2a409ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:01.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.955+0000 7fa2a9293640 1 -- 172.21.15.73:0/1777864975 shutdown_connections 2024-03-29T04:10:01.935 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:01.955+0000 7fa2a9293640 1 -- 172.21.15.73:0/1777864975 wait complete. 2024-03-29T04:10:01.945 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-29T04:10:02.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.069+0000 7f3a782f8640 1 Processor -- start 2024-03-29T04:10:02.049 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.069+0000 7f3a782f8640 1 -- start start 2024-03-29T04:10:02.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.070+0000 7f3a782f8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a700ce470 0x7f3a700d10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:02.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.070+0000 7f3a782f8640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a7009ac60 con 0x7f3a70070aa0 2024-03-29T04:10:02.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.070+0000 7f3a782f8640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a7009af40 con 0x7f3a700d1600 2024-03-29T04:10:02.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.070+0000 7f3a782f8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f3a7009aa30 con 0x7f3a700ce470 2024-03-29T04:10:02.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.070+0000 7f3a76895640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3a70070aa0 0x7f3a7015e0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52526/0 (socket says 172.21.15.73:52526) 2024-03-29T04:10:02.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.070+0000 7f3a76895640 1 -- 172.21.15.73:0/496154585 learned_addr learned my addr 172.21.15.73:0/496154585 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:10:02.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.070+0000 7f3a75092640 1 -- 172.21.15.73:0/496154585 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3814414263 0 0) 0x7f3a7009ac60 con 0x7f3a70070aa0 2024-03-29T04:10:02.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.070+0000 7f3a75092640 1 -- 172.21.15.73:0/496154585 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a5c003520 con 0x7f3a70070aa0 2024-03-29T04:10:02.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.071+0000 7f3a76094640 1 --2- 172.21.15.73:0/496154585 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a700ce470 0x7f3a700d10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:02.053 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.071+0000 7f3a75092640 1 -- 172.21.15.73:0/496154585 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3040601510 0 0) 0x7f3a5c003520 con 0x7f3a70070aa0 2024-03-29T04:10:02.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.071+0000 7f3a75092640 1 -- 172.21.15.73:0/496154585 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a700ce470 msgr2=0x7f3a700d10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:02.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.071+0000 7f3a75092640 1 --2- 172.21.15.73:0/496154585 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a700ce470 0x7f3a700d10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:02.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.071+0000 7f3a75092640 1 -- 172.21.15.73:0/496154585 >> v1:172.21.15.142:6789/0 conn(0x7f3a700d1600 legacy=0x7f3a70070390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:02.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.071+0000 7f3a75092640 1 -- 172.21.15.73:0/496154585 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a7009b220 con 0x7f3a70070aa0 2024-03-29T04:10:02.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.071+0000 7f3a75092640 1 -- 172.21.15.73:0/496154585 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1290421750 0 0) 0x7f3a680019f0 con 0x7f3a70070aa0 2024-03-29T04:10:02.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.071+0000 7f3a75092640 1 -- 172.21.15.73:0/496154585 >> v1:172.21.15.73:6789/0 conn(0x7f3a70070aa0 legacy=0x7f3a7015e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:02.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.071+0000 7f3a75092640 1 --2- 172.21.15.73:0/496154585 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a700ce470 0x7f3a5c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:02.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.071+0000 7f3a75092640 1 --2- 172.21.15.73:0/496154585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a5c004060 0x7f3a5c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:02.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.071+0000 7f3a75092640 1 --2- 172.21.15.73:0/496154585 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a5c004d40 0x7f3a5c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:02.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.071+0000 7f3a75092640 1 -- 172.21.15.73:0/496154585 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5c00bc60 con 0x7f3a5c004060 2024-03-29T04:10:02.054 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.071+0000 7f3a75092640 1 -- 172.21.15.73:0/496154585 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5c00be10 con 0x7f3a5c004d40 2024-03-29T04:10:02.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.071+0000 7f3a75092640 1 -- 172.21.15.73:0/496154585 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f3a5c00c010 con 0x7f3a700ce470 2024-03-29T04:10:02.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.071+0000 7f3a75893640 1 --2- 172.21.15.73:0/496154585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a5c004060 0x7f3a5c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:02.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.071+0000 7f3a76895640 1 --2- 172.21.15.73:0/496154585 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a5c004d40 0x7f3a5c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:02.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.071+0000 7f3a75893640 1 -- 172.21.15.73:0/496154585 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a700ce470 msgr2=0x7f3a5c0039e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-29T04:10:02.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.071+0000 7f3a75893640 1 --2- 172.21.15.73:0/496154585 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a700ce470 0x7f3a5c0039e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:02.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.071+0000 7f3a75893640 1 -- 172.21.15.73:0/496154585 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a5c004d40 msgr2=0x7f3a5c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:02.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.071+0000 7f3a75893640 1 --2- 172.21.15.73:0/496154585 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a5c004d40 0x7f3a5c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:02.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.071+0000 7f3a75893640 1 -- 172.21.15.73:0/496154585 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a5c003520 con 0x7f3a5c004060 2024-03-29T04:10:02.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.071+0000 7f3a76895640 1 --2- 172.21.15.73:0/496154585 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a5c004d40 0x7f3a5c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:10:02.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.072+0000 7f3a75893640 1 --2- 172.21.15.73:0/496154585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a5c004060 0x7f3a5c004800 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c001750 tx=0x7f3a5c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bcc596b9ad47b63 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:02.055 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.072+0000 7f3a75092640 1 -- 172.21.15.73:0/496154585 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c001370 con 0x7f3a5c004060 2024-03-29T04:10:02.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.072+0000 7f3a75092640 1 -- 172.21.15.73:0/496154585 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a6c0052d0 con 0x7f3a5c004060 2024-03-29T04:10:02.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.072+0000 7f3a75092640 1 -- 172.21.15.73:0/496154585 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c003830 con 0x7f3a5c004060 2024-03-29T04:10:02.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.073+0000 7f3a782f8640 1 -- 172.21.15.73:0/496154585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a5c004060 msgr2=0x7f3a5c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:02.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.073+0000 7f3a782f8640 1 --2- 172.21.15.73:0/496154585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a5c004060 0x7f3a5c004800 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c001750 tx=0x7f3a5c005830 comp rx=0 tx=0).stop 2024-03-29T04:10:02.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.073+0000 7f3a76895640 1 -- 172.21.15.73:0/496154585 reap_dead start 2024-03-29T04:10:02.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.073+0000 7f3a782f8640 1 -- 172.21.15.73:0/496154585 shutdown_connections 2024-03-29T04:10:02.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.073+0000 7f3a782f8640 1 -- 172.21.15.73:0/496154585 >> 172.21.15.73:0/496154585 conn(0x7f3a700b3f40 msgr2=0x7f3a700b4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:02.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.073+0000 7f3a782f8640 1 -- 172.21.15.73:0/496154585 shutdown_connections 2024-03-29T04:10:02.056 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.073+0000 7f3a782f8640 1 -- 172.21.15.73:0/496154585 wait complete. 2024-03-29T04:10:02.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.075+0000 7f3a782f8640 1 Processor -- start 2024-03-29T04:10:02.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.075+0000 7f3a782f8640 1 -- start start 2024-03-29T04:10:02.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.076+0000 7f3a782f8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a5c004060 0x7f3a700c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:02.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.076+0000 7f3a782f8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a700b0730 0x7f3a700b7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:02.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.076+0000 7f3a782f8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a700c7fb0 0x7f3a7006c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:02.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.076+0000 7f3a782f8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3a700ce850 con 0x7f3a5c004060 2024-03-29T04:10:02.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.076+0000 7f3a782f8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3a7009b7e0 con 0x7f3a700b0730 2024-03-29T04:10:02.059 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.076+0000 7f3a782f8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f3a7009bd00 con 0x7f3a700c7fb0 2024-03-29T04:10:02.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.076+0000 7f3a76094640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a5c004060 0x7f3a700c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:02.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.076+0000 7f3a76094640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a5c004060 0x7f3a700c8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51694/0 (socket says 172.21.15.73:51694) 2024-03-29T04:10:02.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.076+0000 7f3a76094640 1 -- 172.21.15.73:0/3272413041 learned_addr learned my addr 172.21.15.73:0/3272413041 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:02.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.076+0000 7f3a75893640 1 --2- 172.21.15.73:0/3272413041 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a700b0730 0x7f3a700b7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:02.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.076+0000 7f3a76895640 1 --2- 172.21.15.73:0/3272413041 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a700c7fb0 0x7f3a7006c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:02.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.076+0000 7f3a76094640 1 -- 172.21.15.73:0/3272413041 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a700c7fb0 msgr2=0x7f3a7006c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:02.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.076+0000 7f3a76094640 1 --2- 172.21.15.73:0/3272413041 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a700c7fb0 0x7f3a7006c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:02.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.076+0000 7f3a76094640 1 -- 172.21.15.73:0/3272413041 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a700b0730 msgr2=0x7f3a700b7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:02.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.076+0000 7f3a76094640 1 --2- 172.21.15.73:0/3272413041 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a700b0730 0x7f3a700b7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:02.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.076+0000 7f3a76094640 1 -- 172.21.15.73:0/3272413041 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a700b5300 con 0x7f3a5c004060 2024-03-29T04:10:02.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.077+0000 7f3a76094640 1 --2- 172.21.15.73:0/3272413041 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a5c004060 0x7f3a700c8ac0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f3a6000d800 tx=0x7f3a6000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:02.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.077+0000 7f3a66ffd640 1 -- 172.21.15.73:0/3272413041 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a60018020 con 0x7f3a5c004060 2024-03-29T04:10:02.060 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.077+0000 7f3a66ffd640 1 -- 172.21.15.73:0/3272413041 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a60009640 con 0x7f3a5c004060 2024-03-29T04:10:02.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.077+0000 7f3a66ffd640 1 -- 172.21.15.73:0/3272413041 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a60009a10 con 0x7f3a5c004060 2024-03-29T04:10:02.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.077+0000 7f3a782f8640 1 -- 172.21.15.73:0/3272413041 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a700c9130 con 0x7f3a5c004060 2024-03-29T04:10:02.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.077+0000 7f3a782f8640 1 -- 172.21.15.73:0/3272413041 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a700c74d0 con 0x7f3a5c004060 2024-03-29T04:10:02.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.078+0000 7f3a782f8640 1 -- 172.21.15.73:0/3272413041 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a700a0520 con 0x7f3a5c004060 2024-03-29T04:10:02.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.078+0000 7f3a66ffd640 1 -- 172.21.15.73:0/3272413041 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f3a6001b020 con 0x7f3a5c004060 2024-03-29T04:10:02.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.079+0000 7f3a66ffd640 1 --2- 172.21.15.73:0/3272413041 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3a5406c560 0x7f3a5406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:02.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.079+0000 7f3a75893640 1 --2- 172.21.15.73:0/3272413041 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3a5406c560 0x7f3a5406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:02.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.079+0000 7f3a66ffd640 1 -- 172.21.15.73:0/3272413041 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f3a6008b760 con 0x7f3a5c004060 2024-03-29T04:10:02.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.079+0000 7f3a75893640 1 --2- 172.21.15.73:0/3272413041 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3a5406c560 0x7f3a5406ea20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c033000 tx=0x7f3a6c009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:02.062 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.083+0000 7f3a66ffd640 1 -- 172.21.15.73:0/3272413041 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f3a60022030 con 0x7f3a5c004060 2024-03-29T04:10:02.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.401+0000 7f3a782f8640 1 -- 172.21.15.73:0/3272413041 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3a700b4ba0 con 0x7f3a5c004060 2024-03-29T04:10:02.381 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.402+0000 7f3a66ffd640 1 -- 172.21.15.73:0/3272413041 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) ==== 104+0+11 (secure 0 0 0) 0x7f3a60059e10 con 0x7f3a5c004060 2024-03-29T04:10:02.381 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-03-29T04:10:02.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.403+0000 7f3a782f8640 1 -- 172.21.15.73:0/3272413041 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3a5406c560 msgr2=0x7f3a5406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:02.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.403+0000 7f3a782f8640 1 --2- 172.21.15.73:0/3272413041 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3a5406c560 0x7f3a5406ea20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c033000 tx=0x7f3a6c009030 comp rx=0 tx=0).stop 2024-03-29T04:10:02.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.404+0000 7f3a782f8640 1 -- 172.21.15.73:0/3272413041 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a5c004060 msgr2=0x7f3a700c8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:02.383 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.404+0000 7f3a782f8640 1 --2- 172.21.15.73:0/3272413041 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a5c004060 0x7f3a700c8ac0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f3a6000d800 tx=0x7f3a6000dcc0 comp rx=0 tx=0).stop 2024-03-29T04:10:02.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.404+0000 7f3a782f8640 1 -- 172.21.15.73:0/3272413041 shutdown_connections 2024-03-29T04:10:02.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.404+0000 7f3a782f8640 1 --2- 172.21.15.73:0/3272413041 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f3a700c7fb0 0x7f3a7006c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:02.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.404+0000 7f3a782f8640 1 --2- 172.21.15.73:0/3272413041 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f3a5406c560 0x7f3a5406ea20 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:02.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.404+0000 7f3a782f8640 1 --2- 172.21.15.73:0/3272413041 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3a700b0730 0x7f3a700b7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:02.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.404+0000 7f3a782f8640 1 --2- 172.21.15.73:0/3272413041 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3a5c004060 0x7f3a700c8ac0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:02.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.404+0000 7f3a782f8640 1 -- 172.21.15.73:0/3272413041 >> 172.21.15.73:0/3272413041 conn(0x7f3a700b3f40 msgr2=0x7f3a7006d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:02.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.404+0000 7f3a782f8640 1 -- 172.21.15.73:0/3272413041 shutdown_connections 2024-03-29T04:10:02.384 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.404+0000 7f3a782f8640 1 -- 172.21.15.73:0/3272413041 wait complete. 2024-03-29T04:10:02.394 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-29T04:10:02.499 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.520+0000 7fd2b1b15640 1 Processor -- start 2024-03-29T04:10:02.500 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.520+0000 7fd2b1b15640 1 -- start start 2024-03-29T04:10:02.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.521+0000 7fd2b1b15640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd2ac15e920 0x7fd2ac0d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:02.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.521+0000 7fd2b1b15640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd2ac0cfde0 0x7fd2ac0d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:02.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.521+0000 7fd2b1b15640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2ac0d3780 con 0x7fd2ac0d0f90 2024-03-29T04:10:02.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.521+0000 7fd2b1b15640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fd2ac15ed00 con 0x7fd2ac15e920 2024-03-29T04:10:02.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.521+0000 7fd2b1b15640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd2ac0d21e0 con 0x7fd2ac0cfde0 2024-03-29T04:10:02.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.521+0000 7fd2ab7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd2ac15e920 0x7fd2ac0d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:02.501 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.521+0000 7fd2abfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd2ac0d0f90 0x7fd2ac06c6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52534/0 (socket says 172.21.15.73:52534) 2024-03-29T04:10:02.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.521+0000 7fd2abfff640 1 -- 172.21.15.73:0/4014695378 learned_addr learned my addr 172.21.15.73:0/4014695378 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:10:02.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.521+0000 7fd2aa7fc640 1 -- 172.21.15.73:0/4014695378 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 760693287 0 0) 0x7fd2a4001490 con 0x7fd2ac0d0f90 2024-03-29T04:10:02.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.521+0000 7fd2aa7fc640 1 -- 172.21.15.73:0/4014695378 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd294003520 con 0x7fd2ac0d0f90 2024-03-29T04:10:02.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.521+0000 7fd2ab7fe640 1 -- 172.21.15.73:0/4014695378 >> v2:172.21.15.142:3300/0 conn(0x7fd2ac0cfde0 msgr2=0x7fd2ac0d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:02.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.521+0000 7fd2ab7fe640 1 --2- 172.21.15.73:0/4014695378 >> v2:172.21.15.142:3300/0 conn(0x7fd2ac0cfde0 0x7fd2ac0d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:02.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.521+0000 7fd2ab7fe640 1 -- 172.21.15.73:0/4014695378 >> v1:172.21.15.73:6789/0 conn(0x7fd2ac0d0f90 legacy=0x7fd2ac06c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:02.502 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.521+0000 7fd2ab7fe640 1 -- 172.21.15.73:0/4014695378 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2ac0d2480 con 0x7fd2ac15e920 2024-03-29T04:10:02.503 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.522+0000 7fd2ab7fe640 1 --2- 172.21.15.73:0/4014695378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2ac15e920 0x7fd2ac0d3240 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac08ccb0 tx=0x7fd29c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6299adfca4762ddf server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:02.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.522+0000 7fd2aa7fc640 1 -- 172.21.15.73:0/4014695378 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29c035020 con 0x7fd2ac15e920 2024-03-29T04:10:02.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.522+0000 7fd2aa7fc640 1 -- 172.21.15.73:0/4014695378 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd29c031830 con 0x7fd2ac15e920 2024-03-29T04:10:02.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.522+0000 7fd2aa7fc640 1 -- 172.21.15.73:0/4014695378 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29c031c00 con 0x7fd2ac15e920 2024-03-29T04:10:02.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.523+0000 7fd2b1b15640 1 -- 172.21.15.73:0/4014695378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2ac15e920 msgr2=0x7fd2ac0d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:02.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.523+0000 7fd2b1b15640 1 --2- 172.21.15.73:0/4014695378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2ac15e920 0x7fd2ac0d3240 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac08ccb0 tx=0x7fd29c02b8d0 comp rx=0 tx=0).stop 2024-03-29T04:10:02.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.523+0000 7fd2b1b15640 1 -- 172.21.15.73:0/4014695378 shutdown_connections 2024-03-29T04:10:02.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.523+0000 7fd2b1b15640 1 --2- 172.21.15.73:0/4014695378 >> v2:172.21.15.142:3300/0 conn(0x7fd2ac0cfde0 0x7fd2ac0d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:02.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.523+0000 7fd2b1b15640 1 --2- 172.21.15.73:0/4014695378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2ac15e920 0x7fd2ac0d3240 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:02.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.523+0000 7fd2b1b15640 1 -- 172.21.15.73:0/4014695378 >> 172.21.15.73:0/4014695378 conn(0x7fd2ac08bfc0 msgr2=0x7fd2ac0d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:02.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.523+0000 7fd2b1b15640 1 -- 172.21.15.73:0/4014695378 shutdown_connections 2024-03-29T04:10:02.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.523+0000 7fd2b1b15640 1 -- 172.21.15.73:0/4014695378 wait complete. 2024-03-29T04:10:02.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.524+0000 7fd2b1b15640 1 Processor -- start 2024-03-29T04:10:02.504 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.524+0000 7fd2b1b15640 1 -- start start 2024-03-29T04:10:02.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.525+0000 7fd2b1b15640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2ac0cfde0 0x7fd2ac1ea6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:02.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.525+0000 7fd2b1b15640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2ac0d0f90 0x7fd2ac0c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:02.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.525+0000 7fd2b1b15640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2ac15e920 0x7fd2ac154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:02.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.525+0000 7fd2b1b15640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ac0d2d20 con 0x7fd2ac15e920 2024-03-29T04:10:02.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.525+0000 7fd2b1b15640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ac0d2a40 con 0x7fd2ac0d0f90 2024-03-29T04:10:02.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.525+0000 7fd2b1b15640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd2ac0d4ef0 con 0x7fd2ac0cfde0 2024-03-29T04:10:02.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.525+0000 7fd2abfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2ac15e920 0x7fd2ac154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:02.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.525+0000 7fd2abfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2ac15e920 0x7fd2ac154430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51716/0 (socket says 172.21.15.73:51716) 2024-03-29T04:10:02.507 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.525+0000 7fd2abfff640 1 -- 172.21.15.73:0/2881460809 learned_addr learned my addr 172.21.15.73:0/2881460809 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:02.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.525+0000 7fd2abfff640 1 -- 172.21.15.73:0/2881460809 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2ac0cfde0 msgr2=0x7fd2ac1ea6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:02.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.525+0000 7fd2abfff640 1 --2- 172.21.15.73:0/2881460809 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2ac0cfde0 0x7fd2ac1ea6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:02.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.525+0000 7fd2abfff640 1 -- 172.21.15.73:0/2881460809 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2ac0d0f90 msgr2=0x7fd2ac0c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:02.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.525+0000 7fd2abfff640 1 --2- 172.21.15.73:0/2881460809 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2ac0d0f90 0x7fd2ac0c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:02.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.525+0000 7fd2abfff640 1 -- 172.21.15.73:0/2881460809 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2ac0c9b00 con 0x7fd2ac15e920 2024-03-29T04:10:02.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.525+0000 7fd2abfff640 1 --2- 172.21.15.73:0/2881460809 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2ac15e920 0x7fd2ac154430 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd2a400cb50 tx=0x7fd2a400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:02.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.525+0000 7fd293fff640 1 -- 172.21.15.73:0/2881460809 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4017070 con 0x7fd2ac15e920 2024-03-29T04:10:02.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.525+0000 7fd293fff640 1 -- 172.21.15.73:0/2881460809 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2a400ad40 con 0x7fd2ac15e920 2024-03-29T04:10:02.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.525+0000 7fd2b1b15640 1 -- 172.21.15.73:0/2881460809 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2ac0c9260 con 0x7fd2ac15e920 2024-03-29T04:10:02.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.525+0000 7fd293fff640 1 -- 172.21.15.73:0/2881460809 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4012620 con 0x7fd2ac15e920 2024-03-29T04:10:02.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.526+0000 7fd2b1b15640 1 -- 172.21.15.73:0/2881460809 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2ac0c9820 con 0x7fd2ac15e920 2024-03-29T04:10:02.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.527+0000 7fd2b1b15640 1 -- 172.21.15.73:0/2881460809 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2ac0688c0 con 0x7fd2ac15e920 2024-03-29T04:10:02.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.527+0000 7fd293fff640 1 -- 172.21.15.73:0/2881460809 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fd2a401a070 con 0x7fd2ac15e920 2024-03-29T04:10:02.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.527+0000 7fd293fff640 1 --2- 172.21.15.73:0/2881460809 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd29806c530 0x7fd29806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:02.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.527+0000 7fd293fff640 1 -- 172.21.15.73:0/2881460809 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fd2a408b580 con 0x7fd2ac15e920 2024-03-29T04:10:02.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.527+0000 7fd2ab7fe640 1 --2- 172.21.15.73:0/2881460809 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd29806c530 0x7fd29806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:02.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.528+0000 7fd2ab7fe640 1 --2- 172.21.15.73:0/2881460809 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd29806c530 0x7fd29806e9f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd29c036000 tx=0x7fd29c030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:02.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.532+0000 7fd293fff640 1 -- 172.21.15.73:0/2881460809 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fd2ac0688c0 con 0x7fd2ac15e920 2024-03-29T04:10:02.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.708+0000 7fd2b1b15640 1 -- 172.21.15.73:0/2881460809 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd2ac0a2560 con 0x7fd2ac15e920 2024-03-29T04:10:02.688 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.708+0000 7fd293fff640 1 -- 172.21.15.73:0/2881460809 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) ==== 100+0+11 (secure 0 0 0) 0x7fd2ac0d3780 con 0x7fd2ac15e920 2024-03-29T04:10:02.688 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-03-29T04:10:02.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.710+0000 7fd2b1b15640 1 -- 172.21.15.73:0/2881460809 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd29806c530 msgr2=0x7fd29806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:02.690 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.710+0000 7fd2b1b15640 1 --2- 172.21.15.73:0/2881460809 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd29806c530 0x7fd29806e9f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd29c036000 tx=0x7fd29c030000 comp rx=0 tx=0).stop 2024-03-29T04:10:02.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.710+0000 7fd2b1b15640 1 -- 172.21.15.73:0/2881460809 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2ac15e920 msgr2=0x7fd2ac154430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:02.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.710+0000 7fd2b1b15640 1 --2- 172.21.15.73:0/2881460809 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2ac15e920 0x7fd2ac154430 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd2a400cb50 tx=0x7fd2a400a430 comp rx=0 tx=0).stop 2024-03-29T04:10:02.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.710+0000 7fd2b1b15640 1 -- 172.21.15.73:0/2881460809 shutdown_connections 2024-03-29T04:10:02.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.710+0000 7fd2b1b15640 1 --2- 172.21.15.73:0/2881460809 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2ac15e920 0x7fd2ac154430 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:02.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.710+0000 7fd2b1b15640 1 --2- 172.21.15.73:0/2881460809 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd29806c530 0x7fd29806e9f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:02.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.710+0000 7fd2b1b15640 1 --2- 172.21.15.73:0/2881460809 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd2ac0d0f90 0x7fd2ac0c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:02.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.710+0000 7fd2b1b15640 1 --2- 172.21.15.73:0/2881460809 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd2ac0cfde0 0x7fd2ac1ea6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:02.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.710+0000 7fd2b1b15640 1 -- 172.21.15.73:0/2881460809 >> 172.21.15.73:0/2881460809 conn(0x7fd2ac08bfc0 msgr2=0x7fd2ac06dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:02.691 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.710+0000 7fd2b1b15640 1 -- 172.21.15.73:0/2881460809 shutdown_connections 2024-03-29T04:10:02.692 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.710+0000 7fd2b1b15640 1 -- 172.21.15.73:0/2881460809 wait complete. 2024-03-29T04:10:02.704 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-29T04:10:02.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.857+0000 7f488aa4a640 1 Processor -- start 2024-03-29T04:10:02.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.857+0000 7f488aa4a640 1 -- start start 2024-03-29T04:10:02.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.858+0000 7f488aa4a640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f48840d3310 0x7f48841695b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:02.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.858+0000 7f488aa4a640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48840cfb30 con 0x7f488415e930 2024-03-29T04:10:02.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.858+0000 7f488aa4a640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48840cfe10 con 0x7f48840b3c50 2024-03-29T04:10:02.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.858+0000 7f488aa4a640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f488406c780 con 0x7f48840d3310 2024-03-29T04:10:02.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.858+0000 7f4883fff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f488415e930 0x7f48840cf130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52546/0 (socket says 172.21.15.73:52546) 2024-03-29T04:10:02.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.858+0000 7f4883fff640 1 -- 172.21.15.73:0/2103587483 learned_addr learned my addr 172.21.15.73:0/2103587483 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:10:02.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.859+0000 7f4888fe7640 1 --2- 172.21.15.73:0/2103587483 >> v2:172.21.15.142:3300/0 conn(0x7f48840d3310 0x7f48841695b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:02.839 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.859+0000 7f4882ffd640 1 -- 172.21.15.73:0/2103587483 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 393132856 0 0) 0x7f48840cfb30 con 0x7f488415e930 2024-03-29T04:10:02.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.859+0000 7f4882ffd640 1 -- 172.21.15.73:0/2103587483 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f486c003520 con 0x7f488415e930 2024-03-29T04:10:02.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.859+0000 7f4882ffd640 1 -- 172.21.15.73:0/2103587483 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2008081550 0 0) 0x7f486c003520 con 0x7f488415e930 2024-03-29T04:10:02.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.859+0000 7f4888fe7640 1 -- 172.21.15.73:0/2103587483 >> v1:172.21.15.142:6789/0 conn(0x7f48840b3c50 legacy=0x7f48840d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:02.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.859+0000 7f4888fe7640 1 -- 172.21.15.73:0/2103587483 >> v1:172.21.15.73:6789/0 conn(0x7f488415e930 legacy=0x7f48840cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:02.840 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.859+0000 7f4888fe7640 1 -- 172.21.15.73:0/2103587483 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48840d00f0 con 0x7f48840d3310 2024-03-29T04:10:02.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.860+0000 7f4888fe7640 1 --2- 172.21.15.73:0/2103587483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48840d3310 0x7f48841695b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f487c009d90 tx=0x7f487c02bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b1863f25032590b server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:02.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.860+0000 7f4882ffd640 1 -- 172.21.15.73:0/2103587483 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487c039070 con 0x7f48840d3310 2024-03-29T04:10:02.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.860+0000 7f4882ffd640 1 -- 172.21.15.73:0/2103587483 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f487c02c8b0 con 0x7f48840d3310 2024-03-29T04:10:02.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.860+0000 7f4882ffd640 1 -- 172.21.15.73:0/2103587483 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4874001690 con 0x7f48840d3310 2024-03-29T04:10:02.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.861+0000 7f488aa4a640 1 -- 172.21.15.73:0/2103587483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48840d3310 msgr2=0x7f48841695b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:02.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.861+0000 7f488aa4a640 1 --2- 172.21.15.73:0/2103587483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48840d3310 0x7f48841695b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f487c009d90 tx=0x7f487c02bd80 comp rx=0 tx=0).stop 2024-03-29T04:10:02.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.861+0000 7f488aa4a640 1 -- 172.21.15.73:0/2103587483 shutdown_connections 2024-03-29T04:10:02.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.861+0000 7f488aa4a640 1 --2- 172.21.15.73:0/2103587483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f48840d3310 0x7f48841695b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:02.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.861+0000 7f488aa4a640 1 -- 172.21.15.73:0/2103587483 >> 172.21.15.73:0/2103587483 conn(0x7f488408bfc0 msgr2=0x7f48840d4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:02.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.861+0000 7f488aa4a640 1 -- 172.21.15.73:0/2103587483 shutdown_connections 2024-03-29T04:10:02.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.861+0000 7f488aa4a640 1 -- 172.21.15.73:0/2103587483 wait complete. 2024-03-29T04:10:02.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.862+0000 7f488aa4a640 1 Processor -- start 2024-03-29T04:10:02.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.862+0000 7f488aa4a640 1 -- start start 2024-03-29T04:10:02.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.863+0000 7f488aa4a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48840b3c50 0x7f4884154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:02.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.863+0000 7f488aa4a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48840d3310 0x7f4884160560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:02.846 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.863+0000 7f488aa4a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f488415e930 0x7f4884144870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:02.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.863+0000 7f488aa4a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f488415ed10 con 0x7f48840b3c50 2024-03-29T04:10:02.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.863+0000 7f488aa4a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f48840cf840 con 0x7f488415e930 2024-03-29T04:10:02.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.863+0000 7f488aa4a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f488415ee90 con 0x7f48840d3310 2024-03-29T04:10:02.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.863+0000 7f4883fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48840b3c50 0x7f4884154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:02.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.863+0000 7f4883fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48840b3c50 0x7f4884154b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51720/0 (socket says 172.21.15.73:51720) 2024-03-29T04:10:02.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.863+0000 7f4883fff640 1 -- 172.21.15.73:0/226908739 learned_addr learned my addr 172.21.15.73:0/226908739 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:02.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.863+0000 7f48837fe640 1 --2- 172.21.15.73:0/226908739 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48840d3310 0x7f4884160560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:02.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.863+0000 7f4888fe7640 1 --2- 172.21.15.73:0/226908739 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f488415e930 0x7f4884144870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:02.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.863+0000 7f4883fff640 1 -- 172.21.15.73:0/226908739 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48840d3310 msgr2=0x7f4884160560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:02.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.863+0000 7f4883fff640 1 --2- 172.21.15.73:0/226908739 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48840d3310 0x7f4884160560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:02.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.863+0000 7f4883fff640 1 -- 172.21.15.73:0/226908739 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f488415e930 msgr2=0x7f4884144870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:02.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.863+0000 7f4883fff640 1 --2- 172.21.15.73:0/226908739 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f488415e930 0x7f4884144870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:02.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.863+0000 7f4883fff640 1 -- 172.21.15.73:0/226908739 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f488415ab00 con 0x7f48840b3c50 2024-03-29T04:10:02.847 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.864+0000 7f4883fff640 1 --2- 172.21.15.73:0/226908739 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48840b3c50 0x7f4884154b70 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f487400c530 tx=0x7f487400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:02.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.864+0000 7f4880ff9640 1 -- 172.21.15.73:0/226908739 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4874018070 con 0x7f48840b3c50 2024-03-29T04:10:02.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.864+0000 7f4880ff9640 1 -- 172.21.15.73:0/226908739 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48740074e0 con 0x7f48840b3c50 2024-03-29T04:10:02.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.864+0000 7f4880ff9640 1 -- 172.21.15.73:0/226908739 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4874004a20 con 0x7f48840b3c50 2024-03-29T04:10:02.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.864+0000 7f488aa4a640 1 -- 172.21.15.73:0/226908739 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4884157b50 con 0x7f48840b3c50 2024-03-29T04:10:02.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.864+0000 7f488aa4a640 1 -- 172.21.15.73:0/226908739 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4884144db0 con 0x7f48840b3c50 2024-03-29T04:10:02.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.865+0000 7f488aa4a640 1 -- 172.21.15.73:0/226908739 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4884068640 con 0x7f48840b3c50 2024-03-29T04:10:02.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.865+0000 7f4880ff9640 1 -- 172.21.15.73:0/226908739 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f487401b070 con 0x7f48840b3c50 2024-03-29T04:10:02.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.866+0000 7f4880ff9640 1 --2- 172.21.15.73:0/226908739 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f487006c530 0x7f487006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:02.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.866+0000 7f4880ff9640 1 -- 172.21.15.73:0/226908739 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f487408aa50 con 0x7f48840b3c50 2024-03-29T04:10:02.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.866+0000 7f48837fe640 1 --2- 172.21.15.73:0/226908739 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f487006c530 0x7f487006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:02.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.866+0000 7f48837fe640 1 --2- 172.21.15.73:0/226908739 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f487006c530 0x7f487006e9f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4884154590 tx=0x7f4878009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:02.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:02.870+0000 7f4880ff9640 1 -- 172.21.15.73:0/226908739 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f4874059100 con 0x7f48840b3c50 2024-03-29T04:10:03.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.082+0000 7f488aa4a640 1 -- 172.21.15.73:0/226908739 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4884157680 con 0x7f48840b3c50 2024-03-29T04:10:03.061 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.082+0000 7f4880ff9640 1 -- 172.21.15.73:0/226908739 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5181 (secure 0 0 0) 0x7f4874058a00 con 0x7f48840b3c50 2024-03-29T04:10:03.062 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:10:03.062 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4739,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1125143848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1125143848},{"type":"v1","addr":"172.21.15.73:6837","nonce":1125143848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4742,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2988261972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2988261972},{"type":"v1","addr":"172.21.15.142:6835","nonce":2988261972}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5029,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/510984531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":510984531},{"type":"v1","addr":"172.21.15.142:6834","nonce":510984531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-29T04:08:59.079178+0000","modified":"2024-03-29T04:09:19.890401+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5055},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5055":{"gid":5055,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6836/936189393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":936189393},{"type":"v1","addr":"172.21.15.73:6836","nonce":936189393}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5055,"qdb_cluster":[5055]},"id":2}]} 2024-03-29T04:10:03.062 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 15 2024-03-29T04:10:03.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.084+0000 7f488aa4a640 1 -- 172.21.15.73:0/226908739 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f487006c530 msgr2=0x7f487006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:03.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.084+0000 7f488aa4a640 1 --2- 172.21.15.73:0/226908739 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f487006c530 0x7f487006e9f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4884154590 tx=0x7f4878009040 comp rx=0 tx=0).stop 2024-03-29T04:10:03.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.084+0000 7f488aa4a640 1 -- 172.21.15.73:0/226908739 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48840b3c50 msgr2=0x7f4884154b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:03.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.084+0000 7f488aa4a640 1 --2- 172.21.15.73:0/226908739 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48840b3c50 0x7f4884154b70 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f487400c530 tx=0x7f487400c9f0 comp rx=0 tx=0).stop 2024-03-29T04:10:03.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.084+0000 7f488aa4a640 1 -- 172.21.15.73:0/226908739 shutdown_connections 2024-03-29T04:10:03.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.084+0000 7f488aa4a640 1 --2- 172.21.15.73:0/226908739 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f487006c530 0x7f487006e9f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:03.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.084+0000 7f488aa4a640 1 --2- 172.21.15.73:0/226908739 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f488415e930 0x7f4884144870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:03.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.084+0000 7f488aa4a640 1 --2- 172.21.15.73:0/226908739 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f48840d3310 0x7f4884160560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:03.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.084+0000 7f488aa4a640 1 --2- 172.21.15.73:0/226908739 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48840b3c50 0x7f4884154b70 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:03.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.084+0000 7f488aa4a640 1 -- 172.21.15.73:0/226908739 >> 172.21.15.73:0/226908739 conn(0x7f488408bfc0 msgr2=0x7f48840d2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:03.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.084+0000 7f488aa4a640 1 -- 172.21.15.73:0/226908739 shutdown_connections 2024-03-29T04:10:03.064 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.084+0000 7f488aa4a640 1 -- 172.21.15.73:0/226908739 wait complete. 2024-03-29T04:10:03.074 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-29T04:10:03.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.198+0000 7fc9fd932640 1 Processor -- start 2024-03-29T04:10:03.177 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.198+0000 7fc9fd932640 1 -- start start 2024-03-29T04:10:03.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.198+0000 7fc9fd932640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9f815e930 0x7fc9f80cf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:03.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.198+0000 7fc9fd932640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc9f80d3310 0x7fc9f806cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:03.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.199+0000 7fc9fd932640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9f80cfb30 con 0x7fc9f80cf670 2024-03-29T04:10:03.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.199+0000 7fc9fd932640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fc9f806c780 con 0x7fc9f80d3310 2024-03-29T04:10:03.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.199+0000 7fc9fd932640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc9f80cfe10 con 0x7fc9f815e930 2024-03-29T04:10:03.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.199+0000 7fc9f77fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc9f80d3310 0x7fc9f806cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:03.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.199+0000 7fc9f77fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc9f80d3310 0x7fc9f806cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51724/0 (socket says 172.21.15.73:51724) 2024-03-29T04:10:03.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.199+0000 7fc9f77fe640 1 -- 172.21.15.73:0/4246496207 learned_addr learned my addr 172.21.15.73:0/4246496207 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:03.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.199+0000 7fc9effff640 1 --1- 172.21.15.73:0/4246496207 >> v1:172.21.15.73:6789/0 conn(0x7fc9f80cf670 0x7fc9f80d2c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52550/0 (socket says 172.21.15.73:52550) 2024-03-29T04:10:03.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.199+0000 7fc9f6ffd640 1 --2- 172.21.15.73:0/4246496207 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9f815e930 0x7fc9f80cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:03.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.199+0000 7fc9f77fe640 1 -- 172.21.15.73:0/4246496207 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9f815e930 msgr2=0x7fc9f80cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:03.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.199+0000 7fc9f77fe640 1 --2- 172.21.15.73:0/4246496207 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9f815e930 0x7fc9f80cf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:03.179 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.199+0000 7fc9f77fe640 1 -- 172.21.15.73:0/4246496207 >> v1:172.21.15.73:6789/0 conn(0x7fc9f80cf670 legacy=0x7fc9f80d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:03.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.199+0000 7fc9f77fe640 1 -- 172.21.15.73:0/4246496207 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9f80d00f0 con 0x7fc9f80d3310 2024-03-29T04:10:03.180 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.200+0000 7fc9f77fe640 1 --2- 172.21.15.73:0/4246496207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9f80d3310 0x7fc9f806cc10 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0009e50 tx=0x7fc9f002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c22920a72bb4db3 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:03.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.200+0000 7fc9f67fc640 1 -- 172.21.15.73:0/4246496207 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f002ca70 con 0x7fc9f80d3310 2024-03-29T04:10:03.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.200+0000 7fc9f67fc640 1 -- 172.21.15.73:0/4246496207 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9f002cc10 con 0x7fc9f80d3310 2024-03-29T04:10:03.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.200+0000 7fc9f67fc640 1 -- 172.21.15.73:0/4246496207 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f00343f0 con 0x7fc9f80d3310 2024-03-29T04:10:03.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.200+0000 7fc9fd932640 1 -- 172.21.15.73:0/4246496207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9f80d3310 msgr2=0x7fc9f806cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:03.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.200+0000 7fc9fd932640 1 --2- 172.21.15.73:0/4246496207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9f80d3310 0x7fc9f806cc10 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0009e50 tx=0x7fc9f002bed0 comp rx=0 tx=0).stop 2024-03-29T04:10:03.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.200+0000 7fc9fd932640 1 -- 172.21.15.73:0/4246496207 shutdown_connections 2024-03-29T04:10:03.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.200+0000 7fc9fd932640 1 --2- 172.21.15.73:0/4246496207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9f80d3310 0x7fc9f806cc10 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:03.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.200+0000 7fc9fd932640 1 --2- 172.21.15.73:0/4246496207 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9f815e930 0x7fc9f80cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:03.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.200+0000 7fc9fd932640 1 -- 172.21.15.73:0/4246496207 >> 172.21.15.73:0/4246496207 conn(0x7fc9f808bfc0 msgr2=0x7fc9f80d4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:03.181 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.200+0000 7fc9fd932640 1 -- 172.21.15.73:0/4246496207 shutdown_connections 2024-03-29T04:10:03.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.201+0000 7fc9fd932640 1 -- 172.21.15.73:0/4246496207 wait complete. 2024-03-29T04:10:03.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.202+0000 7fc9fd932640 1 Processor -- start 2024-03-29T04:10:03.182 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.202+0000 7fc9fd932640 1 -- start start 2024-03-29T04:10:03.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.202+0000 7fc9fd932640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9f80cf670 0x7fc9f8157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:03.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.202+0000 7fc9fd932640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9f80d3310 0x7fc9f80cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:03.184 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.202+0000 7fc9fd932640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9f815e930 0x7fc9f81f46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:03.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.202+0000 7fc9fd932640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f815ee90 con 0x7fc9f80d3310 2024-03-29T04:10:03.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.202+0000 7fc9fd932640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f815ed10 con 0x7fc9f80cf670 2024-03-29T04:10:03.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.202+0000 7fc9fd932640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc9f80b3c50 con 0x7fc9f815e930 2024-03-29T04:10:03.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.202+0000 7fc9effff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9f80d3310 0x7fc9f80cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:03.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.202+0000 7fc9effff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9f80d3310 0x7fc9f80cd5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51736/0 (socket says 172.21.15.73:51736) 2024-03-29T04:10:03.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.202+0000 7fc9effff640 1 -- 172.21.15.73:0/812957800 learned_addr learned my addr 172.21.15.73:0/812957800 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:03.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.203+0000 7fc9f77fe640 1 --2- 172.21.15.73:0/812957800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9f815e930 0x7fc9f81f46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:03.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.203+0000 7fc9f6ffd640 1 --2- 172.21.15.73:0/812957800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9f80cf670 0x7fc9f8157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:03.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.203+0000 7fc9effff640 1 -- 172.21.15.73:0/812957800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9f815e930 msgr2=0x7fc9f81f46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:03.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.203+0000 7fc9effff640 1 --2- 172.21.15.73:0/812957800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9f815e930 0x7fc9f81f46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:03.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.203+0000 7fc9effff640 1 -- 172.21.15.73:0/812957800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9f80cf670 msgr2=0x7fc9f8157680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:03.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.203+0000 7fc9effff640 1 --2- 172.21.15.73:0/812957800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9f80cf670 0x7fc9f8157680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:03.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.203+0000 7fc9effff640 1 -- 172.21.15.73:0/812957800 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9f8159e40 con 0x7fc9f80d3310 2024-03-29T04:10:03.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.203+0000 7fc9f77fe640 1 --2- 172.21.15.73:0/812957800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9f815e930 0x7fc9f81f46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:10:03.185 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.203+0000 7fc9effff640 1 --2- 172.21.15.73:0/812957800 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9f80d3310 0x7fc9f80cd5d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc9e000c400 tx=0x7fc9e000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:03.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.203+0000 7fc9f4ff9640 1 -- 172.21.15.73:0/812957800 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e00074e0 con 0x7fc9f80d3310 2024-03-29T04:10:03.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.203+0000 7fc9f4ff9640 1 -- 172.21.15.73:0/812957800 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9e0007680 con 0x7fc9f80d3310 2024-03-29T04:10:03.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.203+0000 7fc9f4ff9640 1 -- 172.21.15.73:0/812957800 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e0004a00 con 0x7fc9f80d3310 2024-03-29T04:10:03.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.203+0000 7fc9fd932640 1 -- 172.21.15.73:0/812957800 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9f815a120 con 0x7fc9f80d3310 2024-03-29T04:10:03.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.203+0000 7fc9fd932640 1 -- 172.21.15.73:0/812957800 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9f81585d0 con 0x7fc9f80d3310 2024-03-29T04:10:03.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.204+0000 7fc9fd932640 1 -- 172.21.15.73:0/812957800 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9f8068640 con 0x7fc9f80d3310 2024-03-29T04:10:03.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.205+0000 7fc9f4ff9640 1 -- 172.21.15.73:0/812957800 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc9e001a020 con 0x7fc9f80d3310 2024-03-29T04:10:03.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.205+0000 7fc9f4ff9640 1 --2- 172.21.15.73:0/812957800 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fc9d806c530 0x7fc9d806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:03.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.205+0000 7fc9f4ff9640 1 -- 172.21.15.73:0/812957800 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fc9e008ae80 con 0x7fc9f80d3310 2024-03-29T04:10:03.186 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.205+0000 7fc9f6ffd640 1 --2- 172.21.15.73:0/812957800 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fc9d806c530 0x7fc9d806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:03.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.206+0000 7fc9f6ffd640 1 --2- 172.21.15.73:0/812957800 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fc9d806c530 0x7fc9d806e9f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8006fd0 tx=0x7fc9e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:03.189 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.210+0000 7fc9f4ff9640 1 -- 172.21.15.73:0/812957800 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fc9e0059530 con 0x7fc9f80d3310 2024-03-29T04:10:03.365 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.386+0000 7fc9fd932640 1 -- 172.21.15.73:0/812957800 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc9f80b4200 con 0x7fc9f80d3310 2024-03-29T04:10:03.366 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.387+0000 7fc9f4ff9640 1 -- 172.21.15.73:0/812957800 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16669 (secure 0 0 0) 0x7fc9e0058e30 con 0x7fc9f80d3310 2024-03-29T04:10:03.366 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:10:03.367 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":32,"fsid":"6bff1617-b138-4517-acca-3ecaae3f2bb3","created":"2024-03-29T04:07:47.346864+0000","modified":"2024-03-29T04:09:00.732697+0000","last_up_change":"2024-03-29T04:07:58.507139+0000","last_in_change":"2024-03-29T04:07:49.637816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-29T04:07:59.537301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-29T04:08:57.521498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-29T04:08:58.027631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"925d7de1-14ab-48c0-aebd-7bded108f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6820","nonce":2387335359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6824","nonce":2387335359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6831","nonce":2387335359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6828","nonce":2387335359}]},"public_addr":"172.21.15.73:6820/2387335359","cluster_addr":"172.21.15.73:6824/2387335359","heartbeat_back_addr":"172.21.15.73:6831/2387335359","heartbeat_front_addr":"172.21.15.73:6828/2387335359","state":["exists","up"]},{"osd":1,"uuid":"6b182102-882a-4e0c-99db-0afae5cfb38b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6801","nonce":2431315515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6803","nonce":2431315515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6807","nonce":2431315515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6805","nonce":2431315515}]},"public_addr":"172.21.15.73:6801/2431315515","cluster_addr":"172.21.15.73:6803/2431315515","heartbeat_back_addr":"172.21.15.73:6807/2431315515","heartbeat_front_addr":"172.21.15.73:6805/2431315515","state":["exists","up"]},{"osd":2,"uuid":"8040902e-b0b8-4a21-bf64-ce1c222115ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6809","nonce":407236597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6811","nonce":407236597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6815","nonce":407236597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6813","nonce":407236597}]},"public_addr":"172.21.15.73:6809/407236597","cluster_addr":"172.21.15.73:6811/407236597","heartbeat_back_addr":"172.21.15.73:6815/407236597","heartbeat_front_addr":"172.21.15.73:6813/407236597","state":["exists","up"]},{"osd":3,"uuid":"1bab19ee-3775-4ce1-a4ce-cf7cda3bbbf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6817","nonce":4291100709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6821","nonce":4291100709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6829","nonce":4291100709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6825","nonce":4291100709}]},"public_addr":"172.21.15.73:6817/4291100709","cluster_addr":"172.21.15.73:6821/4291100709","heartbeat_back_addr":"172.21.15.73:6829/4291100709","heartbeat_front_addr":"172.21.15.73:6825/4291100709","state":["exists","up"]},{"osd":4,"uuid":"b0c74337-8fe4-47dc-b3da-2d07591b1f6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6817","nonce":3703256194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6819","nonce":3703256194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6823","nonce":3703256194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6821","nonce":3703256194}]},"public_addr":"172.21.15.142:6817/3703256194","cluster_addr":"172.21.15.142:6819/3703256194","heartbeat_back_addr":"172.21.15.142:6823/3703256194","heartbeat_front_addr":"172.21.15.142:6821/3703256194","state":["exists","up"]},{"osd":5,"uuid":"9ce36410-a29a-42c6-99f4-f95d4afdd7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6825","nonce":4271575803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6827","nonce":4271575803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6831","nonce":4271575803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6829","nonce":4271575803}]},"public_addr":"172.21.15.142:6825/4271575803","cluster_addr":"172.21.15.142:6827/4271575803","heartbeat_back_addr":"172.21.15.142:6831/4271575803","heartbeat_front_addr":"172.21.15.142:6829/4271575803","state":["exists","up"]},{"osd":6,"uuid":"aec4264a-64ac-428e-a860-d2920a304019","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6801","nonce":1772722570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6803","nonce":1772722570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6807","nonce":1772722570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6805","nonce":1772722570}]},"public_addr":"172.21.15.142:6801/1772722570","cluster_addr":"172.21.15.142:6803/1772722570","heartbeat_back_addr":"172.21.15.142:6807/1772722570","heartbeat_front_addr":"172.21.15.142:6805/1772722570","state":["exists","up"]},{"osd":7,"uuid":"fe599052-8e5a-4c7a-91e7-52d1bae24a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6809","nonce":3910589675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6811","nonce":3910589675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6815","nonce":3910589675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6813","nonce":3910589675}]},"public_addr":"172.21.15.142:6809/3910589675","cluster_addr":"172.21.15.142:6811/3910589675","heartbeat_back_addr":"172.21.15.142:6815/3910589675","heartbeat_front_addr":"172.21.15.142:6813/3910589675","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.835096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.587210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.786547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.778004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.843740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.791160+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.837992+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.718722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:10:03.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.389+0000 7fc9fd932640 1 -- 172.21.15.73:0/812957800 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fc9d806c530 msgr2=0x7fc9d806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:03.368 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.389+0000 7fc9fd932640 1 --2- 172.21.15.73:0/812957800 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fc9d806c530 0x7fc9d806e9f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8006fd0 tx=0x7fc9e8008040 comp rx=0 tx=0).stop 2024-03-29T04:10:03.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.389+0000 7fc9fd932640 1 -- 172.21.15.73:0/812957800 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9f80d3310 msgr2=0x7fc9f80cd5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:03.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.389+0000 7fc9fd932640 1 --2- 172.21.15.73:0/812957800 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9f80d3310 0x7fc9f80cd5d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc9e000c400 tx=0x7fc9e000c8c0 comp rx=0 tx=0).stop 2024-03-29T04:10:03.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.389+0000 7fc9fd932640 1 -- 172.21.15.73:0/812957800 shutdown_connections 2024-03-29T04:10:03.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.389+0000 7fc9fd932640 1 --2- 172.21.15.73:0/812957800 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9f815e930 0x7fc9f81f46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:03.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.389+0000 7fc9fd932640 1 --2- 172.21.15.73:0/812957800 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9f80d3310 0x7fc9f80cd5d0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:03.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.389+0000 7fc9fd932640 1 --2- 172.21.15.73:0/812957800 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fc9d806c530 0x7fc9d806e9f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:03.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.389+0000 7fc9fd932640 1 --2- 172.21.15.73:0/812957800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9f80cf670 0x7fc9f8157680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:03.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.389+0000 7fc9fd932640 1 -- 172.21.15.73:0/812957800 >> 172.21.15.73:0/812957800 conn(0x7fc9f808bfc0 msgr2=0x7fc9f80b2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:03.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.389+0000 7fc9fd932640 1 -- 172.21.15.73:0/812957800 shutdown_connections 2024-03-29T04:10:03.369 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.389+0000 7fc9fd932640 1 -- 172.21.15.73:0/812957800 wait complete. 2024-03-29T04:10:03.379 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-29T04:10:03.379 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-29T04:10:03.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.501+0000 7fc9c3b59640 1 Processor -- start 2024-03-29T04:10:03.481 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.501+0000 7fc9c3b59640 1 -- start start 2024-03-29T04:10:03.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.502+0000 7fc9c3b59640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9bc15e860 0x7fc9bc0d2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:03.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.502+0000 7fc9c3b59640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc9bc0d10d0 0x7fc9bc0705d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:03.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.502+0000 7fc9c3b59640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc9bc070b10 0x7fc9bc0cca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:03.482 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.502+0000 7fc9c3b59640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fc9bc070140 con 0x7fc9bc070b10 2024-03-29T04:10:03.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.502+0000 7fc9c3b59640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fc9bc15ec40 con 0x7fc9bc0d10d0 2024-03-29T04:10:03.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.502+0000 7fc9c3b59640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc9bc0d15d0 con 0x7fc9bc15e860 2024-03-29T04:10:03.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.502+0000 7fc9c20f6640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc9bc070b10 0x7fc9bc0cca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:03.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.502+0000 7fc9c20f6640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc9bc070b10 0x7fc9bc0cca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51750/0 (socket says 172.21.15.73:51750) 2024-03-29T04:10:03.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.502+0000 7fc9c20f6640 1 -- 172.21.15.73:0/4265535629 learned_addr learned my addr 172.21.15.73:0/4265535629 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:03.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.502+0000 7fc9c18f5640 1 --2- 172.21.15.73:0/4265535629 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9bc15e860 0x7fc9bc0d2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:03.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.503+0000 7fc9c10f4640 1 --2- 172.21.15.73:0/4265535629 >> v2:172.21.15.142:3300/0 conn(0x7fc9bc0d10d0 0x7fc9bc0705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:03.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.503+0000 7fc9c20f6640 1 -- 172.21.15.73:0/4265535629 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9bc15e860 msgr2=0x7fc9bc0d2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:03.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.503+0000 7fc9c20f6640 1 --2- 172.21.15.73:0/4265535629 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9bc15e860 0x7fc9bc0d2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:03.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.503+0000 7fc9c20f6640 1 -- 172.21.15.73:0/4265535629 >> v2:172.21.15.142:3300/0 conn(0x7fc9bc0d10d0 msgr2=0x7fc9bc0705d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:03.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.503+0000 7fc9c20f6640 1 --2- 172.21.15.73:0/4265535629 >> v2:172.21.15.142:3300/0 conn(0x7fc9bc0d10d0 0x7fc9bc0705d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:03.483 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.503+0000 7fc9c20f6640 1 -- 172.21.15.73:0/4265535629 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9bc0d18b0 con 0x7fc9bc070b10 2024-03-29T04:10:03.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.503+0000 7fc9c20f6640 1 --2- 172.21.15.73:0/4265535629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9bc070b10 0x7fc9bc0cca80 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc073180 tx=0x7fc9b402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1481c54fd57b4fd0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:03.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.504+0000 7fc9c08f3640 1 -- 172.21.15.73:0/4265535629 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b402ca70 con 0x7fc9bc070b10 2024-03-29T04:10:03.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.504+0000 7fc9c08f3640 1 -- 172.21.15.73:0/4265535629 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9b402cc10 con 0x7fc9bc070b10 2024-03-29T04:10:03.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.504+0000 7fc9c08f3640 1 -- 172.21.15.73:0/4265535629 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b40343f0 con 0x7fc9bc070b10 2024-03-29T04:10:03.487 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.504+0000 7fc9c3b59640 1 -- 172.21.15.73:0/4265535629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9bc070b10 msgr2=0x7fc9bc0cca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:03.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.504+0000 7fc9c3b59640 1 --2- 172.21.15.73:0/4265535629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9bc070b10 0x7fc9bc0cca80 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc073180 tx=0x7fc9b402bed0 comp rx=0 tx=0).stop 2024-03-29T04:10:03.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.504+0000 7fc9c3b59640 1 -- 172.21.15.73:0/4265535629 shutdown_connections 2024-03-29T04:10:03.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.504+0000 7fc9c3b59640 1 --2- 172.21.15.73:0/4265535629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9bc070b10 0x7fc9bc0cca80 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:03.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.504+0000 7fc9c3b59640 1 --2- 172.21.15.73:0/4265535629 >> v2:172.21.15.142:3300/0 conn(0x7fc9bc0d10d0 0x7fc9bc0705d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:03.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.504+0000 7fc9c3b59640 1 --2- 172.21.15.73:0/4265535629 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9bc15e860 0x7fc9bc0d2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:03.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.504+0000 7fc9c3b59640 1 -- 172.21.15.73:0/4265535629 >> 172.21.15.73:0/4265535629 conn(0x7fc9bc0d2430 msgr2=0x7fc9bc0d2840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:03.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.504+0000 7fc9c3b59640 1 -- 172.21.15.73:0/4265535629 shutdown_connections 2024-03-29T04:10:03.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.504+0000 7fc9c3b59640 1 -- 172.21.15.73:0/4265535629 wait complete. 2024-03-29T04:10:03.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.505+0000 7fc9c3b59640 1 Processor -- start 2024-03-29T04:10:03.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.505+0000 7fc9c3b59640 1 -- start start 2024-03-29T04:10:03.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.506+0000 7fc9c3b59640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9bc070b10 0x7fc9bc0c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:03.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.506+0000 7fc9c3b59640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9bc0d10d0 0x7fc9bc149920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:03.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.506+0000 7fc9c3b59640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9bc15e860 0x7fc9bc1e8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:03.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.506+0000 7fc9c3b59640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc9bc163090 con 0x7fc9bc070b10 2024-03-29T04:10:03.488 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.506+0000 7fc9c3b59640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc9bc06fdd0 con 0x7fc9bc0d10d0 2024-03-29T04:10:03.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.506+0000 7fc9c3b59640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc9bc0ccfc0 con 0x7fc9bc15e860 2024-03-29T04:10:03.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.506+0000 7fc9c18f5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9bc070b10 0x7fc9bc0c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:03.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.506+0000 7fc9c18f5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9bc070b10 0x7fc9bc0c9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51762/0 (socket says 172.21.15.73:51762) 2024-03-29T04:10:03.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.506+0000 7fc9c18f5640 1 -- 172.21.15.73:0/2041953908 learned_addr learned my addr 172.21.15.73:0/2041953908 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:03.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.507+0000 7fc9c18f5640 1 -- 172.21.15.73:0/2041953908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9bc15e860 msgr2=0x7fc9bc1e8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:03.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.507+0000 7fc9c18f5640 1 --2- 172.21.15.73:0/2041953908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9bc15e860 0x7fc9bc1e8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:03.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.507+0000 7fc9c18f5640 1 -- 172.21.15.73:0/2041953908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9bc0d10d0 msgr2=0x7fc9bc149920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:03.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.507+0000 7fc9c18f5640 1 --2- 172.21.15.73:0/2041953908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9bc0d10d0 0x7fc9bc149920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:03.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.507+0000 7fc9c18f5640 1 -- 172.21.15.73:0/2041953908 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9bc0ca0d0 con 0x7fc9bc070b10 2024-03-29T04:10:03.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.507+0000 7fc9c18f5640 1 --2- 172.21.15.73:0/2041953908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9bc070b10 0x7fc9bc0c9b90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac00e8a0 tx=0x7fc9ac00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:03.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.507+0000 7fc9b27fc640 1 -- 172.21.15.73:0/2041953908 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac017070 con 0x7fc9bc070b10 2024-03-29T04:10:03.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.507+0000 7fc9b27fc640 1 -- 172.21.15.73:0/2041953908 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9ac00c940 con 0x7fc9bc070b10 2024-03-29T04:10:03.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.507+0000 7fc9c3b59640 1 -- 172.21.15.73:0/2041953908 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9bc14a4a0 con 0x7fc9bc070b10 2024-03-29T04:10:03.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.507+0000 7fc9b27fc640 1 -- 172.21.15.73:0/2041953908 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac00cd30 con 0x7fc9bc070b10 2024-03-29T04:10:03.489 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.507+0000 7fc9c3b59640 1 -- 172.21.15.73:0/2041953908 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9bc14aa60 con 0x7fc9bc070b10 2024-03-29T04:10:03.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.508+0000 7fc9c3b59640 1 -- 172.21.15.73:0/2041953908 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9bc068640 con 0x7fc9bc070b10 2024-03-29T04:10:03.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.509+0000 7fc9b27fc640 1 -- 172.21.15.73:0/2041953908 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc9ac01a070 con 0x7fc9bc070b10 2024-03-29T04:10:03.490 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.509+0000 7fc9b27fc640 1 --2- 172.21.15.73:0/2041953908 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fc9a006c530 0x7fc9a006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:03.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.509+0000 7fc9b27fc640 1 -- 172.21.15.73:0/2041953908 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fc9ac08bc60 con 0x7fc9bc070b10 2024-03-29T04:10:03.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.509+0000 7fc9c10f4640 1 --2- 172.21.15.73:0/2041953908 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fc9a006c530 0x7fc9a006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:03.491 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.509+0000 7fc9c10f4640 1 --2- 172.21.15.73:0/2041953908 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fc9a006c530 0x7fc9a006e9f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc0cdb60 tx=0x7fc9b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:03.492 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.513+0000 7fc9b27fc640 1 -- 172.21.15.73:0/2041953908 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fc9ac05a360 con 0x7fc9bc070b10 2024-03-29T04:10:03.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.726+0000 7fc9c3b59640 1 -- 172.21.15.73:0/2041953908 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc9bc0b83b0 con 0x7fc9bc070b10 2024-03-29T04:10:03.706 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.727+0000 7fc9b27fc640 1 -- 172.21.15.73:0/2041953908 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5181 (secure 0 0 0) 0x7fc9ac059c60 con 0x7fc9bc070b10 2024-03-29T04:10:03.707 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:10:03.707 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4739,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1125143848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1125143848},{"type":"v1","addr":"172.21.15.73:6837","nonce":1125143848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4742,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2988261972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2988261972},{"type":"v1","addr":"172.21.15.142:6835","nonce":2988261972}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5029,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/510984531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":510984531},{"type":"v1","addr":"172.21.15.142:6834","nonce":510984531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-29T04:08:59.079178+0000","modified":"2024-03-29T04:09:19.890401+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5055},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5055":{"gid":5055,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6836/936189393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":936189393},{"type":"v1","addr":"172.21.15.73:6836","nonce":936189393}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5055,"qdb_cluster":[5055]},"id":2}]} 2024-03-29T04:10:03.707 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 15 2024-03-29T04:10:03.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.729+0000 7fc9c3b59640 1 -- 172.21.15.73:0/2041953908 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fc9a006c530 msgr2=0x7fc9a006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:03.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.729+0000 7fc9c3b59640 1 --2- 172.21.15.73:0/2041953908 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fc9a006c530 0x7fc9a006e9f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc0cdb60 tx=0x7fc9b8008040 comp rx=0 tx=0).stop 2024-03-29T04:10:03.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.729+0000 7fc9c3b59640 1 -- 172.21.15.73:0/2041953908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9bc070b10 msgr2=0x7fc9bc0c9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:03.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.729+0000 7fc9c3b59640 1 --2- 172.21.15.73:0/2041953908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9bc070b10 0x7fc9bc0c9b90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac00e8a0 tx=0x7fc9ac00ed60 comp rx=0 tx=0).stop 2024-03-29T04:10:03.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.729+0000 7fc9c3b59640 1 -- 172.21.15.73:0/2041953908 shutdown_connections 2024-03-29T04:10:03.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.729+0000 7fc9c3b59640 1 --2- 172.21.15.73:0/2041953908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc9bc15e860 0x7fc9bc1e8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:03.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.729+0000 7fc9c3b59640 1 --2- 172.21.15.73:0/2041953908 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fc9a006c530 0x7fc9a006e9f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:03.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.729+0000 7fc9c3b59640 1 --2- 172.21.15.73:0/2041953908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc9bc0d10d0 0x7fc9bc149920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:03.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.729+0000 7fc9c3b59640 1 --2- 172.21.15.73:0/2041953908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9bc070b10 0x7fc9bc0c9b90 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:03.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.729+0000 7fc9c3b59640 1 -- 172.21.15.73:0/2041953908 >> 172.21.15.73:0/2041953908 conn(0x7fc9bc0d2430 msgr2=0x7fc9bc06c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:03.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.729+0000 7fc9c3b59640 1 -- 172.21.15.73:0/2041953908 shutdown_connections 2024-03-29T04:10:03.710 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.729+0000 7fc9c3b59640 1 -- 172.21.15.73:0/2041953908 wait complete. 2024-03-29T04:10:03.719 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-29T04:10:03.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.841+0000 7f5776fe2640 1 Processor -- start 2024-03-29T04:10:03.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.842+0000 7f5776fe2640 1 -- start start 2024-03-29T04:10:03.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.842+0000 7f5776fe2640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f577015c740 0x7f57700cda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:03.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.842+0000 7f5776fe2640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5770160920 0x7f5770166540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:03.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.842+0000 7f5776fe2640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f577015cb20 con 0x7f57700d1080 2024-03-29T04:10:03.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.842+0000 7f5776fe2640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f57700d0000 con 0x7f5770160920 2024-03-29T04:10:03.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.842+0000 7f5776fe2640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f57700d02c0 con 0x7f577015c740 2024-03-29T04:10:03.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.843+0000 7f577557f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5770160920 0x7f5770166540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:03.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.843+0000 7f577557f640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5770160920 0x7f5770166540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51776/0 (socket says 172.21.15.73:51776) 2024-03-29T04:10:03.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.843+0000 7f577557f640 1 -- 172.21.15.73:0/459290397 learned_addr learned my addr 172.21.15.73:0/459290397 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:03.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.843+0000 7f5774d7e640 1 --2- 172.21.15.73:0/459290397 >> v2:172.21.15.142:3300/0 conn(0x7f577015c740 0x7f57700cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:03.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.843+0000 7f577557f640 1 -- 172.21.15.73:0/459290397 >> v2:172.21.15.142:3300/0 conn(0x7f577015c740 msgr2=0x7f57700cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:03.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.843+0000 7f577557f640 1 --2- 172.21.15.73:0/459290397 >> v2:172.21.15.142:3300/0 conn(0x7f577015c740 0x7f57700cda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:03.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.843+0000 7f577557f640 1 -- 172.21.15.73:0/459290397 >> v1:172.21.15.142:6789/0 conn(0x7f57700d1080 legacy=0x7f5770160210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:03.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.843+0000 7f577557f640 1 -- 172.21.15.73:0/459290397 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57700d05a0 con 0x7f5770160920 2024-03-29T04:10:03.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.843+0000 7f5774d7e640 1 --2- 172.21.15.73:0/459290397 >> v2:172.21.15.142:3300/0 conn(0x7f577015c740 0x7f57700cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:10:03.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.844+0000 7f577557f640 1 --2- 172.21.15.73:0/459290397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5770160920 0x7f5770166540 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f57700d3530 tx=0x7f576802bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=120c2b36f1a1f710 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:03.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.845+0000 7f57677fe640 1 -- 172.21.15.73:0/459290397 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576802cb10 con 0x7f5770160920 2024-03-29T04:10:03.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.845+0000 7f57677fe640 1 -- 172.21.15.73:0/459290397 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f576802ccb0 con 0x7f5770160920 2024-03-29T04:10:03.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.845+0000 7f57677fe640 1 -- 172.21.15.73:0/459290397 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576802ce60 con 0x7f5770160920 2024-03-29T04:10:03.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.846+0000 7f5776fe2640 1 -- 172.21.15.73:0/459290397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5770160920 msgr2=0x7f5770166540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:03.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.846+0000 7f5776fe2640 1 --2- 172.21.15.73:0/459290397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5770160920 0x7f5770166540 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f57700d3530 tx=0x7f576802bf70 comp rx=0 tx=0).stop 2024-03-29T04:10:03.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.846+0000 7f5776fe2640 1 -- 172.21.15.73:0/459290397 shutdown_connections 2024-03-29T04:10:03.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.846+0000 7f5776fe2640 1 --2- 172.21.15.73:0/459290397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5770160920 0x7f5770166540 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:03.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.846+0000 7f5776fe2640 1 --2- 172.21.15.73:0/459290397 >> v2:172.21.15.142:3300/0 conn(0x7f577015c740 0x7f57700cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:03.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.846+0000 7f5776fe2640 1 -- 172.21.15.73:0/459290397 >> 172.21.15.73:0/459290397 conn(0x7f57700d2430 msgr2=0x7f57700d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:03.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.846+0000 7f5776fe2640 1 -- 172.21.15.73:0/459290397 shutdown_connections 2024-03-29T04:10:03.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.846+0000 7f5776fe2640 1 -- 172.21.15.73:0/459290397 wait complete. 2024-03-29T04:10:03.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.847+0000 7f5776fe2640 1 Processor -- start 2024-03-29T04:10:03.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.847+0000 7f5776fe2640 1 -- start start 2024-03-29T04:10:03.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.848+0000 7f5776fe2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57700d1080 0x7f57701f2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:03.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.848+0000 7f5776fe2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f577015c740 0x7f57701e62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:03.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.848+0000 7f5776fe2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5770160920 0x7f57700b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:03.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.848+0000 7f5776fe2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5770160f70 con 0x7f577015c740 2024-03-29T04:10:03.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.848+0000 7f5776fe2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f57700d0b60 con 0x7f57700d1080 2024-03-29T04:10:03.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.848+0000 7f5776fe2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f57700cdf60 con 0x7f5770160920 2024-03-29T04:10:03.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.848+0000 7f5767fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f577015c740 0x7f57701e62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:03.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.848+0000 7f5767fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f577015c740 0x7f57701e62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51786/0 (socket says 172.21.15.73:51786) 2024-03-29T04:10:03.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.848+0000 7f5767fff640 1 -- 172.21.15.73:0/3544774820 learned_addr learned my addr 172.21.15.73:0/3544774820 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:03.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.848+0000 7f5774d7e640 1 --2- 172.21.15.73:0/3544774820 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57700d1080 0x7f57701f2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:03.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.848+0000 7f577557f640 1 --2- 172.21.15.73:0/3544774820 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5770160920 0x7f57700b5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:03.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.849+0000 7f5767fff640 1 -- 172.21.15.73:0/3544774820 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5770160920 msgr2=0x7f57700b5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:03.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.849+0000 7f5767fff640 1 --2- 172.21.15.73:0/3544774820 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5770160920 0x7f57700b5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:03.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.849+0000 7f5767fff640 1 -- 172.21.15.73:0/3544774820 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57700d1080 msgr2=0x7f57701f2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:03.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.849+0000 7f5767fff640 1 --2- 172.21.15.73:0/3544774820 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57700d1080 0x7f57701f2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:03.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.849+0000 7f5767fff640 1 -- 172.21.15.73:0/3544774820 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57700b63c0 con 0x7f577015c740 2024-03-29T04:10:03.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.849+0000 7f5767fff640 1 --2- 172.21.15.73:0/3544774820 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f577015c740 0x7f57701e62c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f576000c400 tx=0x7f576000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:03.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.849+0000 7f57657fa640 1 -- 172.21.15.73:0/3544774820 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57600052d0 con 0x7f577015c740 2024-03-29T04:10:03.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.849+0000 7f57657fa640 1 -- 172.21.15.73:0/3544774820 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5760005490 con 0x7f577015c740 2024-03-29T04:10:03.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.849+0000 7f5776fe2640 1 -- 172.21.15.73:0/3544774820 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57700b6640 con 0x7f577015c740 2024-03-29T04:10:03.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.849+0000 7f57657fa640 1 -- 172.21.15.73:0/3544774820 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5760007260 con 0x7f577015c740 2024-03-29T04:10:03.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.849+0000 7f5776fe2640 1 -- 172.21.15.73:0/3544774820 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57700b6c00 con 0x7f577015c740 2024-03-29T04:10:03.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.850+0000 7f5776fe2640 1 -- 172.21.15.73:0/3544774820 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5770068640 con 0x7f577015c740 2024-03-29T04:10:03.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.850+0000 7f57657fa640 1 -- 172.21.15.73:0/3544774820 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f5760007400 con 0x7f577015c740 2024-03-29T04:10:03.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.851+0000 7f57657fa640 1 --2- 172.21.15.73:0/3544774820 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f575c06c530 0x7f575c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:03.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.851+0000 7f5774d7e640 1 --2- 172.21.15.73:0/3544774820 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f575c06c530 0x7f575c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:03.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.851+0000 7f57657fa640 1 -- 172.21.15.73:0/3544774820 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f576008ab40 con 0x7f577015c740 2024-03-29T04:10:03.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.852+0000 7f5774d7e640 1 --2- 172.21.15.73:0/3544774820 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f575c06c530 0x7f575c06e9f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f576c006fd0 tx=0x7f576c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:03.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:03.855+0000 7f57657fa640 1 -- 172.21.15.73:0/3544774820 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f57700b63c0 con 0x7f577015c740 2024-03-29T04:10:04.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.068+0000 7f5776fe2640 1 -- 172.21.15.73:0/3544774820 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f57700b0e60 con 0x7f577015c740 2024-03-29T04:10:04.048 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.069+0000 7f57657fa640 1 -- 172.21.15.73:0/3544774820 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5181 (secure 0 0 0) 0x7f5760058b10 con 0x7f577015c740 2024-03-29T04:10:04.048 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:10:04.049 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4739,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1125143848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1125143848},{"type":"v1","addr":"172.21.15.73:6837","nonce":1125143848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4742,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2988261972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2988261972},{"type":"v1","addr":"172.21.15.142:6835","nonce":2988261972}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5029,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/510984531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":510984531},{"type":"v1","addr":"172.21.15.142:6834","nonce":510984531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-29T04:08:59.079178+0000","modified":"2024-03-29T04:09:19.890401+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5055},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5055":{"gid":5055,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6836/936189393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":936189393},{"type":"v1","addr":"172.21.15.73:6836","nonce":936189393}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5055,"qdb_cluster":[5055]},"id":2}]} 2024-03-29T04:10:04.049 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 15 2024-03-29T04:10:04.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.071+0000 7f5776fe2640 1 -- 172.21.15.73:0/3544774820 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f575c06c530 msgr2=0x7f575c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:04.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.071+0000 7f5776fe2640 1 --2- 172.21.15.73:0/3544774820 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f575c06c530 0x7f575c06e9f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f576c006fd0 tx=0x7f576c008040 comp rx=0 tx=0).stop 2024-03-29T04:10:04.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.071+0000 7f5776fe2640 1 -- 172.21.15.73:0/3544774820 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f577015c740 msgr2=0x7f57701e62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:04.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.071+0000 7f5776fe2640 1 --2- 172.21.15.73:0/3544774820 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f577015c740 0x7f57701e62c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f576000c400 tx=0x7f576000c8c0 comp rx=0 tx=0).stop 2024-03-29T04:10:04.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.071+0000 7f5776fe2640 1 -- 172.21.15.73:0/3544774820 shutdown_connections 2024-03-29T04:10:04.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.071+0000 7f5776fe2640 1 --2- 172.21.15.73:0/3544774820 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5770160920 0x7f57700b5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:04.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.071+0000 7f5776fe2640 1 --2- 172.21.15.73:0/3544774820 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f577015c740 0x7f57701e62c0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:04.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.071+0000 7f5776fe2640 1 --2- 172.21.15.73:0/3544774820 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f575c06c530 0x7f575c06e9f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:04.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.071+0000 7f5776fe2640 1 --2- 172.21.15.73:0/3544774820 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57700d1080 0x7f57701f2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:04.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.071+0000 7f5776fe2640 1 -- 172.21.15.73:0/3544774820 >> 172.21.15.73:0/3544774820 conn(0x7f57700d2430 msgr2=0x7f57700b1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:04.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.071+0000 7f5776fe2640 1 -- 172.21.15.73:0/3544774820 shutdown_connections 2024-03-29T04:10:04.051 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.071+0000 7f5776fe2640 1 -- 172.21.15.73:0/3544774820 wait complete. 2024-03-29T04:10:04.061 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-29T04:10:04.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.183+0000 7f66a162a640 1 Processor -- start 2024-03-29T04:10:04.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.183+0000 7f66a162a640 1 -- start start 2024-03-29T04:10:04.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.184+0000 7f66a162a640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f669c15e930 0x7f669c0cf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:04.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.184+0000 7f66a162a640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f669c0cfb30 con 0x7f669c0d3310 2024-03-29T04:10:04.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.184+0000 7f66a162a640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f669c0cfe10 con 0x7f669c0cf670 2024-03-29T04:10:04.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.184+0000 7f66a162a640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f669c06c780 con 0x7f669c15e930 2024-03-29T04:10:04.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.184+0000 7f669affd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f669c15e930 0x7f669c0cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:04.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.184+0000 7f669affd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f669c15e930 0x7f669c0cf130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51794/0 (socket says 172.21.15.73:51794) 2024-03-29T04:10:04.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.184+0000 7f669b7fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f669c0d3310 0x7f669c06cc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52566/0 (socket says 172.21.15.73:52566) 2024-03-29T04:10:04.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.184+0000 7f669affd640 1 -- 172.21.15.73:0/3248266815 learned_addr learned my addr 172.21.15.73:0/3248266815 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:04.164 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.184+0000 7f669affd640 1 -- 172.21.15.73:0/3248266815 >> v1:172.21.15.142:6789/0 conn(0x7f669c0cf670 legacy=0x7f669c0d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:04.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.184+0000 7f669affd640 1 -- 172.21.15.73:0/3248266815 >> v1:172.21.15.73:6789/0 conn(0x7f669c0d3310 legacy=0x7f669c06cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:04.165 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.184+0000 7f669affd640 1 -- 172.21.15.73:0/3248266815 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f669c0d00f0 con 0x7f669c15e930 2024-03-29T04:10:04.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.185+0000 7f669affd640 1 --2- 172.21.15.73:0/3248266815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f669c15e930 0x7f669c0cf130 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f668c009870 tx=0x7f668c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab36ef481a55bfa0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:04.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.185+0000 7f669a7fc640 1 -- 172.21.15.73:0/3248266815 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f668c035020 con 0x7f669c15e930 2024-03-29T04:10:04.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.185+0000 7f669a7fc640 1 -- 172.21.15.73:0/3248266815 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f668c031870 con 0x7f669c15e930 2024-03-29T04:10:04.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.185+0000 7f669a7fc640 1 -- 172.21.15.73:0/3248266815 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f668c031c40 con 0x7f669c15e930 2024-03-29T04:10:04.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.186+0000 7f66a162a640 1 -- 172.21.15.73:0/3248266815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f669c15e930 msgr2=0x7f669c0cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:04.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.186+0000 7f66a162a640 1 --2- 172.21.15.73:0/3248266815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f669c15e930 0x7f669c0cf130 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f668c009870 tx=0x7f668c02b910 comp rx=0 tx=0).stop 2024-03-29T04:10:04.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.186+0000 7f66a162a640 1 -- 172.21.15.73:0/3248266815 shutdown_connections 2024-03-29T04:10:04.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.186+0000 7f66a162a640 1 --2- 172.21.15.73:0/3248266815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f669c15e930 0x7f669c0cf130 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:04.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.186+0000 7f66a162a640 1 -- 172.21.15.73:0/3248266815 >> 172.21.15.73:0/3248266815 conn(0x7f669c08bfc0 msgr2=0x7f669c0d4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:04.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.186+0000 7f66a162a640 1 -- 172.21.15.73:0/3248266815 shutdown_connections 2024-03-29T04:10:04.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.186+0000 7f66a162a640 1 -- 172.21.15.73:0/3248266815 wait complete. 2024-03-29T04:10:04.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.187+0000 7f66a162a640 1 Processor -- start 2024-03-29T04:10:04.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.187+0000 7f66a162a640 1 -- start start 2024-03-29T04:10:04.170 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.188+0000 7f66a162a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f669c0cf670 0x7f669c153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:04.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.188+0000 7f66a162a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f669c0d3310 0x7f669c155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:04.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.188+0000 7f66a162a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f669c15e930 0x7f669c155c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:04.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.188+0000 7f66a162a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f669c15ee90 con 0x7f669c0d3310 2024-03-29T04:10:04.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.188+0000 7f66a162a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f669c15ed10 con 0x7f669c15e930 2024-03-29T04:10:04.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.188+0000 7f66a162a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f669c0b3c50 con 0x7f669c0cf670 2024-03-29T04:10:04.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.188+0000 7f66927fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f669c0d3310 0x7f669c155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:04.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.188+0000 7f66927fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f669c0d3310 0x7f669c155750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51804/0 (socket says 172.21.15.73:51804) 2024-03-29T04:10:04.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.188+0000 7f66927fc640 1 -- 172.21.15.73:0/2649617374 learned_addr learned my addr 172.21.15.73:0/2649617374 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:04.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.188+0000 7f669affd640 1 --2- 172.21.15.73:0/2649617374 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f669c0cf670 0x7f669c153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:04.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.188+0000 7f669b7fe640 1 --2- 172.21.15.73:0/2649617374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f669c15e930 0x7f669c155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:04.171 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.188+0000 7f66927fc640 1 -- 172.21.15.73:0/2649617374 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f669c0cf670 msgr2=0x7f669c153a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:04.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.188+0000 7f66927fc640 1 --2- 172.21.15.73:0/2649617374 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f669c0cf670 0x7f669c153a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:04.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.188+0000 7f66927fc640 1 -- 172.21.15.73:0/2649617374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f669c15e930 msgr2=0x7f669c155c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:04.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.188+0000 7f66927fc640 1 --2- 172.21.15.73:0/2649617374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f669c15e930 0x7f669c155c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:04.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.188+0000 7f66927fc640 1 -- 172.21.15.73:0/2649617374 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f669c159f30 con 0x7f669c0d3310 2024-03-29T04:10:04.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.188+0000 7f669affd640 1 --2- 172.21.15.73:0/2649617374 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f669c0cf670 0x7f669c153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:10:04.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.189+0000 7f66927fc640 1 --2- 172.21.15.73:0/2649617374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f669c0d3310 0x7f669c155750 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f668400c430 tx=0x7f668400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:04.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.189+0000 7f6693fff640 1 -- 172.21.15.73:0/2649617374 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6684011790 con 0x7f669c0d3310 2024-03-29T04:10:04.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.189+0000 7f6693fff640 1 -- 172.21.15.73:0/2649617374 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6684017070 con 0x7f669c0d3310 2024-03-29T04:10:04.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.189+0000 7f66a162a640 1 -- 172.21.15.73:0/2649617374 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f669c1562a0 con 0x7f669c0d3310 2024-03-29T04:10:04.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.189+0000 7f6693fff640 1 -- 172.21.15.73:0/2649617374 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6684011b70 con 0x7f669c0d3310 2024-03-29T04:10:04.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.189+0000 7f66a162a640 1 -- 172.21.15.73:0/2649617374 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f669c156860 con 0x7f669c0d3310 2024-03-29T04:10:04.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.190+0000 7f66a162a640 1 -- 172.21.15.73:0/2649617374 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f669c068640 con 0x7f669c0d3310 2024-03-29T04:10:04.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.190+0000 7f6693fff640 1 -- 172.21.15.73:0/2649617374 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f6684011d10 con 0x7f669c0d3310 2024-03-29T04:10:04.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.191+0000 7f6693fff640 1 --2- 172.21.15.73:0/2649617374 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f667c06c530 0x7f667c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:04.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.191+0000 7f669affd640 1 --2- 172.21.15.73:0/2649617374 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f667c06c530 0x7f667c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:04.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.191+0000 7f6693fff640 1 -- 172.21.15.73:0/2649617374 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f668408b4b0 con 0x7f669c0d3310 2024-03-29T04:10:04.173 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.191+0000 7f669affd640 1 --2- 172.21.15.73:0/2649617374 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f667c06c530 0x7f667c06e9f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f668c036000 tx=0x7f668c03c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:04.174 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.195+0000 7f6693fff640 1 -- 172.21.15.73:0/2649617374 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f6684059b60 con 0x7f669c0d3310 2024-03-29T04:10:04.386 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.407+0000 7f66a162a640 1 -- 172.21.15.73:0/2649617374 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f669c0d30a0 con 0x7f669c0d3310 2024-03-29T04:10:04.387 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.408+0000 7f6693fff640 1 -- 172.21.15.73:0/2649617374 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16669 (secure 0 0 0) 0x7f6684059460 con 0x7f669c0d3310 2024-03-29T04:10:04.388 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:10:04.388 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":32,"fsid":"6bff1617-b138-4517-acca-3ecaae3f2bb3","created":"2024-03-29T04:07:47.346864+0000","modified":"2024-03-29T04:09:00.732697+0000","last_up_change":"2024-03-29T04:07:58.507139+0000","last_in_change":"2024-03-29T04:07:49.637816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-29T04:07:59.537301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-29T04:08:57.521498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-29T04:08:58.027631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"925d7de1-14ab-48c0-aebd-7bded108f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6820","nonce":2387335359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6824","nonce":2387335359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6831","nonce":2387335359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6828","nonce":2387335359}]},"public_addr":"172.21.15.73:6820/2387335359","cluster_addr":"172.21.15.73:6824/2387335359","heartbeat_back_addr":"172.21.15.73:6831/2387335359","heartbeat_front_addr":"172.21.15.73:6828/2387335359","state":["exists","up"]},{"osd":1,"uuid":"6b182102-882a-4e0c-99db-0afae5cfb38b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6801","nonce":2431315515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6803","nonce":2431315515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6807","nonce":2431315515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6805","nonce":2431315515}]},"public_addr":"172.21.15.73:6801/2431315515","cluster_addr":"172.21.15.73:6803/2431315515","heartbeat_back_addr":"172.21.15.73:6807/2431315515","heartbeat_front_addr":"172.21.15.73:6805/2431315515","state":["exists","up"]},{"osd":2,"uuid":"8040902e-b0b8-4a21-bf64-ce1c222115ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6809","nonce":407236597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6811","nonce":407236597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6815","nonce":407236597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6813","nonce":407236597}]},"public_addr":"172.21.15.73:6809/407236597","cluster_addr":"172.21.15.73:6811/407236597","heartbeat_back_addr":"172.21.15.73:6815/407236597","heartbeat_front_addr":"172.21.15.73:6813/407236597","state":["exists","up"]},{"osd":3,"uuid":"1bab19ee-3775-4ce1-a4ce-cf7cda3bbbf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6817","nonce":4291100709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6821","nonce":4291100709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6829","nonce":4291100709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6825","nonce":4291100709}]},"public_addr":"172.21.15.73:6817/4291100709","cluster_addr":"172.21.15.73:6821/4291100709","heartbeat_back_addr":"172.21.15.73:6829/4291100709","heartbeat_front_addr":"172.21.15.73:6825/4291100709","state":["exists","up"]},{"osd":4,"uuid":"b0c74337-8fe4-47dc-b3da-2d07591b1f6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6817","nonce":3703256194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6819","nonce":3703256194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6823","nonce":3703256194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6821","nonce":3703256194}]},"public_addr":"172.21.15.142:6817/3703256194","cluster_addr":"172.21.15.142:6819/3703256194","heartbeat_back_addr":"172.21.15.142:6823/3703256194","heartbeat_front_addr":"172.21.15.142:6821/3703256194","state":["exists","up"]},{"osd":5,"uuid":"9ce36410-a29a-42c6-99f4-f95d4afdd7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6825","nonce":4271575803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6827","nonce":4271575803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6831","nonce":4271575803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6829","nonce":4271575803}]},"public_addr":"172.21.15.142:6825/4271575803","cluster_addr":"172.21.15.142:6827/4271575803","heartbeat_back_addr":"172.21.15.142:6831/4271575803","heartbeat_front_addr":"172.21.15.142:6829/4271575803","state":["exists","up"]},{"osd":6,"uuid":"aec4264a-64ac-428e-a860-d2920a304019","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6801","nonce":1772722570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6803","nonce":1772722570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6807","nonce":1772722570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6805","nonce":1772722570}]},"public_addr":"172.21.15.142:6801/1772722570","cluster_addr":"172.21.15.142:6803/1772722570","heartbeat_back_addr":"172.21.15.142:6807/1772722570","heartbeat_front_addr":"172.21.15.142:6805/1772722570","state":["exists","up"]},{"osd":7,"uuid":"fe599052-8e5a-4c7a-91e7-52d1bae24a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6809","nonce":3910589675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6811","nonce":3910589675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6815","nonce":3910589675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6813","nonce":3910589675}]},"public_addr":"172.21.15.142:6809/3910589675","cluster_addr":"172.21.15.142:6811/3910589675","heartbeat_back_addr":"172.21.15.142:6815/3910589675","heartbeat_front_addr":"172.21.15.142:6813/3910589675","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.835096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.587210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.786547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.778004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.843740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.791160+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.837992+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.718722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:10:04.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.410+0000 7f66a162a640 1 -- 172.21.15.73:0/2649617374 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f667c06c530 msgr2=0x7f667c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:04.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.410+0000 7f66a162a640 1 --2- 172.21.15.73:0/2649617374 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f667c06c530 0x7f667c06e9f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f668c036000 tx=0x7f668c03c040 comp rx=0 tx=0).stop 2024-03-29T04:10:04.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.410+0000 7f66a162a640 1 -- 172.21.15.73:0/2649617374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f669c0d3310 msgr2=0x7f669c155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:04.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.410+0000 7f66a162a640 1 --2- 172.21.15.73:0/2649617374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f669c0d3310 0x7f669c155750 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f668400c430 tx=0x7f668400c8f0 comp rx=0 tx=0).stop 2024-03-29T04:10:04.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.410+0000 7f66a162a640 1 -- 172.21.15.73:0/2649617374 shutdown_connections 2024-03-29T04:10:04.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.410+0000 7f66a162a640 1 --2- 172.21.15.73:0/2649617374 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f667c06c530 0x7f667c06e9f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:04.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.410+0000 7f66a162a640 1 --2- 172.21.15.73:0/2649617374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f669c15e930 0x7f669c155c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:04.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.410+0000 7f66a162a640 1 --2- 172.21.15.73:0/2649617374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f669c0d3310 0x7f669c155750 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:04.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.410+0000 7f66a162a640 1 --2- 172.21.15.73:0/2649617374 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f669c0cf670 0x7f669c153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:04.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.410+0000 7f66a162a640 1 -- 172.21.15.73:0/2649617374 >> 172.21.15.73:0/2649617374 conn(0x7f669c08bfc0 msgr2=0x7f669c0b15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:04.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.410+0000 7f66a162a640 1 -- 172.21.15.73:0/2649617374 shutdown_connections 2024-03-29T04:10:04.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.410+0000 7f66a162a640 1 -- 172.21.15.73:0/2649617374 wait complete. 2024-03-29T04:10:04.404 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-29T04:10:04.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.527+0000 7ff1e218f640 1 Processor -- start 2024-03-29T04:10:04.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.527+0000 7ff1e218f640 1 -- start start 2024-03-29T04:10:04.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.528+0000 7ff1e218f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff1dc15eb60 0x7ff1dc0cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:04.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.528+0000 7ff1e218f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1dc0ba000 0x7ff1dc0d2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:04.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.528+0000 7ff1e218f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1dc0cfe70 con 0x7ff1dc15e780 2024-03-29T04:10:04.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.528+0000 7ff1e218f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7ff1dc0b7f50 con 0x7ff1dc15eb60 2024-03-29T04:10:04.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.528+0000 7ff1e218f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff1dc0b8230 con 0x7ff1dc0ba000 2024-03-29T04:10:04.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.528+0000 7ff1dbfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1dc0ba000 0x7ff1dc0d2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:04.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.528+0000 7ff1daffd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff1dc15eb60 0x7ff1dc0cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:04.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.528+0000 7ff1db7fe640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7ff1dc15e780 0x7ff1dc0cebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.73:58274/0 (socket says 172.21.15.73:58274) 2024-03-29T04:10:04.508 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.528+0000 7ff1dbfff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1dc0ba000 0x7ff1dc0d2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:57760/0 (socket says 172.21.15.73:57760) 2024-03-29T04:10:04.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.528+0000 7ff1db7fe640 1 -- 172.21.15.73:0/3357359237 learned_addr learned my addr 172.21.15.73:0/3357359237 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:10:04.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.528+0000 7ff1da7fc640 1 -- 172.21.15.73:0/3357359237 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3993491127 0 0) 0x7ff1dc0cfe70 con 0x7ff1dc15e780 2024-03-29T04:10:04.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.528+0000 7ff1da7fc640 1 -- 172.21.15.73:0/3357359237 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1c4003520 con 0x7ff1dc15e780 2024-03-29T04:10:04.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.528+0000 7ff1dbfff640 1 -- 172.21.15.73:0/3357359237 >> v2:172.21.15.142:3300/0 conn(0x7ff1dc15eb60 msgr2=0x7ff1dc0cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:04.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.528+0000 7ff1dbfff640 1 --2- 172.21.15.73:0/3357359237 >> v2:172.21.15.142:3300/0 conn(0x7ff1dc15eb60 0x7ff1dc0cf2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:04.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.528+0000 7ff1dbfff640 1 -- 172.21.15.73:0/3357359237 >> v1:172.21.15.142:6789/0 conn(0x7ff1dc15e780 legacy=0x7ff1dc0cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:04.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.528+0000 7ff1dbfff640 1 -- 172.21.15.73:0/3357359237 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1dc0b8510 con 0x7ff1dc0ba000 2024-03-29T04:10:04.509 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.528+0000 7ff1daffd640 1 --2- 172.21.15.73:0/3357359237 >> v2:172.21.15.142:3300/0 conn(0x7ff1dc15eb60 0x7ff1dc0cf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:10:04.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.529+0000 7ff1dbfff640 1 --2- 172.21.15.73:0/3357359237 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1dc0ba000 0x7ff1dc0d2570 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4009d90 tx=0x7ff1d402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96341b3594fea394 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:04.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.529+0000 7ff1da7fc640 1 -- 172.21.15.73:0/3357359237 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d4039070 con 0x7ff1dc0ba000 2024-03-29T04:10:04.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.529+0000 7ff1da7fc640 1 -- 172.21.15.73:0/3357359237 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1d402cc50 con 0x7ff1dc0ba000 2024-03-29T04:10:04.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.529+0000 7ff1da7fc640 1 -- 172.21.15.73:0/3357359237 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d4034440 con 0x7ff1dc0ba000 2024-03-29T04:10:04.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.530+0000 7ff1e218f640 1 -- 172.21.15.73:0/3357359237 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1dc0ba000 msgr2=0x7ff1dc0d2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:04.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.530+0000 7ff1e218f640 1 --2- 172.21.15.73:0/3357359237 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1dc0ba000 0x7ff1dc0d2570 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4009d90 tx=0x7ff1d402bea0 comp rx=0 tx=0).stop 2024-03-29T04:10:04.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.530+0000 7ff1e218f640 1 -- 172.21.15.73:0/3357359237 shutdown_connections 2024-03-29T04:10:04.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.530+0000 7ff1e218f640 1 --2- 172.21.15.73:0/3357359237 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1dc0ba000 0x7ff1dc0d2570 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:04.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.530+0000 7ff1e218f640 1 --2- 172.21.15.73:0/3357359237 >> v2:172.21.15.142:3300/0 conn(0x7ff1dc15eb60 0x7ff1dc0cf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:04.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.530+0000 7ff1e218f640 1 -- 172.21.15.73:0/3357359237 >> 172.21.15.73:0/3357359237 conn(0x7ff1dc08bfc0 msgr2=0x7ff1dc0d4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:04.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.530+0000 7ff1e218f640 1 -- 172.21.15.73:0/3357359237 shutdown_connections 2024-03-29T04:10:04.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.530+0000 7ff1e218f640 1 -- 172.21.15.73:0/3357359237 wait complete. 2024-03-29T04:10:04.511 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.532+0000 7ff1e218f640 1 Processor -- start 2024-03-29T04:10:04.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.532+0000 7ff1e218f640 1 -- start start 2024-03-29T04:10:04.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.533+0000 7ff1e218f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1dc0ba000 0x7ff1dc14eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:04.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.533+0000 7ff1e218f640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1dc15e780 0x7ff1dc161410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:04.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.533+0000 7ff1e218f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1dc161950 0x7ff1dc0cb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:04.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.533+0000 7ff1e218f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff1dc0cf810 con 0x7ff1dc0ba000 2024-03-29T04:10:04.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.533+0000 7ff1e218f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff1dc0b8ad0 con 0x7ff1dc161950 2024-03-29T04:10:04.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.533+0000 7ff1e218f640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ff1dc0cf990 con 0x7ff1dc15e780 2024-03-29T04:10:04.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.533+0000 7ff1db7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1dc0ba000 0x7ff1dc14eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:04.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.533+0000 7ff1db7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1dc0ba000 0x7ff1dc14eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51820/0 (socket says 172.21.15.73:51820) 2024-03-29T04:10:04.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.533+0000 7ff1db7fe640 1 -- 172.21.15.73:0/4242213576 learned_addr learned my addr 172.21.15.73:0/4242213576 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:04.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.534+0000 7ff1daffd640 1 --2- 172.21.15.73:0/4242213576 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1dc15e780 0x7ff1dc161410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:04.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.534+0000 7ff1dbfff640 1 --2- 172.21.15.73:0/4242213576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1dc161950 0x7ff1dc0cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:04.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.534+0000 7ff1db7fe640 1 -- 172.21.15.73:0/4242213576 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1dc15e780 msgr2=0x7ff1dc161410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:04.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.534+0000 7ff1db7fe640 1 --2- 172.21.15.73:0/4242213576 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1dc15e780 0x7ff1dc161410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:04.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.534+0000 7ff1db7fe640 1 -- 172.21.15.73:0/4242213576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1dc161950 msgr2=0x7ff1dc0cb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:04.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.534+0000 7ff1db7fe640 1 --2- 172.21.15.73:0/4242213576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1dc161950 0x7ff1dc0cb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:04.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.534+0000 7ff1db7fe640 1 -- 172.21.15.73:0/4242213576 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1dc0cc6c0 con 0x7ff1dc0ba000 2024-03-29T04:10:04.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.534+0000 7ff1db7fe640 1 --2- 172.21.15.73:0/4242213576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1dc0ba000 0x7ff1dc14eab0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc00c430 tx=0x7ff1cc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:04.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.534+0000 7ff1c3fff640 1 -- 172.21.15.73:0/4242213576 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc017070 con 0x7ff1dc0ba000 2024-03-29T04:10:04.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.534+0000 7ff1c3fff640 1 -- 172.21.15.73:0/4242213576 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1cc005ce0 con 0x7ff1dc0ba000 2024-03-29T04:10:04.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.534+0000 7ff1c3fff640 1 -- 172.21.15.73:0/4242213576 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc0072f0 con 0x7ff1dc0ba000 2024-03-29T04:10:04.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.534+0000 7ff1e218f640 1 -- 172.21.15.73:0/4242213576 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1dc0cc9a0 con 0x7ff1dc0ba000 2024-03-29T04:10:04.515 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.534+0000 7ff1e218f640 1 -- 172.21.15.73:0/4242213576 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1dc14eff0 con 0x7ff1dc0ba000 2024-03-29T04:10:04.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.535+0000 7ff1e218f640 1 -- 172.21.15.73:0/4242213576 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1dc161d60 con 0x7ff1dc0ba000 2024-03-29T04:10:04.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.536+0000 7ff1c3fff640 1 -- 172.21.15.73:0/4242213576 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff1cc01a070 con 0x7ff1dc0ba000 2024-03-29T04:10:04.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.536+0000 7ff1c3fff640 1 --2- 172.21.15.73:0/4242213576 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff1c806c530 0x7ff1c806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:04.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.536+0000 7ff1c3fff640 1 -- 172.21.15.73:0/4242213576 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7ff1cc08ab20 con 0x7ff1dc0ba000 2024-03-29T04:10:04.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.536+0000 7ff1daffd640 1 --2- 172.21.15.73:0/4242213576 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff1c806c530 0x7ff1c806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:04.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.537+0000 7ff1daffd640 1 --2- 172.21.15.73:0/4242213576 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff1c806c530 0x7ff1c806e9f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc08c450 tx=0x7ff1d0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:04.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.541+0000 7ff1c3fff640 1 -- 172.21.15.73:0/4242213576 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7ff1dc161d60 con 0x7ff1dc0ba000 2024-03-29T04:10:04.744 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.765+0000 7ff1e218f640 1 -- 172.21.15.73:0/4242213576 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ff1dc0cf5c0 con 0x7ff1dc0ba000 2024-03-29T04:10:04.745 INFO:tasks.ceph.mon.a.smithi073.stderr:2024-03-29T04:10:04.766+0000 7f73858c4640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-29T04:10:04.747 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.768+0000 7ff1c3fff640 1 -- 172.21.15.73:0/4242213576 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) ==== 161+0+0 (secure 0 0 0) 0x7ff1cc0591d0 con 0x7ff1dc0ba000 2024-03-29T04:10:04.747 INFO:teuthology.orchestra.run.smithi073.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-29T04:10:04.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.771+0000 7ff1e218f640 1 -- 172.21.15.73:0/4242213576 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff1c806c530 msgr2=0x7ff1c806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:04.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.771+0000 7ff1e218f640 1 --2- 172.21.15.73:0/4242213576 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff1c806c530 0x7ff1c806e9f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc08c450 tx=0x7ff1d0008040 comp rx=0 tx=0).stop 2024-03-29T04:10:04.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.771+0000 7ff1e218f640 1 -- 172.21.15.73:0/4242213576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1dc0ba000 msgr2=0x7ff1dc14eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:04.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.771+0000 7ff1e218f640 1 --2- 172.21.15.73:0/4242213576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1dc0ba000 0x7ff1dc14eab0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ff1cc00c430 tx=0x7ff1cc00c8f0 comp rx=0 tx=0).stop 2024-03-29T04:10:04.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.772+0000 7ff1e218f640 1 -- 172.21.15.73:0/4242213576 shutdown_connections 2024-03-29T04:10:04.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.772+0000 7ff1e218f640 1 --2- 172.21.15.73:0/4242213576 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ff1c806c530 0x7ff1c806e9f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:04.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.772+0000 7ff1e218f640 1 --2- 172.21.15.73:0/4242213576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1dc161950 0x7ff1dc0cb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:04.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.772+0000 7ff1e218f640 1 --2- 172.21.15.73:0/4242213576 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ff1dc15e780 0x7ff1dc161410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:04.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.772+0000 7ff1e218f640 1 --2- 172.21.15.73:0/4242213576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1dc0ba000 0x7ff1dc14eab0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:04.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.772+0000 7ff1e218f640 1 -- 172.21.15.73:0/4242213576 >> 172.21.15.73:0/4242213576 conn(0x7ff1dc08bfc0 msgr2=0x7ff1dc06cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:04.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.772+0000 7ff1e218f640 1 -- 172.21.15.73:0/4242213576 shutdown_connections 2024-03-29T04:10:04.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.772+0000 7ff1e218f640 1 -- 172.21.15.73:0/4242213576 wait complete. 2024-03-29T04:10:04.762 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-29T04:10:04.797 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2024-03-29T04:10:04.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.888+0000 7f4d75035640 1 Processor -- start 2024-03-29T04:10:04.867 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.888+0000 7f4d75035640 1 -- start start 2024-03-29T04:10:04.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.888+0000 7f4d75035640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4d700d3280 0x7f4d700d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:04.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.888+0000 7f4d75035640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d700d14d0 0x7f4d7006c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:04.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.888+0000 7f4d75035640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d7015ed00 con 0x7f4d7015e920 2024-03-29T04:10:04.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.888+0000 7f4d75035640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f4d700d21e0 con 0x7f4d700d3280 2024-03-29T04:10:04.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.888+0000 7f4d75035640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f4d700d24c0 con 0x7f4d700d14d0 2024-03-29T04:10:04.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.889+0000 7f4d67fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4d700d3280 0x7f4d700d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:04.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.889+0000 7f4d67fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4d700d3280 0x7f4d700d0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51838/0 (socket says 172.21.15.73:51838) 2024-03-29T04:10:04.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.889+0000 7f4d67fff640 1 -- 172.21.15.73:0/2757827300 learned_addr learned my addr 172.21.15.73:0/2757827300 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:04.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.889+0000 7f4d6f59e640 1 --2- 172.21.15.73:0/2757827300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d700d14d0 0x7f4d7006c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:04.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.889+0000 7f4d67fff640 1 -- 172.21.15.73:0/2757827300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d700d14d0 msgr2=0x7f4d7006c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:04.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.889+0000 7f4d67fff640 1 --2- 172.21.15.73:0/2757827300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d700d14d0 0x7f4d7006c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:04.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.889+0000 7f4d67fff640 1 -- 172.21.15.73:0/2757827300 >> v1:172.21.15.142:6789/0 conn(0x7f4d7015e920 legacy=0x7f4d700cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:04.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.889+0000 7f4d67fff640 1 -- 172.21.15.73:0/2757827300 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d700d27a0 con 0x7f4d700d3280 2024-03-29T04:10:04.869 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.889+0000 7f4d6f59e640 1 --2- 172.21.15.73:0/2757827300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d700d14d0 0x7f4d7006c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:10:04.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.890+0000 7f4d67fff640 1 --2- 172.21.15.73:0/2757827300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d700d3280 0x7f4d700d0f90 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4d58009870 tx=0x7f4d5802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84dc22430d2d493 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:04.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.890+0000 7f4d6e59c640 1 -- 172.21.15.73:0/2757827300 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d58035020 con 0x7f4d700d3280 2024-03-29T04:10:04.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.890+0000 7f4d6e59c640 1 -- 172.21.15.73:0/2757827300 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d58031640 con 0x7f4d700d3280 2024-03-29T04:10:04.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.890+0000 7f4d6e59c640 1 -- 172.21.15.73:0/2757827300 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5802d040 con 0x7f4d700d3280 2024-03-29T04:10:04.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.890+0000 7f4d75035640 1 -- 172.21.15.73:0/2757827300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d700d3280 msgr2=0x7f4d700d0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:04.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.890+0000 7f4d75035640 1 --2- 172.21.15.73:0/2757827300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d700d3280 0x7f4d700d0f90 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4d58009870 tx=0x7f4d5802b8f0 comp rx=0 tx=0).stop 2024-03-29T04:10:04.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.890+0000 7f4d75035640 1 -- 172.21.15.73:0/2757827300 shutdown_connections 2024-03-29T04:10:04.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.890+0000 7f4d75035640 1 --2- 172.21.15.73:0/2757827300 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d700d14d0 0x7f4d7006c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:04.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.890+0000 7f4d75035640 1 --2- 172.21.15.73:0/2757827300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d700d3280 0x7f4d700d0f90 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:04.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.890+0000 7f4d75035640 1 -- 172.21.15.73:0/2757827300 >> 172.21.15.73:0/2757827300 conn(0x7f4d7008bfc0 msgr2=0x7f4d700d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:04.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.890+0000 7f4d75035640 1 -- 172.21.15.73:0/2757827300 shutdown_connections 2024-03-29T04:10:04.871 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.890+0000 7f4d75035640 1 -- 172.21.15.73:0/2757827300 wait complete. 2024-03-29T04:10:04.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.892+0000 7f4d75035640 1 Processor -- start 2024-03-29T04:10:04.872 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.892+0000 7f4d75035640 1 -- start start 2024-03-29T04:10:04.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.892+0000 7f4d75035640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d700d14d0 0x7f4d700cab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:04.873 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.892+0000 7f4d75035640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d700d3280 0x7f4d700b60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:04.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.892+0000 7f4d75035640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d7015e920 0x7f4d700b6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:04.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.892+0000 7f4d75035640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4d700d4f50 con 0x7f4d700d14d0 2024-03-29T04:10:04.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.892+0000 7f4d75035640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4d700d2d60 con 0x7f4d7015e920 2024-03-29T04:10:04.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.892+0000 7f4d75035640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f4d700d36e0 con 0x7f4d700d3280 2024-03-29T04:10:04.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.892+0000 7f4d6ed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d700d14d0 0x7f4d700cab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:04.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.892+0000 7f4d6ed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d700d14d0 0x7f4d700cab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51846/0 (socket says 172.21.15.73:51846) 2024-03-29T04:10:04.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.892+0000 7f4d6ed9d640 1 -- 172.21.15.73:0/2664337289 learned_addr learned my addr 172.21.15.73:0/2664337289 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:04.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.893+0000 7f4d67fff640 1 --2- 172.21.15.73:0/2664337289 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d700d3280 0x7f4d700b60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:04.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.893+0000 7f4d6f59e640 1 --2- 172.21.15.73:0/2664337289 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d7015e920 0x7f4d700b6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:04.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.893+0000 7f4d6ed9d640 1 -- 172.21.15.73:0/2664337289 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d700d3280 msgr2=0x7f4d700b60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:04.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.893+0000 7f4d6ed9d640 1 --2- 172.21.15.73:0/2664337289 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d700d3280 0x7f4d700b60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:04.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.893+0000 7f4d6ed9d640 1 -- 172.21.15.73:0/2664337289 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d7015e920 msgr2=0x7f4d700b6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:04.874 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.893+0000 7f4d6ed9d640 1 --2- 172.21.15.73:0/2664337289 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d7015e920 0x7f4d700b6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:04.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.893+0000 7f4d6ed9d640 1 -- 172.21.15.73:0/2664337289 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d70160860 con 0x7f4d700d14d0 2024-03-29T04:10:04.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.893+0000 7f4d67fff640 1 --2- 172.21.15.73:0/2664337289 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d700d3280 0x7f4d700b60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:10:04.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.893+0000 7f4d6f59e640 1 --2- 172.21.15.73:0/2664337289 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d7015e920 0x7f4d700b6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:10:04.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.893+0000 7f4d6ed9d640 1 --2- 172.21.15.73:0/2664337289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d700d14d0 0x7f4d700cab80 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f4d6000c430 tx=0x7f4d6000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:04.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.893+0000 7f4d677fe640 1 -- 172.21.15.73:0/2664337289 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d60011790 con 0x7f4d700d14d0 2024-03-29T04:10:04.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.893+0000 7f4d677fe640 1 -- 172.21.15.73:0/2664337289 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d60017070 con 0x7f4d700d14d0 2024-03-29T04:10:04.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.893+0000 7f4d677fe640 1 -- 172.21.15.73:0/2664337289 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d60011bb0 con 0x7f4d700d14d0 2024-03-29T04:10:04.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.893+0000 7f4d75035640 1 -- 172.21.15.73:0/2664337289 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d7015faa0 con 0x7f4d700d14d0 2024-03-29T04:10:04.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.893+0000 7f4d75035640 1 -- 172.21.15.73:0/2664337289 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d70160060 con 0x7f4d700d14d0 2024-03-29T04:10:04.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.894+0000 7f4d75035640 1 -- 172.21.15.73:0/2664337289 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d70160390 con 0x7f4d700d14d0 2024-03-29T04:10:04.875 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.894+0000 7f4d677fe640 1 -- 172.21.15.73:0/2664337289 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f4d6001c460 con 0x7f4d700d14d0 2024-03-29T04:10:04.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.895+0000 7f4d677fe640 1 --2- 172.21.15.73:0/2664337289 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f4d5006c530 0x7f4d5006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:04.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.895+0000 7f4d677fe640 1 -- 172.21.15.73:0/2664337289 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f4d6008b650 con 0x7f4d700d14d0 2024-03-29T04:10:04.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.895+0000 7f4d67fff640 1 --2- 172.21.15.73:0/2664337289 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f4d5006c530 0x7f4d5006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:04.876 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.895+0000 7f4d67fff640 1 --2- 172.21.15.73:0/2664337289 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f4d5006c530 0x7f4d5006e9f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4d58036000 tx=0x7f4d5803c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:04.878 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:04.899+0000 7f4d677fe640 1 -- 172.21.15.73:0/2664337289 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f4d60059c10 con 0x7f4d700d14d0 2024-03-29T04:10:05.089 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.110+0000 7f4d75035640 1 -- 172.21.15.73:0/2664337289 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f4d701632b0 con 0x7f4d700d14d0 2024-03-29T04:10:05.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.769+0000 7f4d677fe640 1 -- 172.21.15.73:0/2664337289 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) ==== 104+0+0 (secure 0 0 0) 0x7f4d701632b0 con 0x7f4d700d14d0 2024-03-29T04:10:05.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.772+0000 7f4d75035640 1 -- 172.21.15.73:0/2664337289 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f4d5006c530 msgr2=0x7f4d5006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:05.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.772+0000 7f4d75035640 1 --2- 172.21.15.73:0/2664337289 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f4d5006c530 0x7f4d5006e9f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4d58036000 tx=0x7f4d5803c040 comp rx=0 tx=0).stop 2024-03-29T04:10:05.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.772+0000 7f4d75035640 1 -- 172.21.15.73:0/2664337289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d700d14d0 msgr2=0x7f4d700cab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:05.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.772+0000 7f4d75035640 1 --2- 172.21.15.73:0/2664337289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d700d14d0 0x7f4d700cab80 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f4d6000c430 tx=0x7f4d6000c8f0 comp rx=0 tx=0).stop 2024-03-29T04:10:05.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.772+0000 7f4d75035640 1 -- 172.21.15.73:0/2664337289 shutdown_connections 2024-03-29T04:10:05.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.772+0000 7f4d75035640 1 --2- 172.21.15.73:0/2664337289 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f4d5006c530 0x7f4d5006e9f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:05.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.772+0000 7f4d75035640 1 --2- 172.21.15.73:0/2664337289 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4d7015e920 0x7f4d700b6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:05.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.772+0000 7f4d75035640 1 --2- 172.21.15.73:0/2664337289 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f4d700d3280 0x7f4d700b60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:05.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.772+0000 7f4d75035640 1 --2- 172.21.15.73:0/2664337289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d700d14d0 0x7f4d700cab80 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:05.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.772+0000 7f4d75035640 1 -- 172.21.15.73:0/2664337289 >> 172.21.15.73:0/2664337289 conn(0x7f4d7008bfc0 msgr2=0x7f4d700d0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:05.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.772+0000 7f4d75035640 1 -- 172.21.15.73:0/2664337289 shutdown_connections 2024-03-29T04:10:05.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.772+0000 7f4d75035640 1 -- 172.21.15.73:0/2664337289 wait complete. 2024-03-29T04:10:05.764 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-29T04:10:05.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.933+0000 7f823b4e4640 1 Processor -- start 2024-03-29T04:10:05.912 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.933+0000 7f823b4e4640 1 -- start start 2024-03-29T04:10:05.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.934+0000 7f823b4e4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f82340d1640 0x7f82340d32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:05.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.934+0000 7f823b4e4640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f82340cfeb0 0x7f82340d02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:05.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.934+0000 7f823b4e4640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82340d2290 con 0x7f823415e8a0 2024-03-29T04:10:05.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.934+0000 7f823b4e4640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f823415ec80 con 0x7f82340cfeb0 2024-03-29T04:10:05.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.934+0000 7f823b4e4640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f82340d3830 con 0x7f82340d1640 2024-03-29T04:10:05.913 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.934+0000 7f8239a81640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f82340cfeb0 0x7f82340d02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:05.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.934+0000 7f8239a81640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f82340cfeb0 0x7f82340d02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51862/0 (socket says 172.21.15.73:51862) 2024-03-29T04:10:05.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.934+0000 7f8239a81640 1 -- 172.21.15.73:0/3073653417 learned_addr learned my addr 172.21.15.73:0/3073653417 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:05.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.934+0000 7f8239a81640 1 -- 172.21.15.73:0/3073653417 >> v2:172.21.15.142:3300/0 conn(0x7f82340d1640 msgr2=0x7f82340d32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:05.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.934+0000 7f8239a81640 1 --2- 172.21.15.73:0/3073653417 >> v2:172.21.15.142:3300/0 conn(0x7f82340d1640 0x7f82340d32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:05.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.934+0000 7f8239a81640 1 -- 172.21.15.73:0/3073653417 >> v1:172.21.15.142:6789/0 conn(0x7f823415e8a0 legacy=0x7f82340d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:05.914 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.934+0000 7f8239a81640 1 -- 172.21.15.73:0/3073653417 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82340d2530 con 0x7f82340cfeb0 2024-03-29T04:10:05.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.935+0000 7f8239a81640 1 --2- 172.21.15.73:0/3073653417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82340cfeb0 0x7f82340d02c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f823406c140 tx=0x7f822c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c78defa9d0ae60ad server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:05.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.935+0000 7f822bfff640 1 -- 172.21.15.73:0/3073653417 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f822c0317c0 con 0x7f82340cfeb0 2024-03-29T04:10:05.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.935+0000 7f822bfff640 1 -- 172.21.15.73:0/3073653417 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f822c037070 con 0x7f82340cfeb0 2024-03-29T04:10:05.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.935+0000 7f822bfff640 1 -- 172.21.15.73:0/3073653417 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f822c031b80 con 0x7f82340cfeb0 2024-03-29T04:10:05.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.935+0000 7f823b4e4640 1 -- 172.21.15.73:0/3073653417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82340cfeb0 msgr2=0x7f82340d02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:05.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.935+0000 7f823b4e4640 1 --2- 172.21.15.73:0/3073653417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82340cfeb0 0x7f82340d02c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f823406c140 tx=0x7f822c02b860 comp rx=0 tx=0).stop 2024-03-29T04:10:05.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.935+0000 7f823b4e4640 1 -- 172.21.15.73:0/3073653417 shutdown_connections 2024-03-29T04:10:05.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.935+0000 7f823b4e4640 1 --2- 172.21.15.73:0/3073653417 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82340cfeb0 0x7f82340d02c0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:05.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.935+0000 7f823b4e4640 1 --2- 172.21.15.73:0/3073653417 >> v2:172.21.15.142:3300/0 conn(0x7f82340d1640 0x7f82340d32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:05.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.935+0000 7f823b4e4640 1 -- 172.21.15.73:0/3073653417 >> 172.21.15.73:0/3073653417 conn(0x7f823408bfc0 msgr2=0x7f82340d4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:05.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.935+0000 7f823b4e4640 1 -- 172.21.15.73:0/3073653417 shutdown_connections 2024-03-29T04:10:05.916 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.936+0000 7f823b4e4640 1 -- 172.21.15.73:0/3073653417 wait complete. 2024-03-29T04:10:05.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.937+0000 7f823b4e4640 1 Processor -- start 2024-03-29T04:10:05.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.937+0000 7f823b4e4640 1 -- start start 2024-03-29T04:10:05.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.937+0000 7f823b4e4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82340cfeb0 0x7f82341617b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:05.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.937+0000 7f823b4e4640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82340d1640 0x7f82340cca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:05.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.937+0000 7f823b4e4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f823415e8a0 0x7f82341f7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:05.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.937+0000 7f823b4e4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f82340d2dd0 con 0x7f823415e8a0 2024-03-29T04:10:05.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.937+0000 7f823b4e4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f82340d2af0 con 0x7f82340cfeb0 2024-03-29T04:10:05.918 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.937+0000 7f823b4e4640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f82340d0800 con 0x7f82340d1640 2024-03-29T04:10:05.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.937+0000 7f8239a81640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f823415e8a0 0x7f82341f7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:05.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.937+0000 7f8239a81640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f823415e8a0 0x7f82341f7ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51872/0 (socket says 172.21.15.73:51872) 2024-03-29T04:10:05.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.937+0000 7f8239a81640 1 -- 172.21.15.73:0/2483546115 learned_addr learned my addr 172.21.15.73:0/2483546115 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:05.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.938+0000 7f8239280640 1 --2- 172.21.15.73:0/2483546115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82340cfeb0 0x7f82341617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:05.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.938+0000 7f8238a7f640 1 --2- 172.21.15.73:0/2483546115 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82340d1640 0x7f82340cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:05.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.938+0000 7f8239a81640 1 -- 172.21.15.73:0/2483546115 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82340d1640 msgr2=0x7f82340cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:05.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.938+0000 7f8239a81640 1 --2- 172.21.15.73:0/2483546115 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82340d1640 0x7f82340cca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:05.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.938+0000 7f8239a81640 1 -- 172.21.15.73:0/2483546115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82340cfeb0 msgr2=0x7f82341617b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:05.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.938+0000 7f8239a81640 1 --2- 172.21.15.73:0/2483546115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82340cfeb0 0x7f82341617b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:05.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.938+0000 7f8239a81640 1 -- 172.21.15.73:0/2483546115 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8234160780 con 0x7f823415e8a0 2024-03-29T04:10:05.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.938+0000 7f8239a81640 1 --2- 172.21.15.73:0/2483546115 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f823415e8a0 0x7f82341f7ab0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f822c02b8a0 tx=0x7f822c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:05.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.938+0000 7f8229ffb640 1 -- 172.21.15.73:0/2483546115 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f822c032660 con 0x7f823415e8a0 2024-03-29T04:10:05.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.938+0000 7f8229ffb640 1 -- 172.21.15.73:0/2483546115 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f822c032820 con 0x7f823415e8a0 2024-03-29T04:10:05.919 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.938+0000 7f823b4e4640 1 -- 172.21.15.73:0/2483546115 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82341609f0 con 0x7f823415e8a0 2024-03-29T04:10:05.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.938+0000 7f8229ffb640 1 -- 172.21.15.73:0/2483546115 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f822c032c10 con 0x7f823415e8a0 2024-03-29T04:10:05.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.938+0000 7f823b4e4640 1 -- 172.21.15.73:0/2483546115 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8234160fb0 con 0x7f823415e8a0 2024-03-29T04:10:05.920 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.939+0000 7f823b4e4640 1 -- 172.21.15.73:0/2483546115 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82340cfbf0 con 0x7f823415e8a0 2024-03-29T04:10:05.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.940+0000 7f8229ffb640 1 -- 172.21.15.73:0/2483546115 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f822c04c060 con 0x7f823415e8a0 2024-03-29T04:10:05.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.940+0000 7f8229ffb640 1 --2- 172.21.15.73:0/2483546115 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f821806c530 0x7f821806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:05.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.940+0000 7f8229ffb640 1 -- 172.21.15.73:0/2483546115 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f822c0ad010 con 0x7f823415e8a0 2024-03-29T04:10:05.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.940+0000 7f8239280640 1 --2- 172.21.15.73:0/2483546115 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f821806c530 0x7f821806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:05.921 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.941+0000 7f8239280640 1 --2- 172.21.15.73:0/2483546115 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f821806c530 0x7f821806e9f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8230009f60 tx=0x7f82300094f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:05.923 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:05.944+0000 7f8229ffb640 1 -- 172.21.15.73:0/2483546115 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f82340cfbf0 con 0x7f823415e8a0 2024-03-29T04:10:06.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.120+0000 7f823b4e4640 1 -- 172.21.15.73:0/2483546115 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8234068640 con 0x7f823415e8a0 2024-03-29T04:10:06.283 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-29T04:10:06.285 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-29T04:10:06.841 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.861+0000 7f8229ffb640 1 -- 172.21.15.73:0/2483546115 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v34) ==== 181+0+0 (secure 0 0 0) 0x7f822c040070 con 0x7f823415e8a0 2024-03-29T04:10:06.841 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' removed 2024-03-29T04:10:06.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.863+0000 7f823b4e4640 1 -- 172.21.15.73:0/2483546115 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f821806c530 msgr2=0x7f821806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:06.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.863+0000 7f823b4e4640 1 --2- 172.21.15.73:0/2483546115 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f821806c530 0x7f821806e9f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8230009f60 tx=0x7f82300094f0 comp rx=0 tx=0).stop 2024-03-29T04:10:06.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.863+0000 7f823b4e4640 1 -- 172.21.15.73:0/2483546115 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f823415e8a0 msgr2=0x7f82341f7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:06.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.863+0000 7f823b4e4640 1 --2- 172.21.15.73:0/2483546115 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f823415e8a0 0x7f82341f7ab0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f822c02b8a0 tx=0x7f822c0046c0 comp rx=0 tx=0).stop 2024-03-29T04:10:06.843 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.864+0000 7f823b4e4640 1 -- 172.21.15.73:0/2483546115 shutdown_connections 2024-03-29T04:10:06.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.864+0000 7f823b4e4640 1 --2- 172.21.15.73:0/2483546115 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f823415e8a0 0x7f82341f7ab0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:06.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.864+0000 7f823b4e4640 1 --2- 172.21.15.73:0/2483546115 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f82340d1640 0x7f82340cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:06.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.864+0000 7f823b4e4640 1 --2- 172.21.15.73:0/2483546115 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f821806c530 0x7f821806e9f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:06.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.864+0000 7f823b4e4640 1 --2- 172.21.15.73:0/2483546115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82340cfeb0 0x7f82341617b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:06.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.864+0000 7f823b4e4640 1 -- 172.21.15.73:0/2483546115 >> 172.21.15.73:0/2483546115 conn(0x7f823408bfc0 msgr2=0x7f82340b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:06.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.864+0000 7f823b4e4640 1 -- 172.21.15.73:0/2483546115 shutdown_connections 2024-03-29T04:10:06.844 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.864+0000 7f823b4e4640 1 -- 172.21.15.73:0/2483546115 wait complete. 2024-03-29T04:10:06.857 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-29T04:10:06.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.985+0000 7f8e2ac4e640 1 Processor -- start 2024-03-29T04:10:06.964 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.985+0000 7f8e2ac4e640 1 -- start start 2024-03-29T04:10:06.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.985+0000 7f8e2ac4e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8e240b4cf0 0x7f8e2415c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:06.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.985+0000 7f8e2ac4e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e2415bad0 con 0x7f8e240d0490 2024-03-29T04:10:06.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.985+0000 7f8e2ac4e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e2415f7e0 con 0x7f8e2415b350 2024-03-29T04:10:06.965 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.985+0000 7f8e2ac4e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f8e2415bdd0 con 0x7f8e240b4cf0 2024-03-29T04:10:06.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.986+0000 7f8e23fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8e240b4cf0 0x7f8e2415c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:06.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.986+0000 7f8e291eb640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8e240d0490 0x7f8e240b31c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:52586/0 (socket says 172.21.15.73:52586) 2024-03-29T04:10:06.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.986+0000 7f8e291eb640 1 -- 172.21.15.73:0/956748265 learned_addr learned my addr 172.21.15.73:0/956748265 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:10:06.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.986+0000 7f8e23fff640 1 -- 172.21.15.73:0/956748265 >> v1:172.21.15.142:6789/0 conn(0x7f8e2415b350 legacy=0x7f8e2415efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:06.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.986+0000 7f8e23fff640 1 -- 172.21.15.73:0/956748265 >> v1:172.21.15.73:6789/0 conn(0x7f8e240d0490 legacy=0x7f8e240b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:06.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.986+0000 7f8e23fff640 1 -- 172.21.15.73:0/956748265 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e2415fac0 con 0x7f8e240b4cf0 2024-03-29T04:10:06.966 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.986+0000 7f8e237fe640 1 -- 172.21.15.73:0/956748265 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2052995149 0 0) 0x7f8e2415bad0 con 0x7f8e240d0490 2024-03-29T04:10:06.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.987+0000 7f8e23fff640 1 --2- 172.21.15.73:0/956748265 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e240b4cf0 0x7f8e2415c260 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8e100097a0 tx=0x7f8e1002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84251c2ab02636e0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:06.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.987+0000 7f8e237fe640 1 -- 172.21.15.73:0/956748265 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e10035020 con 0x7f8e240b4cf0 2024-03-29T04:10:06.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.987+0000 7f8e237fe640 1 -- 172.21.15.73:0/956748265 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e10031830 con 0x7f8e240b4cf0 2024-03-29T04:10:06.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.987+0000 7f8e237fe640 1 -- 172.21.15.73:0/956748265 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e10031c00 con 0x7f8e240b4cf0 2024-03-29T04:10:06.967 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.987+0000 7f8e2ac4e640 1 -- 172.21.15.73:0/956748265 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e240b4cf0 msgr2=0x7f8e2415c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:06.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.987+0000 7f8e2ac4e640 1 --2- 172.21.15.73:0/956748265 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e240b4cf0 0x7f8e2415c260 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8e100097a0 tx=0x7f8e1002b8d0 comp rx=0 tx=0).stop 2024-03-29T04:10:06.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.987+0000 7f8e2ac4e640 1 -- 172.21.15.73:0/956748265 shutdown_connections 2024-03-29T04:10:06.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.987+0000 7f8e2ac4e640 1 --2- 172.21.15.73:0/956748265 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e240b4cf0 0x7f8e2415c260 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:06.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.987+0000 7f8e2ac4e640 1 -- 172.21.15.73:0/956748265 >> 172.21.15.73:0/956748265 conn(0x7f8e2406b6f0 msgr2=0x7f8e2406bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:06.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.987+0000 7f8e2ac4e640 1 -- 172.21.15.73:0/956748265 shutdown_connections 2024-03-29T04:10:06.968 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.987+0000 7f8e2ac4e640 1 -- 172.21.15.73:0/956748265 wait complete. 2024-03-29T04:10:06.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.989+0000 7f8e2ac4e640 1 Processor -- start 2024-03-29T04:10:06.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.989+0000 7f8e2ac4e640 1 -- start start 2024-03-29T04:10:06.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.989+0000 7f8e2ac4e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e240b4cf0 0x7f8e240cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:06.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.989+0000 7f8e2ac4e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e240d0490 0x7f8e24153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:06.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.989+0000 7f8e2ac4e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e2415b350 0x7f8e2406de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:06.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.989+0000 7f8e2ac4e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8e2415b8b0 con 0x7f8e240b4cf0 2024-03-29T04:10:06.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.989+0000 7f8e2ac4e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8e2415b730 con 0x7f8e240d0490 2024-03-29T04:10:06.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.989+0000 7f8e2ac4e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f8e2415c7a0 con 0x7f8e2415b350 2024-03-29T04:10:06.970 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.990+0000 7f8e289ea640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e240b4cf0 0x7f8e240cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:06.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.990+0000 7f8e289ea640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e240b4cf0 0x7f8e240cc7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:51886/0 (socket says 172.21.15.73:51886) 2024-03-29T04:10:06.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.990+0000 7f8e289ea640 1 -- 172.21.15.73:0/980089046 learned_addr learned my addr 172.21.15.73:0/980089046 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:06.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.990+0000 7f8e291eb640 1 --2- 172.21.15.73:0/980089046 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e2415b350 0x7f8e2406de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:06.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.990+0000 7f8e23fff640 1 --2- 172.21.15.73:0/980089046 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e240d0490 0x7f8e24153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:06.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.990+0000 7f8e289ea640 1 -- 172.21.15.73:0/980089046 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e2415b350 msgr2=0x7f8e2406de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:06.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.990+0000 7f8e289ea640 1 --2- 172.21.15.73:0/980089046 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e2415b350 0x7f8e2406de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:06.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.990+0000 7f8e289ea640 1 -- 172.21.15.73:0/980089046 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e240d0490 msgr2=0x7f8e24153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:06.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.990+0000 7f8e289ea640 1 --2- 172.21.15.73:0/980089046 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e240d0490 0x7f8e24153f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:06.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.990+0000 7f8e289ea640 1 -- 172.21.15.73:0/980089046 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e240cd0f0 con 0x7f8e240b4cf0 2024-03-29T04:10:06.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.990+0000 7f8e291eb640 1 --2- 172.21.15.73:0/980089046 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e2415b350 0x7f8e2406de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:10:06.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.990+0000 7f8e23fff640 1 --2- 172.21.15.73:0/980089046 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e240d0490 0x7f8e24153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:10:06.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.990+0000 7f8e289ea640 1 --2- 172.21.15.73:0/980089046 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e240b4cf0 0x7f8e240cc7c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800c430 tx=0x7f8e1800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:06.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.990+0000 7f8e217fa640 1 -- 172.21.15.73:0/980089046 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e18011790 con 0x7f8e240b4cf0 2024-03-29T04:10:06.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.990+0000 7f8e217fa640 1 -- 172.21.15.73:0/980089046 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e18017070 con 0x7f8e240b4cf0 2024-03-29T04:10:06.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.990+0000 7f8e2ac4e640 1 -- 172.21.15.73:0/980089046 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e240cd6b0 con 0x7f8e240b4cf0 2024-03-29T04:10:06.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.990+0000 7f8e217fa640 1 -- 172.21.15.73:0/980089046 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e18011bb0 con 0x7f8e240b4cf0 2024-03-29T04:10:06.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.990+0000 7f8e2ac4e640 1 -- 172.21.15.73:0/980089046 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e240cdc70 con 0x7f8e240b4cf0 2024-03-29T04:10:06.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.991+0000 7f8e2ac4e640 1 -- 172.21.15.73:0/980089046 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e24068640 con 0x7f8e240b4cf0 2024-03-29T04:10:06.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.992+0000 7f8e217fa640 1 -- 172.21.15.73:0/980089046 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f8e1801c460 con 0x7f8e240b4cf0 2024-03-29T04:10:06.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.992+0000 7f8e217fa640 1 --2- 172.21.15.73:0/980089046 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f8e0806c530 0x7f8e0806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:06.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.992+0000 7f8e23fff640 1 --2- 172.21.15.73:0/980089046 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f8e0806c530 0x7f8e0806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:06.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.992+0000 7f8e217fa640 1 -- 172.21.15.73:0/980089046 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5357+0+0 (secure 0 0 0) 0x7f8e1808b3f0 con 0x7f8e240b4cf0 2024-03-29T04:10:06.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.993+0000 7f8e23fff640 1 --2- 172.21.15.73:0/980089046 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f8e0806c530 0x7f8e0806e9f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8e10036000 tx=0x7f8e1003c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:06.978 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:06.997+0000 7f8e217fa640 1 -- 172.21.15.73:0/980089046 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f8e18059c00 con 0x7f8e240b4cf0 2024-03-29T04:10:07.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.172+0000 7f8e2ac4e640 1 -- 172.21.15.73:0/980089046 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8e2406f750 con 0x7f8e240b4cf0 2024-03-29T04:10:07.848 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.869+0000 7f8e217fa640 1 -- 172.21.15.73:0/980089046 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v35) ==== 169+0+0 (secure 0 0 0) 0x7f8e18059500 con 0x7f8e240b4cf0 2024-03-29T04:10:07.848 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' removed 2024-03-29T04:10:07.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.872+0000 7f8e2ac4e640 1 -- 172.21.15.73:0/980089046 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f8e0806c530 msgr2=0x7f8e0806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:07.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.872+0000 7f8e2ac4e640 1 --2- 172.21.15.73:0/980089046 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f8e0806c530 0x7f8e0806e9f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8e10036000 tx=0x7f8e1003c040 comp rx=0 tx=0).stop 2024-03-29T04:10:07.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.873+0000 7f8e2ac4e640 1 -- 172.21.15.73:0/980089046 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e240b4cf0 msgr2=0x7f8e240cc7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:07.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.873+0000 7f8e2ac4e640 1 --2- 172.21.15.73:0/980089046 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e240b4cf0 0x7f8e240cc7c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800c430 tx=0x7f8e1800c8f0 comp rx=0 tx=0).stop 2024-03-29T04:10:07.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.873+0000 7f8e2ac4e640 1 -- 172.21.15.73:0/980089046 shutdown_connections 2024-03-29T04:10:07.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.873+0000 7f8e2ac4e640 1 --2- 172.21.15.73:0/980089046 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f8e2415b350 0x7f8e2406de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:07.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.873+0000 7f8e2ac4e640 1 --2- 172.21.15.73:0/980089046 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f8e0806c530 0x7f8e0806e9f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:07.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.873+0000 7f8e2ac4e640 1 --2- 172.21.15.73:0/980089046 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e240d0490 0x7f8e24153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:07.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.873+0000 7f8e2ac4e640 1 --2- 172.21.15.73:0/980089046 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e240b4cf0 0x7f8e240cc7c0 secure :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800c430 tx=0x7f8e1800c8f0 comp rx=0 tx=0).stop 2024-03-29T04:10:07.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.873+0000 7f8e2ac4e640 1 -- 172.21.15.73:0/980089046 >> 172.21.15.73:0/980089046 conn(0x7f8e2406b6f0 msgr2=0x7f8e240aeb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:07.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.873+0000 7f8e2ac4e640 1 -- 172.21.15.73:0/980089046 shutdown_connections 2024-03-29T04:10:07.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.874+0000 7f8e2ac4e640 1 -- 172.21.15.73:0/980089046 wait complete. 2024-03-29T04:10:07.867 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-03-29T04:10:07.973 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.994+0000 7f0f6c11c640 1 Processor -- start 2024-03-29T04:10:07.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.994+0000 7f0f6c11c640 1 -- start start 2024-03-29T04:10:07.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.995+0000 7f0f6c11c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f6415aaa0 0x7f0f640ad660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:07.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.995+0000 7f0f6c11c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0f6415f3e0 0x7f0f640b4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:07.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.995+0000 7f0f6c11c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f6406d920 con 0x7f0f640d0410 2024-03-29T04:10:07.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.995+0000 7f0f6c11c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f0f640b4ef0 con 0x7f0f6415f3e0 2024-03-29T04:10:07.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.995+0000 7f0f6c11c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f0f6406dbc0 con 0x7f0f6415aaa0 2024-03-29T04:10:07.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.995+0000 7f0f696b7640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0f6415f3e0 0x7f0f640b4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:07.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.995+0000 7f0f696b7640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0f6415f3e0 0x7f0f640b4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35436/0 (socket says 172.21.15.73:35436) 2024-03-29T04:10:07.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.995+0000 7f0f696b7640 1 -- 172.21.15.73:0/2811606867 learned_addr learned my addr 172.21.15.73:0/2811606867 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:07.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.995+0000 7f0f696b7640 1 -- 172.21.15.73:0/2811606867 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f6415aaa0 msgr2=0x7f0f640ad660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:07.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.995+0000 7f0f696b7640 1 --2- 172.21.15.73:0/2811606867 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f6415aaa0 0x7f0f640ad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:07.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.995+0000 7f0f696b7640 1 -- 172.21.15.73:0/2811606867 >> v1:172.21.15.142:6789/0 conn(0x7f0f640d0410 legacy=0x7f0f6415e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:07.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.995+0000 7f0f696b7640 1 -- 172.21.15.73:0/2811606867 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f6406dea0 con 0x7f0f6415f3e0 2024-03-29T04:10:07.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.996+0000 7f0f696b7640 1 --2- 172.21.15.73:0/2811606867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f6415f3e0 0x7f0f640b4550 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0f54009870 tx=0x7f0f5402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea3a30ee7bdff2d6 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:07.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.996+0000 7f0f68eb6640 1 -- 172.21.15.73:0/2811606867 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f54035020 con 0x7f0f6415f3e0 2024-03-29T04:10:07.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.996+0000 7f0f68eb6640 1 -- 172.21.15.73:0/2811606867 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f54031640 con 0x7f0f6415f3e0 2024-03-29T04:10:07.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.996+0000 7f0f68eb6640 1 -- 172.21.15.73:0/2811606867 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5402d040 con 0x7f0f6415f3e0 2024-03-29T04:10:07.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.997+0000 7f0f6c11c640 1 -- 172.21.15.73:0/2811606867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f6415f3e0 msgr2=0x7f0f640b4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:07.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.997+0000 7f0f6c11c640 1 --2- 172.21.15.73:0/2811606867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f6415f3e0 0x7f0f640b4550 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0f54009870 tx=0x7f0f5402b8f0 comp rx=0 tx=0).stop 2024-03-29T04:10:07.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.997+0000 7f0f6c11c640 1 -- 172.21.15.73:0/2811606867 shutdown_connections 2024-03-29T04:10:07.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.997+0000 7f0f6c11c640 1 --2- 172.21.15.73:0/2811606867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f6415f3e0 0x7f0f640b4550 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:07.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.997+0000 7f0f6c11c640 1 --2- 172.21.15.73:0/2811606867 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f6415aaa0 0x7f0f640ad660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:07.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.997+0000 7f0f6c11c640 1 -- 172.21.15.73:0/2811606867 >> 172.21.15.73:0/2811606867 conn(0x7f0f6406b6f0 msgr2=0x7f0f6406bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:07.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.997+0000 7f0f6c11c640 1 -- 172.21.15.73:0/2811606867 shutdown_connections 2024-03-29T04:10:07.977 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.997+0000 7f0f6c11c640 1 -- 172.21.15.73:0/2811606867 wait complete. 2024-03-29T04:10:07.979 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.998+0000 7f0f6c11c640 1 Processor -- start 2024-03-29T04:10:07.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.998+0000 7f0f6c11c640 1 -- start start 2024-03-29T04:10:07.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.999+0000 7f0f6c11c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f640d0410 0x7f0f64098fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:07.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.999+0000 7f0f6c11c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f6415aaa0 0x7f0f6415b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:07.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.999+0000 7f0f6c11c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f6415f3e0 0x7f0f6415ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:07.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.999+0000 7f0f6c11c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6415b000 con 0x7f0f640d0410 2024-03-29T04:10:07.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.999+0000 7f0f6c11c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6415ae80 con 0x7f0f6415f3e0 2024-03-29T04:10:07.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.999+0000 7f0f6c11c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f0f640b4a90 con 0x7f0f6415aaa0 2024-03-29T04:10:07.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.999+0000 7f0f69eb8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f640d0410 0x7f0f64098fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:07.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.999+0000 7f0f69eb8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f640d0410 0x7f0f64098fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35452/0 (socket says 172.21.15.73:35452) 2024-03-29T04:10:07.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.999+0000 7f0f69eb8640 1 -- 172.21.15.73:0/769844908 learned_addr learned my addr 172.21.15.73:0/769844908 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:07.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.999+0000 7f0f696b7640 1 --2- 172.21.15.73:0/769844908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f6415aaa0 0x7f0f6415b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:07.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.999+0000 7f0f6a6b9640 1 --2- 172.21.15.73:0/769844908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f6415f3e0 0x7f0f6415ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:07.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.999+0000 7f0f69eb8640 1 -- 172.21.15.73:0/769844908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f6415aaa0 msgr2=0x7f0f6415b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:07.980 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.999+0000 7f0f69eb8640 1 --2- 172.21.15.73:0/769844908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f6415aaa0 0x7f0f6415b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:07.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.999+0000 7f0f69eb8640 1 -- 172.21.15.73:0/769844908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f6415f3e0 msgr2=0x7f0f6415ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:07.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.999+0000 7f0f69eb8640 1 --2- 172.21.15.73:0/769844908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f6415f3e0 0x7f0f6415ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:07.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:07.999+0000 7f0f69eb8640 1 -- 172.21.15.73:0/769844908 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f6415e3d0 con 0x7f0f640d0410 2024-03-29T04:10:07.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.000+0000 7f0f69eb8640 1 --2- 172.21.15.73:0/769844908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f640d0410 0x7f0f64098fc0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f0f6000b4a0 tx=0x7f0f6000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:07.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.000+0000 7f0f5a7fc640 1 -- 172.21.15.73:0/769844908 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f60014070 con 0x7f0f640d0410 2024-03-29T04:10:07.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.000+0000 7f0f5a7fc640 1 -- 172.21.15.73:0/769844908 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f60010610 con 0x7f0f640d0410 2024-03-29T04:10:07.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.000+0000 7f0f6c11c640 1 -- 172.21.15.73:0/769844908 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f6415db30 con 0x7f0f640d0410 2024-03-29T04:10:07.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.000+0000 7f0f5a7fc640 1 -- 172.21.15.73:0/769844908 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f60010a00 con 0x7f0f640d0410 2024-03-29T04:10:07.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.000+0000 7f0f6c11c640 1 -- 172.21.15.73:0/769844908 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f6415e0f0 con 0x7f0f640d0410 2024-03-29T04:10:07.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.001+0000 7f0f6c11c640 1 -- 172.21.15.73:0/769844908 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f640cd0c0 con 0x7f0f640d0410 2024-03-29T04:10:07.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.001+0000 7f0f5a7fc640 1 -- 172.21.15.73:0/769844908 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f0f60017070 con 0x7f0f640d0410 2024-03-29T04:10:07.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.002+0000 7f0f5a7fc640 1 --2- 172.21.15.73:0/769844908 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f0f4806c560 0x7f0f4806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:07.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.002+0000 7f0f696b7640 1 --2- 172.21.15.73:0/769844908 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f0f4806c560 0x7f0f4806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:07.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.002+0000 7f0f5a7fc640 1 -- 172.21.15.73:0/769844908 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f0f6008adb0 con 0x7f0f640d0410 2024-03-29T04:10:07.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.002+0000 7f0f696b7640 1 --2- 172.21.15.73:0/769844908 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f0f4806c560 0x7f0f4806ea20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0f54036000 tx=0x7f0f5403c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:07.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.006+0000 7f0f5a7fc640 1 -- 172.21.15.73:0/769844908 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f0f60059760 con 0x7f0f640d0410 2024-03-29T04:10:08.160 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.181+0000 7f0f6c11c640 1 -- 172.21.15.73:0/769844908 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f0f6409e520 con 0x7f0f640d0410 2024-03-29T04:10:08.163 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.184+0000 7f0f5a7fc640 1 -- 172.21.15.73:0/769844908 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f0f60059060 con 0x7f0f640d0410 2024-03-29T04:10:08.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.186+0000 7f0f6c11c640 1 -- 172.21.15.73:0/769844908 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f0f4806c560 msgr2=0x7f0f4806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:08.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.186+0000 7f0f6c11c640 1 --2- 172.21.15.73:0/769844908 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f0f4806c560 0x7f0f4806ea20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0f54036000 tx=0x7f0f5403c040 comp rx=0 tx=0).stop 2024-03-29T04:10:08.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.186+0000 7f0f6c11c640 1 -- 172.21.15.73:0/769844908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f640d0410 msgr2=0x7f0f64098fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:08.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.186+0000 7f0f6c11c640 1 --2- 172.21.15.73:0/769844908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f640d0410 0x7f0f64098fc0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f0f6000b4a0 tx=0x7f0f6000b960 comp rx=0 tx=0).stop 2024-03-29T04:10:08.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.186+0000 7f0f6c11c640 1 -- 172.21.15.73:0/769844908 shutdown_connections 2024-03-29T04:10:08.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.186+0000 7f0f6c11c640 1 --2- 172.21.15.73:0/769844908 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f0f4806c560 0x7f0f4806ea20 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:08.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.186+0000 7f0f6c11c640 1 --2- 172.21.15.73:0/769844908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0f6415f3e0 0x7f0f6415ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:08.166 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.186+0000 7f0f6c11c640 1 --2- 172.21.15.73:0/769844908 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f0f6415aaa0 0x7f0f6415b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:08.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.186+0000 7f0f6c11c640 1 --2- 172.21.15.73:0/769844908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f640d0410 0x7f0f64098fc0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:08.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.186+0000 7f0f6c11c640 1 -- 172.21.15.73:0/769844908 >> 172.21.15.73:0/769844908 conn(0x7f0f6406b6f0 msgr2=0x7f0f64156e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:08.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.186+0000 7f0f6c11c640 1 -- 172.21.15.73:0/769844908 shutdown_connections 2024-03-29T04:10:08.167 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.186+0000 7f0f6c11c640 1 -- 172.21.15.73:0/769844908 wait complete. 2024-03-29T04:10:08.176 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_uninlining.TestDataUninlining.test_data_uninlining' 2024-03-29T04:10:08.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.297+0000 7f2046f0e640 1 Processor -- start 2024-03-29T04:10:08.277 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.297+0000 7f2046f0e640 1 -- start start 2024-03-29T04:10:08.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.298+0000 7f2046f0e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f204006f060 0x7f204006c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:08.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.298+0000 7f2046f0e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2040146230 con 0x7f20400ad940 2024-03-29T04:10:08.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.298+0000 7f2046f0e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f204006dfc0 con 0x7f204015c670 2024-03-29T04:10:08.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.298+0000 7f2046f0e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f204006e2a0 con 0x7f204006f060 2024-03-29T04:10:08.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.298+0000 7f20454ab640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f204006f060 0x7f204006c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:08.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.298+0000 7f203ffff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f20400ad940 0x7f20400b32c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51652/0 (socket says 172.21.15.73:51652) 2024-03-29T04:10:08.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.298+0000 7f20454ab640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f204006f060 0x7f204006c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35464/0 (socket says 172.21.15.73:35464) 2024-03-29T04:10:08.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.298+0000 7f203ffff640 1 -- 172.21.15.73:0/2490012732 learned_addr learned my addr 172.21.15.73:0/2490012732 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:10:08.278 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.298+0000 7f20454ab640 1 -- 172.21.15.73:0/2490012732 >> v1:172.21.15.142:6789/0 conn(0x7f204015c670 legacy=0x7f20400ad230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:08.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.299+0000 7f20454ab640 1 -- 172.21.15.73:0/2490012732 >> v1:172.21.15.73:6789/0 conn(0x7f20400ad940 legacy=0x7f20400b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:08.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.299+0000 7f203f7fe640 1 -- 172.21.15.73:0/2490012732 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 428978948 0 0) 0x7f2034001110 con 0x7f20400ad940 2024-03-29T04:10:08.279 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.299+0000 7f20454ab640 1 -- 172.21.15.73:0/2490012732 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f204006e580 con 0x7f204006f060 2024-03-29T04:10:08.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.299+0000 7f20454ab640 1 --2- 172.21.15.73:0/2490012732 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f204006f060 0x7f204006c030 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2038009d90 tx=0x7f203802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb25e4a87d33559 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:08.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.299+0000 7f203f7fe640 1 -- 172.21.15.73:0/2490012732 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2038039070 con 0x7f204006f060 2024-03-29T04:10:08.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.299+0000 7f203f7fe640 1 -- 172.21.15.73:0/2490012732 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f203802cbd0 con 0x7f204006f060 2024-03-29T04:10:08.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.299+0000 7f203f7fe640 1 -- 172.21.15.73:0/2490012732 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2038034440 con 0x7f204006f060 2024-03-29T04:10:08.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.300+0000 7f2046f0e640 1 -- 172.21.15.73:0/2490012732 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f204006f060 msgr2=0x7f204006c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:08.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.300+0000 7f2046f0e640 1 --2- 172.21.15.73:0/2490012732 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f204006f060 0x7f204006c030 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2038009d90 tx=0x7f203802be20 comp rx=0 tx=0).stop 2024-03-29T04:10:08.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.300+0000 7f2046f0e640 1 -- 172.21.15.73:0/2490012732 shutdown_connections 2024-03-29T04:10:08.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.300+0000 7f2046f0e640 1 --2- 172.21.15.73:0/2490012732 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f204006f060 0x7f204006c030 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:08.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.300+0000 7f2046f0e640 1 -- 172.21.15.73:0/2490012732 >> 172.21.15.73:0/2490012732 conn(0x7f204006b510 msgr2=0x7f204006b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:08.280 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.300+0000 7f2046f0e640 1 -- 172.21.15.73:0/2490012732 shutdown_connections 2024-03-29T04:10:08.281 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.300+0000 7f2046f0e640 1 -- 172.21.15.73:0/2490012732 wait complete. 2024-03-29T04:10:08.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.301+0000 7f2046f0e640 1 Processor -- start 2024-03-29T04:10:08.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.301+0000 7f2046f0e640 1 -- start start 2024-03-29T04:10:08.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.302+0000 7f2046f0e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f204006f060 0x7f204015f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:08.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.302+0000 7f2046f0e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20400ad940 0x7f20401440b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:08.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.302+0000 7f2046f0e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f204015c670 0x7f2040099300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:08.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.302+0000 7f2046f0e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f204006d930 con 0x7f204006f060 2024-03-29T04:10:08.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.302+0000 7f2046f0e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f204015ca50 con 0x7f20400ad940 2024-03-29T04:10:08.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.302+0000 7f2046f0e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f204006dab0 con 0x7f204015c670 2024-03-29T04:10:08.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.302+0000 7f2044caa640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f204006f060 0x7f204015f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:08.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.302+0000 7f2044caa640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f204006f060 0x7f204015f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35472/0 (socket says 172.21.15.73:35472) 2024-03-29T04:10:08.283 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.302+0000 7f2044caa640 1 -- 172.21.15.73:0/3457821552 learned_addr learned my addr 172.21.15.73:0/3457821552 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:08.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.302+0000 7f203ffff640 1 --2- 172.21.15.73:0/3457821552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20400ad940 0x7f20401440b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:08.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.302+0000 7f2044caa640 1 -- 172.21.15.73:0/3457821552 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f204015c670 msgr2=0x7f2040099300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:08.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.302+0000 7f2044caa640 1 --2- 172.21.15.73:0/3457821552 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f204015c670 0x7f2040099300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:08.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.302+0000 7f2044caa640 1 -- 172.21.15.73:0/3457821552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20400ad940 msgr2=0x7f20401440b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:08.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.302+0000 7f2044caa640 1 --2- 172.21.15.73:0/3457821552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20400ad940 0x7f20401440b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:08.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.302+0000 7f2044caa640 1 -- 172.21.15.73:0/3457821552 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2040099840 con 0x7f204006f060 2024-03-29T04:10:08.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.302+0000 7f203ffff640 1 --2- 172.21.15.73:0/3457821552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20400ad940 0x7f20401440b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:10:08.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.303+0000 7f2044caa640 1 --2- 172.21.15.73:0/3457821552 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f204006f060 0x7f204015f310 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f203000b410 tx=0x7f203000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:08.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.303+0000 7f203d7fa640 1 -- 172.21.15.73:0/3457821552 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2030015020 con 0x7f204006f060 2024-03-29T04:10:08.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.303+0000 7f203d7fa640 1 -- 172.21.15.73:0/3457821552 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2030011830 con 0x7f204006f060 2024-03-29T04:10:08.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.303+0000 7f2046f0e640 1 -- 172.21.15.73:0/3457821552 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f204015cd20 con 0x7f204006f060 2024-03-29T04:10:08.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.303+0000 7f203d7fa640 1 -- 172.21.15.73:0/3457821552 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2030011c20 con 0x7f204006f060 2024-03-29T04:10:08.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.303+0000 7f2046f0e640 1 -- 172.21.15.73:0/3457821552 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f204015cfc0 con 0x7f204006f060 2024-03-29T04:10:08.284 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.304+0000 7f2046f0e640 1 -- 172.21.15.73:0/3457821552 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2040068640 con 0x7f204006f060 2024-03-29T04:10:08.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.304+0000 7f203d7fa640 1 -- 172.21.15.73:0/3457821552 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f2030018020 con 0x7f204006f060 2024-03-29T04:10:08.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.304+0000 7f203d7fa640 1 --2- 172.21.15.73:0/3457821552 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f202c06c530 0x7f202c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:08.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.305+0000 7f203d7fa640 1 -- 172.21.15.73:0/3457821552 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f203008b340 con 0x7f204006f060 2024-03-29T04:10:08.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.305+0000 7f203ffff640 1 --2- 172.21.15.73:0/3457821552 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f202c06c530 0x7f202c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:08.285 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.305+0000 7f203ffff640 1 --2- 172.21.15.73:0/3457821552 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f202c06c530 0x7f202c06e9f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f20400b0eb0 tx=0x7f2034007a10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:08.288 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.309+0000 7f203d7fa640 1 -- 172.21.15.73:0/3457821552 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f203001f020 con 0x7f204006f060 2024-03-29T04:10:08.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.553+0000 7f2046f0e640 1 -- 172.21.15.73:0/3457821552 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_uninlining.TestDataUninlining.test_data_uninlining"]} v 0) -- 0x7f204015a7a0 con 0x7f204006f060 2024-03-29T04:10:08.849 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.870+0000 7f203d7fa640 1 -- 172.21.15.73:0/3457821552 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_uninlining.TestDataUninlining.test_data_uninlining"]}]=0 v116) ==== 147+0+0 (secure 0 0 0) 0x7f20300172c0 con 0x7f204006f060 2024-03-29T04:10:08.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.872+0000 7f2046f0e640 1 -- 172.21.15.73:0/3457821552 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f202c06c530 msgr2=0x7f202c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:08.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.872+0000 7f2046f0e640 1 --2- 172.21.15.73:0/3457821552 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f202c06c530 0x7f202c06e9f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f20400b0eb0 tx=0x7f2034007a10 comp rx=0 tx=0).stop 2024-03-29T04:10:08.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.872+0000 7f2046f0e640 1 -- 172.21.15.73:0/3457821552 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f204006f060 msgr2=0x7f204015f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:08.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.872+0000 7f2046f0e640 1 --2- 172.21.15.73:0/3457821552 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f204006f060 0x7f204015f310 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f203000b410 tx=0x7f203000b8d0 comp rx=0 tx=0).stop 2024-03-29T04:10:08.852 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.873+0000 7f2046f0e640 1 -- 172.21.15.73:0/3457821552 shutdown_connections 2024-03-29T04:10:08.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.873+0000 7f2046f0e640 1 --2- 172.21.15.73:0/3457821552 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f204015c670 0x7f2040099300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:08.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.873+0000 7f2046f0e640 1 --2- 172.21.15.73:0/3457821552 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f202c06c530 0x7f202c06e9f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:08.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.873+0000 7f2046f0e640 1 --2- 172.21.15.73:0/3457821552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f20400ad940 0x7f20401440b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:08.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.873+0000 7f2046f0e640 1 --2- 172.21.15.73:0/3457821552 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f204006f060 0x7f204015f310 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:08.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.873+0000 7f2046f0e640 1 -- 172.21.15.73:0/3457821552 >> 172.21.15.73:0/3457821552 conn(0x7f204006b510 msgr2=0x7f20400aff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:08.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.873+0000 7f2046f0e640 1 -- 172.21.15.73:0/3457821552 shutdown_connections 2024-03-29T04:10:08.853 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:08.873+0000 7f2046f0e640 1 -- 172.21.15.73:0/3457821552 wait complete. 2024-03-29T04:10:08.866 INFO:tasks.cephfs_test_runner:test_data_uninlining (tasks.cephfs.test_uninlining.TestDataUninlining) ... ERROR 2024-03-29T04:10:08.866 INFO:tasks.cephfs_test_runner: 2024-03-29T04:10:08.866 INFO:tasks.cephfs_test_runner:====================================================================== 2024-03-29T04:10:08.866 INFO:tasks.cephfs_test_runner:ERROR: test_data_uninlining (tasks.cephfs.test_uninlining.TestDataUninlining) 2024-03-29T04:10:08.866 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-29T04:10:08.866 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-03-29T04:10:08.866 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_69e2cd73c52284dfd5096c66b60c6e6b26a3c447/qa/tasks/cephfs/test_uninlining.py", line 322, in test_data_uninlining 2024-03-29T04:10:08.866 INFO:tasks.cephfs_test_runner: self.run_test_worker(opt_clear_cache, 2024-03-29T04:10:08.866 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_69e2cd73c52284dfd5096c66b60c6e6b26a3c447/qa/tasks/cephfs/test_uninlining.py", line 259, in run_test_worker 2024-03-29T04:10:08.866 INFO:tasks.cephfs_test_runner: info = self.get_inline_data_info(inodes, files, dir_pins, num_mds) 2024-03-29T04:10:08.866 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_69e2cd73c52284dfd5096c66b60c6e6b26a3c447/qa/tasks/cephfs/test_uninlining.py", line 116, in get_inline_data_info 2024-03-29T04:10:08.867 INFO:tasks.cephfs_test_runner: json_out = get_inode_dump(inode, 2024-03-29T04:10:08.867 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_69e2cd73c52284dfd5096c66b60c6e6b26a3c447/qa/tasks/cephfs/test_uninlining.py", line 101, in get_inode_dump 2024-03-29T04:10:08.867 INFO:tasks.cephfs_test_runner: json_out = self.fs.rank_tell(['dump', 'inode', inode], rank) 2024-03-29T04:10:08.867 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_69e2cd73c52284dfd5096c66b60c6e6b26a3c447/qa/tasks/cephfs/filesystem.py", line 1332, in rank_tell 2024-03-29T04:10:08.867 INFO:tasks.cephfs_test_runner: return self.mds_tell(*args, mds_id=f"{self.id}:{rank}", **kwargs) 2024-03-29T04:10:08.867 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_69e2cd73c52284dfd5096c66b60c6e6b26a3c447/qa/tasks/cephfs/filesystem.py", line 1319, in mds_tell 2024-03-29T04:10:08.867 INFO:tasks.cephfs_test_runner: out = self.get_ceph_cmd_stdout("tell", f"mds.{mds_id}", *args, **kwargs) 2024-03-29T04:10:08.867 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_69e2cd73c52284dfd5096c66b60c6e6b26a3c447/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-03-29T04:10:08.867 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-03-29T04:10:08.867 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_69e2cd73c52284dfd5096c66b60c6e6b26a3c447/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-03-29T04:10:08.867 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-03-29T04:10:08.867 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_69e2cd73c52284dfd5096c66b60c6e6b26a3c447/qa/tasks/ceph_manager.py", line 1647, in run_cluster_cmd 2024-03-29T04:10:08.867 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-03-29T04:10:08.867 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run 2024-03-29T04:10:08.867 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-03-29T04:10:08.867 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 447, in run 2024-03-29T04:10:08.867 INFO:tasks.cephfs_test_runner: r = RemoteProcess(client, args, check_status=check_status, hostname=name, 2024-03-29T04:10:08.867 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 65, in __init__ 2024-03-29T04:10:08.867 INFO:tasks.cephfs_test_runner: self.command = quote(args) 2024-03-29T04:10:08.868 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 257, in quote 2024-03-29T04:10:08.868 INFO:tasks.cephfs_test_runner: return ' '.join(_quote(args)) 2024-03-29T04:10:08.868 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 255, in _quote 2024-03-29T04:10:08.868 INFO:tasks.cephfs_test_runner: yield pipes.quote(a) 2024-03-29T04:10:08.868 INFO:tasks.cephfs_test_runner: File "/usr/lib/python3.8/shlex.py", line 325, in quote 2024-03-29T04:10:08.868 INFO:tasks.cephfs_test_runner: if _find_unsafe(s) is None: 2024-03-29T04:10:08.868 INFO:tasks.cephfs_test_runner:TypeError: expected string or bytes-like object 2024-03-29T04:10:08.868 INFO:tasks.cephfs_test_runner: 2024-03-29T04:10:08.868 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-29T04:10:08.868 INFO:tasks.cephfs_test_runner:Ran 1 test in 92.704s 2024-03-29T04:10:08.868 INFO:tasks.cephfs_test_runner: 2024-03-29T04:10:08.868 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-03-29T04:10:08.868 INFO:tasks.cephfs_test_runner: 2024-03-29T04:10:08.868 INFO:tasks.cephfs_test_runner:====================================================================== 2024-03-29T04:10:08.868 INFO:tasks.cephfs_test_runner:ERROR: test_data_uninlining (tasks.cephfs.test_uninlining.TestDataUninlining) 2024-03-29T04:10:08.868 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-29T04:10:08.869 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-03-29T04:10:08.869 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_69e2cd73c52284dfd5096c66b60c6e6b26a3c447/qa/tasks/cephfs/test_uninlining.py", line 322, in test_data_uninlining 2024-03-29T04:10:08.869 INFO:tasks.cephfs_test_runner: self.run_test_worker(opt_clear_cache, 2024-03-29T04:10:08.869 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_69e2cd73c52284dfd5096c66b60c6e6b26a3c447/qa/tasks/cephfs/test_uninlining.py", line 259, in run_test_worker 2024-03-29T04:10:08.869 INFO:tasks.cephfs_test_runner: info = self.get_inline_data_info(inodes, files, dir_pins, num_mds) 2024-03-29T04:10:08.869 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_69e2cd73c52284dfd5096c66b60c6e6b26a3c447/qa/tasks/cephfs/test_uninlining.py", line 116, in get_inline_data_info 2024-03-29T04:10:08.869 INFO:tasks.cephfs_test_runner: json_out = get_inode_dump(inode, 2024-03-29T04:10:08.869 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_69e2cd73c52284dfd5096c66b60c6e6b26a3c447/qa/tasks/cephfs/test_uninlining.py", line 101, in get_inode_dump 2024-03-29T04:10:08.869 INFO:tasks.cephfs_test_runner: json_out = self.fs.rank_tell(['dump', 'inode', inode], rank) 2024-03-29T04:10:08.869 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_69e2cd73c52284dfd5096c66b60c6e6b26a3c447/qa/tasks/cephfs/filesystem.py", line 1332, in rank_tell 2024-03-29T04:10:08.869 INFO:tasks.cephfs_test_runner: return self.mds_tell(*args, mds_id=f"{self.id}:{rank}", **kwargs) 2024-03-29T04:10:08.869 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_69e2cd73c52284dfd5096c66b60c6e6b26a3c447/qa/tasks/cephfs/filesystem.py", line 1319, in mds_tell 2024-03-29T04:10:08.869 INFO:tasks.cephfs_test_runner: out = self.get_ceph_cmd_stdout("tell", f"mds.{mds_id}", *args, **kwargs) 2024-03-29T04:10:08.869 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_69e2cd73c52284dfd5096c66b60c6e6b26a3c447/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-03-29T04:10:08.869 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-03-29T04:10:08.869 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_69e2cd73c52284dfd5096c66b60c6e6b26a3c447/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-03-29T04:10:08.869 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-03-29T04:10:08.869 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_69e2cd73c52284dfd5096c66b60c6e6b26a3c447/qa/tasks/ceph_manager.py", line 1647, in run_cluster_cmd 2024-03-29T04:10:08.869 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-03-29T04:10:08.870 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run 2024-03-29T04:10:08.870 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-03-29T04:10:08.870 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 447, in run 2024-03-29T04:10:08.870 INFO:tasks.cephfs_test_runner: r = RemoteProcess(client, args, check_status=check_status, hostname=name, 2024-03-29T04:10:08.870 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 65, in __init__ 2024-03-29T04:10:08.870 INFO:tasks.cephfs_test_runner: self.command = quote(args) 2024-03-29T04:10:08.870 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 257, in quote 2024-03-29T04:10:08.870 INFO:tasks.cephfs_test_runner: return ' '.join(_quote(args)) 2024-03-29T04:10:08.870 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 255, in _quote 2024-03-29T04:10:08.870 INFO:tasks.cephfs_test_runner: yield pipes.quote(a) 2024-03-29T04:10:08.870 INFO:tasks.cephfs_test_runner: File "/usr/lib/python3.8/shlex.py", line 325, in quote 2024-03-29T04:10:08.870 INFO:tasks.cephfs_test_runner: if _find_unsafe(s) is None: 2024-03-29T04:10:08.870 INFO:tasks.cephfs_test_runner:TypeError: expected string or bytes-like object 2024-03-29T04:10:08.870 INFO:tasks.cephfs_test_runner: 2024-03-29T04:10:08.871 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_69e2cd73c52284dfd5096c66b60c6e6b26a3c447/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_data_uninlining (tasks.cephfs.test_uninlining.TestDataUninlining) 2024-03-29T04:10:09.110 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=46644ef669984bdc8000f4aa32244409 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_69e2cd73c52284dfd5096c66b60c6e6b26a3c447/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_data_uninlining (tasks.cephfs.test_uninlining.TestDataUninlining) 2024-03-29T04:10:09.112 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-03-29T04:10:09.121 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-03-29T04:10:09.149 INFO:tasks.kclient:Unmounting kernel clients... 2024-03-29T04:10:09.149 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-29T04:10:09.149 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-29T04:10:09.168 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056354,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497668k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18846 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248832k,nr_inodes=812208,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497668k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-29T04:10:09.168 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-03-29T04:10:09.169 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-29T04:10:09.224 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056354,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497668k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18846 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248832k,nr_inodes=812208,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497668k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-29T04:10:09.224 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-03-29T04:10:09.224 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-29T04:10:09.243 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056360,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20876 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-29T04:10:09.243 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-03-29T04:10:09.243 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-29T04:10:09.306 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056360,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20876 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-29T04:10:09.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:10:09.306 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-03-29T04:10:09.322 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-29T04:10:09.323 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-29T04:10:09.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:10:09.323 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-29T04:10:09.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:10:09.392 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-29T04:10:09.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:10:09.461 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2024-03-29T04:10:09.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:10:09.555 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-03-29T04:10:09.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:10:09.569 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2024-03-29T04:10:09.639 INFO:teuthology.orchestra.run.smithi073.stderr:Cannot find device "ceph-brx" 2024-03-29T04:10:09.640 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-29T04:10:09.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:10:09.641 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-03-29T04:10:09.660 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-03-29T04:10:09.660 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-29T04:10:09.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:10:09.660 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-29T04:10:09.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:10:09.732 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-29T04:10:09.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:10:09.803 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2024-03-29T04:10:09.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:10:09.905 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2024-03-29T04:10:09.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-29T04:10:09.921 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2024-03-29T04:10:09.992 INFO:teuthology.orchestra.run.smithi142.stderr:Cannot find device "ceph-brx" 2024-03-29T04:10:09.993 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-29T04:10:09.994 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-03-29T04:10:10.011 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-29T04:10:10.012 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-29T04:10:10.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.133+0000 7f69adb96640 1 Processor -- start 2024-03-29T04:10:10.113 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.133+0000 7f69adb96640 1 -- start start 2024-03-29T04:10:10.116 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.134+0000 7f69adb96640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f69a806f3f0 0x7f69a8072b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:10.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.134+0000 7f69adb96640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69a80730c0 0x7f69a815f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:10.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.134+0000 7f69adb96640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69a8071ae0 con 0x7f69a815b370 2024-03-29T04:10:10.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.134+0000 7f69adb96640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f69a80b39d0 con 0x7f69a806f3f0 2024-03-29T04:10:10.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.134+0000 7f69adb96640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f69a8071dc0 con 0x7f69a80730c0 2024-03-29T04:10:10.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.134+0000 7f69a77fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f69a815b370 0x7f69a80b32c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51668/0 (socket says 172.21.15.73:51668) 2024-03-29T04:10:10.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.134+0000 7f69a77fe640 1 -- 172.21.15.73:0/911172138 learned_addr learned my addr 172.21.15.73:0/911172138 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:10:10.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.135+0000 7f69a7fff640 1 --2- 172.21.15.73:0/911172138 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69a80730c0 0x7f69a815f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:10.117 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.135+0000 7f69a6ffd640 1 --2- 172.21.15.73:0/911172138 >> v2:172.21.15.142:3300/0 conn(0x7f69a806f3f0 0x7f69a8072b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:10.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.135+0000 7f69a67fc640 1 -- 172.21.15.73:0/911172138 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 216929846 0 0) 0x7f69a8071ae0 con 0x7f69a815b370 2024-03-29T04:10:10.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.135+0000 7f69a67fc640 1 -- 172.21.15.73:0/911172138 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6990003520 con 0x7f69a815b370 2024-03-29T04:10:10.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.135+0000 7f69a67fc640 1 -- 172.21.15.73:0/911172138 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 731985557 0 0) 0x7f6990003520 con 0x7f69a815b370 2024-03-29T04:10:10.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.135+0000 7f69a67fc640 1 -- 172.21.15.73:0/911172138 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69a80730c0 msgr2=0x7f69a815f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:10.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.135+0000 7f69a67fc640 1 --2- 172.21.15.73:0/911172138 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69a80730c0 0x7f69a815f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:10.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.135+0000 7f69a67fc640 1 -- 172.21.15.73:0/911172138 >> v2:172.21.15.142:3300/0 conn(0x7f69a806f3f0 msgr2=0x7f69a8072b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:10.118 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.135+0000 7f69a67fc640 1 --2- 172.21.15.73:0/911172138 >> v2:172.21.15.142:3300/0 conn(0x7f69a806f3f0 0x7f69a8072b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:10.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.135+0000 7f69a67fc640 1 -- 172.21.15.73:0/911172138 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69a80720a0 con 0x7f69a815b370 2024-03-29T04:10:10.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.135+0000 7f69a67fc640 1 -- 172.21.15.73:0/911172138 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1290421750 0 0) 0x7f6998001670 con 0x7f69a815b370 2024-03-29T04:10:10.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.135+0000 7f69a67fc640 1 -- 172.21.15.73:0/911172138 >> v1:172.21.15.73:6789/0 conn(0x7f69a815b370 legacy=0x7f69a80b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:10.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.135+0000 7f69a67fc640 1 --2- 172.21.15.73:0/911172138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69900039b0 0x7f6990003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:10.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.135+0000 7f69a67fc640 1 --2- 172.21.15.73:0/911172138 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69a80730c0 0x7f6990004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:10.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.135+0000 7f69a67fc640 1 --2- 172.21.15.73:0/911172138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6990004d40 0x7f69900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:10.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.135+0000 7f69a67fc640 1 -- 172.21.15.73:0/911172138 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f69a80b39d0 con 0x7f6990004d40 2024-03-29T04:10:10.119 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.135+0000 7f69a67fc640 1 -- 172.21.15.73:0/911172138 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f69a8071dc0 con 0x7f69900039b0 2024-03-29T04:10:10.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.135+0000 7f69a67fc640 1 -- 172.21.15.73:0/911172138 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f699000b9c0 con 0x7f69a80730c0 2024-03-29T04:10:10.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.135+0000 7f69a7fff640 1 --2- 172.21.15.73:0/911172138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6990004d40 0x7f69900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:10.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.135+0000 7f69a6ffd640 1 --2- 172.21.15.73:0/911172138 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69a80730c0 0x7f6990004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:10.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.135+0000 7f69a77fe640 1 --2- 172.21.15.73:0/911172138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69900039b0 0x7f6990003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:10.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.135+0000 7f69a7fff640 1 -- 172.21.15.73:0/911172138 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69a80730c0 msgr2=0x7f6990004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:10.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.135+0000 7f69a7fff640 1 --2- 172.21.15.73:0/911172138 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69a80730c0 0x7f6990004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:10.120 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.135+0000 7f69a7fff640 1 -- 172.21.15.73:0/911172138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69900039b0 msgr2=0x7f6990003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:10.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.135+0000 7f69a7fff640 1 --2- 172.21.15.73:0/911172138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69900039b0 0x7f6990003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:10.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.135+0000 7f69a7fff640 1 -- 172.21.15.73:0/911172138 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6990003520 con 0x7f6990004d40 2024-03-29T04:10:10.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.136+0000 7f69a7fff640 1 --2- 172.21.15.73:0/911172138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6990004d40 0x7f69900051c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f69a000e170 tx=0x7f6990005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec74d3a6223b0d2 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:10.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.136+0000 7f69a67fc640 1 -- 172.21.15.73:0/911172138 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a0039070 con 0x7f6990004d40 2024-03-29T04:10:10.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.136+0000 7f69a67fc640 1 -- 172.21.15.73:0/911172138 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69a002cbf0 con 0x7f6990004d40 2024-03-29T04:10:10.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.136+0000 7f69a67fc640 1 -- 172.21.15.73:0/911172138 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a0009c10 con 0x7f6990004d40 2024-03-29T04:10:10.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.137+0000 7f69adb96640 1 -- 172.21.15.73:0/911172138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6990004d40 msgr2=0x7f69900051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:10.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.137+0000 7f69adb96640 1 --2- 172.21.15.73:0/911172138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6990004d40 0x7f69900051c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f69a000e170 tx=0x7f6990005830 comp rx=0 tx=0).stop 2024-03-29T04:10:10.121 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.137+0000 7f69a7fff640 1 -- 172.21.15.73:0/911172138 reap_dead start 2024-03-29T04:10:10.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.137+0000 7f69adb96640 1 -- 172.21.15.73:0/911172138 shutdown_connections 2024-03-29T04:10:10.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.137+0000 7f69adb96640 1 -- 172.21.15.73:0/911172138 >> 172.21.15.73:0/911172138 conn(0x7f69a806b510 msgr2=0x7f69a806b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:10.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.137+0000 7f69adb96640 1 -- 172.21.15.73:0/911172138 shutdown_connections 2024-03-29T04:10:10.122 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.137+0000 7f69adb96640 1 -- 172.21.15.73:0/911172138 wait complete. 2024-03-29T04:10:10.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.138+0000 7f69adb96640 1 Processor -- start 2024-03-29T04:10:10.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.138+0000 7f69adb96640 1 -- start start 2024-03-29T04:10:10.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.139+0000 7f69adb96640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69a809b440 0x7f69a809b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:10.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.139+0000 7f69adb96640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69a809a490 0x7f69a8148f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:10.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.139+0000 7f69adb96640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69a8157d30 0x7f69a81581c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:10.125 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.139+0000 7f69adb96640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f69a8073550 con 0x7f69a8157d30 2024-03-29T04:10:10.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.139+0000 7f69adb96640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f69a8072660 con 0x7f69a809a490 2024-03-29T04:10:10.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.139+0000 7f69adb96640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f69a815b750 con 0x7f69a809b440 2024-03-29T04:10:10.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.139+0000 7f69a7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69a8157d30 0x7f69a81581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:10.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.139+0000 7f69a7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69a8157d30 0x7f69a81581c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35488/0 (socket says 172.21.15.73:35488) 2024-03-29T04:10:10.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.139+0000 7f69a7fff640 1 -- 172.21.15.73:0/757147023 learned_addr learned my addr 172.21.15.73:0/757147023 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:10.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.139+0000 7f69a77fe640 1 --2- 172.21.15.73:0/757147023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69a809b440 0x7f69a809b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:10.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.139+0000 7f69a6ffd640 1 --2- 172.21.15.73:0/757147023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69a809a490 0x7f69a8148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:10.126 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.139+0000 7f69a7fff640 1 -- 172.21.15.73:0/757147023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69a809b440 msgr2=0x7f69a809b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:10.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.139+0000 7f69a7fff640 1 --2- 172.21.15.73:0/757147023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69a809b440 0x7f69a809b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:10.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.139+0000 7f69a7fff640 1 -- 172.21.15.73:0/757147023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69a809a490 msgr2=0x7f69a8148f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:10.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.139+0000 7f69a7fff640 1 --2- 172.21.15.73:0/757147023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69a809a490 0x7f69a8148f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:10.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.139+0000 7f69a7fff640 1 -- 172.21.15.73:0/757147023 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69a8149e50 con 0x7f69a8157d30 2024-03-29T04:10:10.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.139+0000 7f69a7fff640 1 --2- 172.21.15.73:0/757147023 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69a8157d30 0x7f69a81581c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f69a000e170 tx=0x7f69a0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:10.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.139+0000 7f698ffff640 1 -- 172.21.15.73:0/757147023 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a0039030 con 0x7f69a8157d30 2024-03-29T04:10:10.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.140+0000 7f698ffff640 1 -- 172.21.15.73:0/757147023 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69a0043070 con 0x7f69a8157d30 2024-03-29T04:10:10.127 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.140+0000 7f69adb96640 1 -- 172.21.15.73:0/757147023 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69a8149890 con 0x7f69a8157d30 2024-03-29T04:10:10.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.140+0000 7f698ffff640 1 -- 172.21.15.73:0/757147023 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a0009c10 con 0x7f69a8157d30 2024-03-29T04:10:10.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.140+0000 7f69adb96640 1 -- 172.21.15.73:0/757147023 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69a8157530 con 0x7f69a8157d30 2024-03-29T04:10:10.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.141+0000 7f69adb96640 1 -- 172.21.15.73:0/757147023 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69a8068640 con 0x7f69a8157d30 2024-03-29T04:10:10.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.141+0000 7f698ffff640 1 -- 172.21.15.73:0/757147023 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f69a0005d10 con 0x7f69a8157d30 2024-03-29T04:10:10.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.141+0000 7f698ffff640 1 --2- 172.21.15.73:0/757147023 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f699406c560 0x7f699406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:10.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.141+0000 7f698ffff640 1 -- 172.21.15.73:0/757147023 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f69a00ad4a0 con 0x7f69a8157d30 2024-03-29T04:10:10.128 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.141+0000 7f69a77fe640 1 --2- 172.21.15.73:0/757147023 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f699406c560 0x7f699406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:10.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.142+0000 7f69a77fe640 1 --2- 172.21.15.73:0/757147023 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f699406c560 0x7f699406ea20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6998004840 tx=0x7f6998007970 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:10.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.146+0000 7f698ffff640 1 -- 172.21.15.73:0/757147023 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f69a007be80 con 0x7f69a8157d30 2024-03-29T04:10:10.295 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.316+0000 7f69adb96640 1 -- 172.21.15.73:0/757147023 --> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f69a80b5010 con 0x7f699406c560 2024-03-29T04:10:10.296 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.317+0000 7f698ffff640 1 -- 172.21.15.73:0/757147023 <== mgr.4104 v2:172.21.15.73:6832/1640471941 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13543 (secure 0 0 0) 0x7f69a80b5010 con 0x7f699406c560 2024-03-29T04:10:10.297 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:10:10.297 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-29T04:10:10.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.319+0000 7f69adb96640 1 -- 172.21.15.73:0/757147023 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f699406c560 msgr2=0x7f699406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:10.298 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.319+0000 7f69adb96640 1 --2- 172.21.15.73:0/757147023 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f699406c560 0x7f699406ea20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6998004840 tx=0x7f6998007970 comp rx=0 tx=0).stop 2024-03-29T04:10:10.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.319+0000 7f69adb96640 1 -- 172.21.15.73:0/757147023 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69a8157d30 msgr2=0x7f69a81581c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:10.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.319+0000 7f69adb96640 1 --2- 172.21.15.73:0/757147023 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69a8157d30 0x7f69a81581c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f69a000e170 tx=0x7f69a0009750 comp rx=0 tx=0).stop 2024-03-29T04:10:10.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.319+0000 7f69adb96640 1 -- 172.21.15.73:0/757147023 shutdown_connections 2024-03-29T04:10:10.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.319+0000 7f69adb96640 1 --2- 172.21.15.73:0/757147023 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f69a8157d30 0x7f69a81581c0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:10.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.319+0000 7f69adb96640 1 --2- 172.21.15.73:0/757147023 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f699406c560 0x7f699406ea20 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:10.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.319+0000 7f69adb96640 1 --2- 172.21.15.73:0/757147023 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69a809a490 0x7f69a8148f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:10.299 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.319+0000 7f69adb96640 1 --2- 172.21.15.73:0/757147023 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f69a809b440 0x7f69a809b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:10.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.319+0000 7f69adb96640 1 -- 172.21.15.73:0/757147023 >> 172.21.15.73:0/757147023 conn(0x7f69a806b510 msgr2=0x7f69a80b3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:10.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.319+0000 7f69adb96640 1 -- 172.21.15.73:0/757147023 shutdown_connections 2024-03-29T04:10:10.300 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.319+0000 7f69adb96640 1 -- 172.21.15.73:0/757147023 wait complete. 2024-03-29T04:10:10.309 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2024-03-29T04:10:09.544044+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":485600,"kb_used_data":265260,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754489120,"statfs":{"total":773094113280,"available":772596858880,"internally_reserved":0,"allocated":271626240,"data_stored":269411839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-174573950,"num_objects":-138,"num_object_clones":0,"num_object_copies":-276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-138,"num_whiteouts":0,"num_read":-77,"num_read_kb":-2,"num_write":-351,"num_write_kb":-170630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001045"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":195,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-29T04:10:06.865584+0000","last_change":"2024-03-29T04:08:01.885311+0000","last_active":"2024-03-29T04:10:06.865584+0000","last_peered":"2024-03-29T04:10:06.865584+0000","last_clean":"2024-03-29T04:10:06.865584+0000","last_became_active":"2024-03-29T04:08:01.884340+0000","last_became_peered":"2024-03-29T04:08:01.884340+0000","last_unstale":"2024-03-29T04:10:06.865584+0000","last_undegraded":"2024-03-29T04:10:06.865584+0000","last_fullsized":"2024-03-29T04:10:06.865584+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:00.511520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:00.511520+0000","last_clean_scrub_stamp":"2024-03-29T04:08:00.511520+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:40:25.245419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77608,"kb_used_data":46424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94294232,"statfs":{"total":96636764160,"available":96557293568,"internally_reserved":0,"allocated":47538176,"data_stored":47248084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":157003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89112,"kb_used_data":62088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94282728,"statfs":{"total":96636764160,"available":96545513472,"internally_reserved":0,"allocated":63578112,"data_stored":63292764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":85752,"kb_used_data":58732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94286088,"statfs":{"total":96636764160,"available":96548954112,"internally_reserved":0,"allocated":60141568,"data_stored":59859770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64892,"kb_used_data":37868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94306948,"statfs":{"total":96636764160,"available":96570314752,"internally_reserved":0,"allocated":38776832,"data_stored":38477876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52332,"kb_used_data":25312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94319508,"statfs":{"total":96636764160,"available":96583176192,"internally_reserved":0,"allocated":25919488,"data_stored":25643113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":157003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61064,"kb_used_data":34044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94310776,"statfs":{"total":96636764160,"available":96574234624,"internally_reserved":0,"allocated":34861056,"data_stored":34576226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-29T04:10:10.309 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-29T04:10:10.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.430+0000 7f1be52ba640 1 Processor -- start 2024-03-29T04:10:10.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.430+0000 7f1be52ba640 1 -- start start 2024-03-29T04:10:10.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.430+0000 7f1be52ba640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1be015e930 0x7f1be00cf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:10.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.430+0000 7f1be52ba640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1be00cf670 0x7f1be00d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:10.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.430+0000 7f1be52ba640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1be00b3c50 0x7f1be00d3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:10.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.430+0000 7f1be52ba640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f1be006c780 con 0x7f1be015e930 2024-03-29T04:10:10.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.430+0000 7f1be52ba640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f1be00cfb30 con 0x7f1be00cf670 2024-03-29T04:10:10.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.430+0000 7f1be52ba640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f1be00cfe10 con 0x7f1be00b3c50 2024-03-29T04:10:10.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.431+0000 7f1bdeffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1be015e930 0x7f1be00cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:10.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.431+0000 7f1bdeffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1be015e930 0x7f1be00cf130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35494/0 (socket says 172.21.15.73:35494) 2024-03-29T04:10:10.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.431+0000 7f1bdeffd640 1 -- 172.21.15.73:0/3384262508 learned_addr learned my addr 172.21.15.73:0/3384262508 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:10.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.431+0000 7f1bdf7fe640 1 --2- 172.21.15.73:0/3384262508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1be00b3c50 0x7f1be00d3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:10.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.431+0000 7f1bde7fc640 1 --2- 172.21.15.73:0/3384262508 >> v2:172.21.15.142:3300/0 conn(0x7f1be00cf670 0x7f1be00d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:10.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.431+0000 7f1bdeffd640 1 -- 172.21.15.73:0/3384262508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1be00b3c50 msgr2=0x7f1be00d3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:10.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.431+0000 7f1bdeffd640 1 --2- 172.21.15.73:0/3384262508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1be00b3c50 0x7f1be00d3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:10.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.431+0000 7f1bdeffd640 1 -- 172.21.15.73:0/3384262508 >> v2:172.21.15.142:3300/0 conn(0x7f1be00cf670 msgr2=0x7f1be00d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:10.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.431+0000 7f1bdeffd640 1 --2- 172.21.15.73:0/3384262508 >> v2:172.21.15.142:3300/0 conn(0x7f1be00cf670 0x7f1be00d2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:10.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.431+0000 7f1bdeffd640 1 -- 172.21.15.73:0/3384262508 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be00d00f0 con 0x7f1be015e930 2024-03-29T04:10:10.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.432+0000 7f1bdeffd640 1 --2- 172.21.15.73:0/3384262508 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1be015e930 0x7f1be00cf130 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f1be008e610 tx=0x7f1bd002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37cbe17df55364f4 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:10.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.432+0000 7f1bddffb640 1 -- 172.21.15.73:0/3384262508 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd002e070 con 0x7f1be015e930 2024-03-29T04:10:10.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.432+0000 7f1bddffb640 1 -- 172.21.15.73:0/3384262508 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bd0037070 con 0x7f1be015e930 2024-03-29T04:10:10.413 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.432+0000 7f1bddffb640 1 -- 172.21.15.73:0/3384262508 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0031a00 con 0x7f1be015e930 2024-03-29T04:10:10.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.432+0000 7f1be52ba640 1 -- 172.21.15.73:0/3384262508 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1be015e930 msgr2=0x7f1be00cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:10.419 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.432+0000 7f1be52ba640 1 --2- 172.21.15.73:0/3384262508 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1be015e930 0x7f1be00cf130 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f1be008e610 tx=0x7f1bd002b880 comp rx=0 tx=0).stop 2024-03-29T04:10:10.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.432+0000 7f1be52ba640 1 -- 172.21.15.73:0/3384262508 shutdown_connections 2024-03-29T04:10:10.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.432+0000 7f1be52ba640 1 --2- 172.21.15.73:0/3384262508 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1be00b3c50 0x7f1be00d3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:10.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.432+0000 7f1be52ba640 1 --2- 172.21.15.73:0/3384262508 >> v2:172.21.15.142:3300/0 conn(0x7f1be00cf670 0x7f1be00d2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:10.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.432+0000 7f1be52ba640 1 --2- 172.21.15.73:0/3384262508 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1be015e930 0x7f1be00cf130 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:10.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.432+0000 7f1be52ba640 1 -- 172.21.15.73:0/3384262508 >> 172.21.15.73:0/3384262508 conn(0x7f1be008bfc0 msgr2=0x7f1be00d4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:10.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.432+0000 7f1be52ba640 1 -- 172.21.15.73:0/3384262508 shutdown_connections 2024-03-29T04:10:10.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.432+0000 7f1be52ba640 1 -- 172.21.15.73:0/3384262508 wait complete. 2024-03-29T04:10:10.420 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.434+0000 7f1be52ba640 1 Processor -- start 2024-03-29T04:10:10.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.434+0000 7f1be52ba640 1 -- start start 2024-03-29T04:10:10.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.434+0000 7f1be52ba640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1be00b3c50 0x7f1be01f4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:10.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.434+0000 7f1be52ba640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1be00cf670 0x7f1be015b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:10.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.434+0000 7f1be52ba640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1be015e930 0x7f1be014e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:10.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.434+0000 7f1be52ba640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1be015ee90 con 0x7f1be00b3c50 2024-03-29T04:10:10.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.434+0000 7f1be52ba640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f1be015ed10 con 0x7f1be00cf670 2024-03-29T04:10:10.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.434+0000 7f1be52ba640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f1be00d0c50 con 0x7f1be015e930 2024-03-29T04:10:10.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.435+0000 7f1bdeffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1be00b3c50 0x7f1be01f4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:10.421 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.435+0000 7f1bdeffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1be00b3c50 0x7f1be01f4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35504/0 (socket says 172.21.15.73:35504) 2024-03-29T04:10:10.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.435+0000 7f1bdeffd640 1 -- 172.21.15.73:0/464456226 learned_addr learned my addr 172.21.15.73:0/464456226 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:10.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.435+0000 7f1bdf7fe640 1 --2- 172.21.15.73:0/464456226 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1be015e930 0x7f1be014e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:10.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.435+0000 7f1bde7fc640 1 --2- 172.21.15.73:0/464456226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1be00cf670 0x7f1be015b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:10.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.435+0000 7f1bdeffd640 1 -- 172.21.15.73:0/464456226 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1be015e930 msgr2=0x7f1be014e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:10.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.435+0000 7f1bdeffd640 1 --2- 172.21.15.73:0/464456226 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1be015e930 0x7f1be014e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:10.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.435+0000 7f1bdeffd640 1 -- 172.21.15.73:0/464456226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1be00cf670 msgr2=0x7f1be015b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:10.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.435+0000 7f1bdeffd640 1 --2- 172.21.15.73:0/464456226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1be00cf670 0x7f1be015b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:10.422 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.435+0000 7f1bdeffd640 1 -- 172.21.15.73:0/464456226 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be00cc7e0 con 0x7f1be00b3c50 2024-03-29T04:10:10.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.435+0000 7f1bdf7fe640 1 --2- 172.21.15.73:0/464456226 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1be015e930 0x7f1be014e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:10:10.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.435+0000 7f1bdeffd640 1 --2- 172.21.15.73:0/464456226 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1be00b3c50 0x7f1be01f4920 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0000c00 tx=0x7f1bd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:10.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.435+0000 7f1bc77fe640 1 -- 172.21.15.73:0/464456226 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0032670 con 0x7f1be00b3c50 2024-03-29T04:10:10.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.435+0000 7f1bc77fe640 1 -- 172.21.15.73:0/464456226 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bd0032810 con 0x7f1be00b3c50 2024-03-29T04:10:10.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.435+0000 7f1be52ba640 1 -- 172.21.15.73:0/464456226 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1be00ccac0 con 0x7f1be00b3c50 2024-03-29T04:10:10.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.435+0000 7f1bc77fe640 1 -- 172.21.15.73:0/464456226 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0032c00 con 0x7f1be00b3c50 2024-03-29T04:10:10.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.435+0000 7f1be52ba640 1 -- 172.21.15.73:0/464456226 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1be00cd080 con 0x7f1be00b3c50 2024-03-29T04:10:10.423 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.436+0000 7f1be52ba640 1 -- 172.21.15.73:0/464456226 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1be0068640 con 0x7f1be00b3c50 2024-03-29T04:10:10.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.436+0000 7f1bc77fe640 1 -- 172.21.15.73:0/464456226 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f1bd004c060 con 0x7f1be00b3c50 2024-03-29T04:10:10.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.437+0000 7f1bc77fe640 1 --2- 172.21.15.73:0/464456226 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f1bcc06c530 0x7f1bcc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:10.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.437+0000 7f1bc77fe640 1 -- 172.21.15.73:0/464456226 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f1bd00acc30 con 0x7f1be00b3c50 2024-03-29T04:10:10.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.437+0000 7f1bde7fc640 1 --2- 172.21.15.73:0/464456226 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f1bcc06c530 0x7f1bcc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:10.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.437+0000 7f1bde7fc640 1 --2- 172.21.15.73:0/464456226 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f1bcc06c530 0x7f1bcc06e9f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1be00b3590 tx=0x7f1bd4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:10.424 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.441+0000 7f1bc77fe640 1 -- 172.21.15.73:0/464456226 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f1bd0040070 con 0x7f1be00b3c50 2024-03-29T04:10:10.593 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.614+0000 7f1be52ba640 1 -- 172.21.15.73:0/464456226 --> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1be00cb1b0 con 0x7f1bcc06c530 2024-03-29T04:10:10.594 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.614+0000 7f1bc77fe640 1 -- 172.21.15.73:0/464456226 <== mgr.4104 v2:172.21.15.73:6832/1640471941 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13543 (secure 0 0 0) 0x7f1be00cb1b0 con 0x7f1bcc06c530 2024-03-29T04:10:10.595 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:10:10.595 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-29T04:10:10.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.616+0000 7f1be52ba640 1 -- 172.21.15.73:0/464456226 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f1bcc06c530 msgr2=0x7f1bcc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:10.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.616+0000 7f1be52ba640 1 --2- 172.21.15.73:0/464456226 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f1bcc06c530 0x7f1bcc06e9f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1be00b3590 tx=0x7f1bd4008040 comp rx=0 tx=0).stop 2024-03-29T04:10:10.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.616+0000 7f1be52ba640 1 -- 172.21.15.73:0/464456226 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1be00b3c50 msgr2=0x7f1be01f4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:10.596 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.616+0000 7f1be52ba640 1 --2- 172.21.15.73:0/464456226 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1be00b3c50 0x7f1be01f4920 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0000c00 tx=0x7f1bd00046c0 comp rx=0 tx=0).stop 2024-03-29T04:10:10.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.616+0000 7f1be52ba640 1 -- 172.21.15.73:0/464456226 shutdown_connections 2024-03-29T04:10:10.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.616+0000 7f1be52ba640 1 --2- 172.21.15.73:0/464456226 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1be015e930 0x7f1be014e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:10.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.616+0000 7f1be52ba640 1 --2- 172.21.15.73:0/464456226 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f1bcc06c530 0x7f1bcc06e9f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:10.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.616+0000 7f1be52ba640 1 --2- 172.21.15.73:0/464456226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1be00cf670 0x7f1be015b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:10.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.616+0000 7f1be52ba640 1 --2- 172.21.15.73:0/464456226 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1be00b3c50 0x7f1be01f4920 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:10.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.617+0000 7f1be52ba640 1 -- 172.21.15.73:0/464456226 >> 172.21.15.73:0/464456226 conn(0x7f1be008bfc0 msgr2=0x7f1be00d1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:10.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.617+0000 7f1be52ba640 1 -- 172.21.15.73:0/464456226 shutdown_connections 2024-03-29T04:10:10.597 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.617+0000 7f1be52ba640 1 -- 172.21.15.73:0/464456226 wait complete. 2024-03-29T04:10:10.607 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2024-03-29T04:10:09.544044+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":485600,"kb_used_data":265260,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754489120,"statfs":{"total":773094113280,"available":772596858880,"internally_reserved":0,"allocated":271626240,"data_stored":269411839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-174573950,"num_objects":-138,"num_object_clones":0,"num_object_copies":-276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-138,"num_whiteouts":0,"num_read":-77,"num_read_kb":-2,"num_write":-351,"num_write_kb":-170630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001045"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":195,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-29T04:10:06.865584+0000","last_change":"2024-03-29T04:08:01.885311+0000","last_active":"2024-03-29T04:10:06.865584+0000","last_peered":"2024-03-29T04:10:06.865584+0000","last_clean":"2024-03-29T04:10:06.865584+0000","last_became_active":"2024-03-29T04:08:01.884340+0000","last_became_peered":"2024-03-29T04:08:01.884340+0000","last_unstale":"2024-03-29T04:10:06.865584+0000","last_undegraded":"2024-03-29T04:10:06.865584+0000","last_fullsized":"2024-03-29T04:10:06.865584+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:00.511520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:00.511520+0000","last_clean_scrub_stamp":"2024-03-29T04:08:00.511520+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:40:25.245419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77608,"kb_used_data":46424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94294232,"statfs":{"total":96636764160,"available":96557293568,"internally_reserved":0,"allocated":47538176,"data_stored":47248084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":157003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89112,"kb_used_data":62088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94282728,"statfs":{"total":96636764160,"available":96545513472,"internally_reserved":0,"allocated":63578112,"data_stored":63292764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":85752,"kb_used_data":58732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94286088,"statfs":{"total":96636764160,"available":96548954112,"internally_reserved":0,"allocated":60141568,"data_stored":59859770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64892,"kb_used_data":37868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94306948,"statfs":{"total":96636764160,"available":96570314752,"internally_reserved":0,"allocated":38776832,"data_stored":38477876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52332,"kb_used_data":25312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94319508,"statfs":{"total":96636764160,"available":96583176192,"internally_reserved":0,"allocated":25919488,"data_stored":25643113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":157003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61064,"kb_used_data":34044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94310776,"statfs":{"total":96636764160,"available":96574234624,"internally_reserved":0,"allocated":34861056,"data_stored":34576226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-29T04:10:10.607 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-29T04:10:10.607 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-29T04:10:10.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.729+0000 7fd60eaf2640 1 Processor -- start 2024-03-29T04:10:10.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.729+0000 7fd60eaf2640 1 -- start start 2024-03-29T04:10:10.716 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.729+0000 7fd60eaf2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd60806e0f0 0x7fd60806f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:10.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.729+0000 7fd60eaf2640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd60806fc90 0x7fd60806c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:10.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.729+0000 7fd60eaf2640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd60806e6b0 con 0x7fd60815e9a0 2024-03-29T04:10:10.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.729+0000 7fd60eaf2640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd60806f2c0 con 0x7fd60806fc90 2024-03-29T04:10:10.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.729+0000 7fd60eaf2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd60806e990 con 0x7fd60806e0f0 2024-03-29T04:10:10.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.730+0000 7fd60c88e640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd60815e9a0 0x7fd608072d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51674/0 (socket says 172.21.15.73:51674) 2024-03-29T04:10:10.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.730+0000 7fd60c88e640 1 -- 172.21.15.73:0/2107194843 learned_addr learned my addr 172.21.15.73:0/2107194843 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:10:10.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.730+0000 7fd607fff640 1 --2- 172.21.15.73:0/2107194843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd60806e0f0 0x7fd60806f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:10.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.730+0000 7fd60d08f640 1 --2- 172.21.15.73:0/2107194843 >> v2:172.21.15.142:3300/0 conn(0x7fd60806fc90 0x7fd60806c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:10.717 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.730+0000 7fd6077fe640 1 -- 172.21.15.73:0/2107194843 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4050614937 0 0) 0x7fd60806e6b0 con 0x7fd60815e9a0 2024-03-29T04:10:10.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.730+0000 7fd6077fe640 1 -- 172.21.15.73:0/2107194843 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5f8003520 con 0x7fd60815e9a0 2024-03-29T04:10:10.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.730+0000 7fd607fff640 1 -- 172.21.15.73:0/2107194843 >> v2:172.21.15.142:3300/0 conn(0x7fd60806fc90 msgr2=0x7fd60806c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:10.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.730+0000 7fd607fff640 1 --2- 172.21.15.73:0/2107194843 >> v2:172.21.15.142:3300/0 conn(0x7fd60806fc90 0x7fd60806c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:10.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.730+0000 7fd607fff640 1 -- 172.21.15.73:0/2107194843 >> v1:172.21.15.73:6789/0 conn(0x7fd60815e9a0 legacy=0x7fd608072d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:10.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.730+0000 7fd6077fe640 1 -- 172.21.15.73:0/2107194843 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 393299247 0 0) 0x7fd5f8003520 con 0x7fd60815e9a0 2024-03-29T04:10:10.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.730+0000 7fd607fff640 1 -- 172.21.15.73:0/2107194843 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd60806ec70 con 0x7fd60806e0f0 2024-03-29T04:10:10.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.731+0000 7fd607fff640 1 --2- 172.21.15.73:0/2107194843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd60806e0f0 0x7fd60806f750 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd5f40097a0 tx=0x7fd5f402b710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65b19e21c9448abd server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:10.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.731+0000 7fd6077fe640 1 -- 172.21.15.73:0/2107194843 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f4037070 con 0x7fd60806e0f0 2024-03-29T04:10:10.718 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.731+0000 7fd6077fe640 1 -- 172.21.15.73:0/2107194843 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5f4030510 con 0x7fd60806e0f0 2024-03-29T04:10:10.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.731+0000 7fd6077fe640 1 -- 172.21.15.73:0/2107194843 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc001670 con 0x7fd60806e0f0 2024-03-29T04:10:10.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.732+0000 7fd60eaf2640 1 -- 172.21.15.73:0/2107194843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd60806e0f0 msgr2=0x7fd60806f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:10.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.732+0000 7fd60eaf2640 1 --2- 172.21.15.73:0/2107194843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd60806e0f0 0x7fd60806f750 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd5f40097a0 tx=0x7fd5f402b710 comp rx=0 tx=0).stop 2024-03-29T04:10:10.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.732+0000 7fd60eaf2640 1 -- 172.21.15.73:0/2107194843 shutdown_connections 2024-03-29T04:10:10.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.732+0000 7fd60eaf2640 1 --2- 172.21.15.73:0/2107194843 >> v2:172.21.15.142:3300/0 conn(0x7fd60806fc90 0x7fd60806c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:10.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.732+0000 7fd60eaf2640 1 --2- 172.21.15.73:0/2107194843 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd60806e0f0 0x7fd60806f750 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:10.719 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.732+0000 7fd60eaf2640 1 -- 172.21.15.73:0/2107194843 >> 172.21.15.73:0/2107194843 conn(0x7fd608072090 msgr2=0x7fd6080724a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:10.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.732+0000 7fd60eaf2640 1 -- 172.21.15.73:0/2107194843 shutdown_connections 2024-03-29T04:10:10.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.732+0000 7fd60eaf2640 1 -- 172.21.15.73:0/2107194843 wait complete. 2024-03-29T04:10:10.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.733+0000 7fd60eaf2640 1 Processor -- start 2024-03-29T04:10:10.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.733+0000 7fd60eaf2640 1 -- start start 2024-03-29T04:10:10.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.734+0000 7fd60eaf2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd60806e0f0 0x7fd608152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:10.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.734+0000 7fd60eaf2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd60806fc90 0x7fd6080cf320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:10.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.734+0000 7fd60eaf2640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd60815e9a0 0x7fd608160a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:10.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.734+0000 7fd60eaf2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd60806cbe0 con 0x7fd60806e0f0 2024-03-29T04:10:10.720 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.734+0000 7fd60eaf2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd60806ca60 con 0x7fd60806fc90 2024-03-29T04:10:10.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.734+0000 7fd60eaf2640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fd60806cd60 con 0x7fd60815e9a0 2024-03-29T04:10:10.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.734+0000 7fd60c88e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd60806e0f0 0x7fd608152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:10.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.734+0000 7fd60c88e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd60806e0f0 0x7fd608152b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35510/0 (socket says 172.21.15.73:35510) 2024-03-29T04:10:10.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.734+0000 7fd60c88e640 1 -- 172.21.15.73:0/1587195564 learned_addr learned my addr 172.21.15.73:0/1587195564 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:10.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.734+0000 7fd60d08f640 1 --2- 172.21.15.73:0/1587195564 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd60815e9a0 0x7fd608160a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:10.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.734+0000 7fd607fff640 1 --2- 172.21.15.73:0/1587195564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd60806fc90 0x7fd6080cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:10.721 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.734+0000 7fd60c88e640 1 -- 172.21.15.73:0/1587195564 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd60815e9a0 msgr2=0x7fd608160a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:10.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.734+0000 7fd60c88e640 1 --2- 172.21.15.73:0/1587195564 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd60815e9a0 0x7fd608160a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:10.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.734+0000 7fd60c88e640 1 -- 172.21.15.73:0/1587195564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd60806fc90 msgr2=0x7fd6080cf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:10.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.734+0000 7fd60c88e640 1 --2- 172.21.15.73:0/1587195564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd60806fc90 0x7fd6080cf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:10.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.734+0000 7fd60c88e640 1 -- 172.21.15.73:0/1587195564 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd608151ab0 con 0x7fd60806e0f0 2024-03-29T04:10:10.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.734+0000 7fd60c88e640 1 --2- 172.21.15.73:0/1587195564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd60806e0f0 0x7fd608152b50 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc00c750 tx=0x7fd5fc00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:10.722 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.734+0000 7fd6057fa640 1 -- 172.21.15.73:0/1587195564 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc005ad0 con 0x7fd60806e0f0 2024-03-29T04:10:10.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.734+0000 7fd6057fa640 1 -- 172.21.15.73:0/1587195564 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5fc005c90 con 0x7fd60806e0f0 2024-03-29T04:10:10.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.734+0000 7fd60eaf2640 1 -- 172.21.15.73:0/1587195564 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd608151d90 con 0x7fd60806e0f0 2024-03-29T04:10:10.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.734+0000 7fd6057fa640 1 -- 172.21.15.73:0/1587195564 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc0072b0 con 0x7fd60806e0f0 2024-03-29T04:10:10.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.734+0000 7fd60eaf2640 1 -- 172.21.15.73:0/1587195564 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd608152350 con 0x7fd60806e0f0 2024-03-29T04:10:10.723 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.735+0000 7fd60eaf2640 1 -- 172.21.15.73:0/1587195564 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd608068640 con 0x7fd60806e0f0 2024-03-29T04:10:10.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.736+0000 7fd6057fa640 1 -- 172.21.15.73:0/1587195564 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fd5fc007450 con 0x7fd60806e0f0 2024-03-29T04:10:10.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.736+0000 7fd6057fa640 1 --2- 172.21.15.73:0/1587195564 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd5ec06c530 0x7fd5ec06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:10.724 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.736+0000 7fd607fff640 1 --2- 172.21.15.73:0/1587195564 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd5ec06c530 0x7fd5ec06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:10.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.736+0000 7fd6057fa640 1 -- 172.21.15.73:0/1587195564 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fd5fc08b170 con 0x7fd60806e0f0 2024-03-29T04:10:10.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.737+0000 7fd607fff640 1 --2- 172.21.15.73:0/1587195564 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd5ec06c530 0x7fd5ec06e9f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4034000 tx=0x7fd5f4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:10.725 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.741+0000 7fd6057fa640 1 -- 172.21.15.73:0/1587195564 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fd5fc059440 con 0x7fd60806e0f0 2024-03-29T04:10:10.890 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.911+0000 7fd60eaf2640 1 -- 172.21.15.73:0/1587195564 --> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd6080b3fb0 con 0x7fd5ec06c530 2024-03-29T04:10:10.891 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.912+0000 7fd6057fa640 1 -- 172.21.15.73:0/1587195564 <== mgr.4104 v2:172.21.15.73:6832/1640471941 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13543 (secure 0 0 0) 0x7fd6080b3fb0 con 0x7fd5ec06c530 2024-03-29T04:10:10.892 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:10:10.892 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-29T04:10:10.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.914+0000 7fd60eaf2640 1 -- 172.21.15.73:0/1587195564 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd5ec06c530 msgr2=0x7fd5ec06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:10.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.914+0000 7fd60eaf2640 1 --2- 172.21.15.73:0/1587195564 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd5ec06c530 0x7fd5ec06e9f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4034000 tx=0x7fd5f4008030 comp rx=0 tx=0).stop 2024-03-29T04:10:10.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.914+0000 7fd60eaf2640 1 -- 172.21.15.73:0/1587195564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd60806e0f0 msgr2=0x7fd608152b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:10.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.914+0000 7fd60eaf2640 1 --2- 172.21.15.73:0/1587195564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd60806e0f0 0x7fd608152b50 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc00c750 tx=0x7fd5fc00cc10 comp rx=0 tx=0).stop 2024-03-29T04:10:10.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.914+0000 7fd60eaf2640 1 -- 172.21.15.73:0/1587195564 shutdown_connections 2024-03-29T04:10:10.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.914+0000 7fd60eaf2640 1 --2- 172.21.15.73:0/1587195564 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fd60815e9a0 0x7fd608160a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:10.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.914+0000 7fd60eaf2640 1 --2- 172.21.15.73:0/1587195564 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fd5ec06c530 0x7fd5ec06e9f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:10.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.914+0000 7fd60eaf2640 1 --2- 172.21.15.73:0/1587195564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd60806fc90 0x7fd6080cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:10.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.914+0000 7fd60eaf2640 1 --2- 172.21.15.73:0/1587195564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd60806e0f0 0x7fd608152b50 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:10.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.914+0000 7fd60eaf2640 1 -- 172.21.15.73:0/1587195564 >> 172.21.15.73:0/1587195564 conn(0x7fd608072090 msgr2=0x7fd608159340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:10.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.914+0000 7fd60eaf2640 1 -- 172.21.15.73:0/1587195564 shutdown_connections 2024-03-29T04:10:10.895 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:10.914+0000 7fd60eaf2640 1 -- 172.21.15.73:0/1587195564 wait complete. 2024-03-29T04:10:10.904 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2024-03-29T04:10:09.544044+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":485600,"kb_used_data":265260,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754489120,"statfs":{"total":773094113280,"available":772596858880,"internally_reserved":0,"allocated":271626240,"data_stored":269411839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-174573950,"num_objects":-138,"num_object_clones":0,"num_object_copies":-276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-138,"num_whiteouts":0,"num_read":-77,"num_read_kb":-2,"num_write":-351,"num_write_kb":-170630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001045"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":195,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-29T04:10:06.865584+0000","last_change":"2024-03-29T04:08:01.885311+0000","last_active":"2024-03-29T04:10:06.865584+0000","last_peered":"2024-03-29T04:10:06.865584+0000","last_clean":"2024-03-29T04:10:06.865584+0000","last_became_active":"2024-03-29T04:08:01.884340+0000","last_became_peered":"2024-03-29T04:08:01.884340+0000","last_unstale":"2024-03-29T04:10:06.865584+0000","last_undegraded":"2024-03-29T04:10:06.865584+0000","last_fullsized":"2024-03-29T04:10:06.865584+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:00.511520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:00.511520+0000","last_clean_scrub_stamp":"2024-03-29T04:08:00.511520+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:40:25.245419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77608,"kb_used_data":46424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94294232,"statfs":{"total":96636764160,"available":96557293568,"internally_reserved":0,"allocated":47538176,"data_stored":47248084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":157003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":89112,"kb_used_data":62088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94282728,"statfs":{"total":96636764160,"available":96545513472,"internally_reserved":0,"allocated":63578112,"data_stored":63292764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":85752,"kb_used_data":58732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94286088,"statfs":{"total":96636764160,"available":96548954112,"internally_reserved":0,"allocated":60141568,"data_stored":59859770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64892,"kb_used_data":37868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94306948,"statfs":{"total":96636764160,"available":96570314752,"internally_reserved":0,"allocated":38776832,"data_stored":38477876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52332,"kb_used_data":25312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94319508,"statfs":{"total":96636764160,"available":96583176192,"internally_reserved":0,"allocated":25919488,"data_stored":25643113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":157003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61064,"kb_used_data":34044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94310776,"statfs":{"total":96636764160,"available":96574234624,"internally_reserved":0,"allocated":34861056,"data_stored":34576226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-29T04:10:10.905 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-29T04:10:11.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.026+0000 7f11299bd640 1 Processor -- start 2024-03-29T04:10:11.005 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.026+0000 7f11299bd640 1 -- start start 2024-03-29T04:10:11.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.026+0000 7f11299bd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f112415e930 0x7f11240cf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:11.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.027+0000 7f11299bd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f11240d3310 0x7f112406cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:11.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.027+0000 7f11299bd640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11240cfb30 con 0x7f11240cf670 2024-03-29T04:10:11.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.027+0000 7f11299bd640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f112406c780 con 0x7f11240d3310 2024-03-29T04:10:11.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.027+0000 7f11299bd640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f11240cfe10 con 0x7f112415e930 2024-03-29T04:10:11.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.027+0000 7f11237fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f11240d3310 0x7f112406cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:11.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.027+0000 7f111a7fc640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f11240cf670 0x7f11240d2c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51690/0 (socket says 172.21.15.73:51690) 2024-03-29T04:10:11.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.027+0000 7f111a7fc640 1 -- 172.21.15.73:0/4152106478 learned_addr learned my addr 172.21.15.73:0/4152106478 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:10:11.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.027+0000 7f1122ffd640 1 --2- 172.21.15.73:0/4152106478 >> v2:172.21.15.142:3300/0 conn(0x7f112415e930 0x7f11240cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:11.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.027+0000 7f11237fe640 1 -- 172.21.15.73:0/4152106478 >> v2:172.21.15.142:3300/0 conn(0x7f112415e930 msgr2=0x7f11240cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:11.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.027+0000 7f11237fe640 1 --2- 172.21.15.73:0/4152106478 >> v2:172.21.15.142:3300/0 conn(0x7f112415e930 0x7f11240cf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:11.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.027+0000 7f11237fe640 1 -- 172.21.15.73:0/4152106478 >> v1:172.21.15.73:6789/0 conn(0x7f11240cf670 legacy=0x7f11240d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:11.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.027+0000 7f11237fe640 1 -- 172.21.15.73:0/4152106478 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11240d00f0 con 0x7f11240d3310 2024-03-29T04:10:11.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.027+0000 7f11227fc640 1 -- 172.21.15.73:0/4152106478 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1558809020 0 0) 0x7f11240cfb30 con 0x7f11240cf670 2024-03-29T04:10:11.012 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.027+0000 7f1122ffd640 1 --2- 172.21.15.73:0/4152106478 >> v2:172.21.15.142:3300/0 conn(0x7f112415e930 0x7f11240cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:10:11.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.028+0000 7f11237fe640 1 --2- 172.21.15.73:0/4152106478 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11240d3310 0x7f112406cc10 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f112406c400 tx=0x7f111c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5caba82920ad3e27 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:11.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.028+0000 7f11227fc640 1 -- 172.21.15.73:0/4152106478 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111c039070 con 0x7f11240d3310 2024-03-29T04:10:11.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.028+0000 7f11227fc640 1 -- 172.21.15.73:0/4152106478 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f111c02cbf0 con 0x7f11240d3310 2024-03-29T04:10:11.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.028+0000 7f11227fc640 1 -- 172.21.15.73:0/4152106478 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111c034440 con 0x7f11240d3310 2024-03-29T04:10:11.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.028+0000 7f11299bd640 1 -- 172.21.15.73:0/4152106478 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11240d3310 msgr2=0x7f112406cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:11.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.028+0000 7f11299bd640 1 --2- 172.21.15.73:0/4152106478 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11240d3310 0x7f112406cc10 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f112406c400 tx=0x7f111c02be40 comp rx=0 tx=0).stop 2024-03-29T04:10:11.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.028+0000 7f11299bd640 1 -- 172.21.15.73:0/4152106478 shutdown_connections 2024-03-29T04:10:11.013 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.028+0000 7f11299bd640 1 --2- 172.21.15.73:0/4152106478 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11240d3310 0x7f112406cc10 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:11.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.028+0000 7f11299bd640 1 --2- 172.21.15.73:0/4152106478 >> v2:172.21.15.142:3300/0 conn(0x7f112415e930 0x7f11240cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:11.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.028+0000 7f11299bd640 1 -- 172.21.15.73:0/4152106478 >> 172.21.15.73:0/4152106478 conn(0x7f112408bfc0 msgr2=0x7f11240d4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:11.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.028+0000 7f11299bd640 1 -- 172.21.15.73:0/4152106478 shutdown_connections 2024-03-29T04:10:11.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.028+0000 7f11299bd640 1 -- 172.21.15.73:0/4152106478 wait complete. 2024-03-29T04:10:11.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.030+0000 7f11299bd640 1 Processor -- start 2024-03-29T04:10:11.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.030+0000 7f11299bd640 1 -- start start 2024-03-29T04:10:11.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.030+0000 7f11299bd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11240cf670 0x7f11241f4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:11.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.030+0000 7f11299bd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11240d3310 0x7f11241600c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:11.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.030+0000 7f11299bd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f112415e930 0x7f11240d4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:11.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.030+0000 7f11299bd640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f112415ee90 con 0x7f11240d3310 2024-03-29T04:10:11.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.030+0000 7f11299bd640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f112415ed10 con 0x7f11240cf670 2024-03-29T04:10:11.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.030+0000 7f11299bd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f11240b3c50 con 0x7f112415e930 2024-03-29T04:10:11.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.031+0000 7f111a7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11240d3310 0x7f11241600c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:11.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.031+0000 7f111a7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11240d3310 0x7f11241600c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35528/0 (socket says 172.21.15.73:35528) 2024-03-29T04:10:11.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.031+0000 7f111a7fc640 1 -- 172.21.15.73:0/3128720441 learned_addr learned my addr 172.21.15.73:0/3128720441 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:11.015 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.031+0000 7f1122ffd640 1 --2- 172.21.15.73:0/3128720441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11240cf670 0x7f11241f4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:11.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.031+0000 7f11237fe640 1 --2- 172.21.15.73:0/3128720441 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f112415e930 0x7f11240d4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:11.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.031+0000 7f111a7fc640 1 -- 172.21.15.73:0/3128720441 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f112415e930 msgr2=0x7f11240d4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:11.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.031+0000 7f111a7fc640 1 --2- 172.21.15.73:0/3128720441 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f112415e930 0x7f11240d4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:11.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.031+0000 7f111a7fc640 1 -- 172.21.15.73:0/3128720441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11240cf670 msgr2=0x7f11241f4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:11.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.031+0000 7f111a7fc640 1 --2- 172.21.15.73:0/3128720441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11240cf670 0x7f11241f4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:11.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.031+0000 7f111a7fc640 1 -- 172.21.15.73:0/3128720441 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11241607c0 con 0x7f11240d3310 2024-03-29T04:10:11.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.031+0000 7f111a7fc640 1 --2- 172.21.15.73:0/3128720441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11240d3310 0x7f11241600c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f110c00c4a0 tx=0x7f110c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:11.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.031+0000 7f1120ff9640 1 -- 172.21.15.73:0/3128720441 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f110c017070 con 0x7f11240d3310 2024-03-29T04:10:11.016 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.031+0000 7f1120ff9640 1 -- 172.21.15.73:0/3128720441 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f110c005ce0 con 0x7f11240d3310 2024-03-29T04:10:11.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.031+0000 7f11299bd640 1 -- 172.21.15.73:0/3128720441 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1124160aa0 con 0x7f11240d3310 2024-03-29T04:10:11.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.031+0000 7f1120ff9640 1 -- 172.21.15.73:0/3128720441 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f110c0072b0 con 0x7f11240d3310 2024-03-29T04:10:11.017 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.031+0000 7f11299bd640 1 -- 172.21.15.73:0/3128720441 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1124161060 con 0x7f11240d3310 2024-03-29T04:10:11.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.032+0000 7f11299bd640 1 -- 172.21.15.73:0/3128720441 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1124068640 con 0x7f11240d3310 2024-03-29T04:10:11.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.033+0000 7f1120ff9640 1 -- 172.21.15.73:0/3128720441 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f110c01a070 con 0x7f11240d3310 2024-03-29T04:10:11.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.033+0000 7f1120ff9640 1 --2- 172.21.15.73:0/3128720441 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f110406c530 0x7f110406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:11.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.033+0000 7f1120ff9640 1 -- 172.21.15.73:0/3128720441 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f110c08a7d0 con 0x7f11240d3310 2024-03-29T04:10:11.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.033+0000 7f1122ffd640 1 --2- 172.21.15.73:0/3128720441 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f110406c530 0x7f110406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:11.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.033+0000 7f1122ffd640 1 --2- 172.21.15.73:0/3128720441 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f110406c530 0x7f110406e9f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f111400a950 tx=0x7f1114008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:11.019 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.037+0000 7f1120ff9640 1 -- 172.21.15.73:0/3128720441 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f110c0590f0 con 0x7f11240d3310 2024-03-29T04:10:11.192 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.213+0000 7f11299bd640 1 -- 172.21.15.73:0/3128720441 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f112406d750 con 0x7f11240d3310 2024-03-29T04:10:11.193 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.213+0000 7f1120ff9640 1 -- 172.21.15.73:0/3128720441 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+13018 (secure 0 0 0) 0x7f110c0589f0 con 0x7f11240d3310 2024-03-29T04:10:11.193 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:10:11.193 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":35,"fsid":"6bff1617-b138-4517-acca-3ecaae3f2bb3","created":"2024-03-29T04:07:47.346864+0000","modified":"2024-03-29T04:10:07.862938+0000","last_up_change":"2024-03-29T04:07:58.507139+0000","last_in_change":"2024-03-29T04:07:49.637816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-29T04:07:59.537301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"925d7de1-14ab-48c0-aebd-7bded108f808","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6820","nonce":2387335359}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6824","nonce":2387335359}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6831","nonce":2387335359}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2387335359},{"type":"v1","addr":"172.21.15.73:6828","nonce":2387335359}]},"public_addr":"172.21.15.73:6820/2387335359","cluster_addr":"172.21.15.73:6824/2387335359","heartbeat_back_addr":"172.21.15.73:6831/2387335359","heartbeat_front_addr":"172.21.15.73:6828/2387335359","state":["exists","up"]},{"osd":1,"uuid":"6b182102-882a-4e0c-99db-0afae5cfb38b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6801","nonce":2431315515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6803","nonce":2431315515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6807","nonce":2431315515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":2431315515},{"type":"v1","addr":"172.21.15.73:6805","nonce":2431315515}]},"public_addr":"172.21.15.73:6801/2431315515","cluster_addr":"172.21.15.73:6803/2431315515","heartbeat_back_addr":"172.21.15.73:6807/2431315515","heartbeat_front_addr":"172.21.15.73:6805/2431315515","state":["exists","up"]},{"osd":2,"uuid":"8040902e-b0b8-4a21-bf64-ce1c222115ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6809","nonce":407236597}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6811","nonce":407236597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6815","nonce":407236597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":407236597},{"type":"v1","addr":"172.21.15.73:6813","nonce":407236597}]},"public_addr":"172.21.15.73:6809/407236597","cluster_addr":"172.21.15.73:6811/407236597","heartbeat_back_addr":"172.21.15.73:6815/407236597","heartbeat_front_addr":"172.21.15.73:6813/407236597","state":["exists","up"]},{"osd":3,"uuid":"1bab19ee-3775-4ce1-a4ce-cf7cda3bbbf8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6817","nonce":4291100709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6819","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6821","nonce":4291100709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6827","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6829","nonce":4291100709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6823","nonce":4291100709},{"type":"v1","addr":"172.21.15.73:6825","nonce":4291100709}]},"public_addr":"172.21.15.73:6817/4291100709","cluster_addr":"172.21.15.73:6821/4291100709","heartbeat_back_addr":"172.21.15.73:6829/4291100709","heartbeat_front_addr":"172.21.15.73:6825/4291100709","state":["exists","up"]},{"osd":4,"uuid":"b0c74337-8fe4-47dc-b3da-2d07591b1f6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6817","nonce":3703256194}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6819","nonce":3703256194}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6823","nonce":3703256194}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":3703256194},{"type":"v1","addr":"172.21.15.142:6821","nonce":3703256194}]},"public_addr":"172.21.15.142:6817/3703256194","cluster_addr":"172.21.15.142:6819/3703256194","heartbeat_back_addr":"172.21.15.142:6823/3703256194","heartbeat_front_addr":"172.21.15.142:6821/3703256194","state":["exists","up"]},{"osd":5,"uuid":"9ce36410-a29a-42c6-99f4-f95d4afdd7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6825","nonce":4271575803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6827","nonce":4271575803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6831","nonce":4271575803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":4271575803},{"type":"v1","addr":"172.21.15.142:6829","nonce":4271575803}]},"public_addr":"172.21.15.142:6825/4271575803","cluster_addr":"172.21.15.142:6827/4271575803","heartbeat_back_addr":"172.21.15.142:6831/4271575803","heartbeat_front_addr":"172.21.15.142:6829/4271575803","state":["exists","up"]},{"osd":6,"uuid":"aec4264a-64ac-428e-a860-d2920a304019","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6801","nonce":1772722570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6803","nonce":1772722570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6807","nonce":1772722570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":1772722570},{"type":"v1","addr":"172.21.15.142:6805","nonce":1772722570}]},"public_addr":"172.21.15.142:6801/1772722570","cluster_addr":"172.21.15.142:6803/1772722570","heartbeat_back_addr":"172.21.15.142:6807/1772722570","heartbeat_front_addr":"172.21.15.142:6805/1772722570","state":["exists","up"]},{"osd":7,"uuid":"fe599052-8e5a-4c7a-91e7-52d1bae24a42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6809","nonce":3910589675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6811","nonce":3910589675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6815","nonce":3910589675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3910589675},{"type":"v1","addr":"172.21.15.142:6813","nonce":3910589675}]},"public_addr":"172.21.15.142:6809/3910589675","cluster_addr":"172.21.15.142:6811/3910589675","heartbeat_back_addr":"172.21.15.142:6815/3910589675","heartbeat_front_addr":"172.21.15.142:6813/3910589675","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.835096+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.587210+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.786547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.778004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.843740+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.791160+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.837992+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-29T04:07:54.718722+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6836/936189393":"2024-03-30T04:10:04.767029+0000","172.21.15.73:6834/936189393":"2024-03-30T04:10:04.767029+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-29T04:10:11.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.216+0000 7f11299bd640 1 -- 172.21.15.73:0/3128720441 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f110406c530 msgr2=0x7f110406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:11.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.216+0000 7f11299bd640 1 --2- 172.21.15.73:0/3128720441 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f110406c530 0x7f110406e9f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f111400a950 tx=0x7f1114008040 comp rx=0 tx=0).stop 2024-03-29T04:10:11.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.216+0000 7f11299bd640 1 -- 172.21.15.73:0/3128720441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11240d3310 msgr2=0x7f11241600c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:11.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.216+0000 7f11299bd640 1 --2- 172.21.15.73:0/3128720441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11240d3310 0x7f11241600c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f110c00c4a0 tx=0x7f110c00c960 comp rx=0 tx=0).stop 2024-03-29T04:10:11.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.216+0000 7f11299bd640 1 -- 172.21.15.73:0/3128720441 shutdown_connections 2024-03-29T04:10:11.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.216+0000 7f11299bd640 1 --2- 172.21.15.73:0/3128720441 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f112415e930 0x7f11240d4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:11.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.216+0000 7f11299bd640 1 --2- 172.21.15.73:0/3128720441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11240d3310 0x7f11241600c0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:11.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.216+0000 7f11299bd640 1 --2- 172.21.15.73:0/3128720441 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f110406c530 0x7f110406e9f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:11.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.216+0000 7f11299bd640 1 --2- 172.21.15.73:0/3128720441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f11240cf670 0x7f11241f4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:11.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.216+0000 7f11299bd640 1 -- 172.21.15.73:0/3128720441 >> 172.21.15.73:0/3128720441 conn(0x7f112408bfc0 msgr2=0x7f1124153b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:11.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.216+0000 7f11299bd640 1 -- 172.21.15.73:0/3128720441 shutdown_connections 2024-03-29T04:10:11.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:11.216+0000 7f11299bd640 1 -- 172.21.15.73:0/3128720441 wait complete. 2024-03-29T04:10:12.207 INFO:tasks.ceph:Scrubbing osd.0 2024-03-29T04:10:12.207 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-03-29T04:10:12.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.335+0000 7f9902cb7640 1 Processor -- start 2024-03-29T04:10:12.314 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.335+0000 7f9902cb7640 1 -- start start 2024-03-29T04:10:12.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.335+0000 7f9902cb7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98fc0d0ba0 0x7f98fc160180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:12.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.336+0000 7f9902cb7640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98fc06e300 con 0x7f98fc15d630 2024-03-29T04:10:12.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.336+0000 7f9902cb7640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98fc06e5e0 con 0x7f98fc156ba0 2024-03-29T04:10:12.317 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.336+0000 7f9902cb7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f98fc15ce50 con 0x7f98fc0d0ba0 2024-03-29T04:10:12.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.336+0000 7f98fbfff640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f98fc15d630 0x7f98fc0d0490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51692/0 (socket says 172.21.15.73:51692) 2024-03-29T04:10:12.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.336+0000 7f98fbfff640 1 -- 172.21.15.73:0/556931352 learned_addr learned my addr 172.21.15.73:0/556931352 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:10:12.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.336+0000 7f9901254640 1 --2- 172.21.15.73:0/556931352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98fc0d0ba0 0x7f98fc160180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:12.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.336+0000 7f98fb7fe640 1 -- 172.21.15.73:0/556931352 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3869880737 0 0) 0x7f98fc06e300 con 0x7f98fc15d630 2024-03-29T04:10:12.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.336+0000 7f98fb7fe640 1 -- 172.21.15.73:0/556931352 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98ec003520 con 0x7f98fc15d630 2024-03-29T04:10:12.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.336+0000 7f98fb7fe640 1 -- 172.21.15.73:0/556931352 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3780233005 0 0) 0x7f98fc06e5e0 con 0x7f98fc156ba0 2024-03-29T04:10:12.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.336+0000 7f98fb7fe640 1 -- 172.21.15.73:0/556931352 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98fc06e300 con 0x7f98fc156ba0 2024-03-29T04:10:12.318 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.336+0000 7f98fb7fe640 1 -- 172.21.15.73:0/556931352 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2265271647 0 0) 0x7f98ec003520 con 0x7f98fc15d630 2024-03-29T04:10:12.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.336+0000 7f98fb7fe640 1 -- 172.21.15.73:0/556931352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98fc0d0ba0 msgr2=0x7f98fc160180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:12.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.336+0000 7f98fb7fe640 1 --2- 172.21.15.73:0/556931352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98fc0d0ba0 0x7f98fc160180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:12.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.336+0000 7f98fb7fe640 1 -- 172.21.15.73:0/556931352 >> v1:172.21.15.142:6789/0 conn(0x7f98fc156ba0 legacy=0x7f98fc06d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:12.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.336+0000 7f98fb7fe640 1 -- 172.21.15.73:0/556931352 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98fc15d130 con 0x7f98fc15d630 2024-03-29T04:10:12.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.336+0000 7f98fb7fe640 1 -- 172.21.15.73:0/556931352 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1290421750 0 0) 0x7f98e8001670 con 0x7f98fc15d630 2024-03-29T04:10:12.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.336+0000 7f98fb7fe640 1 -- 172.21.15.73:0/556931352 >> v1:172.21.15.73:6789/0 conn(0x7f98fc15d630 legacy=0x7f98fc0d0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:12.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.336+0000 7f98fb7fe640 1 --2- 172.21.15.73:0/556931352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98ec003b70 0x7f98ec003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:12.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.336+0000 7f98fb7fe640 1 --2- 172.21.15.73:0/556931352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98fc0d0ba0 0x7f98ec004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:12.319 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.336+0000 7f98fb7fe640 1 --2- 172.21.15.73:0/556931352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98ec004d40 0x7f98ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:12.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.336+0000 7f98fb7fe640 1 -- 172.21.15.73:0/556931352 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f98fc15ce50 con 0x7f98ec003b70 2024-03-29T04:10:12.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.336+0000 7f98fb7fe640 1 -- 172.21.15.73:0/556931352 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f98ec00bb50 con 0x7f98ec004d40 2024-03-29T04:10:12.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.336+0000 7f98fb7fe640 1 -- 172.21.15.73:0/556931352 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f98ec00bd20 con 0x7f98fc0d0ba0 2024-03-29T04:10:12.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.336+0000 7f9900a53640 1 --2- 172.21.15.73:0/556931352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98ec003b70 0x7f98ec003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:12.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.337+0000 7f98fbfff640 1 --2- 172.21.15.73:0/556931352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98fc0d0ba0 0x7f98ec004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:12.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.336+0000 7f9901254640 1 --2- 172.21.15.73:0/556931352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98ec004d40 0x7f98ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:12.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.337+0000 7f9900a53640 1 -- 172.21.15.73:0/556931352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98fc0d0ba0 msgr2=0x7f98ec004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:12.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.337+0000 7f9900a53640 1 --2- 172.21.15.73:0/556931352 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98fc0d0ba0 0x7f98ec004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:12.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.337+0000 7f9900a53640 1 -- 172.21.15.73:0/556931352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98ec004d40 msgr2=0x7f98ec0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:12.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.337+0000 7f9900a53640 1 --2- 172.21.15.73:0/556931352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98ec004d40 0x7f98ec0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:12.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.337+0000 7f9900a53640 1 -- 172.21.15.73:0/556931352 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98ec003520 con 0x7f98ec003b70 2024-03-29T04:10:12.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.337+0000 7f9901254640 1 --2- 172.21.15.73:0/556931352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98ec004d40 0x7f98ec0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:10:12.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.338+0000 7f9900a53640 1 --2- 172.21.15.73:0/556931352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98ec003b70 0x7f98ec003f70 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f98f0001900 tx=0x7f98ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed13f10fbc24f2d server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:12.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.338+0000 7f98fb7fe640 1 -- 172.21.15.73:0/556931352 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f0037070 con 0x7f98ec003b70 2024-03-29T04:10:12.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.338+0000 7f98fb7fe640 1 -- 172.21.15.73:0/556931352 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98f00052d0 con 0x7f98ec003b70 2024-03-29T04:10:12.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.338+0000 7f98fb7fe640 1 -- 172.21.15.73:0/556931352 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f00014f0 con 0x7f98ec003b70 2024-03-29T04:10:12.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.338+0000 7f9902cb7640 1 -- 172.21.15.73:0/556931352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98ec003b70 msgr2=0x7f98ec003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:12.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.338+0000 7f9902cb7640 1 --2- 172.21.15.73:0/556931352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98ec003b70 0x7f98ec003f70 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f98f0001900 tx=0x7f98ec005830 comp rx=0 tx=0).stop 2024-03-29T04:10:12.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.338+0000 7f9901254640 1 -- 172.21.15.73:0/556931352 reap_dead start 2024-03-29T04:10:12.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.338+0000 7f9902cb7640 1 -- 172.21.15.73:0/556931352 shutdown_connections 2024-03-29T04:10:12.325 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.338+0000 7f9902cb7640 1 -- 172.21.15.73:0/556931352 >> 172.21.15.73:0/556931352 conn(0x7f98fc06b6f0 msgr2=0x7f98fc06bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:12.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.338+0000 7f9902cb7640 1 -- 172.21.15.73:0/556931352 shutdown_connections 2024-03-29T04:10:12.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.339+0000 7f9902cb7640 1 -- 172.21.15.73:0/556931352 wait complete. 2024-03-29T04:10:12.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.340+0000 7f9902cb7640 1 Processor -- start 2024-03-29T04:10:12.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.340+0000 7f9902cb7640 1 -- start start 2024-03-29T04:10:12.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.342+0000 7f9902cb7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98ec003b70 0x7f98fc0b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:12.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.342+0000 7f9902cb7640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98fc14b940 0x7f98fc0afb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:12.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.342+0000 7f9902cb7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98fc14bdc0 0x7f98fc150d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:12.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.342+0000 7f9902cb7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f98fc0ad3d0 con 0x7f98fc14bdc0 2024-03-29T04:10:12.326 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.342+0000 7f9902cb7640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f98fc15dac0 con 0x7f98ec003b70 2024-03-29T04:10:12.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.342+0000 7f9902cb7640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f98fc156f80 con 0x7f98fc14b940 2024-03-29T04:10:12.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.342+0000 7f9901254640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98fc14bdc0 0x7f98fc150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:12.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.342+0000 7f9901254640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98fc14bdc0 0x7f98fc150d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35538/0 (socket says 172.21.15.73:35538) 2024-03-29T04:10:12.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.342+0000 7f9901254640 1 -- 172.21.15.73:0/3233234239 learned_addr learned my addr 172.21.15.73:0/3233234239 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:12.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.342+0000 7f9900a53640 1 --2- 172.21.15.73:0/3233234239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98ec003b70 0x7f98fc0b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:12.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.342+0000 7f98fbfff640 1 --2- 172.21.15.73:0/3233234239 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98fc14b940 0x7f98fc0afb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:12.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.342+0000 7f9901254640 1 -- 172.21.15.73:0/3233234239 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98fc14b940 msgr2=0x7f98fc0afb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:12.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.342+0000 7f9901254640 1 --2- 172.21.15.73:0/3233234239 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98fc14b940 0x7f98fc0afb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:12.327 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.342+0000 7f9901254640 1 -- 172.21.15.73:0/3233234239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98ec003b70 msgr2=0x7f98fc0b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:12.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.342+0000 7f9901254640 1 --2- 172.21.15.73:0/3233234239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98ec003b70 0x7f98fc0b1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:12.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.342+0000 7f9901254640 1 -- 172.21.15.73:0/3233234239 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98fc0b05f0 con 0x7f98fc14bdc0 2024-03-29T04:10:12.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.342+0000 7f9901254640 1 --2- 172.21.15.73:0/3233234239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98fc14bdc0 0x7f98fc150d30 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f98fc15da10 tx=0x7f98f4010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:12.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.342+0000 7f98f97fa640 1 -- 172.21.15.73:0/3233234239 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f401a030 con 0x7f98fc14bdc0 2024-03-29T04:10:12.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.342+0000 7f98f97fa640 1 -- 172.21.15.73:0/3233234239 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98f4003990 con 0x7f98fc14bdc0 2024-03-29T04:10:12.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.342+0000 7f9902cb7640 1 -- 172.21.15.73:0/3233234239 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98fc0b08d0 con 0x7f98fc14bdc0 2024-03-29T04:10:12.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.343+0000 7f98f97fa640 1 -- 172.21.15.73:0/3233234239 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f4003d80 con 0x7f98fc14bdc0 2024-03-29T04:10:12.328 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.343+0000 7f9902cb7640 1 -- 172.21.15.73:0/3233234239 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98fc0b0e90 con 0x7f98fc14bdc0 2024-03-29T04:10:12.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.343+0000 7f9902cb7640 1 -- 172.21.15.73:0/3233234239 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f98fc0b1270 con 0x7f98fc14bdc0 2024-03-29T04:10:12.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.344+0000 7f98f97fa640 1 -- 172.21.15.73:0/3233234239 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f98f401d070 con 0x7f98fc14bdc0 2024-03-29T04:10:12.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.344+0000 7f98f97fa640 1 --2- 172.21.15.73:0/3233234239 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f98e006c530 0x7f98e006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:12.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.344+0000 7f98f97fa640 1 -- 172.21.15.73:0/3233234239 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f98f408ba50 con 0x7f98fc14bdc0 2024-03-29T04:10:12.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.344+0000 7f9900a53640 1 --2- 172.21.15.73:0/3233234239 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f98e006c530 0x7f98e006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:12.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.345+0000 7f98f97fa640 1 --2- 172.21.15.73:0/3233234239 >> [v2:172.21.15.73:6818/2387335359,v1:172.21.15.73:6820/2387335359] conn(0x7f98e00723f0 0x7f98e0074810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:12.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.345+0000 7f98f97fa640 1 -- 172.21.15.73:0/3233234239 --> [v2:172.21.15.73:6818/2387335359,v1:172.21.15.73:6820/2387335359] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f98f4018e50 con 0x7f98e00723f0 2024-03-29T04:10:12.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.345+0000 7f98f97fa640 1 -- 172.21.15.73:0/3233234239 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f98f40902c0 con 0x7f98fc14bdc0 2024-03-29T04:10:12.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.345+0000 7f98fbfff640 1 --2- 172.21.15.73:0/3233234239 >> [v2:172.21.15.73:6818/2387335359,v1:172.21.15.73:6820/2387335359] conn(0x7f98e00723f0 0x7f98e0074810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:12.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.345+0000 7f9900a53640 1 --2- 172.21.15.73:0/3233234239 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f98e006c530 0x7f98e006e9f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f98f0034000 tx=0x7f98f0031000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:12.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.345+0000 7f98fbfff640 1 --2- 172.21.15.73:0/3233234239 >> [v2:172.21.15.73:6818/2387335359,v1:172.21.15.73:6820/2387335359] conn(0x7f98e00723f0 0x7f98e0074810 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:12.330 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.346+0000 7f98f97fa640 1 -- 172.21.15.73:0/3233234239 <== osd.0 v2:172.21.15.73:6818/2387335359 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f98f4018e50 con 0x7f98e00723f0 2024-03-29T04:10:12.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.359+0000 7f9902cb7640 1 -- 172.21.15.73:0/3233234239 --> [v2:172.21.15.73:6818/2387335359,v1:172.21.15.73:6820/2387335359] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f98fc068640 con 0x7f98e00723f0 2024-03-29T04:10:12.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.359+0000 7f98f97fa640 1 -- 172.21.15.73:0/3233234239 <== osd.0 v2:172.21.15.73:6818/2387335359 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f98fc068640 con 0x7f98e00723f0 2024-03-29T04:10:12.339 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-29T04:10:12.339 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-29T04:10:12.339 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-29T04:10:12.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.359+0000 7f9902cb7640 1 -- 172.21.15.73:0/3233234239 >> [v2:172.21.15.73:6818/2387335359,v1:172.21.15.73:6820/2387335359] conn(0x7f98e00723f0 msgr2=0x7f98e0074810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:12.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.359+0000 7f9902cb7640 1 --2- 172.21.15.73:0/3233234239 >> [v2:172.21.15.73:6818/2387335359,v1:172.21.15.73:6820/2387335359] conn(0x7f98e00723f0 0x7f98e0074810 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:12.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.359+0000 7f9902cb7640 1 -- 172.21.15.73:0/3233234239 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f98e006c530 msgr2=0x7f98e006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:12.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.359+0000 7f9902cb7640 1 --2- 172.21.15.73:0/3233234239 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f98e006c530 0x7f98e006e9f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f98f0034000 tx=0x7f98f0031000 comp rx=0 tx=0).stop 2024-03-29T04:10:12.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.359+0000 7f9902cb7640 1 -- 172.21.15.73:0/3233234239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98fc14bdc0 msgr2=0x7f98fc150d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:12.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.359+0000 7f9902cb7640 1 --2- 172.21.15.73:0/3233234239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98fc14bdc0 0x7f98fc150d30 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f98fc15da10 tx=0x7f98f4010590 comp rx=0 tx=0).stop 2024-03-29T04:10:12.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.359+0000 7f9901254640 1 -- 172.21.15.73:0/3233234239 reap_dead start 2024-03-29T04:10:12.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.359+0000 7f9902cb7640 1 -- 172.21.15.73:0/3233234239 shutdown_connections 2024-03-29T04:10:12.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.359+0000 7f9902cb7640 1 -- 172.21.15.73:0/3233234239 >> 172.21.15.73:0/3233234239 conn(0x7f98fc06b6f0 msgr2=0x7f98fc0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:12.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.359+0000 7f9902cb7640 1 -- 172.21.15.73:0/3233234239 shutdown_connections 2024-03-29T04:10:12.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.360+0000 7f9902cb7640 1 -- 172.21.15.73:0/3233234239 wait complete. 2024-03-29T04:10:12.349 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-03-29T04:10:12.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.474+0000 7f5b01ff0640 1 Processor -- start 2024-03-29T04:10:12.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.474+0000 7f5b01ff0640 1 -- start start 2024-03-29T04:10:12.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.474+0000 7f5b01ff0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5afc15e780 0x7f5afc0cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:12.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.474+0000 7f5b01ff0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5afc15eb60 0x7f5afc0cf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:12.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.474+0000 7f5b01ff0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5afc0cfe70 con 0x7f5afc0cf640 2024-03-29T04:10:12.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.474+0000 7f5b01ff0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f5afc0b7f50 con 0x7f5afc15eb60 2024-03-29T04:10:12.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.474+0000 7f5b01ff0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f5afc0b8230 con 0x7f5afc15e780 2024-03-29T04:10:12.462 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.475+0000 7f5afb7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5afc15e780 0x7f5afc0cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:12.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.475+0000 7f5afaffd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5afc15eb60 0x7f5afc0cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:12.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.475+0000 7f5afbfff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f5afc0cf640 0x7f5afc0b8ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.73:44362/0 (socket says 172.21.15.73:44362) 2024-03-29T04:10:12.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.475+0000 7f5afb7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5afc15e780 0x7f5afc0cebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:35648/0 (socket says 172.21.15.73:35648) 2024-03-29T04:10:12.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.475+0000 7f5afbfff640 1 -- 172.21.15.73:0/1082990750 learned_addr learned my addr 172.21.15.73:0/1082990750 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:10:12.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.475+0000 7f5afaffd640 1 -- 172.21.15.73:0/1082990750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5afc15e780 msgr2=0x7f5afc0cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:12.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.475+0000 7f5afaffd640 1 --2- 172.21.15.73:0/1082990750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5afc15e780 0x7f5afc0cebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:12.463 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.475+0000 7f5afaffd640 1 -- 172.21.15.73:0/1082990750 >> v1:172.21.15.142:6789/0 conn(0x7f5afc0cf640 legacy=0x7f5afc0b8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:12.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.475+0000 7f5afaffd640 1 -- 172.21.15.73:0/1082990750 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5afc0b8510 con 0x7f5afc15eb60 2024-03-29T04:10:12.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.476+0000 7f5afaffd640 1 --2- 172.21.15.73:0/1082990750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5afc15eb60 0x7f5afc0cf100 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5af00097a0 tx=0x7f5af002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b4d05d80e41f890 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:12.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.476+0000 7f5afa7fc640 1 -- 172.21.15.73:0/1082990750 <== mon.1 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af0035020 con 0x7f5afc15eb60 2024-03-29T04:10:12.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.476+0000 7f5afa7fc640 1 -- 172.21.15.73:0/1082990750 <== mon.1 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5af0031830 con 0x7f5afc15eb60 2024-03-29T04:10:12.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.476+0000 7f5afa7fc640 1 -- 172.21.15.73:0/1082990750 <== mon.1 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af0031c00 con 0x7f5afc15eb60 2024-03-29T04:10:12.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.477+0000 7f5b01ff0640 1 -- 172.21.15.73:0/1082990750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5afc15eb60 msgr2=0x7f5afc0cf100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:12.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.477+0000 7f5b01ff0640 1 --2- 172.21.15.73:0/1082990750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5afc15eb60 0x7f5afc0cf100 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5af00097a0 tx=0x7f5af002b8d0 comp rx=0 tx=0).stop 2024-03-29T04:10:12.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.477+0000 7f5b01ff0640 1 -- 172.21.15.73:0/1082990750 shutdown_connections 2024-03-29T04:10:12.464 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.477+0000 7f5b01ff0640 1 --2- 172.21.15.73:0/1082990750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5afc15eb60 0x7f5afc0cf100 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:12.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.477+0000 7f5b01ff0640 1 --2- 172.21.15.73:0/1082990750 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5afc15e780 0x7f5afc0cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:12.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.477+0000 7f5b01ff0640 1 -- 172.21.15.73:0/1082990750 >> 172.21.15.73:0/1082990750 conn(0x7f5afc08bfc0 msgr2=0x7f5afc0d4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:12.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.477+0000 7f5b01ff0640 1 -- 172.21.15.73:0/1082990750 shutdown_connections 2024-03-29T04:10:12.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.477+0000 7f5b01ff0640 1 -- 172.21.15.73:0/1082990750 wait complete. 2024-03-29T04:10:12.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.478+0000 7f5b01ff0640 1 Processor -- start 2024-03-29T04:10:12.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.478+0000 7f5b01ff0640 1 -- start start 2024-03-29T04:10:12.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.479+0000 7f5b01ff0640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5afc0cf640 0x7f5afc1e8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:12.465 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.479+0000 7f5b01ff0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5afc15e780 0x7f5afc1e7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:12.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.479+0000 7f5b01ff0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5afc09f9e0 0x7f5afc0cc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:12.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.479+0000 7f5b01ff0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5afc0d3580 con 0x7f5afc09f9e0 2024-03-29T04:10:12.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.479+0000 7f5b01ff0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5afc0b8ad0 con 0x7f5afc15e780 2024-03-29T04:10:12.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.479+0000 7f5b01ff0640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f5afc0d3700 con 0x7f5afc0cf640 2024-03-29T04:10:12.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.479+0000 7f5afbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5afc09f9e0 0x7f5afc0cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:12.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.479+0000 7f5afbfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5afc09f9e0 0x7f5afc0cc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35550/0 (socket says 172.21.15.73:35550) 2024-03-29T04:10:12.466 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.479+0000 7f5afbfff640 1 -- 172.21.15.73:0/2264218183 learned_addr learned my addr 172.21.15.73:0/2264218183 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:12.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.479+0000 7f5afaffd640 1 --2- 172.21.15.73:0/2264218183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5afc15e780 0x7f5afc1e7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:12.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.479+0000 7f5afb7fe640 1 --2- 172.21.15.73:0/2264218183 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5afc0cf640 0x7f5afc1e8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:12.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.479+0000 7f5afbfff640 1 -- 172.21.15.73:0/2264218183 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5afc0cf640 msgr2=0x7f5afc1e8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:12.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.479+0000 7f5afbfff640 1 --2- 172.21.15.73:0/2264218183 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5afc0cf640 0x7f5afc1e8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:12.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.479+0000 7f5afbfff640 1 -- 172.21.15.73:0/2264218183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5afc15e780 msgr2=0x7f5afc1e7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:12.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.479+0000 7f5afbfff640 1 --2- 172.21.15.73:0/2264218183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5afc15e780 0x7f5afc1e7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:12.467 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.479+0000 7f5afbfff640 1 -- 172.21.15.73:0/2264218183 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5afc09fe90 con 0x7f5afc09f9e0 2024-03-29T04:10:12.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.479+0000 7f5afbfff640 1 --2- 172.21.15.73:0/2264218183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5afc09f9e0 0x7f5afc0cc690 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5af400ca80 tx=0x7f5af400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:12.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.479+0000 7f5ae3fff640 1 -- 172.21.15.73:0/2264218183 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af4017070 con 0x7f5afc09f9e0 2024-03-29T04:10:12.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.480+0000 7f5ae3fff640 1 -- 172.21.15.73:0/2264218183 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5af400ac30 con 0x7f5afc09f9e0 2024-03-29T04:10:12.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.480+0000 7f5ae3fff640 1 -- 172.21.15.73:0/2264218183 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af4012600 con 0x7f5afc09f9e0 2024-03-29T04:10:12.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.480+0000 7f5b01ff0640 1 -- 172.21.15.73:0/2264218183 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5afc0a01d0 con 0x7f5afc09f9e0 2024-03-29T04:10:12.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.480+0000 7f5b01ff0640 1 -- 172.21.15.73:0/2264218183 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5afc0a0a10 con 0x7f5afc09f9e0 2024-03-29T04:10:12.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.480+0000 7f5b01ff0640 1 -- 172.21.15.73:0/2264218183 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5afc068640 con 0x7f5afc09f9e0 2024-03-29T04:10:12.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.481+0000 7f5ae3fff640 1 -- 172.21.15.73:0/2264218183 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f5af401a070 con 0x7f5afc09f9e0 2024-03-29T04:10:12.468 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.481+0000 7f5ae3fff640 1 --2- 172.21.15.73:0/2264218183 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f5ae806c530 0x7f5ae806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:12.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.481+0000 7f5ae3fff640 1 -- 172.21.15.73:0/2264218183 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f5af408b040 con 0x7f5afc09f9e0 2024-03-29T04:10:12.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.481+0000 7f5afb7fe640 1 --2- 172.21.15.73:0/2264218183 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f5ae806c530 0x7f5ae806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:12.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.482+0000 7f5afb7fe640 1 --2- 172.21.15.73:0/2264218183 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f5ae806c530 0x7f5ae806e9f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5aec009b40 tx=0x7f5aec009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:12.469 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.486+0000 7f5ae3fff640 1 -- 172.21.15.73:0/2264218183 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f5afc0a01d0 con 0x7f5afc09f9e0 2024-03-29T04:10:12.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.661+0000 7f5b01ff0640 1 -- 172.21.15.73:0/2264218183 --> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f5afc0a03b0 con 0x7f5ae806c530 2024-03-29T04:10:12.641 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.661+0000 7f5ae3fff640 1 -- 172.21.15.73:0/2264218183 <== mgr.4104 v2:172.21.15.73:6832/1640471941 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5afc0a03b0 con 0x7f5ae806c530 2024-03-29T04:10:12.641 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 0 to deep-scrub 2024-03-29T04:10:12.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.663+0000 7f5b01ff0640 1 -- 172.21.15.73:0/2264218183 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f5ae806c530 msgr2=0x7f5ae806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:12.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.663+0000 7f5b01ff0640 1 --2- 172.21.15.73:0/2264218183 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f5ae806c530 0x7f5ae806e9f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5aec009b40 tx=0x7f5aec009190 comp rx=0 tx=0).stop 2024-03-29T04:10:12.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.663+0000 7f5b01ff0640 1 -- 172.21.15.73:0/2264218183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5afc09f9e0 msgr2=0x7f5afc0cc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:12.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.663+0000 7f5b01ff0640 1 --2- 172.21.15.73:0/2264218183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5afc09f9e0 0x7f5afc0cc690 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5af400ca80 tx=0x7f5af400cf40 comp rx=0 tx=0).stop 2024-03-29T04:10:12.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.663+0000 7f5b01ff0640 1 -- 172.21.15.73:0/2264218183 shutdown_connections 2024-03-29T04:10:12.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.663+0000 7f5b01ff0640 1 --2- 172.21.15.73:0/2264218183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5afc09f9e0 0x7f5afc0cc690 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:12.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.663+0000 7f5b01ff0640 1 --2- 172.21.15.73:0/2264218183 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f5ae806c530 0x7f5ae806e9f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:12.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.663+0000 7f5b01ff0640 1 --2- 172.21.15.73:0/2264218183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5afc15e780 0x7f5afc1e7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:12.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.663+0000 7f5b01ff0640 1 --2- 172.21.15.73:0/2264218183 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f5afc0cf640 0x7f5afc1e8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:12.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.663+0000 7f5b01ff0640 1 -- 172.21.15.73:0/2264218183 >> 172.21.15.73:0/2264218183 conn(0x7f5afc08bfc0 msgr2=0x7f5afc0d1660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:12.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.664+0000 7f5b01ff0640 1 -- 172.21.15.73:0/2264218183 shutdown_connections 2024-03-29T04:10:12.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.664+0000 7f5b01ff0640 1 -- 172.21.15.73:0/2264218183 wait complete. 2024-03-29T04:10:12.653 INFO:tasks.ceph:Scrubbing osd.1 2024-03-29T04:10:12.653 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-03-29T04:10:12.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.778+0000 7f9d62b59640 1 Processor -- start 2024-03-29T04:10:12.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.778+0000 7f9d62b59640 1 -- start start 2024-03-29T04:10:12.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.779+0000 7f9d62b59640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9d5c0cffe0 0x7f9d5c09b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:12.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.779+0000 7f9d62b59640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d5c09ba50 0x7f9d5c0cce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:12.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.779+0000 7f9d62b59640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d5c09bec0 con 0x7f9d5c15dc80 2024-03-29T04:10:12.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.779+0000 7f9d62b59640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f9d5c0cebf0 con 0x7f9d5c0cffe0 2024-03-29T04:10:12.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.779+0000 7f9d62b59640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9d5c0714e0 con 0x7f9d5c09ba50 2024-03-29T04:10:12.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.779+0000 7f9d5bfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9d5c0cffe0 0x7f9d5c09b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:12.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.779+0000 7f9d5bfff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9d5c0cffe0 0x7f9d5c09b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35552/0 (socket says 172.21.15.73:35552) 2024-03-29T04:10:12.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.779+0000 7f9d5bfff640 1 -- 172.21.15.73:0/868625989 learned_addr learned my addr 172.21.15.73:0/868625989 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:12.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.780+0000 7f9d5bfff640 1 -- 172.21.15.73:0/868625989 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d5c09ba50 msgr2=0x7f9d5c0cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:12.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.780+0000 7f9d610f6640 1 --2- 172.21.15.73:0/868625989 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d5c09ba50 0x7f9d5c0cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:12.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.780+0000 7f9d5bfff640 1 --2- 172.21.15.73:0/868625989 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d5c09ba50 0x7f9d5c0cce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:12.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.780+0000 7f9d5bfff640 1 -- 172.21.15.73:0/868625989 >> v1:172.21.15.142:6789/0 conn(0x7f9d5c15dc80 legacy=0x7f9d5c06fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:12.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.780+0000 7f9d5bfff640 1 -- 172.21.15.73:0/868625989 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d5c0717c0 con 0x7f9d5c0cffe0 2024-03-29T04:10:12.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.780+0000 7f9d610f6640 1 --2- 172.21.15.73:0/868625989 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d5c09ba50 0x7f9d5c0cce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:10:12.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.780+0000 7f9d5bfff640 1 --2- 172.21.15.73:0/868625989 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d5c0cffe0 0x7f9d5c09b510 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f9d44009870 tx=0x7f9d4402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de768661750a315d server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:12.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.781+0000 7f9d5b7fe640 1 -- 172.21.15.73:0/868625989 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d440317c0 con 0x7f9d5c0cffe0 2024-03-29T04:10:12.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.781+0000 7f9d5b7fe640 1 -- 172.21.15.73:0/868625989 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d44037070 con 0x7f9d5c0cffe0 2024-03-29T04:10:12.762 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.781+0000 7f9d5b7fe640 1 -- 172.21.15.73:0/868625989 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d44031b80 con 0x7f9d5c0cffe0 2024-03-29T04:10:12.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.781+0000 7f9d62b59640 1 -- 172.21.15.73:0/868625989 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d5c0cffe0 msgr2=0x7f9d5c09b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:12.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.781+0000 7f9d62b59640 1 --2- 172.21.15.73:0/868625989 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d5c0cffe0 0x7f9d5c09b510 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f9d44009870 tx=0x7f9d4402b860 comp rx=0 tx=0).stop 2024-03-29T04:10:12.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.781+0000 7f9d62b59640 1 -- 172.21.15.73:0/868625989 shutdown_connections 2024-03-29T04:10:12.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.781+0000 7f9d62b59640 1 --2- 172.21.15.73:0/868625989 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d5c09ba50 0x7f9d5c0cce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:12.764 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.781+0000 7f9d62b59640 1 --2- 172.21.15.73:0/868625989 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d5c0cffe0 0x7f9d5c09b510 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:12.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.781+0000 7f9d62b59640 1 -- 172.21.15.73:0/868625989 >> 172.21.15.73:0/868625989 conn(0x7f9d5c0b3f00 msgr2=0x7f9d5c0b4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:12.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.781+0000 7f9d62b59640 1 -- 172.21.15.73:0/868625989 shutdown_connections 2024-03-29T04:10:12.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.781+0000 7f9d62b59640 1 -- 172.21.15.73:0/868625989 wait complete. 2024-03-29T04:10:12.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.782+0000 7f9d62b59640 1 Processor -- start 2024-03-29T04:10:12.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.782+0000 7f9d62b59640 1 -- start start 2024-03-29T04:10:12.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.783+0000 7f9d62b59640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d5c09ba50 0x7f9d5c154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:12.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.783+0000 7f9d62b59640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d5c0cffe0 0x7f9d5c0b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:12.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.783+0000 7f9d62b59640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d5c15dc80 0x7f9d5c157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:12.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.783+0000 7f9d62b59640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9d5c09aff0 con 0x7f9d5c09ba50 2024-03-29T04:10:12.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.783+0000 7f9d62b59640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9d5c09ad10 con 0x7f9d5c15dc80 2024-03-29T04:10:12.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.783+0000 7f9d62b59640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9d5c070130 con 0x7f9d5c0cffe0 2024-03-29T04:10:12.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.783+0000 7f9d608f5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d5c09ba50 0x7f9d5c154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:12.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.783+0000 7f9d608f5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d5c09ba50 0x7f9d5c154960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35568/0 (socket says 172.21.15.73:35568) 2024-03-29T04:10:12.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.783+0000 7f9d608f5640 1 -- 172.21.15.73:0/1566097913 learned_addr learned my addr 172.21.15.73:0/1566097913 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:12.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.783+0000 7f9d5bfff640 1 --2- 172.21.15.73:0/1566097913 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d5c0cffe0 0x7f9d5c0b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:12.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.784+0000 7f9d610f6640 1 --2- 172.21.15.73:0/1566097913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d5c15dc80 0x7f9d5c157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:12.766 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.784+0000 7f9d608f5640 1 -- 172.21.15.73:0/1566097913 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d5c0cffe0 msgr2=0x7f9d5c0b35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:12.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.784+0000 7f9d608f5640 1 --2- 172.21.15.73:0/1566097913 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d5c0cffe0 0x7f9d5c0b35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:12.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.784+0000 7f9d608f5640 1 -- 172.21.15.73:0/1566097913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d5c15dc80 msgr2=0x7f9d5c157210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:12.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.784+0000 7f9d608f5640 1 --2- 172.21.15.73:0/1566097913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d5c15dc80 0x7f9d5c157210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:12.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.784+0000 7f9d608f5640 1 -- 172.21.15.73:0/1566097913 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d5c0b1ba0 con 0x7f9d5c09ba50 2024-03-29T04:10:12.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.784+0000 7f9d610f6640 1 --2- 172.21.15.73:0/1566097913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d5c15dc80 0x7f9d5c157210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:10:12.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.784+0000 7f9d5bfff640 1 --2- 172.21.15.73:0/1566097913 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9d5c0cffe0 0x7f9d5c0b35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:10:12.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.784+0000 7f9d608f5640 1 --2- 172.21.15.73:0/1566097913 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d5c09ba50 0x7f9d5c154960 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c00ba50 tx=0x7f9d4c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:12.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.784+0000 7f9d597fa640 1 -- 172.21.15.73:0/1566097913 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c019070 con 0x7f9d5c09ba50 2024-03-29T04:10:12.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.784+0000 7f9d597fa640 1 -- 172.21.15.73:0/1566097913 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d4c00cc20 con 0x7f9d5c09ba50 2024-03-29T04:10:12.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.784+0000 7f9d62b59640 1 -- 172.21.15.73:0/1566097913 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d5c0b1e80 con 0x7f9d5c09ba50 2024-03-29T04:10:12.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.784+0000 7f9d597fa640 1 -- 172.21.15.73:0/1566097913 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c014680 con 0x7f9d5c09ba50 2024-03-29T04:10:12.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.784+0000 7f9d62b59640 1 -- 172.21.15.73:0/1566097913 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d5c0b2440 con 0x7f9d5c09ba50 2024-03-29T04:10:12.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.785+0000 7f9d62b59640 1 -- 172.21.15.73:0/1566097913 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9d5c0b2810 con 0x7f9d5c09ba50 2024-03-29T04:10:12.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.785+0000 7f9d597fa640 1 -- 172.21.15.73:0/1566097913 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f9d4c01c070 con 0x7f9d5c09ba50 2024-03-29T04:10:12.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.786+0000 7f9d597fa640 1 --2- 172.21.15.73:0/1566097913 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9d3c06c560 0x7f9d3c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:12.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.786+0000 7f9d597fa640 1 -- 172.21.15.73:0/1566097913 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f9d4c08bcb0 con 0x7f9d5c09ba50 2024-03-29T04:10:12.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.786+0000 7f9d5bfff640 1 --2- 172.21.15.73:0/1566097913 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9d3c06c560 0x7f9d3c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:12.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.786+0000 7f9d597fa640 1 --2- 172.21.15.73:0/1566097913 >> [v2:172.21.15.73:6800/2431315515,v1:172.21.15.73:6801/2431315515] conn(0x7f9d3c072420 0x7f9d3c074840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:12.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.786+0000 7f9d597fa640 1 -- 172.21.15.73:0/1566097913 --> [v2:172.21.15.73:6800/2431315515,v1:172.21.15.73:6801/2431315515] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9d3c074ef0 con 0x7f9d3c072420 2024-03-29T04:10:12.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.786+0000 7f9d597fa640 1 -- 172.21.15.73:0/1566097913 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9d4c08c060 con 0x7f9d5c09ba50 2024-03-29T04:10:12.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.786+0000 7f9d610f6640 1 --2- 172.21.15.73:0/1566097913 >> [v2:172.21.15.73:6800/2431315515,v1:172.21.15.73:6801/2431315515] conn(0x7f9d3c072420 0x7f9d3c074840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:12.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.786+0000 7f9d5bfff640 1 --2- 172.21.15.73:0/1566097913 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9d3c06c560 0x7f9d3c06ea20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9d44036000 tx=0x7f9d44008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:12.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.786+0000 7f9d610f6640 1 --2- 172.21.15.73:0/1566097913 >> [v2:172.21.15.73:6800/2431315515,v1:172.21.15.73:6801/2431315515] conn(0x7f9d3c072420 0x7f9d3c074840 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:12.770 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.787+0000 7f9d597fa640 1 -- 172.21.15.73:0/1566097913 <== osd.1 v2:172.21.15.73:6800/2431315515 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9d3c074ef0 con 0x7f9d3c072420 2024-03-29T04:10:12.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.800+0000 7f9d62b59640 1 -- 172.21.15.73:0/1566097913 --> [v2:172.21.15.73:6800/2431315515,v1:172.21.15.73:6801/2431315515] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9d5c068640 con 0x7f9d3c072420 2024-03-29T04:10:12.779 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.800+0000 7f9d597fa640 1 -- 172.21.15.73:0/1566097913 <== osd.1 v2:172.21.15.73:6800/2431315515 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9d5c068640 con 0x7f9d3c072420 2024-03-29T04:10:12.780 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-29T04:10:12.780 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-29T04:10:12.780 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-29T04:10:12.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.800+0000 7f9d62b59640 1 -- 172.21.15.73:0/1566097913 >> [v2:172.21.15.73:6800/2431315515,v1:172.21.15.73:6801/2431315515] conn(0x7f9d3c072420 msgr2=0x7f9d3c074840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:12.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.800+0000 7f9d62b59640 1 --2- 172.21.15.73:0/1566097913 >> [v2:172.21.15.73:6800/2431315515,v1:172.21.15.73:6801/2431315515] conn(0x7f9d3c072420 0x7f9d3c074840 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:12.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.800+0000 7f9d62b59640 1 -- 172.21.15.73:0/1566097913 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9d3c06c560 msgr2=0x7f9d3c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:12.781 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.801+0000 7f9d62b59640 1 --2- 172.21.15.73:0/1566097913 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9d3c06c560 0x7f9d3c06ea20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9d44036000 tx=0x7f9d44008030 comp rx=0 tx=0).stop 2024-03-29T04:10:12.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.801+0000 7f9d62b59640 1 -- 172.21.15.73:0/1566097913 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d5c09ba50 msgr2=0x7f9d5c154960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:12.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.801+0000 7f9d62b59640 1 --2- 172.21.15.73:0/1566097913 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d5c09ba50 0x7f9d5c154960 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c00ba50 tx=0x7f9d4c00bf10 comp rx=0 tx=0).stop 2024-03-29T04:10:12.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.801+0000 7f9d610f6640 1 -- 172.21.15.73:0/1566097913 reap_dead start 2024-03-29T04:10:12.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.801+0000 7f9d62b59640 1 -- 172.21.15.73:0/1566097913 shutdown_connections 2024-03-29T04:10:12.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.801+0000 7f9d62b59640 1 -- 172.21.15.73:0/1566097913 >> 172.21.15.73:0/1566097913 conn(0x7f9d5c0b3f00 msgr2=0x7f9d5c15b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:12.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.801+0000 7f9d62b59640 1 -- 172.21.15.73:0/1566097913 shutdown_connections 2024-03-29T04:10:12.782 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.801+0000 7f9d62b59640 1 -- 172.21.15.73:0/1566097913 wait complete. 2024-03-29T04:10:12.790 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-03-29T04:10:12.893 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.914+0000 7f08f6014640 1 Processor -- start 2024-03-29T04:10:12.894 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.914+0000 7f08f6014640 1 -- start start 2024-03-29T04:10:12.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.914+0000 7f08f6014640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f08f015e780 0x7f08f00cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:12.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.914+0000 7f08f6014640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08f015eb60 0x7f08f00cf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:12.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.914+0000 7f08f6014640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08f00cfe70 con 0x7f08f00cf640 2024-03-29T04:10:12.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.914+0000 7f08f6014640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f08f00b7f50 con 0x7f08f015e780 2024-03-29T04:10:12.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.914+0000 7f08f6014640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f08f00b8230 con 0x7f08f015eb60 2024-03-29T04:10:12.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.915+0000 7f08ef7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f08f015e780 0x7f08f00cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:12.897 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.915+0000 7f08ef7fe640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f08f015e780 0x7f08f00cebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35570/0 (socket says 172.21.15.73:35570) 2024-03-29T04:10:12.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.915+0000 7f08ef7fe640 1 -- 172.21.15.73:0/1843480627 learned_addr learned my addr 172.21.15.73:0/1843480627 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:12.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.915+0000 7f08eeffd640 1 --2- 172.21.15.73:0/1843480627 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08f015eb60 0x7f08f00cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:12.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.915+0000 7f08ef7fe640 1 -- 172.21.15.73:0/1843480627 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08f015eb60 msgr2=0x7f08f00cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:12.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.915+0000 7f08ef7fe640 1 --2- 172.21.15.73:0/1843480627 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08f015eb60 0x7f08f00cf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:12.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.915+0000 7f08ef7fe640 1 -- 172.21.15.73:0/1843480627 >> v1:172.21.15.142:6789/0 conn(0x7f08f00cf640 legacy=0x7f08f00b8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:12.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.915+0000 7f08ef7fe640 1 -- 172.21.15.73:0/1843480627 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f00b8510 con 0x7f08f015e780 2024-03-29T04:10:12.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.916+0000 7f08ef7fe640 1 --2- 172.21.15.73:0/1843480627 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08f015e780 0x7f08f00cebc0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f08e0009870 tx=0x7f08e002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10411293ff516d1b server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:12.898 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.916+0000 7f08ee7fc640 1 -- 172.21.15.73:0/1843480627 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e0035020 con 0x7f08f015e780 2024-03-29T04:10:12.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.916+0000 7f08ee7fc640 1 -- 172.21.15.73:0/1843480627 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08e0031640 con 0x7f08f015e780 2024-03-29T04:10:12.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.916+0000 7f08ee7fc640 1 -- 172.21.15.73:0/1843480627 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e002d040 con 0x7f08f015e780 2024-03-29T04:10:12.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.916+0000 7f08f6014640 1 -- 172.21.15.73:0/1843480627 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08f015e780 msgr2=0x7f08f00cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:12.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.916+0000 7f08f6014640 1 --2- 172.21.15.73:0/1843480627 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08f015e780 0x7f08f00cebc0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f08e0009870 tx=0x7f08e002b8f0 comp rx=0 tx=0).stop 2024-03-29T04:10:12.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.916+0000 7f08f6014640 1 -- 172.21.15.73:0/1843480627 shutdown_connections 2024-03-29T04:10:12.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.916+0000 7f08f6014640 1 --2- 172.21.15.73:0/1843480627 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08f015eb60 0x7f08f00cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:12.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.916+0000 7f08f6014640 1 --2- 172.21.15.73:0/1843480627 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08f015e780 0x7f08f00cebc0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:12.899 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.916+0000 7f08f6014640 1 -- 172.21.15.73:0/1843480627 >> 172.21.15.73:0/1843480627 conn(0x7f08f008bfc0 msgr2=0x7f08f00d4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:12.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.916+0000 7f08f6014640 1 -- 172.21.15.73:0/1843480627 shutdown_connections 2024-03-29T04:10:12.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.916+0000 7f08f6014640 1 -- 172.21.15.73:0/1843480627 wait complete. 2024-03-29T04:10:12.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.917+0000 7f08f6014640 1 Processor -- start 2024-03-29T04:10:12.900 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.918+0000 7f08f6014640 1 -- start start 2024-03-29T04:10:12.902 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.918+0000 7f08f6014640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08f00cf640 0x7f08f00cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:12.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.918+0000 7f08f6014640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08f015e780 0x7f08f014c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:12.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.918+0000 7f08f6014640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08f015a3d0 0x7f08f015a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:12.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.918+0000 7f08f6014640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f08f00d3580 con 0x7f08f00cf640 2024-03-29T04:10:12.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.918+0000 7f08f6014640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f08f00b8ad0 con 0x7f08f015a3d0 2024-03-29T04:10:12.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.918+0000 7f08f6014640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f08f00d3700 con 0x7f08f015e780 2024-03-29T04:10:12.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.918+0000 7f08ef7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08f00cf640 0x7f08f00cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:12.903 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.918+0000 7f08ef7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08f00cf640 0x7f08f00cdff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35574/0 (socket says 172.21.15.73:35574) 2024-03-29T04:10:12.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.919+0000 7f08ef7fe640 1 -- 172.21.15.73:0/4033264235 learned_addr learned my addr 172.21.15.73:0/4033264235 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:12.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.919+0000 7f08eeffd640 1 --2- 172.21.15.73:0/4033264235 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08f015e780 0x7f08f014c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:12.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.919+0000 7f08effff640 1 --2- 172.21.15.73:0/4033264235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08f015a3d0 0x7f08f015a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:12.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.919+0000 7f08ef7fe640 1 -- 172.21.15.73:0/4033264235 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08f015e780 msgr2=0x7f08f014c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:12.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.919+0000 7f08ef7fe640 1 --2- 172.21.15.73:0/4033264235 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08f015e780 0x7f08f014c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:12.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.919+0000 7f08ef7fe640 1 -- 172.21.15.73:0/4033264235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08f015a3d0 msgr2=0x7f08f015a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:12.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.919+0000 7f08ef7fe640 1 --2- 172.21.15.73:0/4033264235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08f015a3d0 0x7f08f015a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:12.904 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.919+0000 7f08ef7fe640 1 -- 172.21.15.73:0/4033264235 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f0159c00 con 0x7f08f00cf640 2024-03-29T04:10:12.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.919+0000 7f08ef7fe640 1 --2- 172.21.15.73:0/4033264235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08f00cf640 0x7f08f00cdff0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f08e002b930 tx=0x7f08e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:12.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.919+0000 7f08d7fff640 1 -- 172.21.15.73:0/4033264235 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e0040070 con 0x7f08f00cf640 2024-03-29T04:10:12.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.919+0000 7f08d7fff640 1 -- 172.21.15.73:0/4033264235 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08e00399f0 con 0x7f08f00cf640 2024-03-29T04:10:12.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.919+0000 7f08f6014640 1 -- 172.21.15.73:0/4033264235 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08f00ccf40 con 0x7f08f00cf640 2024-03-29T04:10:12.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.919+0000 7f08d7fff640 1 -- 172.21.15.73:0/4033264235 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e0035040 con 0x7f08f00cf640 2024-03-29T04:10:12.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.919+0000 7f08f6014640 1 -- 172.21.15.73:0/4033264235 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08f00cc460 con 0x7f08f00cf640 2024-03-29T04:10:12.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.920+0000 7f08f6014640 1 -- 172.21.15.73:0/4033264235 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08f0068640 con 0x7f08f00cf640 2024-03-29T04:10:12.905 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.920+0000 7f08d7fff640 1 -- 172.21.15.73:0/4033264235 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f08e004b060 con 0x7f08f00cf640 2024-03-29T04:10:12.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.921+0000 7f08d7fff640 1 --2- 172.21.15.73:0/4033264235 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f08dc06c530 0x7f08dc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:12.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.921+0000 7f08d7fff640 1 -- 172.21.15.73:0/4033264235 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f08e00accb0 con 0x7f08f00cf640 2024-03-29T04:10:12.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.921+0000 7f08eeffd640 1 --2- 172.21.15.73:0/4033264235 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f08dc06c530 0x7f08dc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:12.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.921+0000 7f08eeffd640 1 --2- 172.21.15.73:0/4033264235 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f08dc06c530 0x7f08dc06e9f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f08e4006fd0 tx=0x7f08e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:12.906 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:12.925+0000 7f08d7fff640 1 -- 172.21.15.73:0/4033264235 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f08e007b660 con 0x7f08f00cf640 2024-03-29T04:10:13.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.099+0000 7f08f6014640 1 -- 172.21.15.73:0/4033264235 --> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f08f00d4060 con 0x7f08dc06c530 2024-03-29T04:10:13.079 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.099+0000 7f08d7fff640 1 -- 172.21.15.73:0/4033264235 <== mgr.4104 v2:172.21.15.73:6832/1640471941 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f08f00d4060 con 0x7f08dc06c530 2024-03-29T04:10:13.079 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 1 to deep-scrub 2024-03-29T04:10:13.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.101+0000 7f08f6014640 1 -- 172.21.15.73:0/4033264235 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f08dc06c530 msgr2=0x7f08dc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:13.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.101+0000 7f08f6014640 1 --2- 172.21.15.73:0/4033264235 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f08dc06c530 0x7f08dc06e9f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f08e4006fd0 tx=0x7f08e4008040 comp rx=0 tx=0).stop 2024-03-29T04:10:13.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.101+0000 7f08f6014640 1 -- 172.21.15.73:0/4033264235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08f00cf640 msgr2=0x7f08f00cdff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:13.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.101+0000 7f08f6014640 1 --2- 172.21.15.73:0/4033264235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08f00cf640 0x7f08f00cdff0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f08e002b930 tx=0x7f08e00046c0 comp rx=0 tx=0).stop 2024-03-29T04:10:13.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.101+0000 7f08f6014640 1 -- 172.21.15.73:0/4033264235 shutdown_connections 2024-03-29T04:10:13.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.101+0000 7f08f6014640 1 --2- 172.21.15.73:0/4033264235 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f08dc06c530 0x7f08dc06e9f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:13.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.101+0000 7f08f6014640 1 --2- 172.21.15.73:0/4033264235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f08f015a3d0 0x7f08f015a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:13.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.101+0000 7f08f6014640 1 --2- 172.21.15.73:0/4033264235 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f08f015e780 0x7f08f014c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:13.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.101+0000 7f08f6014640 1 --2- 172.21.15.73:0/4033264235 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08f00cf640 0x7f08f00cdff0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:13.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.101+0000 7f08f6014640 1 -- 172.21.15.73:0/4033264235 >> 172.21.15.73:0/4033264235 conn(0x7f08f008bfc0 msgr2=0x7f08f015ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:13.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.101+0000 7f08f6014640 1 -- 172.21.15.73:0/4033264235 shutdown_connections 2024-03-29T04:10:13.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.101+0000 7f08f6014640 1 -- 172.21.15.73:0/4033264235 wait complete. 2024-03-29T04:10:13.091 INFO:tasks.ceph:Scrubbing osd.2 2024-03-29T04:10:13.092 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-03-29T04:10:13.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.216+0000 7f1ace79d640 1 Processor -- start 2024-03-29T04:10:13.196 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.217+0000 7f1ace79d640 1 -- start start 2024-03-29T04:10:13.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.217+0000 7f1ace79d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1ac815e670 0x7f1ac809aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:13.197 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.217+0000 7f1ace79d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ac806bc20 0x7f1ac8160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:13.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.217+0000 7f1ace79d640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ac80b4620 con 0x7f1ac80b4160 2024-03-29T04:10:13.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.217+0000 7f1ace79d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f1ac815fe80 con 0x7f1ac815e670 2024-03-29T04:10:13.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.217+0000 7f1ace79d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f1ac8160720 con 0x7f1ac806bc20 2024-03-29T04:10:13.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.218+0000 7f1acd79b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1ac815e670 0x7f1ac809aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:13.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.218+0000 7f1accf9a640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1ac80b4160 0x7f1ac806b510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51700/0 (socket says 172.21.15.73:51700) 2024-03-29T04:10:13.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.218+0000 7f1accf9a640 1 -- 172.21.15.73:0/2130578444 learned_addr learned my addr 172.21.15.73:0/2130578444 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:10:13.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.218+0000 7f1acd79b640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1ac815e670 0x7f1ac809aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35590/0 (socket says 172.21.15.73:35590) 2024-03-29T04:10:13.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.218+0000 7f1acdf9c640 1 --2- 172.21.15.73:0/2130578444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ac806bc20 0x7f1ac8160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:13.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.218+0000 7f1acd79b640 1 -- 172.21.15.73:0/2130578444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ac806bc20 msgr2=0x7f1ac8160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:13.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.218+0000 7f1acd79b640 1 --2- 172.21.15.73:0/2130578444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ac806bc20 0x7f1ac8160bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:13.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.218+0000 7f1acd79b640 1 -- 172.21.15.73:0/2130578444 >> v1:172.21.15.73:6789/0 conn(0x7f1ac80b4160 legacy=0x7f1ac806b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:13.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.218+0000 7f1acd79b640 1 -- 172.21.15.73:0/2130578444 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ac81600d0 con 0x7f1ac815e670 2024-03-29T04:10:13.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.218+0000 7f1abffff640 1 -- 172.21.15.73:0/2130578444 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3788749623 0 0) 0x7f1ac80b4620 con 0x7f1ac80b4160 2024-03-29T04:10:13.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.219+0000 7f1acd79b640 1 --2- 172.21.15.73:0/2130578444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ac815e670 0x7f1ac809aa30 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f1ac40097a0 tx=0x7f1ac402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71754a33d0e1cba8 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:13.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.219+0000 7f1abffff640 1 -- 172.21.15.73:0/2130578444 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac4035020 con 0x7f1ac815e670 2024-03-29T04:10:13.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.219+0000 7f1abffff640 1 -- 172.21.15.73:0/2130578444 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ac4031830 con 0x7f1ac815e670 2024-03-29T04:10:13.202 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.219+0000 7f1abffff640 1 -- 172.21.15.73:0/2130578444 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac4031c00 con 0x7f1ac815e670 2024-03-29T04:10:13.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.219+0000 7f1ace79d640 1 -- 172.21.15.73:0/2130578444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ac815e670 msgr2=0x7f1ac809aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:13.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.219+0000 7f1ace79d640 1 --2- 172.21.15.73:0/2130578444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ac815e670 0x7f1ac809aa30 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f1ac40097a0 tx=0x7f1ac402b8d0 comp rx=0 tx=0).stop 2024-03-29T04:10:13.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.219+0000 7f1ace79d640 1 -- 172.21.15.73:0/2130578444 shutdown_connections 2024-03-29T04:10:13.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.219+0000 7f1ace79d640 1 --2- 172.21.15.73:0/2130578444 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ac806bc20 0x7f1ac8160bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:13.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.219+0000 7f1ace79d640 1 --2- 172.21.15.73:0/2130578444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ac815e670 0x7f1ac809aa30 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:13.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.219+0000 7f1ace79d640 1 -- 172.21.15.73:0/2130578444 >> 172.21.15.73:0/2130578444 conn(0x7f1ac80b68a0 msgr2=0x7f1ac80b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:13.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.219+0000 7f1ace79d640 1 -- 172.21.15.73:0/2130578444 shutdown_connections 2024-03-29T04:10:13.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.219+0000 7f1ace79d640 1 -- 172.21.15.73:0/2130578444 wait complete. 2024-03-29T04:10:13.203 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.221+0000 7f1ace79d640 1 Processor -- start 2024-03-29T04:10:13.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.221+0000 7f1ace79d640 1 -- start start 2024-03-29T04:10:13.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.221+0000 7f1ace79d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ac806bc20 0x7f1ac8144560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:13.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.221+0000 7f1ace79d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ac80b4160 0x7f1ac81567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:13.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.221+0000 7f1ace79d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ac815e670 0x7f1ac8156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:13.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.221+0000 7f1ace79d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac815fa60 con 0x7f1ac80b4160 2024-03-29T04:10:13.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.221+0000 7f1ace79d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac8072f50 con 0x7f1ac806bc20 2024-03-29T04:10:13.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.221+0000 7f1ace79d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f1ac815fbe0 con 0x7f1ac815e670 2024-03-29T04:10:13.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.221+0000 7f1accf9a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ac80b4160 0x7f1ac81567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:13.204 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.221+0000 7f1accf9a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ac80b4160 0x7f1ac81567d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35598/0 (socket says 172.21.15.73:35598) 2024-03-29T04:10:13.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.221+0000 7f1accf9a640 1 -- 172.21.15.73:0/1493244693 learned_addr learned my addr 172.21.15.73:0/1493244693 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:13.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.222+0000 7f1acdf9c640 1 --2- 172.21.15.73:0/1493244693 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ac815e670 0x7f1ac8156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:13.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.222+0000 7f1acd79b640 1 --2- 172.21.15.73:0/1493244693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ac806bc20 0x7f1ac8144560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:13.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.222+0000 7f1accf9a640 1 -- 172.21.15.73:0/1493244693 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ac815e670 msgr2=0x7f1ac8156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:13.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.222+0000 7f1accf9a640 1 --2- 172.21.15.73:0/1493244693 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1ac815e670 0x7f1ac8156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:13.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.222+0000 7f1accf9a640 1 -- 172.21.15.73:0/1493244693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ac806bc20 msgr2=0x7f1ac8144560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:13.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.222+0000 7f1accf9a640 1 --2- 172.21.15.73:0/1493244693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ac806bc20 0x7f1ac8144560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:13.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.222+0000 7f1accf9a640 1 -- 172.21.15.73:0/1493244693 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ac80cc050 con 0x7f1ac80b4160 2024-03-29T04:10:13.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.222+0000 7f1accf9a640 1 --2- 172.21.15.73:0/1493244693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ac80b4160 0x7f1ac81567d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1ab800c4a0 tx=0x7f1ab800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:13.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.222+0000 7f1abdffb640 1 -- 172.21.15.73:0/1493244693 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab8018070 con 0x7f1ac80b4160 2024-03-29T04:10:13.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.222+0000 7f1abdffb640 1 -- 172.21.15.73:0/1493244693 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ab80074e0 con 0x7f1ac80b4160 2024-03-29T04:10:13.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.222+0000 7f1abdffb640 1 -- 172.21.15.73:0/1493244693 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab8004a20 con 0x7f1ac80b4160 2024-03-29T04:10:13.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.222+0000 7f1ace79d640 1 -- 172.21.15.73:0/1493244693 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ac80cc330 con 0x7f1ac80b4160 2024-03-29T04:10:13.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.222+0000 7f1ace79d640 1 -- 172.21.15.73:0/1493244693 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ac80cc8f0 con 0x7f1ac80b4160 2024-03-29T04:10:13.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.223+0000 7f1ace79d640 1 -- 172.21.15.73:0/1493244693 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1ac80ccc60 con 0x7f1ac80b4160 2024-03-29T04:10:13.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.223+0000 7f1abdffb640 1 -- 172.21.15.73:0/1493244693 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f1ab801b070 con 0x7f1ac80b4160 2024-03-29T04:10:13.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.224+0000 7f1abdffb640 1 --2- 172.21.15.73:0/1493244693 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f1aac06c530 0x7f1aac06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:13.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.224+0000 7f1abdffb640 1 -- 172.21.15.73:0/1493244693 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f1ab808a730 con 0x7f1ac80b4160 2024-03-29T04:10:13.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.224+0000 7f1acd79b640 1 --2- 172.21.15.73:0/1493244693 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f1aac06c530 0x7f1aac06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:13.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.224+0000 7f1abdffb640 1 --2- 172.21.15.73:0/1493244693 >> [v2:172.21.15.73:6808/407236597,v1:172.21.15.73:6809/407236597] conn(0x7f1aac0723f0 0x7f1aac074810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:13.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.224+0000 7f1abdffb640 1 -- 172.21.15.73:0/1493244693 --> [v2:172.21.15.73:6808/407236597,v1:172.21.15.73:6809/407236597] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1aac074ec0 con 0x7f1aac0723f0 2024-03-29T04:10:13.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.224+0000 7f1abdffb640 1 -- 172.21.15.73:0/1493244693 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f1ab8091050 con 0x7f1ac80b4160 2024-03-29T04:10:13.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.224+0000 7f1acdf9c640 1 --2- 172.21.15.73:0/1493244693 >> [v2:172.21.15.73:6808/407236597,v1:172.21.15.73:6809/407236597] conn(0x7f1aac0723f0 0x7f1aac074810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:13.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.224+0000 7f1acd79b640 1 --2- 172.21.15.73:0/1493244693 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f1aac06c530 0x7f1aac06e9f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4036000 tx=0x7f1ac4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:13.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.224+0000 7f1acdf9c640 1 --2- 172.21.15.73:0/1493244693 >> [v2:172.21.15.73:6808/407236597,v1:172.21.15.73:6809/407236597] conn(0x7f1aac0723f0 0x7f1aac074810 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:13.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.225+0000 7f1abdffb640 1 -- 172.21.15.73:0/1493244693 <== osd.2 v2:172.21.15.73:6808/407236597 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1aac074ec0 con 0x7f1aac0723f0 2024-03-29T04:10:13.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.238+0000 7f1ace79d640 1 -- 172.21.15.73:0/1493244693 --> [v2:172.21.15.73:6808/407236597,v1:172.21.15.73:6809/407236597] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1ac8159fa0 con 0x7f1aac0723f0 2024-03-29T04:10:13.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.238+0000 7f1abdffb640 1 -- 172.21.15.73:0/1493244693 <== osd.2 v2:172.21.15.73:6808/407236597 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1ac8159fa0 con 0x7f1aac0723f0 2024-03-29T04:10:13.218 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-29T04:10:13.218 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-29T04:10:13.218 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-29T04:10:13.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.238+0000 7f1ace79d640 1 -- 172.21.15.73:0/1493244693 >> [v2:172.21.15.73:6808/407236597,v1:172.21.15.73:6809/407236597] conn(0x7f1aac0723f0 msgr2=0x7f1aac074810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:13.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.238+0000 7f1ace79d640 1 --2- 172.21.15.73:0/1493244693 >> [v2:172.21.15.73:6808/407236597,v1:172.21.15.73:6809/407236597] conn(0x7f1aac0723f0 0x7f1aac074810 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:13.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.239+0000 7f1ace79d640 1 -- 172.21.15.73:0/1493244693 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f1aac06c530 msgr2=0x7f1aac06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:13.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.239+0000 7f1ace79d640 1 --2- 172.21.15.73:0/1493244693 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f1aac06c530 0x7f1aac06e9f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4036000 tx=0x7f1ac4008030 comp rx=0 tx=0).stop 2024-03-29T04:10:13.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.239+0000 7f1ace79d640 1 -- 172.21.15.73:0/1493244693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ac80b4160 msgr2=0x7f1ac81567d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:13.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.239+0000 7f1ace79d640 1 --2- 172.21.15.73:0/1493244693 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ac80b4160 0x7f1ac81567d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1ab800c4a0 tx=0x7f1ab800c960 comp rx=0 tx=0).stop 2024-03-29T04:10:13.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.239+0000 7f1acdf9c640 1 -- 172.21.15.73:0/1493244693 reap_dead start 2024-03-29T04:10:13.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.239+0000 7f1ace79d640 1 -- 172.21.15.73:0/1493244693 shutdown_connections 2024-03-29T04:10:13.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.239+0000 7f1ace79d640 1 -- 172.21.15.73:0/1493244693 >> 172.21.15.73:0/1493244693 conn(0x7f1ac80b68a0 msgr2=0x7f1ac815cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:13.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.239+0000 7f1ace79d640 1 -- 172.21.15.73:0/1493244693 shutdown_connections 2024-03-29T04:10:13.220 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.239+0000 7f1ace79d640 1 -- 172.21.15.73:0/1493244693 wait complete. 2024-03-29T04:10:13.228 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-03-29T04:10:13.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.349+0000 7fecde04a640 1 Processor -- start 2024-03-29T04:10:13.329 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.349+0000 7fecde04a640 1 -- start start 2024-03-29T04:10:13.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.350+0000 7fecde04a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecd815ec10 0x7fecd80c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:13.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.350+0000 7fecde04a640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fecd80d0730 0x7fecd80b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:13.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.350+0000 7fecde04a640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecd815f100 con 0x7fecd80ce740 2024-03-29T04:10:13.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.350+0000 7fecde04a640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fecd80ceba0 con 0x7fecd80d0730 2024-03-29T04:10:13.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.350+0000 7fecde04a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fecd815f370 con 0x7fecd815ec10 2024-03-29T04:10:13.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.350+0000 7fecd7fff640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fecd80d0730 0x7fecd80b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:13.331 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.350+0000 7fecd6ffd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fecd80ce740 0x7fecd80d0020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51704/0 (socket says 172.21.15.73:51704) 2024-03-29T04:10:13.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.350+0000 7fecd6ffd640 1 -- 172.21.15.73:0/334783516 learned_addr learned my addr 172.21.15.73:0/334783516 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:10:13.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.350+0000 7fecd77fe640 1 --2- 172.21.15.73:0/334783516 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecd815ec10 0x7fecd80c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:13.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.351+0000 7fecd7fff640 1 -- 172.21.15.73:0/334783516 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecd815ec10 msgr2=0x7fecd80c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:13.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.351+0000 7fecd7fff640 1 --2- 172.21.15.73:0/334783516 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecd815ec10 0x7fecd80c67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:13.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.351+0000 7fecd7fff640 1 -- 172.21.15.73:0/334783516 >> v1:172.21.15.73:6789/0 conn(0x7fecd80ce740 legacy=0x7fecd80d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:13.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.351+0000 7fecd7fff640 1 -- 172.21.15.73:0/334783516 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecd815f650 con 0x7fecd80d0730 2024-03-29T04:10:13.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.351+0000 7fecd67fc640 1 -- 172.21.15.73:0/334783516 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 866040659 0 0) 0x7fecd815f100 con 0x7fecd80ce740 2024-03-29T04:10:13.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.351+0000 7fecd7fff640 1 --2- 172.21.15.73:0/334783516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecd80d0730 0x7fecd80b30b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fecd0009d90 tx=0x7fecd002be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c611b92c5304b62 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:13.332 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.351+0000 7fecd67fc640 1 -- 172.21.15.73:0/334783516 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd0039070 con 0x7fecd80d0730 2024-03-29T04:10:13.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.351+0000 7fecd67fc640 1 -- 172.21.15.73:0/334783516 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecd002cbc0 con 0x7fecd80d0730 2024-03-29T04:10:13.333 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.351+0000 7fecd67fc640 1 -- 172.21.15.73:0/334783516 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd0034440 con 0x7fecd80d0730 2024-03-29T04:10:13.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.352+0000 7fecde04a640 1 -- 172.21.15.73:0/334783516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecd80d0730 msgr2=0x7fecd80b30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:13.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.352+0000 7fecde04a640 1 --2- 172.21.15.73:0/334783516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecd80d0730 0x7fecd80b30b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fecd0009d90 tx=0x7fecd002be10 comp rx=0 tx=0).stop 2024-03-29T04:10:13.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.352+0000 7fecde04a640 1 -- 172.21.15.73:0/334783516 shutdown_connections 2024-03-29T04:10:13.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.352+0000 7fecde04a640 1 --2- 172.21.15.73:0/334783516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecd80d0730 0x7fecd80b30b0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:13.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.352+0000 7fecde04a640 1 --2- 172.21.15.73:0/334783516 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecd815ec10 0x7fecd80c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:13.336 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.352+0000 7fecde04a640 1 -- 172.21.15.73:0/334783516 >> 172.21.15.73:0/334783516 conn(0x7fecd806b510 msgr2=0x7fecd806b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:13.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.352+0000 7fecde04a640 1 -- 172.21.15.73:0/334783516 shutdown_connections 2024-03-29T04:10:13.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.352+0000 7fecde04a640 1 -- 172.21.15.73:0/334783516 wait complete. 2024-03-29T04:10:13.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.353+0000 7fecde04a640 1 Processor -- start 2024-03-29T04:10:13.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.353+0000 7fecde04a640 1 -- start start 2024-03-29T04:10:13.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.354+0000 7fecde04a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecd80ce740 0x7fecd809dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:13.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.354+0000 7fecde04a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecd80d0730 0x7fecd8147fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:13.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.354+0000 7fecde04a640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecd815ec10 0x7fecd80ae230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:13.337 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.354+0000 7fecde04a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fecd815fe50 con 0x7fecd80ce740 2024-03-29T04:10:13.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.354+0000 7fecde04a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fecd80c6ee0 con 0x7fecd80d0730 2024-03-29T04:10:13.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.354+0000 7fecde04a640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fecd815ffd0 con 0x7fecd815ec10 2024-03-29T04:10:13.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.354+0000 7fecd77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecd80ce740 0x7fecd809dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:13.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.354+0000 7fecd77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecd80ce740 0x7fecd809dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35620/0 (socket says 172.21.15.73:35620) 2024-03-29T04:10:13.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.354+0000 7fecd77fe640 1 -- 172.21.15.73:0/2541608764 learned_addr learned my addr 172.21.15.73:0/2541608764 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:13.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.354+0000 7fecd7fff640 1 --2- 172.21.15.73:0/2541608764 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecd815ec10 0x7fecd80ae230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:13.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.354+0000 7fecd6ffd640 1 --2- 172.21.15.73:0/2541608764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecd80d0730 0x7fecd8147fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:13.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.354+0000 7fecd77fe640 1 -- 172.21.15.73:0/2541608764 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecd815ec10 msgr2=0x7fecd80ae230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:13.338 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.354+0000 7fecd77fe640 1 --2- 172.21.15.73:0/2541608764 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecd815ec10 0x7fecd80ae230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:13.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.354+0000 7fecd77fe640 1 -- 172.21.15.73:0/2541608764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecd80d0730 msgr2=0x7fecd8147fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:13.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.354+0000 7fecd77fe640 1 --2- 172.21.15.73:0/2541608764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecd80d0730 0x7fecd8147fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:13.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.354+0000 7fecd77fe640 1 -- 172.21.15.73:0/2541608764 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecd815d2d0 con 0x7fecd80ce740 2024-03-29T04:10:13.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.354+0000 7fecd6ffd640 1 --2- 172.21.15.73:0/2541608764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecd80d0730 0x7fecd8147fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:10:13.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.355+0000 7fecd77fe640 1 --2- 172.21.15.73:0/2541608764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecd80ce740 0x7fecd809dbe0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fecc800e9b0 tx=0x7fecc800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:13.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.355+0000 7fecbffff640 1 -- 172.21.15.73:0/2541608764 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc8017070 con 0x7fecd80ce740 2024-03-29T04:10:13.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.355+0000 7fecde04a640 1 -- 172.21.15.73:0/2541608764 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecd809e120 con 0x7fecd80ce740 2024-03-29T04:10:13.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.355+0000 7fecde04a640 1 -- 172.21.15.73:0/2541608764 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecd815d830 con 0x7fecd80ce740 2024-03-29T04:10:13.339 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.355+0000 7fecbffff640 1 -- 172.21.15.73:0/2541608764 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecc800c9a0 con 0x7fecd80ce740 2024-03-29T04:10:13.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.355+0000 7fecbffff640 1 -- 172.21.15.73:0/2541608764 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc8021060 con 0x7fecd80ce740 2024-03-29T04:10:13.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.356+0000 7fecde04a640 1 -- 172.21.15.73:0/2541608764 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecb8005290 con 0x7fecd80ce740 2024-03-29T04:10:13.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.356+0000 7fecbffff640 1 -- 172.21.15.73:0/2541608764 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fecc801a070 con 0x7fecd80ce740 2024-03-29T04:10:13.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.357+0000 7fecbffff640 1 --2- 172.21.15.73:0/2541608764 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fecc406c560 0x7fecc406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:13.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.357+0000 7fecbffff640 1 -- 172.21.15.73:0/2541608764 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fecc808b6d0 con 0x7fecd80ce740 2024-03-29T04:10:13.340 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.357+0000 7fecd6ffd640 1 --2- 172.21.15.73:0/2541608764 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fecc406c560 0x7fecc406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:13.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.357+0000 7fecd6ffd640 1 --2- 172.21.15.73:0/2541608764 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fecc406c560 0x7fecc406ea20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fecd80b2c30 tx=0x7feccc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:13.341 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.361+0000 7fecbffff640 1 -- 172.21.15.73:0/2541608764 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fecd809e120 con 0x7fecd80ce740 2024-03-29T04:10:13.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.534+0000 7fecde04a640 1 -- 172.21.15.73:0/2541608764 --> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fecb8000bc0 con 0x7fecc406c560 2024-03-29T04:10:13.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.535+0000 7fecbffff640 1 -- 172.21.15.73:0/2541608764 <== mgr.4104 v2:172.21.15.73:6832/1640471941 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fecb8000bc0 con 0x7fecc406c560 2024-03-29T04:10:13.514 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 2 to deep-scrub 2024-03-29T04:10:13.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.536+0000 7fecde04a640 1 -- 172.21.15.73:0/2541608764 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fecc406c560 msgr2=0x7fecc406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:13.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.536+0000 7fecde04a640 1 --2- 172.21.15.73:0/2541608764 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fecc406c560 0x7fecc406ea20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fecd80b2c30 tx=0x7feccc009040 comp rx=0 tx=0).stop 2024-03-29T04:10:13.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.536+0000 7fecde04a640 1 -- 172.21.15.73:0/2541608764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecd80ce740 msgr2=0x7fecd809dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:13.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.536+0000 7fecde04a640 1 --2- 172.21.15.73:0/2541608764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecd80ce740 0x7fecd809dbe0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fecc800e9b0 tx=0x7fecc800ee70 comp rx=0 tx=0).stop 2024-03-29T04:10:13.516 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.536+0000 7fecde04a640 1 -- 172.21.15.73:0/2541608764 shutdown_connections 2024-03-29T04:10:13.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.536+0000 7fecde04a640 1 --2- 172.21.15.73:0/2541608764 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fecd815ec10 0x7fecd80ae230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:13.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.536+0000 7fecde04a640 1 --2- 172.21.15.73:0/2541608764 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fecc406c560 0x7fecc406ea20 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:13.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.536+0000 7fecde04a640 1 --2- 172.21.15.73:0/2541608764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecd80d0730 0x7fecd8147fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:13.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.536+0000 7fecde04a640 1 --2- 172.21.15.73:0/2541608764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecd80ce740 0x7fecd809dbe0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:13.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.536+0000 7fecde04a640 1 -- 172.21.15.73:0/2541608764 >> 172.21.15.73:0/2541608764 conn(0x7fecd806b510 msgr2=0x7fecd80d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:13.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.537+0000 7fecde04a640 1 -- 172.21.15.73:0/2541608764 shutdown_connections 2024-03-29T04:10:13.517 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.537+0000 7fecde04a640 1 -- 172.21.15.73:0/2541608764 wait complete. 2024-03-29T04:10:13.527 INFO:tasks.ceph:Scrubbing osd.3 2024-03-29T04:10:13.527 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-03-29T04:10:13.630 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.651+0000 7f9b90c35640 1 Processor -- start 2024-03-29T04:10:13.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.651+0000 7f9b90c35640 1 -- start start 2024-03-29T04:10:13.633 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.652+0000 7f9b90c35640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b8c0d0980 0x7f9b8c162ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:13.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.652+0000 7f9b90c35640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b8c0b37c0 con 0x7f9b8c15e780 2024-03-29T04:10:13.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.652+0000 7f9b90c35640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b8c0d53e0 con 0x7f9b8c0d4f20 2024-03-29T04:10:13.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.652+0000 7f9b90c35640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9b8c163430 con 0x7f9b8c0d0980 2024-03-29T04:10:13.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.652+0000 7f9b8a59c640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9b8c15e780 0x7f9b8c0b1170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51710/0 (socket says 172.21.15.73:51710) 2024-03-29T04:10:13.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.652+0000 7f9b8a59c640 1 -- 172.21.15.73:0/1159373056 learned_addr learned my addr 172.21.15.73:0/1159373056 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:10:13.634 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.653+0000 7f9b8959a640 1 -- 172.21.15.73:0/1159373056 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1342748369 0 0) 0x7f9b8c0b37c0 con 0x7f9b8c15e780 2024-03-29T04:10:13.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.653+0000 7f9b8959a640 1 -- 172.21.15.73:0/1159373056 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b74003520 con 0x7f9b8c15e780 2024-03-29T04:10:13.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.653+0000 7f9b8ad9d640 1 --2- 172.21.15.73:0/1159373056 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b8c0d0980 0x7f9b8c162ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:13.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.653+0000 7f9b8959a640 1 -- 172.21.15.73:0/1159373056 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2779838280 0 0) 0x7f9b74003520 con 0x7f9b8c15e780 2024-03-29T04:10:13.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.653+0000 7f9b8959a640 1 -- 172.21.15.73:0/1159373056 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b8c0d0980 msgr2=0x7f9b8c162ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:13.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.653+0000 7f9b8959a640 1 --2- 172.21.15.73:0/1159373056 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b8c0d0980 0x7f9b8c162ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:13.635 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.653+0000 7f9b8959a640 1 -- 172.21.15.73:0/1159373056 >> v1:172.21.15.142:6789/0 conn(0x7f9b8c0d4f20 legacy=0x7f9b8c0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:13.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.653+0000 7f9b8959a640 1 -- 172.21.15.73:0/1159373056 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b8c0cf790 con 0x7f9b8c15e780 2024-03-29T04:10:13.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.653+0000 7f9b8959a640 1 -- 172.21.15.73:0/1159373056 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1290421750 0 0) 0x7f9b7c001a10 con 0x7f9b8c15e780 2024-03-29T04:10:13.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.653+0000 7f9b8959a640 1 -- 172.21.15.73:0/1159373056 >> v1:172.21.15.73:6789/0 conn(0x7f9b8c15e780 legacy=0x7f9b8c0b1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:13.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.653+0000 7f9b8959a640 1 --2- 172.21.15.73:0/1159373056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b740039e0 0x7f9b74003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:13.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.653+0000 7f9b8959a640 1 --2- 172.21.15.73:0/1159373056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b74004800 0x7f9b74004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:13.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.653+0000 7f9b8959a640 1 --2- 172.21.15.73:0/1159373056 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b8c0d0980 0x7f9b740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:13.636 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.653+0000 7f9b8959a640 1 -- 172.21.15.73:0/1159373056 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9b8c163430 con 0x7f9b74004800 2024-03-29T04:10:13.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.653+0000 7f9b8959a640 1 -- 172.21.15.73:0/1159373056 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9b7400baa0 con 0x7f9b740039e0 2024-03-29T04:10:13.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.653+0000 7f9b8959a640 1 -- 172.21.15.73:0/1159373056 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9b7400bca0 con 0x7f9b8c0d0980 2024-03-29T04:10:13.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.653+0000 7f9b89d9b640 1 --2- 172.21.15.73:0/1159373056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b74004800 0x7f9b74004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:13.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.653+0000 7f9b8a59c640 1 --2- 172.21.15.73:0/1159373056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b740039e0 0x7f9b74003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:13.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.653+0000 7f9b8ad9d640 1 --2- 172.21.15.73:0/1159373056 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b8c0d0980 0x7f9b740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:13.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.653+0000 7f9b89d9b640 1 -- 172.21.15.73:0/1159373056 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b8c0d0980 msgr2=0x7f9b740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:13.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.653+0000 7f9b89d9b640 1 --2- 172.21.15.73:0/1159373056 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b8c0d0980 0x7f9b740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:13.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.653+0000 7f9b89d9b640 1 -- 172.21.15.73:0/1159373056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b740039e0 msgr2=0x7f9b74003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:13.637 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.653+0000 7f9b89d9b640 1 --2- 172.21.15.73:0/1159373056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b740039e0 0x7f9b74003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:13.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.653+0000 7f9b89d9b640 1 -- 172.21.15.73:0/1159373056 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b74003520 con 0x7f9b74004800 2024-03-29T04:10:13.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.654+0000 7f9b89d9b640 1 --2- 172.21.15.73:0/1159373056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b74004800 0x7f9b74004c80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f9b80007fd0 tx=0x7f9b74005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c830f4d0eb7d646 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:13.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.654+0000 7f9b8959a640 1 -- 172.21.15.73:0/1159373056 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b800013c0 con 0x7f9b74004800 2024-03-29T04:10:13.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.654+0000 7f9b8959a640 1 -- 172.21.15.73:0/1159373056 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b800052d0 con 0x7f9b74004800 2024-03-29T04:10:13.638 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.654+0000 7f9b8959a640 1 -- 172.21.15.73:0/1159373056 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b80003640 con 0x7f9b74004800 2024-03-29T04:10:13.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.655+0000 7f9b90c35640 1 -- 172.21.15.73:0/1159373056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b74004800 msgr2=0x7f9b74004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:13.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.655+0000 7f9b90c35640 1 --2- 172.21.15.73:0/1159373056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b74004800 0x7f9b74004c80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f9b80007fd0 tx=0x7f9b74005830 comp rx=0 tx=0).stop 2024-03-29T04:10:13.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.655+0000 7f9b8ad9d640 1 -- 172.21.15.73:0/1159373056 reap_dead start 2024-03-29T04:10:13.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.655+0000 7f9b90c35640 1 -- 172.21.15.73:0/1159373056 shutdown_connections 2024-03-29T04:10:13.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.655+0000 7f9b90c35640 1 -- 172.21.15.73:0/1159373056 >> 172.21.15.73:0/1159373056 conn(0x7f9b8c08bfc0 msgr2=0x7f9b8c0d4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:13.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.655+0000 7f9b90c35640 1 -- 172.21.15.73:0/1159373056 shutdown_connections 2024-03-29T04:10:13.642 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.655+0000 7f9b90c35640 1 -- 172.21.15.73:0/1159373056 wait complete. 2024-03-29T04:10:13.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.656+0000 7f9b90c35640 1 Processor -- start 2024-03-29T04:10:13.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.656+0000 7f9b90c35640 1 -- start start 2024-03-29T04:10:13.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.657+0000 7f9b90c35640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b74004800 0x7f9b8c15eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:13.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.657+0000 7f9b90c35640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b8c14e510 0x7f9b8c161760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:13.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.657+0000 7f9b90c35640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b8c0caa90 0x7f9b8c1f7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:13.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.657+0000 7f9b90c35640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9b8c0cf440 con 0x7f9b8c14e510 2024-03-29T04:10:13.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.657+0000 7f9b90c35640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9b8c0cfde0 con 0x7f9b74004800 2024-03-29T04:10:13.643 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.657+0000 7f9b90c35640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f9b8c0b1880 con 0x7f9b8c0caa90 2024-03-29T04:10:13.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.657+0000 7f9b89d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b8c14e510 0x7f9b8c161760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:13.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.657+0000 7f9b89d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b8c14e510 0x7f9b8c161760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35624/0 (socket says 172.21.15.73:35624) 2024-03-29T04:10:13.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.657+0000 7f9b89d9b640 1 -- 172.21.15.73:0/3527149388 learned_addr learned my addr 172.21.15.73:0/3527149388 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:13.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.657+0000 7f9b8ad9d640 1 --2- 172.21.15.73:0/3527149388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b8c0caa90 0x7f9b8c1f7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:13.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.657+0000 7f9b8a59c640 1 --2- 172.21.15.73:0/3527149388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b74004800 0x7f9b8c15eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:13.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.657+0000 7f9b89d9b640 1 -- 172.21.15.73:0/3527149388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b8c0caa90 msgr2=0x7f9b8c1f7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:13.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.657+0000 7f9b89d9b640 1 --2- 172.21.15.73:0/3527149388 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f9b8c0caa90 0x7f9b8c1f7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:13.644 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.657+0000 7f9b89d9b640 1 -- 172.21.15.73:0/3527149388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b74004800 msgr2=0x7f9b8c15eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:13.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.657+0000 7f9b89d9b640 1 --2- 172.21.15.73:0/3527149388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b74004800 0x7f9b8c15eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:13.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.657+0000 7f9b89d9b640 1 -- 172.21.15.73:0/3527149388 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b8c14e990 con 0x7f9b8c14e510 2024-03-29T04:10:13.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.657+0000 7f9b8a59c640 1 --2- 172.21.15.73:0/3527149388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9b74004800 0x7f9b8c15eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:10:13.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.657+0000 7f9b89d9b640 1 --2- 172.21.15.73:0/3527149388 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b8c14e510 0x7f9b8c161760 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f9b8002bc80 tx=0x7f9b80001170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:13.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.658+0000 7f9b7affd640 1 -- 172.21.15.73:0/3527149388 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b80041020 con 0x7f9b8c14e510 2024-03-29T04:10:13.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.658+0000 7f9b7affd640 1 -- 172.21.15.73:0/3527149388 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b800050d0 con 0x7f9b8c14e510 2024-03-29T04:10:13.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.658+0000 7f9b7affd640 1 -- 172.21.15.73:0/3527149388 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b80007450 con 0x7f9b8c14e510 2024-03-29T04:10:13.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.658+0000 7f9b90c35640 1 -- 172.21.15.73:0/3527149388 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b8c161ca0 con 0x7f9b8c14e510 2024-03-29T04:10:13.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.658+0000 7f9b90c35640 1 -- 172.21.15.73:0/3527149388 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b8c1609a0 con 0x7f9b8c14e510 2024-03-29T04:10:13.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.658+0000 7f9b90c35640 1 -- 172.21.15.73:0/3527149388 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9b8c068de0 con 0x7f9b8c14e510 2024-03-29T04:10:13.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.659+0000 7f9b7affd640 1 -- 172.21.15.73:0/3527149388 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f9b80044020 con 0x7f9b8c14e510 2024-03-29T04:10:13.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.659+0000 7f9b7affd640 1 --2- 172.21.15.73:0/3527149388 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9b6c06c560 0x7f9b6c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:13.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.659+0000 7f9b7affd640 1 -- 172.21.15.73:0/3527149388 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f9b800ace30 con 0x7f9b8c14e510 2024-03-29T04:10:13.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.659+0000 7f9b8a59c640 1 --2- 172.21.15.73:0/3527149388 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9b6c06c560 0x7f9b6c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:13.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.660+0000 7f9b7affd640 1 --2- 172.21.15.73:0/3527149388 >> [v2:172.21.15.73:6816/4291100709,v1:172.21.15.73:6817/4291100709] conn(0x7f9b6c072420 0x7f9b6c074840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:13.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.660+0000 7f9b7affd640 1 -- 172.21.15.73:0/3527149388 --> [v2:172.21.15.73:6816/4291100709,v1:172.21.15.73:6817/4291100709] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9b80033e90 con 0x7f9b6c072420 2024-03-29T04:10:13.646 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.660+0000 7f9b7affd640 1 -- 172.21.15.73:0/3527149388 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9b800af530 con 0x7f9b8c14e510 2024-03-29T04:10:13.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.660+0000 7f9b8ad9d640 1 --2- 172.21.15.73:0/3527149388 >> [v2:172.21.15.73:6816/4291100709,v1:172.21.15.73:6817/4291100709] conn(0x7f9b6c072420 0x7f9b6c074840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:13.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.660+0000 7f9b8a59c640 1 --2- 172.21.15.73:0/3527149388 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9b6c06c560 0x7f9b6c06ea20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0c8100 tx=0x7f9b7c006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:13.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.660+0000 7f9b8ad9d640 1 --2- 172.21.15.73:0/3527149388 >> [v2:172.21.15.73:6816/4291100709,v1:172.21.15.73:6817/4291100709] conn(0x7f9b6c072420 0x7f9b6c074840 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:13.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.661+0000 7f9b7affd640 1 -- 172.21.15.73:0/3527149388 <== osd.3 v2:172.21.15.73:6816/4291100709 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9b80033e90 con 0x7f9b6c072420 2024-03-29T04:10:13.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.673+0000 7f9b90c35640 1 -- 172.21.15.73:0/3527149388 --> [v2:172.21.15.73:6816/4291100709,v1:172.21.15.73:6817/4291100709] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9b8c068640 con 0x7f9b6c072420 2024-03-29T04:10:13.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.674+0000 7f9b7affd640 1 -- 172.21.15.73:0/3527149388 <== osd.3 v2:172.21.15.73:6816/4291100709 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9b8c068640 con 0x7f9b6c072420 2024-03-29T04:10:13.654 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-29T04:10:13.654 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-29T04:10:13.654 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-29T04:10:13.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.674+0000 7f9b90c35640 1 -- 172.21.15.73:0/3527149388 >> [v2:172.21.15.73:6816/4291100709,v1:172.21.15.73:6817/4291100709] conn(0x7f9b6c072420 msgr2=0x7f9b6c074840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:13.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.674+0000 7f9b90c35640 1 --2- 172.21.15.73:0/3527149388 >> [v2:172.21.15.73:6816/4291100709,v1:172.21.15.73:6817/4291100709] conn(0x7f9b6c072420 0x7f9b6c074840 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:13.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.674+0000 7f9b90c35640 1 -- 172.21.15.73:0/3527149388 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9b6c06c560 msgr2=0x7f9b6c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:13.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.674+0000 7f9b90c35640 1 --2- 172.21.15.73:0/3527149388 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f9b6c06c560 0x7f9b6c06ea20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0c8100 tx=0x7f9b7c006040 comp rx=0 tx=0).stop 2024-03-29T04:10:13.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.674+0000 7f9b90c35640 1 -- 172.21.15.73:0/3527149388 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b8c14e510 msgr2=0x7f9b8c161760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:13.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.674+0000 7f9b90c35640 1 --2- 172.21.15.73:0/3527149388 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b8c14e510 0x7f9b8c161760 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f9b8002bc80 tx=0x7f9b80001170 comp rx=0 tx=0).stop 2024-03-29T04:10:13.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.674+0000 7f9b8ad9d640 1 -- 172.21.15.73:0/3527149388 reap_dead start 2024-03-29T04:10:13.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.674+0000 7f9b90c35640 1 -- 172.21.15.73:0/3527149388 shutdown_connections 2024-03-29T04:10:13.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.674+0000 7f9b90c35640 1 -- 172.21.15.73:0/3527149388 >> 172.21.15.73:0/3527149388 conn(0x7f9b8c08bfc0 msgr2=0x7f9b8c0d4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:13.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.674+0000 7f9b90c35640 1 -- 172.21.15.73:0/3527149388 shutdown_connections 2024-03-29T04:10:13.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.674+0000 7f9b90c35640 1 -- 172.21.15.73:0/3527149388 wait complete. 2024-03-29T04:10:13.664 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-03-29T04:10:13.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.786+0000 7f522bf8d640 1 Processor -- start 2024-03-29T04:10:13.765 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.786+0000 7f522bf8d640 1 -- start start 2024-03-29T04:10:13.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.787+0000 7f522bf8d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52240d0730 0x7f52240c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:13.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.787+0000 7f522bf8d640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f52240ce740 0x7f52240b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:13.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.787+0000 7f522bf8d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f522415f100 con 0x7f522415ec10 2024-03-29T04:10:13.767 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.787+0000 7f522bf8d640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f52240cebf0 con 0x7f52240ce740 2024-03-29T04:10:13.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.787+0000 7f522bf8d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f522415f370 con 0x7f52240d0730 2024-03-29T04:10:13.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.787+0000 7f522a52a640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f52240ce740 0x7f52240b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:13.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.787+0000 7f522a52a640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f52240ce740 0x7f52240b30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35628/0 (socket says 172.21.15.73:35628) 2024-03-29T04:10:13.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.787+0000 7f522a52a640 1 -- 172.21.15.73:0/3395653471 learned_addr learned my addr 172.21.15.73:0/3395653471 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:13.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.787+0000 7f5229528640 1 --2- 172.21.15.73:0/3395653471 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52240d0730 0x7f52240c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:13.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.787+0000 7f522a52a640 1 -- 172.21.15.73:0/3395653471 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52240d0730 msgr2=0x7f52240c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:13.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.787+0000 7f522a52a640 1 --2- 172.21.15.73:0/3395653471 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52240d0730 0x7f52240c67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:13.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.787+0000 7f522a52a640 1 -- 172.21.15.73:0/3395653471 >> v1:172.21.15.142:6789/0 conn(0x7f522415ec10 legacy=0x7f52240d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:13.768 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.787+0000 7f522a52a640 1 -- 172.21.15.73:0/3395653471 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f522415f650 con 0x7f52240ce740 2024-03-29T04:10:13.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.788+0000 7f522a52a640 1 --2- 172.21.15.73:0/3395653471 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52240ce740 0x7f52240b30b0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f521c009e50 tx=0x7f521c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33e39ed7fa152af6 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:13.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.788+0000 7f5228d27640 1 -- 172.21.15.73:0/3395653471 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f521c02ca70 con 0x7f52240ce740 2024-03-29T04:10:13.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.788+0000 7f5228d27640 1 -- 172.21.15.73:0/3395653471 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f521c02cc10 con 0x7f52240ce740 2024-03-29T04:10:13.769 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.788+0000 7f5228d27640 1 -- 172.21.15.73:0/3395653471 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f521c0343f0 con 0x7f52240ce740 2024-03-29T04:10:13.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.788+0000 7f522bf8d640 1 -- 172.21.15.73:0/3395653471 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52240ce740 msgr2=0x7f52240b30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:13.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.788+0000 7f522bf8d640 1 --2- 172.21.15.73:0/3395653471 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52240ce740 0x7f52240b30b0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f521c009e50 tx=0x7f521c02bed0 comp rx=0 tx=0).stop 2024-03-29T04:10:13.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.788+0000 7f522bf8d640 1 -- 172.21.15.73:0/3395653471 shutdown_connections 2024-03-29T04:10:13.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.788+0000 7f522bf8d640 1 --2- 172.21.15.73:0/3395653471 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52240ce740 0x7f52240b30b0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:13.772 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.788+0000 7f522bf8d640 1 --2- 172.21.15.73:0/3395653471 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52240d0730 0x7f52240c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:13.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.788+0000 7f522bf8d640 1 -- 172.21.15.73:0/3395653471 >> 172.21.15.73:0/3395653471 conn(0x7f522406b510 msgr2=0x7f522406b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:13.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.789+0000 7f522bf8d640 1 -- 172.21.15.73:0/3395653471 shutdown_connections 2024-03-29T04:10:13.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.789+0000 7f522bf8d640 1 -- 172.21.15.73:0/3395653471 wait complete. 2024-03-29T04:10:13.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.790+0000 7f522bf8d640 1 Processor -- start 2024-03-29T04:10:13.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.790+0000 7f522bf8d640 1 -- start start 2024-03-29T04:10:13.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.790+0000 7f522bf8d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52240ce740 0x7f522414d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:13.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.790+0000 7f522bf8d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52240d0730 0x7f52240727f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:13.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.790+0000 7f522bf8d640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f522415ec10 0x7f522415b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:13.773 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.790+0000 7f522bf8d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f522415fe50 con 0x7f52240ce740 2024-03-29T04:10:13.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.790+0000 7f522bf8d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f52240c6ee0 con 0x7f52240d0730 2024-03-29T04:10:13.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.790+0000 7f522bf8d640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f522415ffd0 con 0x7f522415ec10 2024-03-29T04:10:13.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.790+0000 7f5229d29640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52240ce740 0x7f522414d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:13.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.790+0000 7f5229d29640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52240ce740 0x7f522414d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35632/0 (socket says 172.21.15.73:35632) 2024-03-29T04:10:13.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.791+0000 7f5229d29640 1 -- 172.21.15.73:0/4188396390 learned_addr learned my addr 172.21.15.73:0/4188396390 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:13.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.791+0000 7f5229528640 1 --2- 172.21.15.73:0/4188396390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52240d0730 0x7f52240727f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:13.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.791+0000 7f522a52a640 1 --2- 172.21.15.73:0/4188396390 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f522415ec10 0x7f522415b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:13.774 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.791+0000 7f5229d29640 1 -- 172.21.15.73:0/4188396390 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f522415ec10 msgr2=0x7f522415b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:13.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.791+0000 7f5229d29640 1 --2- 172.21.15.73:0/4188396390 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f522415ec10 0x7f522415b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:13.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.791+0000 7f5229d29640 1 -- 172.21.15.73:0/4188396390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52240d0730 msgr2=0x7f52240727f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:13.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.791+0000 7f5229d29640 1 --2- 172.21.15.73:0/4188396390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52240d0730 0x7f52240727f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:13.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.791+0000 7f5229d29640 1 -- 172.21.15.73:0/4188396390 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f522415e3d0 con 0x7f52240ce740 2024-03-29T04:10:13.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.791+0000 7f5229d29640 1 --2- 172.21.15.73:0/4188396390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52240ce740 0x7f522414d290 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f521400c430 tx=0x7f521400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:13.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.791+0000 7f521a7fc640 1 -- 172.21.15.73:0/4188396390 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52140052d0 con 0x7f52240ce740 2024-03-29T04:10:13.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.791+0000 7f521a7fc640 1 -- 172.21.15.73:0/4188396390 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5214005490 con 0x7f52240ce740 2024-03-29T04:10:13.775 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.791+0000 7f522bf8d640 1 -- 172.21.15.73:0/4188396390 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5224072d30 con 0x7f52240ce740 2024-03-29T04:10:13.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.791+0000 7f521a7fc640 1 -- 172.21.15.73:0/4188396390 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5214007260 con 0x7f52240ce740 2024-03-29T04:10:13.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.791+0000 7f522bf8d640 1 -- 172.21.15.73:0/4188396390 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52240732b0 con 0x7f52240ce740 2024-03-29T04:10:13.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.792+0000 7f522bf8d640 1 -- 172.21.15.73:0/4188396390 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5224068640 con 0x7f52240ce740 2024-03-29T04:10:13.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.793+0000 7f521a7fc640 1 -- 172.21.15.73:0/4188396390 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f5214007400 con 0x7f52240ce740 2024-03-29T04:10:13.776 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.793+0000 7f521a7fc640 1 --2- 172.21.15.73:0/4188396390 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f520806c530 0x7f520806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:13.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.793+0000 7f521a7fc640 1 -- 172.21.15.73:0/4188396390 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f521408a830 con 0x7f52240ce740 2024-03-29T04:10:13.777 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.793+0000 7f5229528640 1 --2- 172.21.15.73:0/4188396390 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f520806c530 0x7f520806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:13.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.793+0000 7f5229528640 1 --2- 172.21.15.73:0/4188396390 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f520806c530 0x7f520806e9f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f522414dff0 tx=0x7f5220008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:13.778 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.798+0000 7f521a7fc640 1 -- 172.21.15.73:0/4188396390 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f5214058b00 con 0x7f52240ce740 2024-03-29T04:10:13.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.974+0000 7f522bf8d640 1 -- 172.21.15.73:0/4188396390 --> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f52240b4f60 con 0x7f520806c530 2024-03-29T04:10:13.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.974+0000 7f521a7fc640 1 -- 172.21.15.73:0/4188396390 <== mgr.4104 v2:172.21.15.73:6832/1640471941 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f52240b4f60 con 0x7f520806c530 2024-03-29T04:10:13.954 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 3 to deep-scrub 2024-03-29T04:10:13.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.976+0000 7f522bf8d640 1 -- 172.21.15.73:0/4188396390 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f520806c530 msgr2=0x7f520806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:13.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.976+0000 7f522bf8d640 1 --2- 172.21.15.73:0/4188396390 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f520806c530 0x7f520806e9f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f522414dff0 tx=0x7f5220008040 comp rx=0 tx=0).stop 2024-03-29T04:10:13.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.976+0000 7f522bf8d640 1 -- 172.21.15.73:0/4188396390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52240ce740 msgr2=0x7f522414d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:13.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.976+0000 7f522bf8d640 1 --2- 172.21.15.73:0/4188396390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52240ce740 0x7f522414d290 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f521400c430 tx=0x7f521400c8f0 comp rx=0 tx=0).stop 2024-03-29T04:10:13.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.976+0000 7f522bf8d640 1 -- 172.21.15.73:0/4188396390 shutdown_connections 2024-03-29T04:10:13.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.976+0000 7f522bf8d640 1 --2- 172.21.15.73:0/4188396390 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f522415ec10 0x7f522415b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:13.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.976+0000 7f522bf8d640 1 --2- 172.21.15.73:0/4188396390 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f520806c530 0x7f520806e9f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:13.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.976+0000 7f522bf8d640 1 --2- 172.21.15.73:0/4188396390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52240d0730 0x7f52240727f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:13.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.976+0000 7f522bf8d640 1 --2- 172.21.15.73:0/4188396390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52240ce740 0x7f522414d290 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:13.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.976+0000 7f522bf8d640 1 -- 172.21.15.73:0/4188396390 >> 172.21.15.73:0/4188396390 conn(0x7f522406b510 msgr2=0x7f52240cb530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:13.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.976+0000 7f522bf8d640 1 -- 172.21.15.73:0/4188396390 shutdown_connections 2024-03-29T04:10:13.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:13.976+0000 7f522bf8d640 1 -- 172.21.15.73:0/4188396390 wait complete. 2024-03-29T04:10:13.966 INFO:tasks.ceph:Scrubbing osd.4 2024-03-29T04:10:13.966 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-03-29T04:10:14.070 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.091+0000 7f9875be8640 1 Processor -- start 2024-03-29T04:10:14.071 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.091+0000 7f9875be8640 1 -- start start 2024-03-29T04:10:14.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.092+0000 7f9875be8640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f987006b510 0x7f987006b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:14.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.092+0000 7f9875be8640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f98700b2c10 0x7f98700b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:14.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.092+0000 7f9875be8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98700d1100 0x7f98700d1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:14.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.092+0000 7f9875be8640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f98700ce810 con 0x7f98700b2c10 2024-03-29T04:10:14.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.092+0000 7f9875be8640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f987006be30 con 0x7f987006b510 2024-03-29T04:10:14.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.092+0000 7f9875be8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f98700b6420 con 0x7f98700d1100 2024-03-29T04:10:14.074 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.092+0000 7f986effd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f98700b2c10 0x7f98700b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:14.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.092+0000 7f986effd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f98700b2c10 0x7f98700b43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35642/0 (socket says 172.21.15.73:35642) 2024-03-29T04:10:14.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.092+0000 7f986effd640 1 -- 172.21.15.73:0/2349922120 learned_addr learned my addr 172.21.15.73:0/2349922120 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:14.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.093+0000 7f986ffff640 1 --2- 172.21.15.73:0/2349922120 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98700d1100 0x7f98700d1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:14.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.093+0000 7f986f7fe640 1 --2- 172.21.15.73:0/2349922120 >> v2:172.21.15.142:3300/0 conn(0x7f987006b510 0x7f987006b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:14.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.093+0000 7f986effd640 1 -- 172.21.15.73:0/2349922120 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98700d1100 msgr2=0x7f98700d1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:14.075 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.093+0000 7f986effd640 1 --2- 172.21.15.73:0/2349922120 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98700d1100 0x7f98700d1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.093+0000 7f986effd640 1 -- 172.21.15.73:0/2349922120 >> v2:172.21.15.142:3300/0 conn(0x7f987006b510 msgr2=0x7f987006b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:14.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.093+0000 7f986effd640 1 --2- 172.21.15.73:0/2349922120 >> v2:172.21.15.142:3300/0 conn(0x7f987006b510 0x7f987006b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.093+0000 7f986effd640 1 -- 172.21.15.73:0/2349922120 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98700b6700 con 0x7f98700b2c10 2024-03-29T04:10:14.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.093+0000 7f986f7fe640 1 --2- 172.21.15.73:0/2349922120 >> v2:172.21.15.142:3300/0 conn(0x7f987006b510 0x7f987006b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:10:14.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.093+0000 7f986effd640 1 --2- 172.21.15.73:0/2349922120 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98700b2c10 0x7f98700b43b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f9870148800 tx=0x7f986402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aa3fec2bec6e15a server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:14.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.094+0000 7f986e7fc640 1 -- 172.21.15.73:0/2349922120 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986402e070 con 0x7f98700b2c10 2024-03-29T04:10:14.076 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.094+0000 7f986e7fc640 1 -- 172.21.15.73:0/2349922120 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9864037070 con 0x7f98700b2c10 2024-03-29T04:10:14.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.094+0000 7f986e7fc640 1 -- 172.21.15.73:0/2349922120 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9864031a00 con 0x7f98700b2c10 2024-03-29T04:10:14.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.094+0000 7f9875be8640 1 -- 172.21.15.73:0/2349922120 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98700b2c10 msgr2=0x7f98700b43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:14.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.094+0000 7f9875be8640 1 --2- 172.21.15.73:0/2349922120 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98700b2c10 0x7f98700b43b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f9870148800 tx=0x7f986402b880 comp rx=0 tx=0).stop 2024-03-29T04:10:14.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.094+0000 7f9875be8640 1 -- 172.21.15.73:0/2349922120 shutdown_connections 2024-03-29T04:10:14.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.094+0000 7f9875be8640 1 --2- 172.21.15.73:0/2349922120 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98700d1100 0x7f98700d1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.077 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.094+0000 7f9875be8640 1 --2- 172.21.15.73:0/2349922120 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98700b2c10 0x7f98700b43b0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.094+0000 7f9875be8640 1 --2- 172.21.15.73:0/2349922120 >> v2:172.21.15.142:3300/0 conn(0x7f987006b510 0x7f987006b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.094+0000 7f9875be8640 1 -- 172.21.15.73:0/2349922120 >> 172.21.15.73:0/2349922120 conn(0x7f98700b6af0 msgr2=0x7f987009aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:14.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.094+0000 7f9875be8640 1 -- 172.21.15.73:0/2349922120 shutdown_connections 2024-03-29T04:10:14.078 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.094+0000 7f9875be8640 1 -- 172.21.15.73:0/2349922120 wait complete. 2024-03-29T04:10:14.081 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.095+0000 7f9875be8640 1 Processor -- start 2024-03-29T04:10:14.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.096+0000 7f9875be8640 1 -- start start 2024-03-29T04:10:14.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.096+0000 7f9875be8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f987006b510 0x7f987009be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:14.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.096+0000 7f9875be8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98700b2c10 0x7f98701419c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:14.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.096+0000 7f9875be8640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98700d1100 0x7f9870141f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:14.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.096+0000 7f9875be8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9870145430 con 0x7f98700b2c10 2024-03-29T04:10:14.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.096+0000 7f9875be8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f98701452b0 con 0x7f987006b510 2024-03-29T04:10:14.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.096+0000 7f9875be8640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f98700b48f0 con 0x7f98700d1100 2024-03-29T04:10:14.082 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.096+0000 7f986effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98700b2c10 0x7f98701419c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:14.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.096+0000 7f986effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98700b2c10 0x7f98701419c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35658/0 (socket says 172.21.15.73:35658) 2024-03-29T04:10:14.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.096+0000 7f986effd640 1 -- 172.21.15.73:0/2896997466 learned_addr learned my addr 172.21.15.73:0/2896997466 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:14.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.097+0000 7f986ffff640 1 --2- 172.21.15.73:0/2896997466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98700d1100 0x7f9870141f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:14.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.097+0000 7f986f7fe640 1 --2- 172.21.15.73:0/2896997466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f987006b510 0x7f987009be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:14.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.097+0000 7f986effd640 1 -- 172.21.15.73:0/2896997466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98700d1100 msgr2=0x7f9870141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:14.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.097+0000 7f986effd640 1 --2- 172.21.15.73:0/2896997466 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f98700d1100 0x7f9870141f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.097+0000 7f986effd640 1 -- 172.21.15.73:0/2896997466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f987006b510 msgr2=0x7f987009be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:14.083 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.097+0000 7f986effd640 1 --2- 172.21.15.73:0/2896997466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f987006b510 0x7f987009be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.097+0000 7f986effd640 1 -- 172.21.15.73:0/2896997466 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98700ca7d0 con 0x7f98700b2c10 2024-03-29T04:10:14.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.097+0000 7f986f7fe640 1 --2- 172.21.15.73:0/2896997466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f987006b510 0x7f987009be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:10:14.084 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.097+0000 7f986effd640 1 --2- 172.21.15.73:0/2896997466 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98700b2c10 0x7f98701419c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f9864000c00 tx=0x7f98640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:14.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.097+0000 7f9857fff640 1 -- 172.21.15.73:0/2896997466 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9864032670 con 0x7f98700b2c10 2024-03-29T04:10:14.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.097+0000 7f9857fff640 1 -- 172.21.15.73:0/2896997466 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9864032850 con 0x7f98700b2c10 2024-03-29T04:10:14.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.097+0000 7f9875be8640 1 -- 172.21.15.73:0/2896997466 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98700caab0 con 0x7f98700b2c10 2024-03-29T04:10:14.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.097+0000 7f9857fff640 1 -- 172.21.15.73:0/2896997466 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9864032c40 con 0x7f98700b2c10 2024-03-29T04:10:14.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.097+0000 7f9875be8640 1 -- 172.21.15.73:0/2896997466 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98700cb070 con 0x7f98700b2c10 2024-03-29T04:10:14.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.098+0000 7f9875be8640 1 -- 172.21.15.73:0/2896997466 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9870068640 con 0x7f98700b2c10 2024-03-29T04:10:14.085 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.098+0000 7f9857fff640 1 -- 172.21.15.73:0/2896997466 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f986404c060 con 0x7f98700b2c10 2024-03-29T04:10:14.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.099+0000 7f9857fff640 1 --2- 172.21.15.73:0/2896997466 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f985c06c530 0x7f985c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:14.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.099+0000 7f9857fff640 1 -- 172.21.15.73:0/2896997466 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f98640acde0 con 0x7f98700b2c10 2024-03-29T04:10:14.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.099+0000 7f986f7fe640 1 --2- 172.21.15.73:0/2896997466 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f985c06c530 0x7f985c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:14.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.099+0000 7f9857fff640 1 --2- 172.21.15.73:0/2896997466 >> [v2:172.21.15.142:6816/3703256194,v1:172.21.15.142:6817/3703256194] conn(0x7f985c0723f0 0x7f985c074810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:14.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.099+0000 7f9857fff640 1 -- 172.21.15.73:0/2896997466 --> [v2:172.21.15.142:6816/3703256194,v1:172.21.15.142:6817/3703256194] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9864007e80 con 0x7f985c0723f0 2024-03-29T04:10:14.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.099+0000 7f9857fff640 1 -- 172.21.15.73:0/2896997466 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f98640af4e0 con 0x7f98700b2c10 2024-03-29T04:10:14.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.099+0000 7f986ffff640 1 --2- 172.21.15.73:0/2896997466 >> [v2:172.21.15.142:6816/3703256194,v1:172.21.15.142:6817/3703256194] conn(0x7f985c0723f0 0x7f985c074810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:14.086 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.099+0000 7f986f7fe640 1 --2- 172.21.15.73:0/2896997466 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f985c06c530 0x7f985c06e9f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9860006fd0 tx=0x7f9860008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:14.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.100+0000 7f986ffff640 1 --2- 172.21.15.73:0/2896997466 >> [v2:172.21.15.142:6816/3703256194,v1:172.21.15.142:6817/3703256194] conn(0x7f985c0723f0 0x7f985c074810 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:14.087 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.100+0000 7f9857fff640 1 -- 172.21.15.73:0/2896997466 <== osd.4 v2:172.21.15.142:6816/3703256194 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9864007e80 con 0x7f985c0723f0 2024-03-29T04:10:14.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.113+0000 7f9875be8640 1 -- 172.21.15.73:0/2896997466 --> [v2:172.21.15.142:6816/3703256194,v1:172.21.15.142:6817/3703256194] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9870070750 con 0x7f985c0723f0 2024-03-29T04:10:14.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.114+0000 7f9857fff640 1 -- 172.21.15.73:0/2896997466 <== osd.4 v2:172.21.15.142:6816/3703256194 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9870070750 con 0x7f985c0723f0 2024-03-29T04:10:14.095 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-29T04:10:14.095 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-29T04:10:14.095 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-29T04:10:14.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.115+0000 7f9875be8640 1 -- 172.21.15.73:0/2896997466 >> [v2:172.21.15.142:6816/3703256194,v1:172.21.15.142:6817/3703256194] conn(0x7f985c0723f0 msgr2=0x7f985c074810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:14.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.115+0000 7f9875be8640 1 --2- 172.21.15.73:0/2896997466 >> [v2:172.21.15.142:6816/3703256194,v1:172.21.15.142:6817/3703256194] conn(0x7f985c0723f0 0x7f985c074810 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.115+0000 7f9875be8640 1 -- 172.21.15.73:0/2896997466 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f985c06c530 msgr2=0x7f985c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:14.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.115+0000 7f9875be8640 1 --2- 172.21.15.73:0/2896997466 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f985c06c530 0x7f985c06e9f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9860006fd0 tx=0x7f9860008040 comp rx=0 tx=0).stop 2024-03-29T04:10:14.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.115+0000 7f9875be8640 1 -- 172.21.15.73:0/2896997466 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98700b2c10 msgr2=0x7f98701419c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:14.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.115+0000 7f9875be8640 1 --2- 172.21.15.73:0/2896997466 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f98700b2c10 0x7f98701419c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f9864000c00 tx=0x7f98640046c0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.115+0000 7f986ffff640 1 -- 172.21.15.73:0/2896997466 reap_dead start 2024-03-29T04:10:14.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.115+0000 7f9875be8640 1 -- 172.21.15.73:0/2896997466 shutdown_connections 2024-03-29T04:10:14.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.115+0000 7f9875be8640 1 -- 172.21.15.73:0/2896997466 >> 172.21.15.73:0/2896997466 conn(0x7f98700b6af0 msgr2=0x7f98700d1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:14.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.115+0000 7f9875be8640 1 -- 172.21.15.73:0/2896997466 shutdown_connections 2024-03-29T04:10:14.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.115+0000 7f9875be8640 1 -- 172.21.15.73:0/2896997466 wait complete. 2024-03-29T04:10:14.105 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-03-29T04:10:14.205 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.226+0000 7fcfc9d74640 1 Processor -- start 2024-03-29T04:10:14.206 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.226+0000 7fcfc9d74640 1 -- start start 2024-03-29T04:10:14.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.227+0000 7fcfc9d74640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfc40b3af0 0x7fcfc40cb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:14.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.227+0000 7fcfc9d74640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcfc406b510 0x7fcfc406b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:14.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.227+0000 7fcfc9d74640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfc40cf500 con 0x7fcfc415e7e0 2024-03-29T04:10:14.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.227+0000 7fcfc9d74640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fcfc406beb0 con 0x7fcfc406b510 2024-03-29T04:10:14.207 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.227+0000 7fcfc9d74640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fcfc40cfe30 con 0x7fcfc40b3af0 2024-03-29T04:10:14.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.227+0000 7fcfc2ffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfc40b3af0 0x7fcfc40cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:14.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.227+0000 7fcfc3fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcfc406b510 0x7fcfc406b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:14.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.227+0000 7fcfc2ffd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfc40b3af0 0x7fcfc40cb060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:35806/0 (socket says 172.21.15.73:35806) 2024-03-29T04:10:14.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.227+0000 7fcfc2ffd640 1 -- 172.21.15.73:0/1444534482 learned_addr learned my addr 172.21.15.73:0/1444534482 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:14.208 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.227+0000 7fcfc37fe640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fcfc415e7e0 0x7fcfc40d02c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.73:44432/0 (socket says 172.21.15.73:44432) 2024-03-29T04:10:14.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.227+0000 7fcfc2ffd640 1 -- 172.21.15.73:0/1444534482 >> v2:172.21.15.142:3300/0 conn(0x7fcfc406b510 msgr2=0x7fcfc406b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:14.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.227+0000 7fcfc2ffd640 1 --2- 172.21.15.73:0/1444534482 >> v2:172.21.15.142:3300/0 conn(0x7fcfc406b510 0x7fcfc406b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.227+0000 7fcfc2ffd640 1 -- 172.21.15.73:0/1444534482 >> v1:172.21.15.142:6789/0 conn(0x7fcfc415e7e0 legacy=0x7fcfc40d02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:14.209 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.227+0000 7fcfc2ffd640 1 -- 172.21.15.73:0/1444534482 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfc40cf7e0 con 0x7fcfc40b3af0 2024-03-29T04:10:14.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.228+0000 7fcfc2ffd640 1 --2- 172.21.15.73:0/1444534482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfc40b3af0 0x7fcfc40cb060 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8009870 tx=0x7fcfb802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbcf331ef1110582 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:14.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.228+0000 7fcfc27fc640 1 -- 172.21.15.73:0/1444534482 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8034070 con 0x7fcfc40b3af0 2024-03-29T04:10:14.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.228+0000 7fcfc27fc640 1 -- 172.21.15.73:0/1444534482 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfb8030840 con 0x7fcfc40b3af0 2024-03-29T04:10:14.213 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.228+0000 7fcfc27fc640 1 -- 172.21.15.73:0/1444534482 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8030c10 con 0x7fcfc40b3af0 2024-03-29T04:10:14.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.229+0000 7fcfc9d74640 1 -- 172.21.15.73:0/1444534482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfc40b3af0 msgr2=0x7fcfc40cb060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:14.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.229+0000 7fcfc9d74640 1 --2- 172.21.15.73:0/1444534482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfc40b3af0 0x7fcfc40cb060 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8009870 tx=0x7fcfb802b980 comp rx=0 tx=0).stop 2024-03-29T04:10:14.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.229+0000 7fcfc9d74640 1 -- 172.21.15.73:0/1444534482 shutdown_connections 2024-03-29T04:10:14.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.229+0000 7fcfc9d74640 1 --2- 172.21.15.73:0/1444534482 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfc40b3af0 0x7fcfc40cb060 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.229+0000 7fcfc9d74640 1 --2- 172.21.15.73:0/1444534482 >> v2:172.21.15.142:3300/0 conn(0x7fcfc406b510 0x7fcfc406b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.229+0000 7fcfc9d74640 1 -- 172.21.15.73:0/1444534482 >> 172.21.15.73:0/1444534482 conn(0x7fcfc40b2fd0 msgr2=0x7fcfc40b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:14.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.229+0000 7fcfc9d74640 1 -- 172.21.15.73:0/1444534482 shutdown_connections 2024-03-29T04:10:14.214 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.229+0000 7fcfc9d74640 1 -- 172.21.15.73:0/1444534482 wait complete. 2024-03-29T04:10:14.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.230+0000 7fcfc9d74640 1 Processor -- start 2024-03-29T04:10:14.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.230+0000 7fcfc9d74640 1 -- start start 2024-03-29T04:10:14.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.231+0000 7fcfc9d74640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfc406b510 0x7fcfc4147b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:14.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.231+0000 7fcfc9d74640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfc40b3af0 0x7fcfc40ce280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:14.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.231+0000 7fcfc9d74640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfc415e7e0 0x7fcfc4152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:14.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.231+0000 7fcfc9d74640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc415ebc0 con 0x7fcfc406b510 2024-03-29T04:10:14.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.231+0000 7fcfc9d74640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc40cb5a0 con 0x7fcfc40b3af0 2024-03-29T04:10:14.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.231+0000 7fcfc9d74640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fcfc40cf1b0 con 0x7fcfc415e7e0 2024-03-29T04:10:14.215 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.231+0000 7fcfc37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfc406b510 0x7fcfc4147b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:14.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.231+0000 7fcfc37fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfc406b510 0x7fcfc4147b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35660/0 (socket says 172.21.15.73:35660) 2024-03-29T04:10:14.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.231+0000 7fcfc37fe640 1 -- 172.21.15.73:0/1553612456 learned_addr learned my addr 172.21.15.73:0/1553612456 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:14.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.231+0000 7fcfc3fff640 1 --2- 172.21.15.73:0/1553612456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfc415e7e0 0x7fcfc4152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:14.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.231+0000 7fcfc2ffd640 1 --2- 172.21.15.73:0/1553612456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfc40b3af0 0x7fcfc40ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:14.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.231+0000 7fcfc37fe640 1 -- 172.21.15.73:0/1553612456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfc415e7e0 msgr2=0x7fcfc4152840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:14.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.231+0000 7fcfc37fe640 1 --2- 172.21.15.73:0/1553612456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfc415e7e0 0x7fcfc4152840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.231+0000 7fcfc37fe640 1 -- 172.21.15.73:0/1553612456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfc40b3af0 msgr2=0x7fcfc40ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:14.216 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.231+0000 7fcfc37fe640 1 --2- 172.21.15.73:0/1553612456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfc40b3af0 0x7fcfc40ce280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.231+0000 7fcfc37fe640 1 -- 172.21.15.73:0/1553612456 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfc40b4580 con 0x7fcfc406b510 2024-03-29T04:10:14.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.231+0000 7fcfc2ffd640 1 --2- 172.21.15.73:0/1553612456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfc40b3af0 0x7fcfc40ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:10:14.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.231+0000 7fcfc37fe640 1 --2- 172.21.15.73:0/1553612456 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfc406b510 0x7fcfc4147b40 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fcfb400c430 tx=0x7fcfb400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:14.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.232+0000 7fcfabfff640 1 -- 172.21.15.73:0/1553612456 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb40074e0 con 0x7fcfc406b510 2024-03-29T04:10:14.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.232+0000 7fcfabfff640 1 -- 172.21.15.73:0/1553612456 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfb4007680 con 0x7fcfc406b510 2024-03-29T04:10:14.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.232+0000 7fcfc9d74640 1 -- 172.21.15.73:0/1553612456 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfc40b4860 con 0x7fcfc406b510 2024-03-29T04:10:14.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.232+0000 7fcfabfff640 1 -- 172.21.15.73:0/1553612456 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4004a00 con 0x7fcfc406b510 2024-03-29T04:10:14.217 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.232+0000 7fcfc9d74640 1 -- 172.21.15.73:0/1553612456 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfc40b4e20 con 0x7fcfc406b510 2024-03-29T04:10:14.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.233+0000 7fcfc9d74640 1 -- 172.21.15.73:0/1553612456 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfc40b3910 con 0x7fcfc406b510 2024-03-29T04:10:14.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.233+0000 7fcfabfff640 1 -- 172.21.15.73:0/1553612456 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fcfb401a020 con 0x7fcfc406b510 2024-03-29T04:10:14.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.233+0000 7fcfabfff640 1 --2- 172.21.15.73:0/1553612456 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fcfb006c530 0x7fcfb006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:14.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.233+0000 7fcfabfff640 1 -- 172.21.15.73:0/1553612456 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fcfb408abe0 con 0x7fcfc406b510 2024-03-29T04:10:14.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.234+0000 7fcfc2ffd640 1 --2- 172.21.15.73:0/1553612456 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fcfb006c530 0x7fcfb006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:14.218 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.234+0000 7fcfc2ffd640 1 --2- 172.21.15.73:0/1553612456 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fcfb006c530 0x7fcfb006e9f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8036000 tx=0x7fcfb803b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:14.219 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.238+0000 7fcfabfff640 1 -- 172.21.15.73:0/1553612456 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fcfc40b3910 con 0x7fcfc406b510 2024-03-29T04:10:14.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.413+0000 7fcfc9d74640 1 -- 172.21.15.73:0/1553612456 --> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fcfc4148080 con 0x7fcfb006c530 2024-03-29T04:10:14.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.413+0000 7fcfabfff640 1 -- 172.21.15.73:0/1553612456 <== mgr.4104 v2:172.21.15.73:6832/1640471941 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fcfc4148080 con 0x7fcfb006c530 2024-03-29T04:10:14.393 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 4 to deep-scrub 2024-03-29T04:10:14.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.415+0000 7fcfc9d74640 1 -- 172.21.15.73:0/1553612456 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fcfb006c530 msgr2=0x7fcfb006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:14.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.415+0000 7fcfc9d74640 1 --2- 172.21.15.73:0/1553612456 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fcfb006c530 0x7fcfb006e9f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8036000 tx=0x7fcfb803b040 comp rx=0 tx=0).stop 2024-03-29T04:10:14.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.415+0000 7fcfc9d74640 1 -- 172.21.15.73:0/1553612456 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfc406b510 msgr2=0x7fcfc4147b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:14.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.415+0000 7fcfc9d74640 1 --2- 172.21.15.73:0/1553612456 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfc406b510 0x7fcfc4147b40 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fcfb400c430 tx=0x7fcfb400c8f0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.415+0000 7fcfc9d74640 1 -- 172.21.15.73:0/1553612456 shutdown_connections 2024-03-29T04:10:14.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.415+0000 7fcfc9d74640 1 --2- 172.21.15.73:0/1553612456 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fcfc415e7e0 0x7fcfc4152840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.415+0000 7fcfc9d74640 1 --2- 172.21.15.73:0/1553612456 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fcfb006c530 0x7fcfb006e9f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.415+0000 7fcfc9d74640 1 --2- 172.21.15.73:0/1553612456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfc40b3af0 0x7fcfc40ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.415+0000 7fcfc9d74640 1 --2- 172.21.15.73:0/1553612456 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcfc406b510 0x7fcfc4147b40 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.395 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.415+0000 7fcfc9d74640 1 -- 172.21.15.73:0/1553612456 >> 172.21.15.73:0/1553612456 conn(0x7fcfc40b2fd0 msgr2=0x7fcfc415d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:14.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.415+0000 7fcfc9d74640 1 -- 172.21.15.73:0/1553612456 shutdown_connections 2024-03-29T04:10:14.396 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.415+0000 7fcfc9d74640 1 -- 172.21.15.73:0/1553612456 wait complete. 2024-03-29T04:10:14.405 INFO:tasks.ceph:Scrubbing osd.5 2024-03-29T04:10:14.405 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-03-29T04:10:14.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.530+0000 7faf05731640 1 Processor -- start 2024-03-29T04:10:14.510 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.530+0000 7faf05731640 1 -- start start 2024-03-29T04:10:14.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.531+0000 7faf05731640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7faf0015ff10 0x7faf000b1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:14.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.531+0000 7faf05731640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faf000cd9d0 0x7faf0006ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:14.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.531+0000 7faf05731640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf00070460 0x7faf0009aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:14.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.531+0000 7faf05731640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7faf000708d0 con 0x7faf0015ff10 2024-03-29T04:10:14.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.531+0000 7faf05731640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7faf000cded0 con 0x7faf000cd9d0 2024-03-29T04:10:14.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.531+0000 7faf05731640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7faf000ce1b0 con 0x7faf00070460 2024-03-29T04:10:14.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.531+0000 7faefeffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7faf0015ff10 0x7faf000b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:14.512 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.531+0000 7faefeffd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7faf0015ff10 0x7faf000b1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35668/0 (socket says 172.21.15.73:35668) 2024-03-29T04:10:14.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.531+0000 7faefeffd640 1 -- 172.21.15.73:0/3762912062 learned_addr learned my addr 172.21.15.73:0/3762912062 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:14.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.531+0000 7faefe7fc640 1 --2- 172.21.15.73:0/3762912062 >> v2:172.21.15.142:3300/0 conn(0x7faf000cd9d0 0x7faf0006ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:14.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.531+0000 7faeff7fe640 1 --2- 172.21.15.73:0/3762912062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf00070460 0x7faf0009aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:14.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.531+0000 7faefeffd640 1 -- 172.21.15.73:0/3762912062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf00070460 msgr2=0x7faf0009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:14.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.531+0000 7faefeffd640 1 --2- 172.21.15.73:0/3762912062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf00070460 0x7faf0009aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.531+0000 7faefeffd640 1 -- 172.21.15.73:0/3762912062 >> v2:172.21.15.142:3300/0 conn(0x7faf000cd9d0 msgr2=0x7faf0006ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:14.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.531+0000 7faefeffd640 1 --2- 172.21.15.73:0/3762912062 >> v2:172.21.15.142:3300/0 conn(0x7faf000cd9d0 0x7faf0006ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.513 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.532+0000 7faefeffd640 1 -- 172.21.15.73:0/3762912062 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf000ce490 con 0x7faf0015ff10 2024-03-29T04:10:14.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.532+0000 7faefeffd640 1 --2- 172.21.15.73:0/3762912062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf0015ff10 0x7faf000b1370 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7faf00072f00 tx=0x7faef002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69793a0005ba786f server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:14.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.532+0000 7faefdffb640 1 -- 172.21.15.73:0/3762912062 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef002c9e0 con 0x7faf0015ff10 2024-03-29T04:10:14.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.532+0000 7faefdffb640 1 -- 172.21.15.73:0/3762912062 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faef002cb80 con 0x7faf0015ff10 2024-03-29T04:10:14.514 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.532+0000 7faefdffb640 1 -- 172.21.15.73:0/3762912062 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef00343f0 con 0x7faf0015ff10 2024-03-29T04:10:14.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.533+0000 7faf05731640 1 -- 172.21.15.73:0/3762912062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf0015ff10 msgr2=0x7faf000b1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:14.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.533+0000 7faf05731640 1 --2- 172.21.15.73:0/3762912062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf0015ff10 0x7faf000b1370 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7faf00072f00 tx=0x7faef002be40 comp rx=0 tx=0).stop 2024-03-29T04:10:14.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.533+0000 7faf05731640 1 -- 172.21.15.73:0/3762912062 shutdown_connections 2024-03-29T04:10:14.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.533+0000 7faf05731640 1 --2- 172.21.15.73:0/3762912062 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf00070460 0x7faf0009aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.518 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.533+0000 7faf05731640 1 --2- 172.21.15.73:0/3762912062 >> v2:172.21.15.142:3300/0 conn(0x7faf000cd9d0 0x7faf0006ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.533+0000 7faf05731640 1 --2- 172.21.15.73:0/3762912062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf0015ff10 0x7faf000b1370 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.533+0000 7faf05731640 1 -- 172.21.15.73:0/3762912062 >> 172.21.15.73:0/3762912062 conn(0x7faf000b3f40 msgr2=0x7faf000b4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:14.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.533+0000 7faf05731640 1 -- 172.21.15.73:0/3762912062 shutdown_connections 2024-03-29T04:10:14.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.533+0000 7faf05731640 1 -- 172.21.15.73:0/3762912062 wait complete. 2024-03-29T04:10:14.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.534+0000 7faf05731640 1 Processor -- start 2024-03-29T04:10:14.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.534+0000 7faf05731640 1 -- start start 2024-03-29T04:10:14.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.535+0000 7faf05731640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf00070460 0x7faf0015c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:14.519 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.535+0000 7faf05731640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf000cd9d0 0x7faf000cb860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:14.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.535+0000 7faf05731640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf0015ff10 0x7faf000b7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:14.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.535+0000 7faf05731640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7faf000b1a30 con 0x7faf000cd9d0 2024-03-29T04:10:14.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.535+0000 7faf05731640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7faf000b18b0 con 0x7faf0015ff10 2024-03-29T04:10:14.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.535+0000 7faf05731640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7faf0009af70 con 0x7faf00070460 2024-03-29T04:10:14.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.535+0000 7faefe7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf000cd9d0 0x7faf000cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:14.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.535+0000 7faefe7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf000cd9d0 0x7faf000cb860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35678/0 (socket says 172.21.15.73:35678) 2024-03-29T04:10:14.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.535+0000 7faefe7fc640 1 -- 172.21.15.73:0/1503379871 learned_addr learned my addr 172.21.15.73:0/1503379871 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:14.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.535+0000 7faefeffd640 1 --2- 172.21.15.73:0/1503379871 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf00070460 0x7faf0015c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:14.520 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.535+0000 7faeff7fe640 1 --2- 172.21.15.73:0/1503379871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf0015ff10 0x7faf000b7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:14.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.535+0000 7faefe7fc640 1 -- 172.21.15.73:0/1503379871 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf00070460 msgr2=0x7faf0015c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:14.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.535+0000 7faefe7fc640 1 --2- 172.21.15.73:0/1503379871 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf00070460 0x7faf0015c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.535+0000 7faefe7fc640 1 -- 172.21.15.73:0/1503379871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf0015ff10 msgr2=0x7faf000b7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:14.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.535+0000 7faefe7fc640 1 --2- 172.21.15.73:0/1503379871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf0015ff10 0x7faf000b7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.535+0000 7faefe7fc640 1 -- 172.21.15.73:0/1503379871 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf000ca7c0 con 0x7faf000cd9d0 2024-03-29T04:10:14.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.535+0000 7faefeffd640 1 --2- 172.21.15.73:0/1503379871 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7faf00070460 0x7faf0015c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:10:14.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.536+0000 7faefe7fc640 1 --2- 172.21.15.73:0/1503379871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf000cd9d0 0x7faf000cb860 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7faef400d7d0 tx=0x7faef400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:14.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.536+0000 7faee77fe640 1 -- 172.21.15.73:0/1503379871 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef400b660 con 0x7faf000cd9d0 2024-03-29T04:10:14.521 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.536+0000 7faee77fe640 1 -- 172.21.15.73:0/1503379871 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faef4019070 con 0x7faf000cd9d0 2024-03-29T04:10:14.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.536+0000 7faf05731640 1 -- 172.21.15.73:0/1503379871 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf000caaa0 con 0x7faf000cd9d0 2024-03-29T04:10:14.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.536+0000 7faee77fe640 1 -- 172.21.15.73:0/1503379871 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef400ba60 con 0x7faf000cd9d0 2024-03-29T04:10:14.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.536+0000 7faf05731640 1 -- 172.21.15.73:0/1503379871 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf000cb060 con 0x7faf000cd9d0 2024-03-29T04:10:14.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.536+0000 7faf05731640 1 -- 172.21.15.73:0/1503379871 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faf00068d50 con 0x7faf000cd9d0 2024-03-29T04:10:14.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.537+0000 7faee77fe640 1 -- 172.21.15.73:0/1503379871 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7faef400bc00 con 0x7faf000cd9d0 2024-03-29T04:10:14.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.538+0000 7faee77fe640 1 --2- 172.21.15.73:0/1503379871 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7faeec06c560 0x7faeec06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:14.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.538+0000 7faee77fe640 1 -- 172.21.15.73:0/1503379871 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7faef408b6d0 con 0x7faf000cd9d0 2024-03-29T04:10:14.522 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.538+0000 7faefeffd640 1 --2- 172.21.15.73:0/1503379871 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7faeec06c560 0x7faeec06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:14.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.538+0000 7faee77fe640 1 --2- 172.21.15.73:0/1503379871 >> [v2:172.21.15.142:6824/4271575803,v1:172.21.15.142:6825/4271575803] conn(0x7faeec072420 0x7faeec074840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:14.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.538+0000 7faee77fe640 1 -- 172.21.15.73:0/1503379871 --> [v2:172.21.15.142:6824/4271575803,v1:172.21.15.142:6825/4271575803] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faeec074ef0 con 0x7faeec072420 2024-03-29T04:10:14.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.538+0000 7faee77fe640 1 -- 172.21.15.73:0/1503379871 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7faef4092050 con 0x7faf000cd9d0 2024-03-29T04:10:14.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.538+0000 7faeff7fe640 1 --2- 172.21.15.73:0/1503379871 >> [v2:172.21.15.142:6824/4271575803,v1:172.21.15.142:6825/4271575803] conn(0x7faeec072420 0x7faeec074840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:14.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.538+0000 7faefeffd640 1 --2- 172.21.15.73:0/1503379871 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7faeec06c560 0x7faeec06ea20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7faef0035000 tx=0x7faef0030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:14.523 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.538+0000 7faeff7fe640 1 --2- 172.21.15.73:0/1503379871 >> [v2:172.21.15.142:6824/4271575803,v1:172.21.15.142:6825/4271575803] conn(0x7faeec072420 0x7faeec074840 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:14.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.539+0000 7faee77fe640 1 -- 172.21.15.73:0/1503379871 <== osd.5 v2:172.21.15.142:6824/4271575803 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faeec074ef0 con 0x7faeec072420 2024-03-29T04:10:14.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.552+0000 7faf05731640 1 -- 172.21.15.73:0/1503379871 --> [v2:172.21.15.142:6824/4271575803,v1:172.21.15.142:6825/4271575803] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7faf000b2cb0 con 0x7faeec072420 2024-03-29T04:10:14.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.553+0000 7faee77fe640 1 -- 172.21.15.73:0/1503379871 <== osd.5 v2:172.21.15.142:6824/4271575803 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7faf000b2cb0 con 0x7faeec072420 2024-03-29T04:10:14.532 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-29T04:10:14.532 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-29T04:10:14.532 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-29T04:10:14.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.553+0000 7faf05731640 1 -- 172.21.15.73:0/1503379871 >> [v2:172.21.15.142:6824/4271575803,v1:172.21.15.142:6825/4271575803] conn(0x7faeec072420 msgr2=0x7faeec074840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:14.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.553+0000 7faf05731640 1 --2- 172.21.15.73:0/1503379871 >> [v2:172.21.15.142:6824/4271575803,v1:172.21.15.142:6825/4271575803] conn(0x7faeec072420 0x7faeec074840 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.553+0000 7faf05731640 1 -- 172.21.15.73:0/1503379871 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7faeec06c560 msgr2=0x7faeec06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:14.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.553+0000 7faf05731640 1 --2- 172.21.15.73:0/1503379871 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7faeec06c560 0x7faeec06ea20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7faef0035000 tx=0x7faef0030000 comp rx=0 tx=0).stop 2024-03-29T04:10:14.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.553+0000 7faf05731640 1 -- 172.21.15.73:0/1503379871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf000cd9d0 msgr2=0x7faf000cb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:14.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.553+0000 7faf05731640 1 --2- 172.21.15.73:0/1503379871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf000cd9d0 0x7faf000cb860 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7faef400d7d0 tx=0x7faef400dc90 comp rx=0 tx=0).stop 2024-03-29T04:10:14.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.553+0000 7faeff7fe640 1 -- 172.21.15.73:0/1503379871 reap_dead start 2024-03-29T04:10:14.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.553+0000 7faf05731640 1 -- 172.21.15.73:0/1503379871 shutdown_connections 2024-03-29T04:10:14.534 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.553+0000 7faf05731640 1 -- 172.21.15.73:0/1503379871 >> 172.21.15.73:0/1503379871 conn(0x7faf000b3f40 msgr2=0x7faf000b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:14.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.553+0000 7faf05731640 1 -- 172.21.15.73:0/1503379871 shutdown_connections 2024-03-29T04:10:14.535 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.553+0000 7faf05731640 1 -- 172.21.15.73:0/1503379871 wait complete. 2024-03-29T04:10:14.543 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-03-29T04:10:14.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.665+0000 7fac62b1c640 1 Processor -- start 2024-03-29T04:10:14.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.665+0000 7fac62b1c640 1 -- start start 2024-03-29T04:10:14.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.666+0000 7fac62b1c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac5c15e970 0x7fac5c06dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:14.647 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.666+0000 7fac62b1c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fac5c06c520 0x7fac5c06c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:14.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.666+0000 7fac62b1c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac5c06e3f0 con 0x7fac5c0b3a80 2024-03-29T04:10:14.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.666+0000 7fac62b1c640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fac5c06e6d0 con 0x7fac5c06c520 2024-03-29T04:10:14.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.666+0000 7fac62b1c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fac5c06e9b0 con 0x7fac5c15e970 2024-03-29T04:10:14.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.666+0000 7fac610b9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fac5c06c520 0x7fac5c06c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:14.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.666+0000 7fac610b9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fac5c06c520 0x7fac5c06c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35694/0 (socket says 172.21.15.73:35694) 2024-03-29T04:10:14.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.666+0000 7fac610b9640 1 -- 172.21.15.73:0/1441084287 learned_addr learned my addr 172.21.15.73:0/1441084287 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:14.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.666+0000 7fac608b8640 1 --2- 172.21.15.73:0/1441084287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac5c15e970 0x7fac5c06dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:14.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.666+0000 7fac610b9640 1 -- 172.21.15.73:0/1441084287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac5c15e970 msgr2=0x7fac5c06dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:14.648 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.666+0000 7fac610b9640 1 --2- 172.21.15.73:0/1441084287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac5c15e970 0x7fac5c06dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.666+0000 7fac610b9640 1 -- 172.21.15.73:0/1441084287 >> v1:172.21.15.142:6789/0 conn(0x7fac5c0b3a80 legacy=0x7fac5c0ada80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:14.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.667+0000 7fac610b9640 1 -- 172.21.15.73:0/1441084287 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac5c06ec90 con 0x7fac5c06c520 2024-03-29T04:10:14.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.667+0000 7fac610b9640 1 --2- 172.21.15.73:0/1441084287 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac5c06c520 0x7fac5c06c9b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fac54009e50 tx=0x7fac5402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be5032010cc80957 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:14.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.667+0000 7fac5b7fe640 1 -- 172.21.15.73:0/1441084287 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac5402cb00 con 0x7fac5c06c520 2024-03-29T04:10:14.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.667+0000 7fac5b7fe640 1 -- 172.21.15.73:0/1441084287 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac5402cca0 con 0x7fac5c06c520 2024-03-29T04:10:14.649 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.667+0000 7fac5b7fe640 1 -- 172.21.15.73:0/1441084287 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac54034610 con 0x7fac5c06c520 2024-03-29T04:10:14.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.668+0000 7fac62b1c640 1 -- 172.21.15.73:0/1441084287 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac5c06c520 msgr2=0x7fac5c06c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:14.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.668+0000 7fac62b1c640 1 --2- 172.21.15.73:0/1441084287 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac5c06c520 0x7fac5c06c9b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fac54009e50 tx=0x7fac5402bf60 comp rx=0 tx=0).stop 2024-03-29T04:10:14.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.668+0000 7fac62b1c640 1 -- 172.21.15.73:0/1441084287 shutdown_connections 2024-03-29T04:10:14.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.668+0000 7fac62b1c640 1 --2- 172.21.15.73:0/1441084287 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac5c06c520 0x7fac5c06c9b0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.668+0000 7fac62b1c640 1 --2- 172.21.15.73:0/1441084287 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac5c15e970 0x7fac5c06dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.668+0000 7fac62b1c640 1 -- 172.21.15.73:0/1441084287 >> 172.21.15.73:0/1441084287 conn(0x7fac5c071fe0 msgr2=0x7fac5c0723f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:14.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.668+0000 7fac62b1c640 1 -- 172.21.15.73:0/1441084287 shutdown_connections 2024-03-29T04:10:14.650 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.668+0000 7fac62b1c640 1 -- 172.21.15.73:0/1441084287 wait complete. 2024-03-29T04:10:14.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.669+0000 7fac62b1c640 1 Processor -- start 2024-03-29T04:10:14.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.669+0000 7fac62b1c640 1 -- start start 2024-03-29T04:10:14.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.670+0000 7fac62b1c640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac5c06c520 0x7fac5c0ae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:14.653 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.670+0000 7fac62b1c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac5c0b3a80 0x7fac5c150810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:14.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.670+0000 7fac62b1c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac5c15e970 0x7fac5c1f7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:14.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.670+0000 7fac62b1c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fac5c0ae190 con 0x7fac5c15e970 2024-03-29T04:10:14.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.670+0000 7fac62b1c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fac5c0b3ee0 con 0x7fac5c0b3a80 2024-03-29T04:10:14.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.670+0000 7fac62b1c640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fac5c06f490 con 0x7fac5c06c520 2024-03-29T04:10:14.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.670+0000 7fac610b9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac5c15e970 0x7fac5c1f7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:14.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.670+0000 7fac610b9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac5c15e970 0x7fac5c1f7c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35702/0 (socket says 172.21.15.73:35702) 2024-03-29T04:10:14.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.670+0000 7fac610b9640 1 -- 172.21.15.73:0/3076874871 learned_addr learned my addr 172.21.15.73:0/3076874871 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:14.654 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.670+0000 7fac608b8640 1 --2- 172.21.15.73:0/3076874871 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac5c06c520 0x7fac5c0ae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:14.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.670+0000 7fac5bfff640 1 --2- 172.21.15.73:0/3076874871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac5c0b3a80 0x7fac5c150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:14.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.670+0000 7fac610b9640 1 -- 172.21.15.73:0/3076874871 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac5c06c520 msgr2=0x7fac5c0ae7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:14.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.670+0000 7fac610b9640 1 --2- 172.21.15.73:0/3076874871 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac5c06c520 0x7fac5c0ae7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.670+0000 7fac610b9640 1 -- 172.21.15.73:0/3076874871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac5c0b3a80 msgr2=0x7fac5c150810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:14.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.670+0000 7fac610b9640 1 --2- 172.21.15.73:0/3076874871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac5c0b3a80 0x7fac5c150810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.670+0000 7fac610b9640 1 -- 172.21.15.73:0/3076874871 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac5c1516d0 con 0x7fac5c15e970 2024-03-29T04:10:14.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.671+0000 7fac610b9640 1 --2- 172.21.15.73:0/3076874871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac5c15e970 0x7fac5c1f7c20 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fac54009e50 tx=0x7fac54004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:14.655 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.671+0000 7fac597fa640 1 -- 172.21.15.73:0/3076874871 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac54043020 con 0x7fac5c15e970 2024-03-29T04:10:14.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.671+0000 7fac597fa640 1 -- 172.21.15.73:0/3076874871 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac5402ce50 con 0x7fac5c15e970 2024-03-29T04:10:14.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.671+0000 7fac62b1c640 1 -- 172.21.15.73:0/3076874871 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac5c0afda0 con 0x7fac5c15e970 2024-03-29T04:10:14.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.671+0000 7fac597fa640 1 -- 172.21.15.73:0/3076874871 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac54009510 con 0x7fac5c15e970 2024-03-29T04:10:14.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.671+0000 7fac62b1c640 1 -- 172.21.15.73:0/3076874871 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac5c0b0360 con 0x7fac5c15e970 2024-03-29T04:10:14.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.672+0000 7fac62b1c640 1 -- 172.21.15.73:0/3076874871 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac5c0afb30 con 0x7fac5c15e970 2024-03-29T04:10:14.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.672+0000 7fac597fa640 1 -- 172.21.15.73:0/3076874871 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fac54046020 con 0x7fac5c15e970 2024-03-29T04:10:14.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.673+0000 7fac597fa640 1 --2- 172.21.15.73:0/3076874871 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fac4806c530 0x7fac4806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:14.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.673+0000 7fac597fa640 1 -- 172.21.15.73:0/3076874871 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fac540ada00 con 0x7fac5c15e970 2024-03-29T04:10:14.656 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.673+0000 7fac608b8640 1 --2- 172.21.15.73:0/3076874871 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fac4806c530 0x7fac4806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:14.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.673+0000 7fac608b8640 1 --2- 172.21.15.73:0/3076874871 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fac4806c530 0x7fac4806e9f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fac4c006fd0 tx=0x7fac4c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:14.657 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.677+0000 7fac597fa640 1 -- 172.21.15.73:0/3076874871 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fac5404d030 con 0x7fac5c15e970 2024-03-29T04:10:14.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.852+0000 7fac62b1c640 1 -- 172.21.15.73:0/3076874871 --> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fac5c0ada40 con 0x7fac4806c530 2024-03-29T04:10:14.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.852+0000 7fac597fa640 1 -- 172.21.15.73:0/3076874871 <== mgr.4104 v2:172.21.15.73:6832/1640471941 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fac5c0ada40 con 0x7fac4806c530 2024-03-29T04:10:14.832 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 5 to deep-scrub 2024-03-29T04:10:14.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.854+0000 7fac62b1c640 1 -- 172.21.15.73:0/3076874871 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fac4806c530 msgr2=0x7fac4806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:14.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.854+0000 7fac62b1c640 1 --2- 172.21.15.73:0/3076874871 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fac4806c530 0x7fac4806e9f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fac4c006fd0 tx=0x7fac4c008040 comp rx=0 tx=0).stop 2024-03-29T04:10:14.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.854+0000 7fac62b1c640 1 -- 172.21.15.73:0/3076874871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac5c15e970 msgr2=0x7fac5c1f7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:14.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.854+0000 7fac62b1c640 1 --2- 172.21.15.73:0/3076874871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac5c15e970 0x7fac5c1f7c20 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fac54009e50 tx=0x7fac54004a40 comp rx=0 tx=0).stop 2024-03-29T04:10:14.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.855+0000 7fac62b1c640 1 -- 172.21.15.73:0/3076874871 shutdown_connections 2024-03-29T04:10:14.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.855+0000 7fac62b1c640 1 --2- 172.21.15.73:0/3076874871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac5c15e970 0x7fac5c1f7c20 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.855+0000 7fac62b1c640 1 --2- 172.21.15.73:0/3076874871 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fac4806c530 0x7fac4806e9f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.855+0000 7fac62b1c640 1 --2- 172.21.15.73:0/3076874871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac5c0b3a80 0x7fac5c150810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.855+0000 7fac62b1c640 1 --2- 172.21.15.73:0/3076874871 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fac5c06c520 0x7fac5c0ae7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.855+0000 7fac62b1c640 1 -- 172.21.15.73:0/3076874871 >> 172.21.15.73:0/3076874871 conn(0x7fac5c071fe0 msgr2=0x7fac5c15d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:14.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.855+0000 7fac62b1c640 1 -- 172.21.15.73:0/3076874871 shutdown_connections 2024-03-29T04:10:14.835 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.855+0000 7fac62b1c640 1 -- 172.21.15.73:0/3076874871 wait complete. 2024-03-29T04:10:14.844 INFO:tasks.ceph:Scrubbing osd.6 2024-03-29T04:10:14.845 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-03-29T04:10:14.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.970+0000 7ffba287e640 1 Processor -- start 2024-03-29T04:10:14.949 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.970+0000 7ffba287e640 1 -- start start 2024-03-29T04:10:14.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.970+0000 7ffba287e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ffb9c15dc80 0x7ffb9c0cffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:14.951 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.970+0000 7ffba287e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb9c06fa20 0x7ffb9c09b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:14.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.970+0000 7ffba287e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb9c0714e0 con 0x7ffb9c06fe80 2024-03-29T04:10:14.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.970+0000 7ffba287e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7ffb9c0cebf0 con 0x7ffb9c15dc80 2024-03-29T04:10:14.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.970+0000 7ffba287e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ffb9c0717c0 con 0x7ffb9c06fa20 2024-03-29T04:10:14.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.971+0000 7ffb9b7fe640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb9c06fa20 0x7ffb9c09b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:14.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.971+0000 7ffb9bfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ffb9c15dc80 0x7ffb9c0cffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:14.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.971+0000 7ffba0e1b640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7ffb9c06fe80 0x7ffb9c160320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.73:44442/0 (socket says 172.21.15.73:44442) 2024-03-29T04:10:14.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.971+0000 7ffba0e1b640 1 -- 172.21.15.73:0/3006105310 learned_addr learned my addr 172.21.15.73:0/3006105310 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:10:14.952 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.971+0000 7ffb9affd640 1 -- 172.21.15.73:0/3006105310 <== mon.1 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4293544264 0 0) 0x7ffb9c0714e0 con 0x7ffb9c06fe80 2024-03-29T04:10:14.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.971+0000 7ffb9affd640 1 -- 172.21.15.73:0/3006105310 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb84003520 con 0x7ffb9c06fe80 2024-03-29T04:10:14.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.971+0000 7ffb9b7fe640 1 -- 172.21.15.73:0/3006105310 >> v2:172.21.15.142:3300/0 conn(0x7ffb9c15dc80 msgr2=0x7ffb9c0cffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:14.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.971+0000 7ffb9b7fe640 1 --2- 172.21.15.73:0/3006105310 >> v2:172.21.15.142:3300/0 conn(0x7ffb9c15dc80 0x7ffb9c0cffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.971+0000 7ffb9b7fe640 1 -- 172.21.15.73:0/3006105310 >> v1:172.21.15.142:6789/0 conn(0x7ffb9c06fe80 legacy=0x7ffb9c160320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:14.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.971+0000 7ffb9b7fe640 1 -- 172.21.15.73:0/3006105310 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb9c09aa30 con 0x7ffb9c06fa20 2024-03-29T04:10:14.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.971+0000 7ffb9bfff640 1 --2- 172.21.15.73:0/3006105310 >> v2:172.21.15.142:3300/0 conn(0x7ffb9c15dc80 0x7ffb9c0cffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-29T04:10:14.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.972+0000 7ffb9b7fe640 1 --2- 172.21.15.73:0/3006105310 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb9c06fa20 0x7ffb9c09b510 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffb900097a0 tx=0x7ffb9002b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9df953d83ffc73ab server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:14.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.972+0000 7ffb9affd640 1 -- 172.21.15.73:0/3006105310 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb900315a0 con 0x7ffb9c06fa20 2024-03-29T04:10:14.953 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.972+0000 7ffb9affd640 1 -- 172.21.15.73:0/3006105310 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb90037070 con 0x7ffb9c06fa20 2024-03-29T04:10:14.954 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.972+0000 7ffb9affd640 1 -- 172.21.15.73:0/3006105310 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb90031940 con 0x7ffb9c06fa20 2024-03-29T04:10:14.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.973+0000 7ffba287e640 1 -- 172.21.15.73:0/3006105310 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb9c06fa20 msgr2=0x7ffb9c09b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:14.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.973+0000 7ffba287e640 1 --2- 172.21.15.73:0/3006105310 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb9c06fa20 0x7ffb9c09b510 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffb900097a0 tx=0x7ffb9002b840 comp rx=0 tx=0).stop 2024-03-29T04:10:14.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.973+0000 7ffba287e640 1 -- 172.21.15.73:0/3006105310 shutdown_connections 2024-03-29T04:10:14.957 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.973+0000 7ffba287e640 1 --2- 172.21.15.73:0/3006105310 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb9c06fa20 0x7ffb9c09b510 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.973+0000 7ffba287e640 1 --2- 172.21.15.73:0/3006105310 >> v2:172.21.15.142:3300/0 conn(0x7ffb9c15dc80 0x7ffb9c0cffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.973+0000 7ffba287e640 1 -- 172.21.15.73:0/3006105310 >> 172.21.15.73:0/3006105310 conn(0x7ffb9c0b3f00 msgr2=0x7ffb9c0b4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:14.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.973+0000 7ffba287e640 1 -- 172.21.15.73:0/3006105310 shutdown_connections 2024-03-29T04:10:14.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.973+0000 7ffba287e640 1 -- 172.21.15.73:0/3006105310 wait complete. 2024-03-29T04:10:14.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.974+0000 7ffba287e640 1 Processor -- start 2024-03-29T04:10:14.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.974+0000 7ffba287e640 1 -- start start 2024-03-29T04:10:14.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.975+0000 7ffba287e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb9c06fa20 0x7ffb9c15e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:14.958 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.975+0000 7ffba287e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb9c06fe80 0x7ffb9c160290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:14.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.975+0000 7ffba287e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb9c15dc80 0x7ffb9c0b6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:14.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.975+0000 7ffba287e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9c09ba50 con 0x7ffb9c15dc80 2024-03-29T04:10:14.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.975+0000 7ffba287e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9c09aff0 con 0x7ffb9c06fe80 2024-03-29T04:10:14.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.975+0000 7ffba287e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7ffb9c09bbd0 con 0x7ffb9c06fa20 2024-03-29T04:10:14.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.975+0000 7ffba0e1b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb9c15dc80 0x7ffb9c0b6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:14.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.975+0000 7ffba0e1b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb9c15dc80 0x7ffb9c0b6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35714/0 (socket says 172.21.15.73:35714) 2024-03-29T04:10:14.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.975+0000 7ffba0e1b640 1 -- 172.21.15.73:0/4263926945 learned_addr learned my addr 172.21.15.73:0/4263926945 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:14.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.975+0000 7ffb9bfff640 1 --2- 172.21.15.73:0/4263926945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb9c06fa20 0x7ffb9c15e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:14.959 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.975+0000 7ffb9b7fe640 1 --2- 172.21.15.73:0/4263926945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb9c06fe80 0x7ffb9c160290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:14.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.975+0000 7ffba0e1b640 1 -- 172.21.15.73:0/4263926945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb9c06fa20 msgr2=0x7ffb9c15e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:14.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.975+0000 7ffba0e1b640 1 --2- 172.21.15.73:0/4263926945 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7ffb9c06fa20 0x7ffb9c15e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.975+0000 7ffba0e1b640 1 -- 172.21.15.73:0/4263926945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb9c06fe80 msgr2=0x7ffb9c160290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:14.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.975+0000 7ffba0e1b640 1 --2- 172.21.15.73:0/4263926945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb9c06fe80 0x7ffb9c160290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.975+0000 7ffba0e1b640 1 -- 172.21.15.73:0/4263926945 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb9c0cba30 con 0x7ffb9c15dc80 2024-03-29T04:10:14.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.975+0000 7ffb9b7fe640 1 --2- 172.21.15.73:0/4263926945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffb9c06fe80 0x7ffb9c160290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:10:14.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.975+0000 7ffba0e1b640 1 --2- 172.21.15.73:0/4263926945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb9c15dc80 0x7ffb9c0b6e90 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ffb9400cb70 tx=0x7ffb9400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:14.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.975+0000 7ffb98ff9640 1 -- 172.21.15.73:0/4263926945 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb94017070 con 0x7ffb9c15dc80 2024-03-29T04:10:14.960 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.975+0000 7ffb98ff9640 1 -- 172.21.15.73:0/4263926945 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb9400ad40 con 0x7ffb9c15dc80 2024-03-29T04:10:14.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.975+0000 7ffba287e640 1 -- 172.21.15.73:0/4263926945 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb9c15e660 con 0x7ffb9c15dc80 2024-03-29T04:10:14.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.975+0000 7ffb98ff9640 1 -- 172.21.15.73:0/4263926945 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb94012620 con 0x7ffb9c15dc80 2024-03-29T04:10:14.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.976+0000 7ffba287e640 1 -- 172.21.15.73:0/4263926945 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb9c15ec20 con 0x7ffb9c15dc80 2024-03-29T04:10:14.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.976+0000 7ffba287e640 1 -- 172.21.15.73:0/4263926945 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffb9c068640 con 0x7ffb9c15dc80 2024-03-29T04:10:14.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.977+0000 7ffb98ff9640 1 -- 172.21.15.73:0/4263926945 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ffb9401a070 con 0x7ffb9c15dc80 2024-03-29T04:10:14.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.977+0000 7ffb98ff9640 1 --2- 172.21.15.73:0/4263926945 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ffb8806c560 0x7ffb8806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:14.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.977+0000 7ffb98ff9640 1 -- 172.21.15.73:0/4263926945 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7ffb9408b990 con 0x7ffb9c15dc80 2024-03-29T04:10:14.961 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.978+0000 7ffb9bfff640 1 --2- 172.21.15.73:0/4263926945 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ffb8806c560 0x7ffb8806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:14.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.978+0000 7ffb98ff9640 1 --2- 172.21.15.73:0/4263926945 >> [v2:172.21.15.142:6800/1772722570,v1:172.21.15.142:6801/1772722570] conn(0x7ffb88072420 0x7ffb88074840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:14.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.978+0000 7ffb98ff9640 1 -- 172.21.15.73:0/4263926945 --> [v2:172.21.15.142:6800/1772722570,v1:172.21.15.142:6801/1772722570] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffb94016ec0 con 0x7ffb88072420 2024-03-29T04:10:14.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.978+0000 7ffb98ff9640 1 -- 172.21.15.73:0/4263926945 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ffb9408be20 con 0x7ffb9c15dc80 2024-03-29T04:10:14.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.978+0000 7ffb9bfff640 1 --2- 172.21.15.73:0/4263926945 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ffb8806c560 0x7ffb8806ea20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c009a30 tx=0x7ffb8c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:14.962 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.978+0000 7ffb9b7fe640 1 --2- 172.21.15.73:0/4263926945 >> [v2:172.21.15.142:6800/1772722570,v1:172.21.15.142:6801/1772722570] conn(0x7ffb88072420 0x7ffb88074840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:14.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.978+0000 7ffb9b7fe640 1 --2- 172.21.15.73:0/4263926945 >> [v2:172.21.15.142:6800/1772722570,v1:172.21.15.142:6801/1772722570] conn(0x7ffb88072420 0x7ffb88074840 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:14.963 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.979+0000 7ffb98ff9640 1 -- 172.21.15.73:0/4263926945 <== osd.6 v2:172.21.15.142:6800/1772722570 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffb94016ec0 con 0x7ffb88072420 2024-03-29T04:10:14.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.992+0000 7ffba287e640 1 -- 172.21.15.73:0/4263926945 --> [v2:172.21.15.142:6800/1772722570,v1:172.21.15.142:6801/1772722570] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ffb9c15d4a0 con 0x7ffb88072420 2024-03-29T04:10:14.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.993+0000 7ffb98ff9640 1 -- 172.21.15.73:0/4263926945 <== osd.6 v2:172.21.15.142:6800/1772722570 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ffb9c15d4a0 con 0x7ffb88072420 2024-03-29T04:10:14.972 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-29T04:10:14.972 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-29T04:10:14.973 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-29T04:10:14.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.993+0000 7ffba287e640 1 -- 172.21.15.73:0/4263926945 >> [v2:172.21.15.142:6800/1772722570,v1:172.21.15.142:6801/1772722570] conn(0x7ffb88072420 msgr2=0x7ffb88074840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:14.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.993+0000 7ffba287e640 1 --2- 172.21.15.73:0/4263926945 >> [v2:172.21.15.142:6800/1772722570,v1:172.21.15.142:6801/1772722570] conn(0x7ffb88072420 0x7ffb88074840 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:14.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.993+0000 7ffba287e640 1 -- 172.21.15.73:0/4263926945 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ffb8806c560 msgr2=0x7ffb8806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:14.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.993+0000 7ffba287e640 1 --2- 172.21.15.73:0/4263926945 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7ffb8806c560 0x7ffb8806ea20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c009a30 tx=0x7ffb8c008040 comp rx=0 tx=0).stop 2024-03-29T04:10:14.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.993+0000 7ffba287e640 1 -- 172.21.15.73:0/4263926945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb9c15dc80 msgr2=0x7ffb9c0b6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:14.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.993+0000 7ffba287e640 1 --2- 172.21.15.73:0/4263926945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb9c15dc80 0x7ffb9c0b6e90 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ffb9400cb70 tx=0x7ffb9400a430 comp rx=0 tx=0).stop 2024-03-29T04:10:14.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.993+0000 7ffba0e1b640 1 -- 172.21.15.73:0/4263926945 reap_dead start 2024-03-29T04:10:14.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.993+0000 7ffba287e640 1 -- 172.21.15.73:0/4263926945 shutdown_connections 2024-03-29T04:10:14.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.993+0000 7ffba287e640 1 -- 172.21.15.73:0/4263926945 >> 172.21.15.73:0/4263926945 conn(0x7ffb9c0b3f00 msgr2=0x7ffb9c1582c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:14.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.994+0000 7ffba287e640 1 -- 172.21.15.73:0/4263926945 shutdown_connections 2024-03-29T04:10:14.976 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:14.994+0000 7ffba287e640 1 -- 172.21.15.73:0/4263926945 wait complete. 2024-03-29T04:10:14.983 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-03-29T04:10:15.093 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.105+0000 7f1f1b59e640 1 Processor -- start 2024-03-29T04:10:15.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.105+0000 7f1f1b59e640 1 -- start start 2024-03-29T04:10:15.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.106+0000 7f1f1b59e640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1f1c15e520 0x7f1f1c0d0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:15.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.106+0000 7f1f1b59e640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f1c0cef40 con 0x7f1f1c0d3060 2024-03-29T04:10:15.094 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.106+0000 7f1f1b59e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f1c0cf1e0 con 0x7f1f1c15e900 2024-03-29T04:10:15.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.106+0000 7f1f1b59e640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f1f1c0cf4c0 con 0x7f1f1c15e520 2024-03-29T04:10:15.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.106+0000 7f1f1a59c640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1f1c15e520 0x7f1f1c0d0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:15.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.106+0000 7f1f1ad9d640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1f1c0d3060 0x7f1f1c06c5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51712/0 (socket says 172.21.15.73:51712) 2024-03-29T04:10:15.095 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.106+0000 7f1f1ad9d640 1 -- 172.21.15.73:0/4000796055 learned_addr learned my addr 172.21.15.73:0/4000796055 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:10:15.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.106+0000 7f1f1a59c640 1 -- 172.21.15.73:0/4000796055 >> v1:172.21.15.142:6789/0 conn(0x7f1f1c15e900 legacy=0x7f1f1c0d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:15.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.106+0000 7f1f1a59c640 1 -- 172.21.15.73:0/4000796055 >> v1:172.21.15.73:6789/0 conn(0x7f1f1c0d3060 legacy=0x7f1f1c06c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:15.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.106+0000 7f1f1a59c640 1 -- 172.21.15.73:0/4000796055 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f1c0cf7a0 con 0x7f1f1c15e520 2024-03-29T04:10:15.096 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.106+0000 7f1f19d9b640 1 -- 172.21.15.73:0/4000796055 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2749476094 0 0) 0x7f1f1c0cef40 con 0x7f1f1c0d3060 2024-03-29T04:10:15.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.107+0000 7f1f1a59c640 1 --2- 172.21.15.73:0/4000796055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f1c15e520 0x7f1f1c0d0d90 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c0097a0 tx=0x7f1f0c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4391d411a7ad8d77 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:15.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.107+0000 7f1f19d9b640 1 -- 172.21.15.73:0/4000796055 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c034070 con 0x7f1f1c15e520 2024-03-29T04:10:15.097 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.107+0000 7f1f19d9b640 1 -- 172.21.15.73:0/4000796055 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f0c030610 con 0x7f1f1c15e520 2024-03-29T04:10:15.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.107+0000 7f1f19d9b640 1 -- 172.21.15.73:0/4000796055 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c0309e0 con 0x7f1f1c15e520 2024-03-29T04:10:15.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.107+0000 7f1f1b59e640 1 -- 172.21.15.73:0/4000796055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f1c15e520 msgr2=0x7f1f1c0d0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:15.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.107+0000 7f1f1b59e640 1 --2- 172.21.15.73:0/4000796055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f1c15e520 0x7f1f1c0d0d90 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c0097a0 tx=0x7f1f0c02b960 comp rx=0 tx=0).stop 2024-03-29T04:10:15.098 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.108+0000 7f1f1b59e640 1 -- 172.21.15.73:0/4000796055 shutdown_connections 2024-03-29T04:10:15.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.108+0000 7f1f1b59e640 1 --2- 172.21.15.73:0/4000796055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f1c15e520 0x7f1f1c0d0d90 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:15.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.108+0000 7f1f1b59e640 1 -- 172.21.15.73:0/4000796055 >> 172.21.15.73:0/4000796055 conn(0x7f1f1c09d730 msgr2=0x7f1f1c0d43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:15.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.108+0000 7f1f1b59e640 1 -- 172.21.15.73:0/4000796055 shutdown_connections 2024-03-29T04:10:15.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.108+0000 7f1f1b59e640 1 -- 172.21.15.73:0/4000796055 wait complete. 2024-03-29T04:10:15.099 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.109+0000 7f1f1b59e640 1 Processor -- start 2024-03-29T04:10:15.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.109+0000 7f1f1b59e640 1 -- start start 2024-03-29T04:10:15.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.110+0000 7f1f1b59e640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f1c0d3060 0x7f1f1c0b91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:15.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.110+0000 7f1f1b59e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f1c15e520 0x7f1f1c1531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:15.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.110+0000 7f1f1b59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f1c15e900 0x7f1f1c0c9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:15.100 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.110+0000 7f1f1b59e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c0d0280 con 0x7f1f1c15e520 2024-03-29T04:10:15.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.110+0000 7f1f1b59e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c0cfd60 con 0x7f1f1c15e900 2024-03-29T04:10:15.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.110+0000 7f1f1b59e640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f1f1c0d0400 con 0x7f1f1c0d3060 2024-03-29T04:10:15.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.110+0000 7f1f13fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f1c15e520 0x7f1f1c1531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:15.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.110+0000 7f1f13fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f1c15e520 0x7f1f1c1531b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35724/0 (socket says 172.21.15.73:35724) 2024-03-29T04:10:15.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.110+0000 7f1f13fff640 1 -- 172.21.15.73:0/1901930973 learned_addr learned my addr 172.21.15.73:0/1901930973 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:15.101 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.110+0000 7f1f1a59c640 1 --2- 172.21.15.73:0/1901930973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f1c0d3060 0x7f1f1c0b91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:15.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.110+0000 7f1f1ad9d640 1 --2- 172.21.15.73:0/1901930973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f1c15e900 0x7f1f1c0c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:15.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.110+0000 7f1f13fff640 1 -- 172.21.15.73:0/1901930973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f1c0d3060 msgr2=0x7f1f1c0b91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:15.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.110+0000 7f1f13fff640 1 --2- 172.21.15.73:0/1901930973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f1c0d3060 0x7f1f1c0b91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:15.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.110+0000 7f1f13fff640 1 -- 172.21.15.73:0/1901930973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f1c15e900 msgr2=0x7f1f1c0c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:15.102 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.110+0000 7f1f13fff640 1 --2- 172.21.15.73:0/1901930973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f1c15e900 0x7f1f1c0c9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:15.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.110+0000 7f1f13fff640 1 -- 172.21.15.73:0/1901930973 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f1c0b8130 con 0x7f1f1c15e520 2024-03-29T04:10:15.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.110+0000 7f1f13fff640 1 --2- 172.21.15.73:0/1901930973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f1c15e520 0x7f1f1c1531b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f1f0400c400 tx=0x7f1f0400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:15.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.110+0000 7f1f12ffd640 1 -- 172.21.15.73:0/1901930973 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f04017070 con 0x7f1f1c15e520 2024-03-29T04:10:15.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.110+0000 7f1f12ffd640 1 -- 172.21.15.73:0/1901930973 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f040052d0 con 0x7f1f1c15e520 2024-03-29T04:10:15.103 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.110+0000 7f1f1b59e640 1 -- 172.21.15.73:0/1901930973 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f1c0b8410 con 0x7f1f1c15e520 2024-03-29T04:10:15.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.110+0000 7f1f12ffd640 1 -- 172.21.15.73:0/1901930973 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f04003830 con 0x7f1f1c15e520 2024-03-29T04:10:15.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.110+0000 7f1f1b59e640 1 -- 172.21.15.73:0/1901930973 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f1c0b89d0 con 0x7f1f1c15e520 2024-03-29T04:10:15.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.111+0000 7f1f1b59e640 1 -- 172.21.15.73:0/1901930973 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f1c0c7ae0 con 0x7f1f1c15e520 2024-03-29T04:10:15.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.112+0000 7f1f12ffd640 1 -- 172.21.15.73:0/1901930973 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f1f0401a070 con 0x7f1f1c15e520 2024-03-29T04:10:15.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.112+0000 7f1f12ffd640 1 --2- 172.21.15.73:0/1901930973 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f1efc06c560 0x7f1efc06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:15.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.112+0000 7f1f12ffd640 1 -- 172.21.15.73:0/1901930973 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f1f0408a630 con 0x7f1f1c15e520 2024-03-29T04:10:15.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.112+0000 7f1f1a59c640 1 --2- 172.21.15.73:0/1901930973 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f1efc06c560 0x7f1efc06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:15.104 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.113+0000 7f1f1a59c640 1 --2- 172.21.15.73:0/1901930973 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f1efc06c560 0x7f1efc06ea20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c036000 tx=0x7f1f0c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:15.105 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.117+0000 7f1f12ffd640 1 -- 172.21.15.73:0/1901930973 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f1f04058900 con 0x7f1f1c15e520 2024-03-29T04:10:15.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.290+0000 7f1f1b59e640 1 -- 172.21.15.73:0/1901930973 --> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f1f1c15d060 con 0x7f1efc06c560 2024-03-29T04:10:15.270 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.291+0000 7f1f12ffd640 1 -- 172.21.15.73:0/1901930973 <== mgr.4104 v2:172.21.15.73:6832/1640471941 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1f1c15d060 con 0x7f1efc06c560 2024-03-29T04:10:15.270 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 6 to deep-scrub 2024-03-29T04:10:15.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.292+0000 7f1f1b59e640 1 -- 172.21.15.73:0/1901930973 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f1efc06c560 msgr2=0x7f1efc06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:15.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.292+0000 7f1f1b59e640 1 --2- 172.21.15.73:0/1901930973 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f1efc06c560 0x7f1efc06ea20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c036000 tx=0x7f1f0c008030 comp rx=0 tx=0).stop 2024-03-29T04:10:15.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.292+0000 7f1f1b59e640 1 -- 172.21.15.73:0/1901930973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f1c15e520 msgr2=0x7f1f1c1531b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:15.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.292+0000 7f1f1b59e640 1 --2- 172.21.15.73:0/1901930973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f1c15e520 0x7f1f1c1531b0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f1f0400c400 tx=0x7f1f0400c8c0 comp rx=0 tx=0).stop 2024-03-29T04:10:15.272 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.293+0000 7f1f1b59e640 1 -- 172.21.15.73:0/1901930973 shutdown_connections 2024-03-29T04:10:15.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.293+0000 7f1f1b59e640 1 --2- 172.21.15.73:0/1901930973 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f1efc06c560 0x7f1efc06ea20 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:15.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.293+0000 7f1f1b59e640 1 --2- 172.21.15.73:0/1901930973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f1c15e900 0x7f1f1c0c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:15.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.293+0000 7f1f1b59e640 1 --2- 172.21.15.73:0/1901930973 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f1c15e520 0x7f1f1c1531b0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:15.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.293+0000 7f1f1b59e640 1 --2- 172.21.15.73:0/1901930973 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f1f1c0d3060 0x7f1f1c0b91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:15.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.293+0000 7f1f1b59e640 1 -- 172.21.15.73:0/1901930973 >> 172.21.15.73:0/1901930973 conn(0x7f1f1c09d730 msgr2=0x7f1f1c0b3080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:15.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.293+0000 7f1f1b59e640 1 -- 172.21.15.73:0/1901930973 shutdown_connections 2024-03-29T04:10:15.273 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.293+0000 7f1f1b59e640 1 -- 172.21.15.73:0/1901930973 wait complete. 2024-03-29T04:10:15.283 INFO:tasks.ceph:Scrubbing osd.7 2024-03-29T04:10:15.283 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-03-29T04:10:15.389 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.407+0000 7f90de062640 1 Processor -- start 2024-03-29T04:10:15.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.407+0000 7f90de062640 1 -- start start 2024-03-29T04:10:15.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.408+0000 7f90de062640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f90d80b4cf0 0x7f90d815c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:15.390 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.408+0000 7f90de062640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90d80d0490 0x7f90d80d0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:15.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.408+0000 7f90de062640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90d815bad0 con 0x7f90d815b350 2024-03-29T04:10:15.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.408+0000 7f90de062640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f90d815bdd0 con 0x7f90d80b4cf0 2024-03-29T04:10:15.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.408+0000 7f90de062640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f90d815f7e0 con 0x7f90d80d0490 2024-03-29T04:10:15.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.408+0000 7f90d7fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90d80d0490 0x7f90d80d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:15.391 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.408+0000 7f90d7fff640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90d80d0490 0x7f90d80d0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3301/0 says I am v2:172.21.15.73:35888/0 (socket says 172.21.15.73:35888) 2024-03-29T04:10:15.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.408+0000 7f90d7fff640 1 -- 172.21.15.73:0/662015383 learned_addr learned my addr 172.21.15.73:0/662015383 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:15.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.408+0000 7f90d6ffd640 1 --2- 172.21.15.73:0/662015383 >> v2:172.21.15.142:3300/0 conn(0x7f90d80b4cf0 0x7f90d815c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:15.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.408+0000 7f90d7fff640 1 -- 172.21.15.73:0/662015383 >> v2:172.21.15.142:3300/0 conn(0x7f90d80b4cf0 msgr2=0x7f90d815c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:15.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.408+0000 7f90d7fff640 1 --2- 172.21.15.73:0/662015383 >> v2:172.21.15.142:3300/0 conn(0x7f90d80b4cf0 0x7f90d815c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:15.392 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.408+0000 7f90d7fff640 1 -- 172.21.15.73:0/662015383 >> v1:172.21.15.142:6789/0 conn(0x7f90d815b350 legacy=0x7f90d815efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:15.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.408+0000 7f90d7fff640 1 -- 172.21.15.73:0/662015383 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90d815fac0 con 0x7f90d80d0490 2024-03-29T04:10:15.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.409+0000 7f90d7fff640 1 --2- 172.21.15.73:0/662015383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90d80d0490 0x7f90d80d0920 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f90d0009e50 tx=0x7f90d002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85b58f350ec5d904 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:15.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.409+0000 7f90d67fc640 1 -- 172.21.15.73:0/662015383 <== mon.2 v2:172.21.15.142:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d002cb00 con 0x7f90d80d0490 2024-03-29T04:10:15.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.409+0000 7f90d67fc640 1 -- 172.21.15.73:0/662015383 <== mon.2 v2:172.21.15.142:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90d002cca0 con 0x7f90d80d0490 2024-03-29T04:10:15.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.409+0000 7f90d67fc640 1 -- 172.21.15.73:0/662015383 <== mon.2 v2:172.21.15.142:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d0034610 con 0x7f90d80d0490 2024-03-29T04:10:15.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.410+0000 7f90de062640 1 -- 172.21.15.73:0/662015383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90d80d0490 msgr2=0x7f90d80d0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:15.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.410+0000 7f90de062640 1 --2- 172.21.15.73:0/662015383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90d80d0490 0x7f90d80d0920 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f90d0009e50 tx=0x7f90d002bf60 comp rx=0 tx=0).stop 2024-03-29T04:10:15.393 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.410+0000 7f90de062640 1 -- 172.21.15.73:0/662015383 shutdown_connections 2024-03-29T04:10:15.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.410+0000 7f90de062640 1 --2- 172.21.15.73:0/662015383 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90d80d0490 0x7f90d80d0920 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:15.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.410+0000 7f90de062640 1 --2- 172.21.15.73:0/662015383 >> v2:172.21.15.142:3300/0 conn(0x7f90d80b4cf0 0x7f90d815c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:15.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.410+0000 7f90de062640 1 -- 172.21.15.73:0/662015383 >> 172.21.15.73:0/662015383 conn(0x7f90d806b6f0 msgr2=0x7f90d806bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:15.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.410+0000 7f90de062640 1 -- 172.21.15.73:0/662015383 shutdown_connections 2024-03-29T04:10:15.394 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.410+0000 7f90de062640 1 -- 172.21.15.73:0/662015383 wait complete. 2024-03-29T04:10:15.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.411+0000 7f90de062640 1 Processor -- start 2024-03-29T04:10:15.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.411+0000 7f90de062640 1 -- start start 2024-03-29T04:10:15.397 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.412+0000 7f90de062640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90d80b4cf0 0x7f90d80cef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:15.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.412+0000 7f90de062640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90d80d0490 0x7f90d80b2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:15.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.412+0000 7f90de062640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90d815b350 0x7f90d80affb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:15.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.412+0000 7f90de062640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f90d815b8b0 con 0x7f90d80b4cf0 2024-03-29T04:10:15.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.412+0000 7f90de062640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f90d815b730 con 0x7f90d80d0490 2024-03-29T04:10:15.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.412+0000 7f90de062640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f90d815c7a0 con 0x7f90d815b350 2024-03-29T04:10:15.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.412+0000 7f90d77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90d80b4cf0 0x7f90d80cef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:15.398 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.412+0000 7f90d77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90d80b4cf0 0x7f90d80cef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35738/0 (socket says 172.21.15.73:35738) 2024-03-29T04:10:15.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.412+0000 7f90d77fe640 1 -- 172.21.15.73:0/410832554 learned_addr learned my addr 172.21.15.73:0/410832554 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:15.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.412+0000 7f90d7fff640 1 --2- 172.21.15.73:0/410832554 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90d815b350 0x7f90d80affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:15.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.412+0000 7f90d6ffd640 1 --2- 172.21.15.73:0/410832554 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90d80d0490 0x7f90d80b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:15.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.412+0000 7f90d77fe640 1 -- 172.21.15.73:0/410832554 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90d815b350 msgr2=0x7f90d80affb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:15.399 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.412+0000 7f90d77fe640 1 --2- 172.21.15.73:0/410832554 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f90d815b350 0x7f90d80affb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:15.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.413+0000 7f90d77fe640 1 -- 172.21.15.73:0/410832554 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90d80d0490 msgr2=0x7f90d80b2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:15.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.413+0000 7f90d77fe640 1 --2- 172.21.15.73:0/410832554 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90d80d0490 0x7f90d80b2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:15.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.413+0000 7f90d77fe640 1 -- 172.21.15.73:0/410832554 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90d80cde80 con 0x7f90d80b4cf0 2024-03-29T04:10:15.400 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.413+0000 7f90d6ffd640 1 --2- 172.21.15.73:0/410832554 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90d80d0490 0x7f90d80b2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:10:15.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.413+0000 7f90d77fe640 1 --2- 172.21.15.73:0/410832554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90d80b4cf0 0x7f90d80cef20 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f90c800c400 tx=0x7f90c800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:15.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.413+0000 7f90bffff640 1 -- 172.21.15.73:0/410832554 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c80052d0 con 0x7f90d80b4cf0 2024-03-29T04:10:15.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.413+0000 7f90bffff640 1 -- 172.21.15.73:0/410832554 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90c8005490 con 0x7f90d80b4cf0 2024-03-29T04:10:15.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.413+0000 7f90de062640 1 -- 172.21.15.73:0/410832554 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90d80ce160 con 0x7f90d80b4cf0 2024-03-29T04:10:15.401 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.413+0000 7f90bffff640 1 -- 172.21.15.73:0/410832554 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c8007260 con 0x7f90d80b4cf0 2024-03-29T04:10:15.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.413+0000 7f90de062640 1 -- 172.21.15.73:0/410832554 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90d80ce720 con 0x7f90d80b4cf0 2024-03-29T04:10:15.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.414+0000 7f90de062640 1 -- 172.21.15.73:0/410832554 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f90d80ceb00 con 0x7f90d80b4cf0 2024-03-29T04:10:15.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.414+0000 7f90bffff640 1 -- 172.21.15.73:0/410832554 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f90c8007400 con 0x7f90d80b4cf0 2024-03-29T04:10:15.402 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.415+0000 7f90bffff640 1 --2- 172.21.15.73:0/410832554 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f90c406c530 0x7f90c406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:15.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.415+0000 7f90bffff640 1 -- 172.21.15.73:0/410832554 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f90c808a900 con 0x7f90d80b4cf0 2024-03-29T04:10:15.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.415+0000 7f90d6ffd640 1 --2- 172.21.15.73:0/410832554 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f90c406c530 0x7f90c406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:15.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.415+0000 7f90bffff640 1 --2- 172.21.15.73:0/410832554 >> [v2:172.21.15.142:6808/3910589675,v1:172.21.15.142:6809/3910589675] conn(0x7f90c40723f0 0x7f90c4074810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:15.403 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.415+0000 7f90bffff640 1 -- 172.21.15.73:0/410832554 --> [v2:172.21.15.142:6808/3910589675,v1:172.21.15.142:6809/3910589675] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f90c8009e50 con 0x7f90c40723f0 2024-03-29T04:10:15.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.415+0000 7f90bffff640 1 -- 172.21.15.73:0/410832554 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f90c808f2c0 con 0x7f90d80b4cf0 2024-03-29T04:10:15.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.415+0000 7f90d6ffd640 1 --2- 172.21.15.73:0/410832554 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f90c406c530 0x7f90c406e9f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f90d80ae590 tx=0x7f90cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:15.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.415+0000 7f90d7fff640 1 --2- 172.21.15.73:0/410832554 >> [v2:172.21.15.142:6808/3910589675,v1:172.21.15.142:6809/3910589675] conn(0x7f90c40723f0 0x7f90c4074810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:15.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.416+0000 7f90d7fff640 1 --2- 172.21.15.73:0/410832554 >> [v2:172.21.15.142:6808/3910589675,v1:172.21.15.142:6809/3910589675] conn(0x7f90c40723f0 0x7f90c4074810 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:15.404 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.416+0000 7f90bffff640 1 -- 172.21.15.73:0/410832554 <== osd.7 v2:172.21.15.142:6808/3910589675 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f90c8009e50 con 0x7f90c40723f0 2024-03-29T04:10:15.408 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.429+0000 7f90de062640 1 -- 172.21.15.73:0/410832554 --> [v2:172.21.15.142:6808/3910589675,v1:172.21.15.142:6809/3910589675] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f90d8068640 con 0x7f90c40723f0 2024-03-29T04:10:15.409 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.430+0000 7f90bffff640 1 -- 172.21.15.73:0/410832554 <== osd.7 v2:172.21.15.142:6808/3910589675 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f90d8068640 con 0x7f90c40723f0 2024-03-29T04:10:15.409 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-03-29T04:10:15.409 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-29T04:10:15.409 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-03-29T04:10:15.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.430+0000 7f90de062640 1 -- 172.21.15.73:0/410832554 >> [v2:172.21.15.142:6808/3910589675,v1:172.21.15.142:6809/3910589675] conn(0x7f90c40723f0 msgr2=0x7f90c4074810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:15.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.430+0000 7f90de062640 1 --2- 172.21.15.73:0/410832554 >> [v2:172.21.15.142:6808/3910589675,v1:172.21.15.142:6809/3910589675] conn(0x7f90c40723f0 0x7f90c4074810 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:15.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.430+0000 7f90de062640 1 -- 172.21.15.73:0/410832554 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f90c406c530 msgr2=0x7f90c406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:15.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.430+0000 7f90de062640 1 --2- 172.21.15.73:0/410832554 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f90c406c530 0x7f90c406e9f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f90d80ae590 tx=0x7f90cc008040 comp rx=0 tx=0).stop 2024-03-29T04:10:15.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.430+0000 7f90de062640 1 -- 172.21.15.73:0/410832554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90d80b4cf0 msgr2=0x7f90d80cef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:15.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.430+0000 7f90de062640 1 --2- 172.21.15.73:0/410832554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90d80b4cf0 0x7f90d80cef20 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f90c800c400 tx=0x7f90c800c8c0 comp rx=0 tx=0).stop 2024-03-29T04:10:15.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.430+0000 7f90d7fff640 1 -- 172.21.15.73:0/410832554 reap_dead start 2024-03-29T04:10:15.411 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.430+0000 7f90de062640 1 -- 172.21.15.73:0/410832554 shutdown_connections 2024-03-29T04:10:15.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.430+0000 7f90de062640 1 -- 172.21.15.73:0/410832554 >> 172.21.15.73:0/410832554 conn(0x7f90d806b6f0 msgr2=0x7f90d80b38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:15.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.430+0000 7f90de062640 1 -- 172.21.15.73:0/410832554 shutdown_connections 2024-03-29T04:10:15.412 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.430+0000 7f90de062640 1 -- 172.21.15.73:0/410832554 wait complete. 2024-03-29T04:10:15.420 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-03-29T04:10:15.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.541+0000 7fc4b7ed9640 1 Processor -- start 2024-03-29T04:10:15.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.541+0000 7fc4b7ed9640 1 -- start start 2024-03-29T04:10:15.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.542+0000 7fc4b7ed9640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc4b015c740 0x7fc4b00cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:15.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.542+0000 7fc4b7ed9640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4b00d1310 con 0x7fc4b00cceb0 2024-03-29T04:10:15.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.542+0000 7fc4b7ed9640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4b009ac40 con 0x7fc4b00d0b30 2024-03-29T04:10:15.524 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.542+0000 7fc4b7ed9640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7fc4b00cd310 con 0x7fc4b015c740 2024-03-29T04:10:15.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.542+0000 7fc4b5c75640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc4b015c740 0x7fc4b00cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:15.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.542+0000 7fc4b5474640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc4b00cceb0 0x7fc4b00d0420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:51722/0 (socket says 172.21.15.73:51722) 2024-03-29T04:10:15.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.542+0000 7fc4b5474640 1 -- 172.21.15.73:0/2787585169 learned_addr learned my addr 172.21.15.73:0/2787585169 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:10:15.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.543+0000 7fc4b5c75640 1 -- 172.21.15.73:0/2787585169 >> v1:172.21.15.142:6789/0 conn(0x7fc4b00d0b30 legacy=0x7fc4b006fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:15.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.543+0000 7fc4b5c75640 1 -- 172.21.15.73:0/2787585169 >> v1:172.21.15.73:6789/0 conn(0x7fc4b00cceb0 legacy=0x7fc4b00d0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:15.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.543+0000 7fc4b5c75640 1 -- 172.21.15.73:0/2787585169 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b009af20 con 0x7fc4b015c740 2024-03-29T04:10:15.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.543+0000 7fc4b4c73640 1 -- 172.21.15.73:0/2787585169 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3512319518 0 0) 0x7fc4b00d1310 con 0x7fc4b00cceb0 2024-03-29T04:10:15.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.543+0000 7fc4b5c75640 1 --2- 172.21.15.73:0/2787585169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4b015c740 0x7fc4b00cdea0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac009d90 tx=0x7fc4ac02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=904210b001a54264 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:15.525 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.543+0000 7fc4b4c73640 1 -- 172.21.15.73:0/2787585169 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac039070 con 0x7fc4b015c740 2024-03-29T04:10:15.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.544+0000 7fc4b4c73640 1 -- 172.21.15.73:0/2787585169 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4ac02cc60 con 0x7fc4b015c740 2024-03-29T04:10:15.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.544+0000 7fc4b4c73640 1 -- 172.21.15.73:0/2787585169 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac034660 con 0x7fc4b015c740 2024-03-29T04:10:15.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.544+0000 7fc4b7ed9640 1 -- 172.21.15.73:0/2787585169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4b015c740 msgr2=0x7fc4b00cdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:15.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.544+0000 7fc4b7ed9640 1 --2- 172.21.15.73:0/2787585169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4b015c740 0x7fc4b00cdea0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac009d90 tx=0x7fc4ac02beb0 comp rx=0 tx=0).stop 2024-03-29T04:10:15.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.544+0000 7fc4b7ed9640 1 -- 172.21.15.73:0/2787585169 shutdown_connections 2024-03-29T04:10:15.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.544+0000 7fc4b7ed9640 1 --2- 172.21.15.73:0/2787585169 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4b015c740 0x7fc4b00cdea0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:15.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.544+0000 7fc4b7ed9640 1 -- 172.21.15.73:0/2787585169 >> 172.21.15.73:0/2787585169 conn(0x7fc4b00b3e90 msgr2=0x7fc4b00b42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:15.526 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.544+0000 7fc4b7ed9640 1 -- 172.21.15.73:0/2787585169 shutdown_connections 2024-03-29T04:10:15.527 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.544+0000 7fc4b7ed9640 1 -- 172.21.15.73:0/2787585169 wait complete. 2024-03-29T04:10:15.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.545+0000 7fc4b7ed9640 1 Processor -- start 2024-03-29T04:10:15.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.545+0000 7fc4b7ed9640 1 -- start start 2024-03-29T04:10:15.529 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.546+0000 7fc4b7ed9640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4b00cceb0 0x7fc4b00c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:15.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.546+0000 7fc4b7ed9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4b00d0b30 0x7fc4b01f2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:15.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.546+0000 7fc4b7ed9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4b015c740 0x7fc4b015a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:15.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.546+0000 7fc4b7ed9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b009b4e0 con 0x7fc4b015c740 2024-03-29T04:10:15.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.546+0000 7fc4b7ed9640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b009b850 con 0x7fc4b00d0b30 2024-03-29T04:10:15.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.546+0000 7fc4b7ed9640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fc4b009bce0 con 0x7fc4b00cceb0 2024-03-29T04:10:15.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.546+0000 7fc4b6476640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4b015c740 0x7fc4b015a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:15.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.546+0000 7fc4b6476640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4b015c740 0x7fc4b015a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35770/0 (socket says 172.21.15.73:35770) 2024-03-29T04:10:15.530 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.546+0000 7fc4b6476640 1 -- 172.21.15.73:0/3701185002 learned_addr learned my addr 172.21.15.73:0/3701185002 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:15.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.546+0000 7fc4b5c75640 1 --2- 172.21.15.73:0/3701185002 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4b00cceb0 0x7fc4b00c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:15.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.546+0000 7fc4b5474640 1 --2- 172.21.15.73:0/3701185002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4b00d0b30 0x7fc4b01f2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:15.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.546+0000 7fc4b6476640 1 -- 172.21.15.73:0/3701185002 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4b00cceb0 msgr2=0x7fc4b00c74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:15.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.546+0000 7fc4b6476640 1 --2- 172.21.15.73:0/3701185002 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4b00cceb0 0x7fc4b00c74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:15.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.546+0000 7fc4b6476640 1 -- 172.21.15.73:0/3701185002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4b00d0b30 msgr2=0x7fc4b01f2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:15.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.546+0000 7fc4b6476640 1 --2- 172.21.15.73:0/3701185002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4b00d0b30 0x7fc4b01f2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:15.531 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.546+0000 7fc4b6476640 1 -- 172.21.15.73:0/3701185002 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b015e3a0 con 0x7fc4b015c740 2024-03-29T04:10:15.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.547+0000 7fc4b6476640 1 --2- 172.21.15.73:0/3701185002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4b015c740 0x7fc4b015a590 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fc4a800c440 tx=0x7fc4a800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:15.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.547+0000 7fc4a67fc640 1 -- 172.21.15.73:0/3701185002 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8011790 con 0x7fc4b015c740 2024-03-29T04:10:15.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.547+0000 7fc4a67fc640 1 -- 172.21.15.73:0/3701185002 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4a8017070 con 0x7fc4b015c740 2024-03-29T04:10:15.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.547+0000 7fc4b7ed9640 1 -- 172.21.15.73:0/3701185002 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4b015d900 con 0x7fc4b015c740 2024-03-29T04:10:15.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.547+0000 7fc4a67fc640 1 -- 172.21.15.73:0/3701185002 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8011b70 con 0x7fc4b015c740 2024-03-29T04:10:15.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.547+0000 7fc4b7ed9640 1 -- 172.21.15.73:0/3701185002 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4b00c79f0 con 0x7fc4b015c740 2024-03-29T04:10:15.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.548+0000 7fc4b7ed9640 1 -- 172.21.15.73:0/3701185002 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4b0068d50 con 0x7fc4b015c740 2024-03-29T04:10:15.532 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.548+0000 7fc4a67fc640 1 -- 172.21.15.73:0/3701185002 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc4a8011d10 con 0x7fc4b015c740 2024-03-29T04:10:15.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.549+0000 7fc4a67fc640 1 --2- 172.21.15.73:0/3701185002 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fc49406c530 0x7fc49406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:15.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.549+0000 7fc4a67fc640 1 -- 172.21.15.73:0/3701185002 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fc4a808b0d0 con 0x7fc4b015c740 2024-03-29T04:10:15.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.549+0000 7fc4b5c75640 1 --2- 172.21.15.73:0/3701185002 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fc49406c530 0x7fc49406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:15.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.549+0000 7fc4b5c75640 1 --2- 172.21.15.73:0/3701185002 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fc49406c530 0x7fc49406e9f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac036000 tx=0x7fc4ac030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:15.533 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.553+0000 7fc4a67fc640 1 -- 172.21.15.73:0/3701185002 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7fc4a8059b40 con 0x7fc4b015c740 2024-03-29T04:10:15.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.729+0000 7fc4b7ed9640 1 -- 172.21.15.73:0/3701185002 --> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fc4b00c8ec0 con 0x7fc49406c530 2024-03-29T04:10:15.709 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.730+0000 7fc4a67fc640 1 -- 172.21.15.73:0/3701185002 <== mgr.4104 v2:172.21.15.73:6832/1640471941 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc4b00c8ec0 con 0x7fc49406c530 2024-03-29T04:10:15.709 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 7 to deep-scrub 2024-03-29T04:10:15.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.731+0000 7fc4b7ed9640 1 -- 172.21.15.73:0/3701185002 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fc49406c530 msgr2=0x7fc49406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:15.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.731+0000 7fc4b7ed9640 1 --2- 172.21.15.73:0/3701185002 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fc49406c530 0x7fc49406e9f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac036000 tx=0x7fc4ac030000 comp rx=0 tx=0).stop 2024-03-29T04:10:15.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.732+0000 7fc4b7ed9640 1 -- 172.21.15.73:0/3701185002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4b015c740 msgr2=0x7fc4b015a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:15.711 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.732+0000 7fc4b7ed9640 1 --2- 172.21.15.73:0/3701185002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4b015c740 0x7fc4b015a590 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fc4a800c440 tx=0x7fc4a800c840 comp rx=0 tx=0).stop 2024-03-29T04:10:15.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.732+0000 7fc4b7ed9640 1 -- 172.21.15.73:0/3701185002 shutdown_connections 2024-03-29T04:10:15.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.732+0000 7fc4b7ed9640 1 --2- 172.21.15.73:0/3701185002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4b015c740 0x7fc4b015a590 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:15.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.732+0000 7fc4b7ed9640 1 --2- 172.21.15.73:0/3701185002 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fc49406c530 0x7fc49406e9f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:15.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.732+0000 7fc4b7ed9640 1 --2- 172.21.15.73:0/3701185002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4b00d0b30 0x7fc4b01f2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:15.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.732+0000 7fc4b7ed9640 1 --2- 172.21.15.73:0/3701185002 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fc4b00cceb0 0x7fc4b00c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:15.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.732+0000 7fc4b7ed9640 1 -- 172.21.15.73:0/3701185002 >> 172.21.15.73:0/3701185002 conn(0x7fc4b00b3e90 msgr2=0x7fc4b00749e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:15.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.732+0000 7fc4b7ed9640 1 -- 172.21.15.73:0/3701185002 shutdown_connections 2024-03-29T04:10:15.712 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.732+0000 7fc4b7ed9640 1 -- 172.21.15.73:0/3701185002 wait complete. 2024-03-29T04:10:15.722 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-29T04:10:15.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.842+0000 7f205b560640 1 Processor -- start 2024-03-29T04:10:15.822 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.842+0000 7f205b560640 1 -- start start 2024-03-29T04:10:15.823 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.843+0000 7f205b560640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f205415b370 0x7f20540b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:15.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.843+0000 7f205b560640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f205406f3f0 0x7f2054072b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:15.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.843+0000 7f205b560640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f20540730c0 0x7f20540ae020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:15.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.843+0000 7f205b560640 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 -- 0x7f2054071ae0 con 0x7f20540730c0 2024-03-29T04:10:15.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.843+0000 7f205b560640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f2054071dc0 con 0x7f205406f3f0 2024-03-29T04:10:15.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.843+0000 7f205b560640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f20540720a0 con 0x7f205415b370 2024-03-29T04:10:15.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.843+0000 7f2059afd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f20540730c0 0x7f20540ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:15.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.843+0000 7f2059afd640 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f20540730c0 0x7f20540ae020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35772/0 (socket says 172.21.15.73:35772) 2024-03-29T04:10:15.824 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.843+0000 7f2059afd640 1 -- 172.21.15.73:0/3095953582 learned_addr learned my addr 172.21.15.73:0/3095953582 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:15.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.843+0000 7f2058afb640 1 --2- 172.21.15.73:0/3095953582 >> v2:172.21.15.142:3300/0 conn(0x7f205406f3f0 0x7f2054072b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:15.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.843+0000 7f20592fc640 1 --2- 172.21.15.73:0/3095953582 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f205415b370 0x7f20540b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:15.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.843+0000 7f2059afd640 1 -- 172.21.15.73:0/3095953582 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f205415b370 msgr2=0x7f20540b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:15.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.843+0000 7f2059afd640 1 --2- 172.21.15.73:0/3095953582 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f205415b370 0x7f20540b32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:15.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.843+0000 7f2059afd640 1 -- 172.21.15.73:0/3095953582 >> v2:172.21.15.142:3300/0 conn(0x7f205406f3f0 msgr2=0x7f2054072b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:15.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.843+0000 7f2059afd640 1 --2- 172.21.15.73:0/3095953582 >> v2:172.21.15.142:3300/0 conn(0x7f205406f3f0 0x7f2054072b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:15.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.843+0000 7f2059afd640 1 -- 172.21.15.73:0/3095953582 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2054072380 con 0x7f20540730c0 2024-03-29T04:10:15.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.844+0000 7f2059afd640 1 --2- 172.21.15.73:0/3095953582 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20540730c0 0x7f20540ae020 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f20540b3080 tx=0x7f204c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a39337fd9e5ccbd server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:15.825 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.844+0000 7f204bfff640 1 -- 172.21.15.73:0/3095953582 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c02ca70 con 0x7f20540730c0 2024-03-29T04:10:15.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.844+0000 7f204bfff640 1 -- 172.21.15.73:0/3095953582 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f204c02cc10 con 0x7f20540730c0 2024-03-29T04:10:15.826 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.844+0000 7f204bfff640 1 -- 172.21.15.73:0/3095953582 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c0343f0 con 0x7f20540730c0 2024-03-29T04:10:15.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.845+0000 7f205b560640 1 -- 172.21.15.73:0/3095953582 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20540730c0 msgr2=0x7f20540ae020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:15.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.845+0000 7f205b560640 1 --2- 172.21.15.73:0/3095953582 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20540730c0 0x7f20540ae020 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f20540b3080 tx=0x7f204c02bed0 comp rx=0 tx=0).stop 2024-03-29T04:10:15.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.845+0000 7f205b560640 1 -- 172.21.15.73:0/3095953582 shutdown_connections 2024-03-29T04:10:15.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.845+0000 7f205b560640 1 --2- 172.21.15.73:0/3095953582 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f20540730c0 0x7f20540ae020 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:15.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.845+0000 7f205b560640 1 --2- 172.21.15.73:0/3095953582 >> v2:172.21.15.142:3300/0 conn(0x7f205406f3f0 0x7f2054072b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:15.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.845+0000 7f205b560640 1 --2- 172.21.15.73:0/3095953582 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f205415b370 0x7f20540b32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:15.829 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.845+0000 7f205b560640 1 -- 172.21.15.73:0/3095953582 >> 172.21.15.73:0/3095953582 conn(0x7f205406b510 msgr2=0x7f205406b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:15.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.845+0000 7f205b560640 1 -- 172.21.15.73:0/3095953582 shutdown_connections 2024-03-29T04:10:15.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.845+0000 7f205b560640 1 -- 172.21.15.73:0/3095953582 wait complete. 2024-03-29T04:10:15.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.846+0000 7f205b560640 1 Processor -- start 2024-03-29T04:10:15.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.846+0000 7f205b560640 1 -- start start 2024-03-29T04:10:15.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.847+0000 7f205b560640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f205406f3f0 0x7f20540cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:15.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.847+0000 7f205b560640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20540730c0 0x7f205413ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:15.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.847+0000 7f205b560640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f205415b370 0x7f205415b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:15.830 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.847+0000 7f205b560640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f20540b3800 con 0x7f205406f3f0 2024-03-29T04:10:15.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.847+0000 7f205b560640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2054073550 con 0x7f205415b370 2024-03-29T04:10:15.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.847+0000 7f205b560640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f20540b3980 con 0x7f20540730c0 2024-03-29T04:10:15.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.847+0000 7f20592fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f205406f3f0 0x7f20540cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:15.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.847+0000 7f20592fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f205406f3f0 0x7f20540cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35782/0 (socket says 172.21.15.73:35782) 2024-03-29T04:10:15.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.847+0000 7f20592fc640 1 -- 172.21.15.73:0/1108785924 learned_addr learned my addr 172.21.15.73:0/1108785924 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:15.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.847+0000 7f2059afd640 1 --2- 172.21.15.73:0/1108785924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f205415b370 0x7f205415b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:15.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.847+0000 7f2058afb640 1 --2- 172.21.15.73:0/1108785924 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20540730c0 0x7f205413ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:15.831 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.847+0000 7f20592fc640 1 -- 172.21.15.73:0/1108785924 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20540730c0 msgr2=0x7f205413ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:15.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.847+0000 7f20592fc640 1 --2- 172.21.15.73:0/1108785924 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20540730c0 0x7f205413ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:15.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.847+0000 7f20592fc640 1 -- 172.21.15.73:0/1108785924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f205415b370 msgr2=0x7f205415b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:15.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.847+0000 7f20592fc640 1 --2- 172.21.15.73:0/1108785924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f205415b370 0x7f205415b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:15.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.847+0000 7f20592fc640 1 -- 172.21.15.73:0/1108785924 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f205413f2a0 con 0x7f205406f3f0 2024-03-29T04:10:15.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.847+0000 7f20592fc640 1 --2- 172.21.15.73:0/1108785924 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f205406f3f0 0x7f20540cdcf0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f205000d830 tx=0x7f205000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:15.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.847+0000 7f2049ffb640 1 -- 172.21.15.73:0/1108785924 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205000b6c0 con 0x7f205406f3f0 2024-03-29T04:10:15.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.848+0000 7f2049ffb640 1 -- 172.21.15.73:0/1108785924 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2050019070 con 0x7f205406f3f0 2024-03-29T04:10:15.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.848+0000 7f205b560640 1 -- 172.21.15.73:0/1108785924 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20540ce2d0 con 0x7f205406f3f0 2024-03-29T04:10:15.832 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.848+0000 7f2049ffb640 1 -- 172.21.15.73:0/1108785924 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205000ba80 con 0x7f205406f3f0 2024-03-29T04:10:15.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.848+0000 7f205b560640 1 -- 172.21.15.73:0/1108785924 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20540ce890 con 0x7f205406f3f0 2024-03-29T04:10:15.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.849+0000 7f205b560640 1 -- 172.21.15.73:0/1108785924 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20540cefa0 con 0x7f205406f3f0 2024-03-29T04:10:15.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.849+0000 7f2049ffb640 1 -- 172.21.15.73:0/1108785924 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f205001e460 con 0x7f205406f3f0 2024-03-29T04:10:15.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.849+0000 7f2049ffb640 1 --2- 172.21.15.73:0/1108785924 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f203806c530 0x7f203806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:15.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.850+0000 7f2049ffb640 1 -- 172.21.15.73:0/1108785924 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f205008bb20 con 0x7f205406f3f0 2024-03-29T04:10:15.833 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.850+0000 7f2058afb640 1 --2- 172.21.15.73:0/1108785924 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f203806c530 0x7f203806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:15.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.850+0000 7f2058afb640 1 --2- 172.21.15.73:0/1108785924 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f203806c530 0x7f203806e9f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2044006fd0 tx=0x7f2044008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:15.834 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:15.854+0000 7f2049ffb640 1 -- 172.21.15.73:0/1108785924 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f205005a3b0 con 0x7f205406f3f0 2024-03-29T04:10:16.006 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:16.027+0000 7f205b560640 1 -- 172.21.15.73:0/1108785924 --> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2054068640 con 0x7f203806c530 2024-03-29T04:10:16.007 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:16.027+0000 7f2049ffb640 1 -- 172.21.15.73:0/1108785924 <== mgr.4104 v2:172.21.15.73:6832/1640471941 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13452 (secure 0 0 0) 0x7f2054068640 con 0x7f203806c530 2024-03-29T04:10:16.007 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:10:16.007 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-29T04:10:16.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:16.029+0000 7f205b560640 1 -- 172.21.15.73:0/1108785924 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f203806c530 msgr2=0x7f203806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:16.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:16.029+0000 7f205b560640 1 --2- 172.21.15.73:0/1108785924 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f203806c530 0x7f203806e9f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2044006fd0 tx=0x7f2044008040 comp rx=0 tx=0).stop 2024-03-29T04:10:16.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:16.029+0000 7f205b560640 1 -- 172.21.15.73:0/1108785924 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f205406f3f0 msgr2=0x7f20540cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:16.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:16.029+0000 7f205b560640 1 --2- 172.21.15.73:0/1108785924 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f205406f3f0 0x7f20540cdcf0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f205000d830 tx=0x7f205000dcf0 comp rx=0 tx=0).stop 2024-03-29T04:10:16.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:16.029+0000 7f205b560640 1 -- 172.21.15.73:0/1108785924 shutdown_connections 2024-03-29T04:10:16.009 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:16.029+0000 7f205b560640 1 --2- 172.21.15.73:0/1108785924 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f203806c530 0x7f203806e9f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:16.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:16.029+0000 7f205b560640 1 --2- 172.21.15.73:0/1108785924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f205415b370 0x7f205415b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:16.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:16.029+0000 7f205b560640 1 --2- 172.21.15.73:0/1108785924 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f20540730c0 0x7f205413ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:16.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:16.029+0000 7f205b560640 1 --2- 172.21.15.73:0/1108785924 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f205406f3f0 0x7f20540cdcf0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:16.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:16.029+0000 7f205b560640 1 -- 172.21.15.73:0/1108785924 >> 172.21.15.73:0/1108785924 conn(0x7f205406b510 msgr2=0x7f20540aff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:16.010 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:16.029+0000 7f205b560640 1 -- 172.21.15.73:0/1108785924 shutdown_connections 2024-03-29T04:10:16.011 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:16.029+0000 7f205b560640 1 -- 172.21.15.73:0/1108785924 wait complete. 2024-03-29T04:10:16.019 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":97,"stamp":"2024-03-29T04:10:15.544961+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":224660,"kb_used_data":4328,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750060,"statfs":{"total":773094113280,"available":772864061440,"internally_reserved":0,"allocated":4431872,"data_stored":2436760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-173890432,"num_objects":-116,"num_object_clones":0,"num_object_copies":-232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-116,"num_whiteouts":0,"num_read":-75,"num_read_kb":0,"num_write":-193,"num_write_kb":-169856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.679623"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":197,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-29T04:10:09.316824+0000","last_change":"2024-03-29T04:08:01.885311+0000","last_active":"2024-03-29T04:10:09.316824+0000","last_peered":"2024-03-29T04:10:09.316824+0000","last_clean":"2024-03-29T04:10:09.316824+0000","last_became_active":"2024-03-29T04:08:01.884340+0000","last_became_peered":"2024-03-29T04:08:01.884340+0000","last_unstale":"2024-03-29T04:10:09.316824+0000","last_undegraded":"2024-03-29T04:10:09.316824+0000","last_fullsized":"2024-03-29T04:10:09.316824+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-29T04:08:00.511520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-29T04:08:00.511520+0000","last_clean_scrub_stamp":"2024-03-29T04:08:00.511520+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T05:40:25.245419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":999424,"data_stored":747371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":157003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":157003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27420,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":405504,"data_stored":157003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":157003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":157003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":157003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":999424,"data_stored":747371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-29T04:10:16.023 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-29T04:08:00.511520+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=29, tm_hour=4, tm_min=8, tm_sec=0, tm_wday=4, tm_yday=89, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=29, tm_hour=4, tm_min=10, tm_sec=11, tm_wday=4, tm_yday=89, tm_isdst=0) 2024-03-29T04:10:16.023 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-29T04:10:36.024 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-29T04:10:36.136 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.157+0000 7feaae0c5640 1 Processor -- start 2024-03-29T04:10:36.137 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.157+0000 7feaae0c5640 1 -- start start 2024-03-29T04:10:36.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.157+0000 7feaae0c5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7feaa815e930 0x7feaa80cf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:36.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.157+0000 7feaae0c5640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feaa80cfb30 con 0x7feaa80cf670 2024-03-29T04:10:36.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.157+0000 7feaae0c5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feaa80cfe10 con 0x7feaa80d3310 2024-03-29T04:10:36.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.157+0000 7feaae0c5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7feaa806c780 con 0x7feaa815e930 2024-03-29T04:10:36.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.158+0000 7feaa6ffd640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7feaa80cf670 0x7feaa80d2c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47654/0 (socket says 172.21.15.73:47654) 2024-03-29T04:10:36.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.158+0000 7feaa6ffd640 1 -- 172.21.15.73:0/1557613779 learned_addr learned my addr 172.21.15.73:0/1557613779 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:10:36.141 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.158+0000 7feaa77fe640 1 --2- 172.21.15.73:0/1557613779 >> v2:172.21.15.142:3300/0 conn(0x7feaa815e930 0x7feaa80cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:36.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.158+0000 7feaa67fc640 1 -- 172.21.15.73:0/1557613779 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1248863156 0 0) 0x7feaa80cfb30 con 0x7feaa80cf670 2024-03-29T04:10:36.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.158+0000 7feaa67fc640 1 -- 172.21.15.73:0/1557613779 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea90003520 con 0x7feaa80cf670 2024-03-29T04:10:36.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.158+0000 7feaa67fc640 1 -- 172.21.15.73:0/1557613779 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3675807047 0 0) 0x7fea90003520 con 0x7feaa80cf670 2024-03-29T04:10:36.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.158+0000 7feaa67fc640 1 -- 172.21.15.73:0/1557613779 >> v2:172.21.15.142:3300/0 conn(0x7feaa815e930 msgr2=0x7feaa80cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:36.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.158+0000 7feaa67fc640 1 --2- 172.21.15.73:0/1557613779 >> v2:172.21.15.142:3300/0 conn(0x7feaa815e930 0x7feaa80cf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:36.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.158+0000 7feaa67fc640 1 -- 172.21.15.73:0/1557613779 >> v1:172.21.15.142:6789/0 conn(0x7feaa80d3310 legacy=0x7feaa806cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:36.142 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.158+0000 7feaa67fc640 1 -- 172.21.15.73:0/1557613779 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaa80d00f0 con 0x7feaa80cf670 2024-03-29T04:10:36.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.158+0000 7feaa67fc640 1 -- 172.21.15.73:0/1557613779 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1290421750 0 0) 0x7fea9c001690 con 0x7feaa80cf670 2024-03-29T04:10:36.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.158+0000 7feaa67fc640 1 -- 172.21.15.73:0/1557613779 >> v1:172.21.15.73:6789/0 conn(0x7feaa80cf670 legacy=0x7feaa80d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:36.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.158+0000 7feaa67fc640 1 --2- 172.21.15.73:0/1557613779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea900039b0 0x7fea90003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:36.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.158+0000 7feaa67fc640 1 --2- 172.21.15.73:0/1557613779 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea90004800 0x7fea90004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:36.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.158+0000 7feaa67fc640 1 --2- 172.21.15.73:0/1557613779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea900051c0 0x7fea9000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:36.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.158+0000 7feaa67fc640 1 -- 172.21.15.73:0/1557613779 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7feaa806c780 con 0x7fea90004800 2024-03-29T04:10:36.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.158+0000 7feaa67fc640 1 -- 172.21.15.73:0/1557613779 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fea9000c160 con 0x7fea900039b0 2024-03-29T04:10:36.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.158+0000 7feaa67fc640 1 -- 172.21.15.73:0/1557613779 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7fea9000c360 con 0x7fea900051c0 2024-03-29T04:10:36.143 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.158+0000 7feaa6ffd640 1 --2- 172.21.15.73:0/1557613779 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea90004800 0x7fea90004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:36.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.158+0000 7feaa77fe640 1 --2- 172.21.15.73:0/1557613779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea900039b0 0x7fea90003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:36.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.159+0000 7feaa7fff640 1 --2- 172.21.15.73:0/1557613779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea900051c0 0x7fea9000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:36.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.159+0000 7feaa6ffd640 1 -- 172.21.15.73:0/1557613779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea900051c0 msgr2=0x7fea9000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:36.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.159+0000 7feaa6ffd640 1 --2- 172.21.15.73:0/1557613779 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea900051c0 0x7fea9000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:36.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.159+0000 7feaa6ffd640 1 -- 172.21.15.73:0/1557613779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea900039b0 msgr2=0x7fea90003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:36.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.159+0000 7feaa6ffd640 1 --2- 172.21.15.73:0/1557613779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea900039b0 0x7fea90003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:36.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.159+0000 7feaa6ffd640 1 -- 172.21.15.73:0/1557613779 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea90003520 con 0x7fea90004800 2024-03-29T04:10:36.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.159+0000 7feaa7fff640 1 -- 172.21.15.73:0/1557613779 reap_dead start 2024-03-29T04:10:36.144 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.159+0000 7feaa77fe640 1 --2- 172.21.15.73:0/1557613779 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea900039b0 0x7fea90003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-29T04:10:36.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.159+0000 7feaa6ffd640 1 --2- 172.21.15.73:0/1557613779 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea90004800 0x7fea90004c80 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fea9c007fd0 tx=0x7fea90005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61487dd0b757bbcd server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:36.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.159+0000 7feaa67fc640 1 -- 172.21.15.73:0/1557613779 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9c007d50 con 0x7fea90004800 2024-03-29T04:10:36.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.160+0000 7feaa67fc640 1 -- 172.21.15.73:0/1557613779 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea9c030070 con 0x7fea90004800 2024-03-29T04:10:36.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.160+0000 7feaa67fc640 1 -- 172.21.15.73:0/1557613779 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9c005d10 con 0x7fea90004800 2024-03-29T04:10:36.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.160+0000 7feaae0c5640 1 -- 172.21.15.73:0/1557613779 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea90004800 msgr2=0x7fea90004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:36.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.160+0000 7feaae0c5640 1 --2- 172.21.15.73:0/1557613779 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea90004800 0x7fea90004c80 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fea9c007fd0 tx=0x7fea90005830 comp rx=0 tx=0).stop 2024-03-29T04:10:36.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.160+0000 7feaae0c5640 1 -- 172.21.15.73:0/1557613779 shutdown_connections 2024-03-29T04:10:36.145 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.160+0000 7feaae0c5640 1 --2- 172.21.15.73:0/1557613779 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea90004800 0x7fea90004c80 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:36.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.160+0000 7feaae0c5640 1 -- 172.21.15.73:0/1557613779 >> 172.21.15.73:0/1557613779 conn(0x7feaa808bfc0 msgr2=0x7feaa80d4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:36.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.160+0000 7feaae0c5640 1 -- 172.21.15.73:0/1557613779 shutdown_connections 2024-03-29T04:10:36.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.160+0000 7feaae0c5640 1 -- 172.21.15.73:0/1557613779 wait complete. 2024-03-29T04:10:36.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.161+0000 7feaae0c5640 1 Processor -- start 2024-03-29T04:10:36.146 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.162+0000 7feaae0c5640 1 -- start start 2024-03-29T04:10:36.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.162+0000 7feaae0c5640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea90004800 0x7feaa80b98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:36.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.162+0000 7feaae0c5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feaa80cdfe0 0x7feaa80cc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:36.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.162+0000 7feaae0c5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaa80ce460 0x7feaa80cc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:36.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.162+0000 7feaae0c5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7feaa815ee90 con 0x7feaa80ce460 2024-03-29T04:10:36.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.162+0000 7feaae0c5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7feaa815ed10 con 0x7feaa80cdfe0 2024-03-29T04:10:36.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.162+0000 7feaae0c5640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7feaa80b3c50 con 0x7fea90004800 2024-03-29T04:10:36.149 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.162+0000 7feaa7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaa80ce460 0x7feaa80cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:36.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.162+0000 7feaa7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaa80ce460 0x7feaa80cc640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54864/0 (socket says 172.21.15.73:54864) 2024-03-29T04:10:36.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.162+0000 7feaa7fff640 1 -- 172.21.15.73:0/425317619 learned_addr learned my addr 172.21.15.73:0/425317619 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:36.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.163+0000 7feaa6ffd640 1 --2- 172.21.15.73:0/425317619 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feaa80cdfe0 0x7feaa80cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:36.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.163+0000 7feaa77fe640 1 --2- 172.21.15.73:0/425317619 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea90004800 0x7feaa80b98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:36.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.163+0000 7feaa7fff640 1 -- 172.21.15.73:0/425317619 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea90004800 msgr2=0x7feaa80b98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:36.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.163+0000 7feaa7fff640 1 --2- 172.21.15.73:0/425317619 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea90004800 0x7feaa80b98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:36.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.163+0000 7feaa7fff640 1 -- 172.21.15.73:0/425317619 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feaa80cdfe0 msgr2=0x7feaa80cc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:36.150 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.163+0000 7feaa7fff640 1 --2- 172.21.15.73:0/425317619 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feaa80cdfe0 0x7feaa80cc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:36.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.163+0000 7feaa7fff640 1 -- 172.21.15.73:0/425317619 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaa80b9df0 con 0x7feaa80ce460 2024-03-29T04:10:36.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.163+0000 7feaa7fff640 1 --2- 172.21.15.73:0/425317619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaa80ce460 0x7feaa80cc640 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7feaa808ca20 tx=0x7feaa000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:36.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.163+0000 7fea8ffff640 1 -- 172.21.15.73:0/425317619 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa0003970 con 0x7feaa80ce460 2024-03-29T04:10:36.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.163+0000 7fea8ffff640 1 -- 172.21.15.73:0/425317619 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaa0018070 con 0x7feaa80ce460 2024-03-29T04:10:36.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.163+0000 7fea8ffff640 1 -- 172.21.15.73:0/425317619 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa0003d70 con 0x7feaa80ce460 2024-03-29T04:10:36.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.163+0000 7feaae0c5640 1 -- 172.21.15.73:0/425317619 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaa80ccf40 con 0x7feaa80ce460 2024-03-29T04:10:36.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.163+0000 7feaae0c5640 1 -- 172.21.15.73:0/425317619 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaa80cd500 con 0x7feaa80ce460 2024-03-29T04:10:36.151 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.164+0000 7feaae0c5640 1 -- 172.21.15.73:0/425317619 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaa8068640 con 0x7feaa80ce460 2024-03-29T04:10:36.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.165+0000 7fea8ffff640 1 -- 172.21.15.73:0/425317619 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7feaa00050d0 con 0x7feaa80ce460 2024-03-29T04:10:36.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.165+0000 7fea8ffff640 1 --2- 172.21.15.73:0/425317619 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fea9406c560 0x7fea9406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:36.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.165+0000 7fea8ffff640 1 -- 172.21.15.73:0/425317619 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7feaa008b0a0 con 0x7feaa80ce460 2024-03-29T04:10:36.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.165+0000 7feaa77fe640 1 --2- 172.21.15.73:0/425317619 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fea9406c560 0x7fea9406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:36.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.165+0000 7feaa77fe640 1 --2- 172.21.15.73:0/425317619 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fea9406c560 0x7fea9406ea20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7feaa80510d0 tx=0x7fea98008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:36.152 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.170+0000 7fea8ffff640 1 -- 172.21.15.73:0/425317619 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7feaa00599c0 con 0x7feaa80ce460 2024-03-29T04:10:36.320 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.341+0000 7feaae0c5640 1 -- 172.21.15.73:0/425317619 --> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feaa806d650 con 0x7fea9406c560 2024-03-29T04:10:36.321 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.342+0000 7fea8ffff640 1 -- 172.21.15.73:0/425317619 <== mgr.4104 v2:172.21.15.73:6832/1640471941 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13355 (secure 0 0 0) 0x7feaa806d650 con 0x7fea9406c560 2024-03-29T04:10:36.321 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:10:36.321 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-03-29T04:10:36.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.343+0000 7feaae0c5640 1 -- 172.21.15.73:0/425317619 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fea9406c560 msgr2=0x7fea9406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:36.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.343+0000 7feaae0c5640 1 --2- 172.21.15.73:0/425317619 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fea9406c560 0x7fea9406ea20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7feaa80510d0 tx=0x7fea98008040 comp rx=0 tx=0).stop 2024-03-29T04:10:36.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.344+0000 7feaae0c5640 1 -- 172.21.15.73:0/425317619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaa80ce460 msgr2=0x7feaa80cc640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:36.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.344+0000 7feaae0c5640 1 --2- 172.21.15.73:0/425317619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaa80ce460 0x7feaa80cc640 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7feaa808ca20 tx=0x7feaa000ec10 comp rx=0 tx=0).stop 2024-03-29T04:10:36.323 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.344+0000 7feaae0c5640 1 -- 172.21.15.73:0/425317619 shutdown_connections 2024-03-29T04:10:36.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.344+0000 7feaae0c5640 1 --2- 172.21.15.73:0/425317619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaa80ce460 0x7feaa80cc640 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:36.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.344+0000 7feaae0c5640 1 --2- 172.21.15.73:0/425317619 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7fea9406c560 0x7fea9406ea20 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:36.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.344+0000 7feaae0c5640 1 --2- 172.21.15.73:0/425317619 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feaa80cdfe0 0x7feaa80cc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:36.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.344+0000 7feaae0c5640 1 --2- 172.21.15.73:0/425317619 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7fea90004800 0x7feaa80b98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:36.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.344+0000 7feaae0c5640 1 -- 172.21.15.73:0/425317619 >> 172.21.15.73:0/425317619 conn(0x7feaa808bfc0 msgr2=0x7feaa80cac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:36.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.344+0000 7feaae0c5640 1 -- 172.21.15.73:0/425317619 shutdown_connections 2024-03-29T04:10:36.324 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.344+0000 7feaae0c5640 1 -- 172.21.15.73:0/425317619 wait complete. 2024-03-29T04:10:36.334 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":107,"stamp":"2024-03-29T04:10:35.549009+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":224652,"kb_used_data":4328,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750068,"statfs":{"total":773094113280,"available":772864069632,"internally_reserved":0,"allocated":4431872,"data_stored":2436760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002569"},"pg_stats":[{"pgid":"1.0","version":"35'119","reported_seq":208,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-29T04:10:15.950120+0000","last_change":"2024-03-29T04:10:15.950154+0000","last_active":"2024-03-29T04:10:15.950120+0000","last_peered":"2024-03-29T04:10:15.950120+0000","last_clean":"2024-03-29T04:10:15.950120+0000","last_became_active":"2024-03-29T04:08:01.884340+0000","last_became_peered":"2024-03-29T04:08:01.884340+0000","last_unstale":"2024-03-29T04:10:15.950120+0000","last_undegraded":"2024-03-29T04:10:15.950120+0000","last_fullsized":"2024-03-29T04:10:15.950120+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'119","last_scrub_stamp":"2024-03-29T04:10:15.950032+0000","last_deep_scrub":"35'119","last_deep_scrub_stamp":"2024-03-29T04:10:15.950032+0000","last_clean_scrub_stamp":"2024-03-29T04:10:15.950032+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T11:27:51.142376+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":999424,"data_stored":747371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":157003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":157003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27420,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":405504,"data_stored":157003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":157003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":157003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":157003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":999424,"data_stored":747371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-29T04:10:36.335 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-03-29T04:10:36.357 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-29T04:10:36.380 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-29T04:10:36.436 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.457+0000 7f7f6c7bd640 1 Processor -- start 2024-03-29T04:10:36.437 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.457+0000 7f7f6c7bd640 1 -- start start 2024-03-29T04:10:36.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.458+0000 7f7f6c7bd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f7f640722e0 0x7f7f6406ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:36.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.458+0000 7f7f6c7bd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f64147c90 0x7f7f6406f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:36.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.458+0000 7f7f6c7bd640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f6406df60 con 0x7f7f641477a0 2024-03-29T04:10:36.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.458+0000 7f7f6c7bd640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f7f6406e830 con 0x7f7f640722e0 2024-03-29T04:10:36.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.458+0000 7f7f6c7bd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7f64162e60 con 0x7f7f64147c90 2024-03-29T04:10:36.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.458+0000 7f7f6a559640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7f641477a0 0x7f7f64071bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47658/0 (socket says 172.21.15.73:47658) 2024-03-29T04:10:36.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.458+0000 7f7f6a559640 1 -- 172.21.15.73:0/1114969112 learned_addr learned my addr 172.21.15.73:0/1114969112 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:10:36.444 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.458+0000 7f7f6ad5a640 1 --2- 172.21.15.73:0/1114969112 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f64147c90 0x7f7f6406f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:36.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.458+0000 7f7f69d58640 1 --2- 172.21.15.73:0/1114969112 >> v2:172.21.15.142:3300/0 conn(0x7f7f640722e0 0x7f7f6406ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:36.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.458+0000 7f7f69557640 1 -- 172.21.15.73:0/1114969112 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1949165656 0 0) 0x7f7f54001110 con 0x7f7f641477a0 2024-03-29T04:10:36.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.458+0000 7f7f69557640 1 -- 172.21.15.73:0/1114969112 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f50003520 con 0x7f7f641477a0 2024-03-29T04:10:36.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.459+0000 7f7f69557640 1 -- 172.21.15.73:0/1114969112 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 610443876 0 0) 0x7f7f50003520 con 0x7f7f641477a0 2024-03-29T04:10:36.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.459+0000 7f7f69557640 1 -- 172.21.15.73:0/1114969112 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f64147c90 msgr2=0x7f7f6406f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:36.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.459+0000 7f7f69557640 1 --2- 172.21.15.73:0/1114969112 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f64147c90 0x7f7f6406f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:36.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.459+0000 7f7f69557640 1 -- 172.21.15.73:0/1114969112 >> v2:172.21.15.142:3300/0 conn(0x7f7f640722e0 msgr2=0x7f7f6406ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:36.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.459+0000 7f7f69557640 1 --2- 172.21.15.73:0/1114969112 >> v2:172.21.15.142:3300/0 conn(0x7f7f640722e0 0x7f7f6406ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:36.445 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.459+0000 7f7f69557640 1 -- 172.21.15.73:0/1114969112 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f64163140 con 0x7f7f641477a0 2024-03-29T04:10:36.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.459+0000 7f7f69557640 1 -- 172.21.15.73:0/1114969112 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1290421750 0 0) 0x7f7f54001840 con 0x7f7f641477a0 2024-03-29T04:10:36.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.459+0000 7f7f69557640 1 -- 172.21.15.73:0/1114969112 >> v1:172.21.15.73:6789/0 conn(0x7f7f641477a0 legacy=0x7f7f64071bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:36.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.459+0000 7f7f69557640 1 --2- 172.21.15.73:0/1114969112 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f64147c90 0x7f7f500039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:36.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.459+0000 7f7f69557640 1 --2- 172.21.15.73:0/1114969112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f50003f30 0x7f7f50004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:36.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.459+0000 7f7f69557640 1 --2- 172.21.15.73:0/1114969112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f50004d40 0x7f7f500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:36.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.459+0000 7f7f69557640 1 -- 172.21.15.73:0/1114969112 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6406e830 con 0x7f7f50004d40 2024-03-29T04:10:36.446 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.459+0000 7f7f69557640 1 -- 172.21.15.73:0/1114969112 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7f64162e60 con 0x7f7f50003f30 2024-03-29T04:10:36.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.459+0000 7f7f69557640 1 -- 172.21.15.73:0/1114969112 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7f5000b9c0 con 0x7f7f64147c90 2024-03-29T04:10:36.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.459+0000 7f7f6ad5a640 1 --2- 172.21.15.73:0/1114969112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f50004d40 0x7f7f500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:36.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.459+0000 7f7f69d58640 1 --2- 172.21.15.73:0/1114969112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f50003f30 0x7f7f50004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:36.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.459+0000 7f7f6a559640 1 --2- 172.21.15.73:0/1114969112 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f64147c90 0x7f7f500039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:36.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.459+0000 7f7f6ad5a640 1 -- 172.21.15.73:0/1114969112 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f64147c90 msgr2=0x7f7f500039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:36.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.459+0000 7f7f6ad5a640 1 --2- 172.21.15.73:0/1114969112 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f64147c90 0x7f7f500039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:36.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.459+0000 7f7f6ad5a640 1 -- 172.21.15.73:0/1114969112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f50003f30 msgr2=0x7f7f50004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:36.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.459+0000 7f7f6ad5a640 1 --2- 172.21.15.73:0/1114969112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f50003f30 0x7f7f50004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:36.447 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.459+0000 7f7f6ad5a640 1 -- 172.21.15.73:0/1114969112 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f50003520 con 0x7f7f50004d40 2024-03-29T04:10:36.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.460+0000 7f7f6ad5a640 1 --2- 172.21.15.73:0/1114969112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f50004d40 0x7f7f500051c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c009fc0 tx=0x7f7f50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc5d02d0cb5735f1 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:36.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.460+0000 7f7f69557640 1 -- 172.21.15.73:0/1114969112 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c039070 con 0x7f7f50004d40 2024-03-29T04:10:36.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.460+0000 7f7f69557640 1 -- 172.21.15.73:0/1114969112 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f5c02cc00 con 0x7f7f50004d40 2024-03-29T04:10:36.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.460+0000 7f7f69557640 1 -- 172.21.15.73:0/1114969112 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c009c10 con 0x7f7f50004d40 2024-03-29T04:10:36.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.460+0000 7f7f6c7bd640 1 -- 172.21.15.73:0/1114969112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f50004d40 msgr2=0x7f7f500051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:36.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.460+0000 7f7f6c7bd640 1 --2- 172.21.15.73:0/1114969112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f50004d40 0x7f7f500051c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c009fc0 tx=0x7f7f50005830 comp rx=0 tx=0).stop 2024-03-29T04:10:36.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.460+0000 7f7f6ad5a640 1 -- 172.21.15.73:0/1114969112 reap_dead start 2024-03-29T04:10:36.448 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.461+0000 7f7f6c7bd640 1 -- 172.21.15.73:0/1114969112 shutdown_connections 2024-03-29T04:10:36.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.461+0000 7f7f6c7bd640 1 -- 172.21.15.73:0/1114969112 >> 172.21.15.73:0/1114969112 conn(0x7f7f640b2340 msgr2=0x7f7f640b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:36.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.461+0000 7f7f6c7bd640 1 -- 172.21.15.73:0/1114969112 shutdown_connections 2024-03-29T04:10:36.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.461+0000 7f7f6c7bd640 1 -- 172.21.15.73:0/1114969112 wait complete. 2024-03-29T04:10:36.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.462+0000 7f7f6c7bd640 1 Processor -- start 2024-03-29T04:10:36.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.462+0000 7f7f6c7bd640 1 -- start start 2024-03-29T04:10:36.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.462+0000 7f7f6c7bd640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f50004d40 0x7f7f6415ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:36.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.462+0000 7f7f6c7bd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f641f56c0 0x7f7f64161cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:36.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.462+0000 7f7f6c7bd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f6415f4d0 0x7f7f6415f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:36.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.462+0000 7f7f6c7bd640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7f641481e0 con 0x7f7f6415f4d0 2024-03-29T04:10:36.449 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.462+0000 7f7f6c7bd640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6406e4c0 con 0x7f7f641f56c0 2024-03-29T04:10:36.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.462+0000 7f7f6c7bd640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f7f64148360 con 0x7f7f50004d40 2024-03-29T04:10:36.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.463+0000 7f7f6ad5a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f6415f4d0 0x7f7f6415f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:36.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.463+0000 7f7f6ad5a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f6415f4d0 0x7f7f6415f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54878/0 (socket says 172.21.15.73:54878) 2024-03-29T04:10:36.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.463+0000 7f7f6ad5a640 1 -- 172.21.15.73:0/2151430264 learned_addr learned my addr 172.21.15.73:0/2151430264 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:36.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.463+0000 7f7f6a559640 1 --2- 172.21.15.73:0/2151430264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f50004d40 0x7f7f6415ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:36.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.463+0000 7f7f6ad5a640 1 -- 172.21.15.73:0/2151430264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f50004d40 msgr2=0x7f7f6415ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:36.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.463+0000 7f7f69d58640 1 --2- 172.21.15.73:0/2151430264 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f641f56c0 0x7f7f64161cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:36.450 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.463+0000 7f7f6ad5a640 1 --2- 172.21.15.73:0/2151430264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f50004d40 0x7f7f6415ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:36.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.463+0000 7f7f6ad5a640 1 -- 172.21.15.73:0/2151430264 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f641f56c0 msgr2=0x7f7f64161cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:36.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.463+0000 7f7f6ad5a640 1 --2- 172.21.15.73:0/2151430264 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f641f56c0 0x7f7f64161cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:36.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.463+0000 7f7f6ad5a640 1 -- 172.21.15.73:0/2151430264 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f64145370 con 0x7f7f6415f4d0 2024-03-29T04:10:36.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.463+0000 7f7f6a559640 1 --2- 172.21.15.73:0/2151430264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f50004d40 0x7f7f6415ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:10:36.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.463+0000 7f7f69d58640 1 --2- 172.21.15.73:0/2151430264 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f641f56c0 0x7f7f64161cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-29T04:10:36.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.463+0000 7f7f6ad5a640 1 --2- 172.21.15.73:0/2151430264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f6415f4d0 0x7f7f6415f960 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c00e230 tx=0x7f7f5c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:36.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.463+0000 7f7f5affd640 1 -- 172.21.15.73:0/2151430264 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c039030 con 0x7f7f6415f4d0 2024-03-29T04:10:36.451 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.463+0000 7f7f5affd640 1 -- 172.21.15.73:0/2151430264 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f5c03a040 con 0x7f7f6415f4d0 2024-03-29T04:10:36.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.463+0000 7f7f6c7bd640 1 -- 172.21.15.73:0/2151430264 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f64145650 con 0x7f7f6415f4d0 2024-03-29T04:10:36.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.463+0000 7f7f5affd640 1 -- 172.21.15.73:0/2151430264 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c003990 con 0x7f7f6415f4d0 2024-03-29T04:10:36.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.463+0000 7f7f6c7bd640 1 -- 172.21.15.73:0/2151430264 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f64145040 con 0x7f7f6415f4d0 2024-03-29T04:10:36.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.464+0000 7f7f6c7bd640 1 -- 172.21.15.73:0/2151430264 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f64073580 con 0x7f7f6415f4d0 2024-03-29T04:10:36.452 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.465+0000 7f7f5affd640 1 -- 172.21.15.73:0/2151430264 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f7f5c045030 con 0x7f7f6415f4d0 2024-03-29T04:10:36.453 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.465+0000 7f7f5affd640 1 --2- 172.21.15.73:0/2151430264 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7f4806c560 0x7f7f4806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:36.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.465+0000 7f7f5affd640 1 -- 172.21.15.73:0/2151430264 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f7f5c0ad2c0 con 0x7f7f6415f4d0 2024-03-29T04:10:36.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.465+0000 7f7f6a559640 1 --2- 172.21.15.73:0/2151430264 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7f4806c560 0x7f7f4806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:36.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.465+0000 7f7f6a559640 1 --2- 172.21.15.73:0/2151430264 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7f4806c560 0x7f7f4806ea20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7f6413f7c0 tx=0x7f7f54009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:36.454 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.469+0000 7f7f5affd640 1 -- 172.21.15.73:0/2151430264 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f7f5c04c020 con 0x7f7f6415f4d0 2024-03-29T04:10:36.624 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.645+0000 7f7f6c7bd640 1 -- 172.21.15.73:0/2151430264 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f7f64069150 con 0x7f7f6415f4d0 2024-03-29T04:10:36.627 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.648+0000 7f7f5affd640 1 -- 172.21.15.73:0/2151430264 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7f7f5c07bc70 con 0x7f7f6415f4d0 2024-03-29T04:10:36.628 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.649+0000 7f7f5affd640 1 -- 172.21.15.73:0/2151430264 <== mon.0 v2:172.21.15.73:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7f5c009cd0 con 0x7f7f6415f4d0 2024-03-29T04:10:36.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.651+0000 7f7f6c7bd640 1 -- 172.21.15.73:0/2151430264 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7f4806c560 msgr2=0x7f7f4806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:36.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.651+0000 7f7f6c7bd640 1 --2- 172.21.15.73:0/2151430264 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7f4806c560 0x7f7f4806ea20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7f6413f7c0 tx=0x7f7f54009040 comp rx=0 tx=0).stop 2024-03-29T04:10:36.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.651+0000 7f7f6c7bd640 1 -- 172.21.15.73:0/2151430264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f6415f4d0 msgr2=0x7f7f6415f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:36.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.651+0000 7f7f6c7bd640 1 --2- 172.21.15.73:0/2151430264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f6415f4d0 0x7f7f6415f960 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c00e230 tx=0x7f7f5c009750 comp rx=0 tx=0).stop 2024-03-29T04:10:36.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.651+0000 7f7f6c7bd640 1 -- 172.21.15.73:0/2151430264 shutdown_connections 2024-03-29T04:10:36.631 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.651+0000 7f7f6c7bd640 1 --2- 172.21.15.73:0/2151430264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f6415f4d0 0x7f7f6415f960 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:36.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.651+0000 7f7f6c7bd640 1 --2- 172.21.15.73:0/2151430264 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f7f4806c560 0x7f7f4806ea20 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:36.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.651+0000 7f7f6c7bd640 1 --2- 172.21.15.73:0/2151430264 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f641f56c0 0x7f7f64161cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:36.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.651+0000 7f7f6c7bd640 1 --2- 172.21.15.73:0/2151430264 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f7f50004d40 0x7f7f6415ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:36.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.651+0000 7f7f6c7bd640 1 -- 172.21.15.73:0/2151430264 >> 172.21.15.73:0/2151430264 conn(0x7f7f640b2340 msgr2=0x7f7f640b4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:36.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.651+0000 7f7f6c7bd640 1 -- 172.21.15.73:0/2151430264 shutdown_connections 2024-03-29T04:10:36.632 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.651+0000 7f7f6c7bd640 1 -- 172.21.15.73:0/2151430264 wait complete. 2024-03-29T04:10:36.641 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-29T04:10:36.642 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-29T04:10:36.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.763+0000 7f529e4f1640 1 Processor -- start 2024-03-29T04:10:36.743 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.763+0000 7f529e4f1640 1 -- start start 2024-03-29T04:10:36.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.764+0000 7f529e4f1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f529815b370 0x7f52980b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:36.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.764+0000 7f529e4f1640 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5298071ae0 con 0x7f529806f3f0 2024-03-29T04:10:36.749 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.764+0000 7f529e4f1640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5298071dc0 con 0x7f5298073290 2024-03-29T04:10:36.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.764+0000 7f529e4f1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f52980720a0 con 0x7f529815b370 2024-03-29T04:10:36.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.764+0000 7f52977fe640 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f529806f3f0 0x7f5298072b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:47668/0 (socket says 172.21.15.73:47668) 2024-03-29T04:10:36.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.764+0000 7f52977fe640 1 -- 172.21.15.73:0/1475976308 learned_addr learned my addr 172.21.15.73:0/1475976308 (peer_addr_for_me v1:172.21.15.73:0/0) 2024-03-29T04:10:36.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.765+0000 7f5296ffd640 1 -- 172.21.15.73:0/1475976308 <== mon.0 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4150663110 0 0) 0x7f5298071ae0 con 0x7f529806f3f0 2024-03-29T04:10:36.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.765+0000 7f5296ffd640 1 -- 172.21.15.73:0/1475976308 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5280003520 con 0x7f529806f3f0 2024-03-29T04:10:36.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.765+0000 7f5297fff640 1 --2- 172.21.15.73:0/1475976308 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f529815b370 0x7f52980b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:36.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.765+0000 7f5296ffd640 1 -- 172.21.15.73:0/1475976308 <== mon.0 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1252932466 0 0) 0x7f5280003520 con 0x7f529806f3f0 2024-03-29T04:10:36.750 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.765+0000 7f5296ffd640 1 -- 172.21.15.73:0/1475976308 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f529815b370 msgr2=0x7f52980b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:36.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.765+0000 7f5296ffd640 1 --2- 172.21.15.73:0/1475976308 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f529815b370 0x7f52980b32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:36.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.765+0000 7f5296ffd640 1 -- 172.21.15.73:0/1475976308 >> v1:172.21.15.142:6789/0 conn(0x7f5298073290 legacy=0x7f529815f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:36.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.765+0000 7f5296ffd640 1 -- 172.21.15.73:0/1475976308 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5298072380 con 0x7f529806f3f0 2024-03-29T04:10:36.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.765+0000 7f5296ffd640 1 -- 172.21.15.73:0/1475976308 <== mon.0 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1290421750 0 0) 0x7f528c001670 con 0x7f529806f3f0 2024-03-29T04:10:36.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.765+0000 7f5296ffd640 1 -- 172.21.15.73:0/1475976308 >> v1:172.21.15.73:6789/0 conn(0x7f529806f3f0 legacy=0x7f5298072b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:36.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.765+0000 7f5296ffd640 1 --2- 172.21.15.73:0/1475976308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52800039e0 0x7f5280003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:36.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.765+0000 7f5296ffd640 1 --2- 172.21.15.73:0/1475976308 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f529815b370 0x7f5280004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:36.751 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.765+0000 7f5296ffd640 1 --2- 172.21.15.73:0/1475976308 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5280004d40 0x7f52800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:36.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.765+0000 7f5296ffd640 1 -- 172.21.15.73:0/1475976308 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f52980720a0 con 0x7f5280004d40 2024-03-29T04:10:36.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.765+0000 7f5296ffd640 1 -- 172.21.15.73:0/1475976308 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f528000bb50 con 0x7f52800039e0 2024-03-29T04:10:36.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.765+0000 7f5296ffd640 1 -- 172.21.15.73:0/1475976308 --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f528000bd20 con 0x7f529815b370 2024-03-29T04:10:36.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.765+0000 7f529ca8e640 1 --2- 172.21.15.73:0/1475976308 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5280004d40 0x7f52800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:36.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.765+0000 7f5297fff640 1 --2- 172.21.15.73:0/1475976308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52800039e0 0x7f5280003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:36.752 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.765+0000 7f52977fe640 1 --2- 172.21.15.73:0/1475976308 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f529815b370 0x7f5280004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:36.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.765+0000 7f529ca8e640 1 -- 172.21.15.73:0/1475976308 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f529815b370 msgr2=0x7f5280004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:36.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.765+0000 7f529ca8e640 1 --2- 172.21.15.73:0/1475976308 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f529815b370 0x7f5280004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:36.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.765+0000 7f529ca8e640 1 -- 172.21.15.73:0/1475976308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52800039e0 msgr2=0x7f5280003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-29T04:10:36.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.765+0000 7f529ca8e640 1 --2- 172.21.15.73:0/1475976308 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52800039e0 0x7f5280003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:36.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.765+0000 7f529ca8e640 1 -- 172.21.15.73:0/1475976308 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5280003520 con 0x7f5280004d40 2024-03-29T04:10:36.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.766+0000 7f529ca8e640 1 --2- 172.21.15.73:0/1475976308 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5280004d40 0x7f52800051c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5290001e80 tx=0x7f5280005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94a7e8a5e4989603 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:36.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.766+0000 7f5296ffd640 1 -- 172.21.15.73:0/1475976308 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5290001a70 con 0x7f5280004d40 2024-03-29T04:10:36.753 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.766+0000 7f5296ffd640 1 -- 172.21.15.73:0/1475976308 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5290003b70 con 0x7f5280004d40 2024-03-29T04:10:36.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.766+0000 7f5296ffd640 1 -- 172.21.15.73:0/1475976308 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52900050d0 con 0x7f5280004d40 2024-03-29T04:10:36.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.767+0000 7f529e4f1640 1 -- 172.21.15.73:0/1475976308 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5280004d40 msgr2=0x7f52800051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:36.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.767+0000 7f529e4f1640 1 --2- 172.21.15.73:0/1475976308 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5280004d40 0x7f52800051c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5290001e80 tx=0x7f5280005830 comp rx=0 tx=0).stop 2024-03-29T04:10:36.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.767+0000 7f529ca8e640 1 -- 172.21.15.73:0/1475976308 reap_dead start 2024-03-29T04:10:36.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.767+0000 7f529e4f1640 1 -- 172.21.15.73:0/1475976308 shutdown_connections 2024-03-29T04:10:36.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.767+0000 7f529e4f1640 1 -- 172.21.15.73:0/1475976308 >> 172.21.15.73:0/1475976308 conn(0x7f529806b510 msgr2=0x7f529806b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:36.754 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.767+0000 7f529e4f1640 1 -- 172.21.15.73:0/1475976308 shutdown_connections 2024-03-29T04:10:36.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.767+0000 7f529e4f1640 1 -- 172.21.15.73:0/1475976308 wait complete. 2024-03-29T04:10:36.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.768+0000 7f529e4f1640 1 Processor -- start 2024-03-29T04:10:36.755 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.768+0000 7f529e4f1640 1 -- start start 2024-03-29T04:10:36.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.769+0000 7f529e4f1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52981561b0 0x7f5298157e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:36.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.769+0000 7f529e4f1640 1 --2- >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52981583c0 0x7f52981e5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:36.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.769+0000 7f529e4f1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52981e64c0 0x7f5298159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:36.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.769+0000 7f529e4f1640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f529815b8d0 con 0x7f52981e64c0 2024-03-29T04:10:36.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.769+0000 7f529e4f1640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f529815b750 con 0x7f52981561b0 2024-03-29T04:10:36.758 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.769+0000 7f529e4f1640 1 -- --> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] -- mon_getmap magic: 0 -- 0x7f52980b32c0 con 0x7f52981583c0 2024-03-29T04:10:36.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.769+0000 7f529ca8e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52981e64c0 0x7f5298159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:36.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.769+0000 7f529ca8e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52981e64c0 0x7f5298159b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:54890/0 (socket says 172.21.15.73:54890) 2024-03-29T04:10:36.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.769+0000 7f529ca8e640 1 -- 172.21.15.73:0/1937823914 learned_addr learned my addr 172.21.15.73:0/1937823914 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-03-29T04:10:36.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.769+0000 7f52977fe640 1 --2- 172.21.15.73:0/1937823914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52981583c0 0x7f52981e5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:36.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.769+0000 7f529ca8e640 1 -- 172.21.15.73:0/1937823914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52981583c0 msgr2=0x7f52981e5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:36.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.769+0000 7f529ca8e640 1 --2- 172.21.15.73:0/1937823914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52981583c0 0x7f52981e5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:36.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.769+0000 7f529ca8e640 1 -- 172.21.15.73:0/1937823914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52981561b0 msgr2=0x7f5298157e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:36.759 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.769+0000 7f529ca8e640 1 --2- 172.21.15.73:0/1937823914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52981561b0 0x7f5298157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:36.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.769+0000 7f529ca8e640 1 -- 172.21.15.73:0/1937823914 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f529815c430 con 0x7f52981e64c0 2024-03-29T04:10:36.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.769+0000 7f529ca8e640 1 --2- 172.21.15.73:0/1937823914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52981e64c0 0x7f5298159b40 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5290005040 tx=0x7f52900014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:36.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.769+0000 7f5294ff9640 1 -- 172.21.15.73:0/1937823914 <== mon.0 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5290007db0 con 0x7f52981e64c0 2024-03-29T04:10:36.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.770+0000 7f5294ff9640 1 -- 172.21.15.73:0/1937823914 <== mon.0 v2:172.21.15.73:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5290003970 con 0x7f52981e64c0 2024-03-29T04:10:36.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.770+0000 7f5294ff9640 1 -- 172.21.15.73:0/1937823914 <== mon.0 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5290006d90 con 0x7f52981e64c0 2024-03-29T04:10:36.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.770+0000 7f529e4f1640 1 -- 172.21.15.73:0/1937823914 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f529815c6b0 con 0x7f52981e64c0 2024-03-29T04:10:36.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.770+0000 7f529e4f1640 1 -- 172.21.15.73:0/1937823914 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f529815cc70 con 0x7f52981e64c0 2024-03-29T04:10:36.760 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.771+0000 7f529e4f1640 1 -- 172.21.15.73:0/1937823914 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5298068640 con 0x7f52981e64c0 2024-03-29T04:10:36.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.771+0000 7f5294ff9640 1 -- 172.21.15.73:0/1937823914 <== mon.0 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f5290041030 con 0x7f52981e64c0 2024-03-29T04:10:36.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.771+0000 7f5294ff9640 1 --2- 172.21.15.73:0/1937823914 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f528406c530 0x7f528406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-29T04:10:36.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.771+0000 7f5294ff9640 1 -- 172.21.15.73:0/1937823914 <== mon.0 v2:172.21.15.73:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f52900ac4b0 con 0x7f52981e64c0 2024-03-29T04:10:36.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.771+0000 7f5297fff640 1 --2- 172.21.15.73:0/1937823914 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f528406c530 0x7f528406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-29T04:10:36.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.772+0000 7f5297fff640 1 --2- 172.21.15.73:0/1937823914 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f528406c530 0x7f528406e9f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5288006a90 tx=0x7f5288006a20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-29T04:10:36.761 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.776+0000 7f5294ff9640 1 -- 172.21.15.73:0/1937823914 <== mon.0 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186564 (secure 0 0 0) 0x7f529815c430 con 0x7f52981e64c0 2024-03-29T04:10:36.971 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.992+0000 7f529e4f1640 1 -- 172.21.15.73:0/1937823914 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f52980d0000 con 0x7f52981e64c0 2024-03-29T04:10:36.972 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.992+0000 7f5294ff9640 1 -- 172.21.15.73:0/1937823914 <== mon.0 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+3872 (secure 0 0 0) 0x7f5290033020 con 0x7f52981e64c0 2024-03-29T04:10:36.972 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-03-29T04:10:36.972 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":17,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4739,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/1125143848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6835","nonce":1125143848},{"type":"v1","addr":"172.21.15.73:6837","nonce":1125143848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4742,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2988261972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6833","nonce":2988261972},{"type":"v1","addr":"172.21.15.142:6835","nonce":2988261972}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5029,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6834/510984531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":510984531},{"type":"v1","addr":"172.21.15.142:6834","nonce":510984531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5502,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6836/1392290741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1392290741},{"type":"v1","addr":"172.21.15.73:6836","nonce":1392290741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[]} 2024-03-29T04:10:36.972 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 17 2024-03-29T04:10:36.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.994+0000 7f529e4f1640 1 -- 172.21.15.73:0/1937823914 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f528406c530 msgr2=0x7f528406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:36.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.994+0000 7f529e4f1640 1 --2- 172.21.15.73:0/1937823914 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f528406c530 0x7f528406e9f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5288006a90 tx=0x7f5288006a20 comp rx=0 tx=0).stop 2024-03-29T04:10:36.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.994+0000 7f529e4f1640 1 -- 172.21.15.73:0/1937823914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52981e64c0 msgr2=0x7f5298159b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-29T04:10:36.974 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.994+0000 7f529e4f1640 1 --2- 172.21.15.73:0/1937823914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52981e64c0 0x7f5298159b40 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5290005040 tx=0x7f52900014a0 comp rx=0 tx=0).stop 2024-03-29T04:10:36.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.994+0000 7f529e4f1640 1 -- 172.21.15.73:0/1937823914 shutdown_connections 2024-03-29T04:10:36.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.994+0000 7f529e4f1640 1 --2- 172.21.15.73:0/1937823914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52981e64c0 0x7f5298159b40 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:36.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.994+0000 7f529e4f1640 1 --2- 172.21.15.73:0/1937823914 >> [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] conn(0x7f52981583c0 0x7f52981e5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:36.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.994+0000 7f529e4f1640 1 --2- 172.21.15.73:0/1937823914 >> [v2:172.21.15.73:6832/1640471941,v1:172.21.15.73:6833/1640471941] conn(0x7f528406c530 0x7f528406e9f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:36.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.994+0000 7f529e4f1640 1 --2- 172.21.15.73:0/1937823914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52981561b0 0x7f5298157e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-29T04:10:36.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.994+0000 7f529e4f1640 1 -- 172.21.15.73:0/1937823914 >> 172.21.15.73:0/1937823914 conn(0x7f529806b510 msgr2=0x7f52980cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-29T04:10:36.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.994+0000 7f529e4f1640 1 -- 172.21.15.73:0/1937823914 shutdown_connections 2024-03-29T04:10:36.975 INFO:teuthology.orchestra.run.smithi073.stderr:2024-03-29T04:10:36.994+0000 7f529e4f1640 1 -- 172.21.15.73:0/1937823914 wait complete. 2024-03-29T04:10:36.984 DEBUG:tasks.cephfs.filesystem:already dead... 2024-03-29T04:10:36.985 INFO:teuthology.misc:Shutting down mds daemons... 2024-03-29T04:10:36.985 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-29T04:10:36.985 INFO:teuthology.orchestra.run:waiting for 300 2024-03-29T04:10:36.994 INFO:tasks.ceph.mds.a:Stopped 2024-03-29T04:10:36.994 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-29T04:10:36.994 INFO:teuthology.orchestra.run:waiting for 300 2024-03-29T04:10:37.043 INFO:tasks.ceph.mds.c:Stopped 2024-03-29T04:10:37.044 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-29T04:10:37.044 INFO:teuthology.orchestra.run:waiting for 300 2024-03-29T04:10:37.055 INFO:tasks.ceph.mds.b:Stopped 2024-03-29T04:10:37.056 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-29T04:10:37.056 INFO:teuthology.orchestra.run:waiting for 300 2024-03-29T04:10:37.107 INFO:tasks.ceph.mds.d:Stopped 2024-03-29T04:10:37.108 INFO:teuthology.misc:Shutting down osd daemons... 2024-03-29T04:10:37.108 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-03-29T04:10:37.108 INFO:teuthology.orchestra.run:waiting for 300 2024-03-29T04:10:37.135 INFO:tasks.ceph.osd.0:Stopped 2024-03-29T04:10:37.135 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-03-29T04:10:37.135 INFO:teuthology.orchestra.run:waiting for 300 2024-03-29T04:10:37.210 INFO:tasks.ceph.osd.1:Stopped 2024-03-29T04:10:37.210 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-03-29T04:10:37.210 INFO:teuthology.orchestra.run:waiting for 300 2024-03-29T04:10:37.274 INFO:tasks.ceph.osd.2:Stopped 2024-03-29T04:10:37.275 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-03-29T04:10:37.275 INFO:teuthology.orchestra.run:waiting for 300 2024-03-29T04:10:37.338 INFO:tasks.ceph.osd.3:Stopped 2024-03-29T04:10:37.338 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-03-29T04:10:37.338 INFO:teuthology.orchestra.run:waiting for 300 2024-03-29T04:10:37.378 INFO:tasks.ceph.osd.4:Stopped 2024-03-29T04:10:37.379 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-03-29T04:10:37.379 INFO:teuthology.orchestra.run:waiting for 300 2024-03-29T04:10:37.453 INFO:tasks.ceph.osd.5:Stopped 2024-03-29T04:10:37.454 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-03-29T04:10:37.454 INFO:teuthology.orchestra.run:waiting for 300 2024-03-29T04:10:37.524 INFO:tasks.ceph.osd.6:Stopped 2024-03-29T04:10:37.525 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-03-29T04:10:37.525 INFO:teuthology.orchestra.run:waiting for 300 2024-03-29T04:10:37.602 INFO:tasks.ceph.osd.7:Stopped 2024-03-29T04:10:37.602 INFO:teuthology.misc:Shutting down mgr daemons... 2024-03-29T04:10:37.603 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-03-29T04:10:37.603 INFO:teuthology.orchestra.run:waiting for 300 2024-03-29T04:10:37.628 INFO:tasks.ceph.mgr.y:Stopped 2024-03-29T04:10:37.629 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-03-29T04:10:37.629 INFO:teuthology.orchestra.run:waiting for 300 2024-03-29T04:10:37.668 INFO:tasks.ceph.mgr.x:Stopped 2024-03-29T04:10:37.668 INFO:teuthology.misc:Shutting down mon daemons... 2024-03-29T04:10:37.669 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-29T04:10:37.669 INFO:teuthology.orchestra.run:waiting for 300 2024-03-29T04:10:37.681 INFO:tasks.ceph.mon.a:Stopped 2024-03-29T04:10:37.681 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-29T04:10:37.681 INFO:teuthology.orchestra.run:waiting for 300 2024-03-29T04:10:37.721 INFO:tasks.ceph.mon.b:Stopped 2024-03-29T04:10:37.721 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-29T04:10:37.721 INFO:teuthology.orchestra.run:waiting for 300 2024-03-29T04:10:37.773 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-03-29T04:10:37.773 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-03-29T04:10:37.774 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-03-29T04:10:37.774 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-03-29T04:10:37.774 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-03-29T04:10:37.774 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-03-29T04:10:37.774 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-03-29T04:10:37.774 INFO:tasks.ceph.mon.c:Stopped 2024-03-29T04:10:37.775 INFO:tasks.ceph:Checking cluster log for badness... 2024-03-29T04:10:37.775 DEBUG:teuthology.orchestra.run.smithi073:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-03-29T04:10:37.818 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi073.front.sepia.ceph.com 2024-03-29T04:10:37.819 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-03-29T04:10:38.043 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi073.front.sepia.ceph.com 2024-03-29T04:10:38.044 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-03-29T04:10:38.148 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi073.front.sepia.ceph.com 2024-03-29T04:10:38.149 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-03-29T04:10:38.205 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi073.front.sepia.ceph.com 2024-03-29T04:10:38.206 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-03-29T04:10:38.270 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi142.front.sepia.ceph.com 2024-03-29T04:10:38.270 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-03-29T04:10:38.423 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi142.front.sepia.ceph.com 2024-03-29T04:10:38.423 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-03-29T04:10:38.503 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi142.front.sepia.ceph.com 2024-03-29T04:10:38.503 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-03-29T04:10:38.561 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi142.front.sepia.ceph.com 2024-03-29T04:10:38.562 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-03-29T04:10:38.620 INFO:tasks.ceph:Archiving mon data... 2024-03-29T04:10:38.622 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/mchangir-2024-03-29_02:01:30-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629079/data/mon.a.tgz 2024-03-29T04:10:38.622 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-03-29T04:10:38.639 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.BZnnQYuB6c 2024-03-29T04:10:38.640 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.BZnnQYuB6c 2024-03-29T04:10:38.759 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.BZnnQYuB6c 2024-03-29T04:10:38.846 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.BZnnQYuB6c is 290KB 2024-03-29T04:10:38.945 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.BZnnQYuB6c 2024-03-29T04:10:38.961 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/mchangir-2024-03-29_02:01:30-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629079/data/mon.b.tgz 2024-03-29T04:10:38.961 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2024-03-29T04:10:38.979 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.lLM9NxUEFB 2024-03-29T04:10:38.980 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.lLM9NxUEFB 2024-03-29T04:10:39.137 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.lLM9NxUEFB 2024-03-29T04:10:39.224 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.lLM9NxUEFB is 387KB 2024-03-29T04:10:39.321 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.lLM9NxUEFB 2024-03-29T04:10:39.335 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/mchangir-2024-03-29_02:01:30-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629079/data/mon.c.tgz 2024-03-29T04:10:39.335 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2024-03-29T04:10:39.390 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.ERdaTOVdzG 2024-03-29T04:10:39.391 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.ERdaTOVdzG 2024-03-29T04:10:39.526 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.ERdaTOVdzG 2024-03-29T04:10:39.611 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.ERdaTOVdzG is 387KB 2024-03-29T04:10:39.707 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.ERdaTOVdzG 2024-03-29T04:10:39.722 INFO:tasks.ceph:Cleaning ceph cluster... 2024-03-29T04:10:39.722 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-29T04:10:39.724 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-29T04:10:39.807 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-29T04:10:39.843 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-29T04:10:39.844 INFO:tasks.ceph:Archiving crash dumps... 2024-03-29T04:10:39.845 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-03-29_02:01:30-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629079/remote/smithi073/crash 2024-03-29T04:10:39.846 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-29T04:10:39.875 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-03-29_02:01:30-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629079/remote/smithi142/crash 2024-03-29T04:10:39.876 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-29T04:10:39.910 INFO:tasks.ceph:Shutting down logrotate 2024-03-29T04:10:39.910 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-29T04:10:39.921 DEBUG:teuthology.orchestra.run.smithi142:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-29T04:10:39.996 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-29T04:10:40.024 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-29T04:10:40.062 INFO:tasks.ceph:Compressing logs... 2024-03-29T04:10:40.063 DEBUG:teuthology.orchestra.run.smithi073:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-29T04:10:40.066 DEBUG:teuthology.orchestra.run.smithi142:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-29T04:10:40.162 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37525.log 2024-03-29T04:10:40.162 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-03-29T04:10:40.162 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.37525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37325.log 2024-03-29T04:10:40.163 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.6.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37525.log.gz 2024-03-29T04:10:40.163 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37445.log 2024-03-29T04:10:40.163 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.37325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.43915.log 2024-03-29T04:10:40.163 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.37445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44518.log 2024-03-29T04:10:40.163 INFO:teuthology.orchestra.run.smithi142.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37325.log.gz 2024-03-29T04:10:40.163 INFO:teuthology.orchestra.run.smithi142.stderr: 87.4%/var/log/ceph/ceph-client.3.43915.log: -- replaced with /var/log/ceph/ceph-client.admin.37445.log.gz 2024-03-29T04:10:40.163 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-29T04:10:40.163 INFO:teuthology.orchestra.run.smithi142.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.43915.log.gz 2024-03-29T04:10:40.163 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.1.44518.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-03-29T04:10:40.164 INFO:teuthology.orchestra.run.smithi142.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44518.log.gz 2024-03-29T04:10:40.164 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37405.log 2024-03-29T04:10:40.164 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-03-29T04:10:40.164 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.37405.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-03-29T04:10:40.164 INFO:teuthology.orchestra.run.smithi142.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37405.log.gz 2024-03-29T04:10:40.164 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43510.log 2024-03-29T04:10:40.164 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-03-29T04:10:40.164 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.1.43510.log: gzip 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-29T04:10:40.165 INFO:teuthology.orchestra.run.smithi142.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43510.log.gz 2024-03-29T04:10:40.165 INFO:teuthology.orchestra.run.smithi142.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.37285.log 2024-03-29T04:10:40.165 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44522.log 2024-03-29T04:10:40.165 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.37285.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-03-29T04:10:40.165 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.1.44522.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37285.log.gz 2024-03-29T04:10:40.165 INFO:teuthology.orchestra.run.smithi142.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44522.log.gz 2024-03-29T04:10:40.165 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37485.log 2024-03-29T04:10:40.165 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose/var/log/ceph/ceph-mgr.x.log: -- /var/log/ceph/ceph-client.3.43911.log 2024-03-29T04:10:40.165 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.37485.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-29T04:10:40.166 INFO:teuthology.orchestra.run.smithi142.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37485.log.gz 2024-03-29T04:10:40.166 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.3.43911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37565.log 2024-03-29T04:10:40.166 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.43911.log.gz 2024-03-29T04:10:40.166 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-03-29T04:10:40.166 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.37565.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37565.log.gz 2024-03-29T04:10:40.166 INFO:teuthology.orchestra.run.smithi142.stderr: 91.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-29T04:10:40.166 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-03-29T04:10:40.166 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43515.log 2024-03-29T04:10:40.167 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mds.d.log: 92.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-03-29T04:10:40.167 INFO:teuthology.orchestra.run.smithi142.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-03-29T04:10:40.167 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37365.log 2024-03-29T04:10:40.167 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.1.43515.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-03-29T04:10:40.167 INFO:teuthology.orchestra.run.smithi142.stderr: -- replaced with /var/log/ceph/ceph-client.1.43515.log.gz 2024-03-29T04:10:40.167 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.37365.log: /var/log/ceph/ceph-mon.c.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37365.log.gz 2024-03-29T04:10:40.189 INFO:teuthology.orchestra.run.smithi142.stderr: 94.3% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-03-29T04:10:40.197 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42860.log 2024-03-29T04:10:40.198 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46203.log 2024-03-29T04:10:40.198 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.42860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52129.log 2024-03-29T04:10:40.198 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.46203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48480.log 2024-03-29T04:10:40.198 INFO:teuthology.orchestra.run.smithi073.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42860.log.gz 2024-03-29T04:10:40.198 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.52129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44770.log 2024-03-29T04:10:40.198 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46203.log.gz 2024-03-29T04:10:40.198 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.48480.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52129.log.gz 2024-03-29T04:10:40.199 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46593.log 2024-03-29T04:10:40.199 INFO:teuthology.orchestra.run.smithi073.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48480.log.gz 2024-03-29T04:10:40.199 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49444.log 2024-03-29T04:10:40.199 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.46593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46761.log 2024-03-29T04:10:40.199 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44770.log.gz 2024-03-29T04:10:40.199 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.49444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44896.log 2024-03-29T04:10:40.199 INFO:teuthology.orchestra.run.smithi073.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46593.log.gz 2024-03-29T04:10:40.199 INFO:teuthology.orchestra.run.smithi073.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49444.log.gz 2024-03-29T04:10:40.200 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.46761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49400.log 2024-03-29T04:10:40.200 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44896.log: gzip 89.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.46761.log.gz --verbose 2024-03-29T04:10:40.200 INFO:teuthology.orchestra.run.smithi073.stderr: -- /var/log/ceph/ceph-mon.a.log 2024-03-29T04:10:40.200 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.49400.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44896.log.gz 2024-03-29T04:10:40.200 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49188.log 2024-03-29T04:10:40.200 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 89.1% --verbose -- replaced with /var/log/ceph/ceph-client.admin.49400.log.gz -- 2024-03-29T04:10:40.200 INFO:teuthology.orchestra.run.smithi073.stderr: /var/log/ceph/ceph-client.admin.44274.log 2024-03-29T04:10:40.200 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.49188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43943.log 2024-03-29T04:10:40.200 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44476.log 2024-03-29T04:10:40.201 INFO:teuthology.orchestra.run.smithi073.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49188.log.gz 2024-03-29T04:10:40.201 INFO:teuthology.orchestra.run.smithi073.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44274.log.gz 2024-03-29T04:10:40.201 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46287.log 2024-03-29T04:10:40.201 INFO:teuthology.orchestra.run.smithi073.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43943.log.gz 2024-03-29T04:10:40.201 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51446.log 2024-03-29T04:10:40.201 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.46287.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44476.log.gz 2024-03-29T04:10:40.201 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46414.log 2024-03-29T04:10:40.201 INFO:teuthology.orchestra.run.smithi073.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46287.log.gz 2024-03-29T04:10:40.202 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.51446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49019.log 2024-03-29T04:10:40.202 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.46414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49709.log 2024-03-29T04:10:40.202 INFO:teuthology.orchestra.run.smithi073.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51446.log.gz 2024-03-29T04:10:40.202 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.49019.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46414.log.gz 2024-03-29T04:10:40.202 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43300.log 2024-03-29T04:10:40.202 INFO:teuthology.orchestra.run.smithi073.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49019.log.gz 2024-03-29T04:10:40.202 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.49709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47640.log 2024-03-29T04:10:40.202 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50833.log 2024-03-29T04:10:40.203 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49709.log.gz 2024-03-29T04:10:40.203 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.47640.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43300.log.gz 2024-03-29T04:10:40.203 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43636.log 2024-03-29T04:10:40.203 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47640.log.gz 2024-03-29T04:10:40.203 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.50833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44279.log 2024-03-29T04:10:40.203 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43944.log 2024-03-29T04:10:40.203 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44279.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43636.log.gz 2024-03-29T04:10:40.204 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51362.log 2024-03-29T04:10:40.204 INFO:teuthology.orchestra.run.smithi073.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.50833.log.gz 2024-03-29T04:10:40.204 INFO:teuthology.orchestra.run.smithi073.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44279.log.gz 2024-03-29T04:10:40.204 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44267.log 2024-03-29T04:10:40.204 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43944.log: /var/log/ceph/ceph-client.admin.51362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50749.log 2024-03-29T04:10:40.204 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43944.log.gz 2024-03-29T04:10:40.204 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44267.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51362.log.gz 2024-03-29T04:10:40.204 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48312.log 2024-03-29T04:10:40.205 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.50749.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44267.log.gz 2024-03-29T04:10:40.205 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52914.log 2024-03-29T04:10:40.205 INFO:teuthology.orchestra.run.smithi073.stderr:gzip/var/log/ceph/ceph-client.admin.48312.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.51793.log 2024-03-29T04:10:40.205 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.52914.log: 88.4%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.48312.log.gz 2024-03-29T04:10:40.205 INFO:teuthology.orchestra.run.smithi073.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44278.log 2024-03-29T04:10:40.205 INFO:teuthology.orchestra.run.smithi073.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.50749.log.gz 2024-03-29T04:10:40.205 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52914.log.gz 2024-03-29T04:10:40.205 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.51793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49877.log 2024-03-29T04:10:40.206 INFO:teuthology.orchestra.run.smithi073.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51793.log.gz 2024-03-29T04:10:40.206 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52829.log 2024-03-29T04:10:40.206 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.49877.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44278.log.gz 2024-03-29T04:10:40.206 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50021.log 2024-03-29T04:10:40.206 INFO:teuthology.orchestra.run.smithi073.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49877.log.gz 2024-03-29T04:10:40.206 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.52829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53460.log 2024-03-29T04:10:40.206 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.50021.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52829.log.gz 2024-03-29T04:10:40.206 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42764.log 2024-03-29T04:10:40.206 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.53460.log: gzip 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50021.log.gz -5 2024-03-29T04:10:40.207 INFO:teuthology.orchestra.run.smithi073.stderr: --verbose -- /var/log/ceph/ceph-client.0.50363.log 2024-03-29T04:10:40.207 INFO:teuthology.orchestra.run.smithi073.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53460.log.gz 2024-03-29T04:10:40.207 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.42764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49537.log 2024-03-29T04:10:40.207 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42764.log.gz 2024-03-29T04:10:40.207 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43940.log 2024-03-29T04:10:40.207 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.50363.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50363.log.gz 2024-03-29T04:10:40.207 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.49537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46464.log 2024-03-29T04:10:40.207 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43940.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49537.log.gz 2024-03-29T04:10:40.208 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52418.log 2024-03-29T04:10:40.208 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.46464.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43940.log.gz 2024-03-29T04:10:40.208 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51735.log 2024-03-29T04:10:40.208 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.52418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44812.log 88.6% 2024-03-29T04:10:40.208 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46464.log.gz 2024-03-29T04:10:40.208 INFO:teuthology.orchestra.run.smithi073.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52418.log.gz 2024-03-29T04:10:40.208 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.51735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49356.log 2024-03-29T04:10:40.208 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51735.log.gz 2024-03-29T04:10:40.208 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52872.log 2024-03-29T04:10:40.209 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.49356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46887.log 2024-03-29T04:10:40.209 INFO:teuthology.orchestra.run.smithi073.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44812.log.gz 2024-03-29T04:10:40.209 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.52872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51650.log 2024-03-29T04:10:40.209 INFO:teuthology.orchestra.run.smithi073.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49356.log.gz 2024-03-29T04:10:40.209 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.46887.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52872.log.gz 2024-03-29T04:10:40.209 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47394.log 2024-03-29T04:10:40.209 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.51650.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46887.log.gz 2024-03-29T04:10:40.209 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49146.log 2024-03-29T04:10:40.210 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.47394.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51650.log.gz 2024-03-29T04:10:40.210 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48648.log 2024-03-29T04:10:40.210 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47394.log.gz 2024-03-29T04:10:40.210 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.49146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47940.log 2024-03-29T04:10:40.210 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.48648.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49146.log.gz 2024-03-29T04:10:40.210 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44980.log 2024-03-29T04:10:40.210 INFO:teuthology.orchestra.run.smithi073.stderr: 88.1%/var/log/ceph/ceph-client.admin.47940.log: -- replaced with /var/log/ceph/ceph-client.admin.48648.log.gz 2024-03-29T04:10:40.210 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44728.log 2024-03-29T04:10:40.211 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47940.log.gz 2024-03-29T04:10:40.211 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52087.log 2024-03-29T04:10:40.211 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44980.log.gz 2024-03-29T04:10:40.211 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51566.log 2024-03-29T04:10:40.211 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.52087.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44728.log.gz 2024-03-29T04:10:40.211 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44644.log 2024-03-29T04:10:40.211 INFO:teuthology.orchestra.run.smithi073.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52087.log.gz 2024-03-29T04:10:40.211 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.51566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44280.log 2024-03-29T04:10:40.211 INFO:teuthology.orchestra.run.smithi073.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51566.log.gz 2024-03-29T04:10:40.212 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46245.log 2024-03-29T04:10:40.212 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50683.log 2024-03-29T04:10:40.212 INFO:teuthology.orchestra.run.smithi073.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44644.log.gz 2024-03-29T04:10:40.212 INFO:teuthology.orchestra.run.smithi073.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44280.log.gz 2024-03-29T04:10:40.212 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.46245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43941.log 2024-03-29T04:10:40.212 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46245.log.gz 2024-03-29T04:10:40.212 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.50683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53584.log 2024-03-29T04:10:40.212 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44854.log 2024-03-29T04:10:40.213 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.53584.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43941.log.gz 2024-03-29T04:10:40.213 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37612.log 2024-03-29T04:10:40.213 INFO:teuthology.orchestra.run.smithi073.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53584.log.gz 2024-03-29T04:10:40.213 INFO:teuthology.orchestra.run.smithi073.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.50683.log.gz 2024-03-29T04:10:40.213 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49979.log 2024-03-29T04:10:40.213 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44854.log: /var/log/ceph/ceph-client.admin.37612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45720.log 2024-03-29T04:10:40.213 INFO:teuthology.orchestra.run.smithi073.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44854.log.gz 2024-03-29T04:10:40.213 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.49979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43426.log 2024-03-29T04:10:40.213 INFO:teuthology.orchestra.run.smithi073.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.37612.log.gz 2024-03-29T04:10:40.214 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.45720.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49979.log.gz 2024-03-29T04:10:40.214 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48270.log 2024-03-29T04:10:40.214 INFO:teuthology.orchestra.run.smithi073.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45720.log.gz 2024-03-29T04:10:40.214 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53418.log 2024-03-29T04:10:40.214 INFO:teuthology.orchestra.run.smithi073.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43426.log.gz 2024-03-29T04:10:40.214 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.48270.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-29T04:10:40.214 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.53418.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48270.log.gz 2024-03-29T04:10:40.214 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51488.log 2024-03-29T04:10:40.214 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53418.log.gz 2024-03-29T04:10:40.215 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53502.log 2024-03-29T04:10:40.215 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.51488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48935.log 2024-03-29T04:10:40.215 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.53502.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51488.log.gz 2024-03-29T04:10:40.215 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44518.log 2024-03-29T04:10:40.215 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48396.log 2024-03-29T04:10:40.215 INFO:teuthology.orchestra.run.smithi073.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53502.log.gz 2024-03-29T04:10:40.215 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.48935.log: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-29T04:10:40.215 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49793.log 2024-03-29T04:10:40.216 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48935.log.gz 2024-03-29T04:10:40.216 INFO:teuthology.orchestra.run.smithi073.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44518.log.gz 2024-03-29T04:10:40.216 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50171.log 2024-03-29T04:10:40.216 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.48396.log: /var/log/ceph/ceph-client.admin.49793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48102.log 2024-03-29T04:10:40.216 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48396.log.gz 2024-03-29T04:10:40.216 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.50171.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49793.log.gz 2024-03-29T04:10:40.216 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43933.log 2024-03-29T04:10:40.216 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50171.log.gz 2024-03-29T04:10:40.216 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.48102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.46024.log 2024-03-29T04:10:40.217 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43933.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48102.log.gzgzip 2024-03-29T04:10:40.217 INFO:teuthology.orchestra.run.smithi073.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48144.log 2024-03-29T04:10:40.217 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.2.46024.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43933.log.gz 2024-03-29T04:10:40.217 INFO:teuthology.orchestra.run.smithi073.stderr:gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.2.46024.log.gz --verbose 2024-03-29T04:10:40.217 INFO:teuthology.orchestra.run.smithi073.stderr: -- /var/log/ceph/ceph-client.admin.47352.log 2024-03-29T04:10:40.217 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.48144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52692.log 2024-03-29T04:10:40.217 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.47352.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48144.log.gz 2024-03-29T04:10:40.217 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43937.log 2024-03-29T04:10:40.217 INFO:teuthology.orchestra.run.smithi073.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47352.log.gz 2024-03-29T04:10:40.218 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.52692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47310.log 2024-03-29T04:10:40.218 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43937.log: 89.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.52692.log.gz -5 2024-03-29T04:10:40.218 INFO:teuthology.orchestra.run.smithi073.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44602.log 2024-03-29T04:10:40.218 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.47310.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43937.log.gz 2024-03-29T04:10:40.218 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51693.log 2024-03-29T04:10:40.218 INFO:teuthology.orchestra.run.smithi073.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47310.log.gz 2024-03-29T04:10:40.218 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45582.log 2024-03-29T04:10:40.218 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.51693.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44602.log.gz 2024-03-29T04:10:40.219 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52376.log 2024-03-29T04:10:40.219 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.45582.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51693.log.gz 2024-03-29T04:10:40.219 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50063.log 2024-03-29T04:10:40.219 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45582.log.gz 2024-03-29T04:10:40.219 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.52376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52045.log 2024-03-29T04:10:40.219 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.50063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43552.log 2024-03-29T04:10:40.219 INFO:teuthology.orchestra.run.smithi073.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52376.log.gz 2024-03-29T04:10:40.219 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.52045.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50063.log.gz 2024-03-29T04:10:40.219 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53376.log 2024-03-29T04:10:40.220 INFO:teuthology.orchestra.run.smithi073.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52045.log.gz 2024-03-29T04:10:40.220 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44277.log 2024-03-29T04:10:40.220 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.53376.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43552.log.gz 2024-03-29T04:10:40.220 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50105.log 2024-03-29T04:10:40.220 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44277.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53376.log.gz 2024-03-29T04:10:40.220 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47157.log 2024-03-29T04:10:40.220 INFO:teuthology.orchestra.run.smithi073.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44277.log.gz 2024-03-29T04:10:40.220 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.50105.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-03-29T04:10:40.221 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.47157.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47157.log.gz 2024-03-29T04:10:40.221 INFO:teuthology.orchestra.run.smithi073.stderr:gzip 90.9% -- replaced with /var/log/ceph/ceph-client.admin.50105.log.gz -5 2024-03-29T04:10:40.221 INFO:teuthology.orchestra.run.smithi073.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43510.log 2024-03-29T04:10:40.221 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47514.log 2024-03-29T04:10:40.221 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50359.log 2024-03-29T04:10:40.221 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.47514.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43510.log.gz 2024-03-29T04:10:40.221 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48690.log 2024-03-29T04:10:40.221 INFO:teuthology.orchestra.run.smithi073.stderr: 89.5%/var/log/ceph/ceph-client.0.50359.log: -- replaced with /var/log/ceph/ceph-client.admin.47514.log.gz 2024-03-29T04:10:40.221 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50359.log.gz 2024-03-29T04:10:40.222 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45064.log 2024-03-29T04:10:40.222 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47436.log 2024-03-29T04:10:40.222 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.48690.log: /var/log/ceph/ceph-client.admin.45064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51961.log 2024-03-29T04:10:40.222 INFO:teuthology.orchestra.run.smithi073.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48690.log.gz 2024-03-29T04:10:40.222 INFO:teuthology.orchestra.run.smithi073.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45064.log.gz 2024-03-29T04:10:40.222 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.47436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52956.log 2024-03-29T04:10:40.222 INFO:teuthology.orchestra.run.smithi073.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47436.log.gz 2024-03-29T04:10:40.222 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52171.log 2024-03-29T04:10:40.223 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.51961.log: /var/log/ceph/ceph-client.admin.52956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52255.log 2024-03-29T04:10:40.223 INFO:teuthology.orchestra.run.smithi073.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51961.log.gz 2024-03-29T04:10:40.223 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.52171.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52956.log.gz 2024-03-29T04:10:40.223 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43938.log 2024-03-29T04:10:40.223 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.52255.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52171.log.gz 2024-03-29T04:10:40.223 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53292.log 2024-03-29T04:10:40.223 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52255.log.gz 2024-03-29T04:10:40.223 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49314.log 2024-03-29T04:10:40.224 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43938.log: /var/log/ceph/ceph-client.admin.53292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52003.log 2024-03-29T04:10:40.224 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43938.log.gz 2024-03-29T04:10:40.224 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.49314.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53292.log.gz 2024-03-29T04:10:40.224 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.31593.log 2024-03-29T04:10:40.224 INFO:teuthology.orchestra.run.smithi073.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49314.log.gz 2024-03-29T04:10:40.224 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46803.log 2024-03-29T04:10:40.224 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.52003.log: /var/log/ceph/ceph.tmp-client.admin.31593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43720.log 2024-03-29T04:10:40.224 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31593.log.gz 2024-03-29T04:10:40.224 INFO:teuthology.orchestra.run.smithi073.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52003.log.gz 2024-03-29T04:10:40.225 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.46803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44275.log 2024-03-29T04:10:40.225 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43720.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46803.log.gz 2024-03-29T04:10:40.225 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43762.log 2024-03-29T04:10:40.225 INFO:teuthology.orchestra.run.smithi073.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43720.log.gz 2024-03-29T04:10:40.225 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43086.log 2024-03-29T04:10:40.225 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44275.log: /var/log/ceph/ceph-client.admin.43762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49579.log 2024-03-29T04:10:40.225 INFO:teuthology.orchestra.run.smithi073.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44275.log.gz 2024-03-29T04:10:40.225 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43086.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43762.log.gz 2024-03-29T04:10:40.225 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48060.log 2024-03-29T04:10:40.226 INFO:teuthology.orchestra.run.smithi073.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.43086.log.gz 2024-03-29T04:10:40.226 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.49579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43678.log 2024-03-29T04:10:40.226 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.48060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53334.log 2024-03-29T04:10:40.226 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49579.log.gz 2024-03-29T04:10:40.226 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43678.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48060.log.gz 2024-03-29T04:10:40.226 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44686.log 2024-03-29T04:10:40.226 INFO:teuthology.orchestra.run.smithi073.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43678.log.gz 2024-03-29T04:10:40.226 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.53334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52734.log 2024-03-29T04:10:40.227 INFO:teuthology.orchestra.run.smithi073.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53334.log.gz 2024-03-29T04:10:40.227 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49667.log 2024-03-29T04:10:40.227 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44686.log: /var/log/ceph/ceph-client.admin.52734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46508.log 2024-03-29T04:10:40.227 INFO:teuthology.orchestra.run.smithi073.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44686.log.gz 2024-03-29T04:10:40.227 INFO:teuthology.orchestra.run.smithi073.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52734.log.gz 2024-03-29T04:10:40.227 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.49667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43170.log 2024-03-29T04:10:40.227 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-03-29T04:10:40.227 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.46508.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49667.log.gz 2024-03-29T04:10:40.227 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43170.log: 89.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.46508.log.gz -5 2024-03-29T04:10:40.228 INFO:teuthology.orchestra.run.smithi073.stderr: --verbose -- /var/log/ceph/ceph-client.admin.49230.log 2024-03-29T04:10:40.228 INFO:teuthology.orchestra.run.smithi073.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43170.log.gz 2024-03-29T04:10:40.228 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47814.log 2024-03-29T04:10:40.228 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.49230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49104.log 2024-03-29T04:10:40.228 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.47814.log: gzip 88.5% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.49230.log.gz -- 2024-03-29T04:10:40.228 INFO:teuthology.orchestra.run.smithi073.stderr: /var/log/ceph/ceph-client.admin.43128.log 2024-03-29T04:10:40.228 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.49104.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47814.log.gz 2024-03-29T04:10:40.228 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43342.log 2024-03-29T04:10:40.228 INFO:teuthology.orchestra.run.smithi073.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49104.log.gz 2024-03-29T04:10:40.229 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43044.log 2024-03-29T04:10:40.229 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43128.log: /var/log/ceph/ceph-client.admin.43342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48186.log 2024-03-29T04:10:40.229 INFO:teuthology.orchestra.run.smithi073.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43128.log.gz 2024-03-29T04:10:40.229 INFO:teuthology.orchestra.run.smithi073.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43342.log.gz 2024-03-29T04:10:40.229 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48977.log 2024-03-29T04:10:40.229 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52650.log 2024-03-29T04:10:40.229 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.48186.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43044.log.gz 2024-03-29T04:10:40.229 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.48977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51608.log 2024-03-29T04:10:40.230 INFO:teuthology.orchestra.run.smithi073.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48186.log.gz 2024-03-29T04:10:40.230 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.52650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50541.log 2024-03-29T04:10:40.230 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48977.log.gz 2024-03-29T04:10:40.230 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.51608.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52650.log.gz 2024-03-29T04:10:40.230 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49835.log 2024-03-29T04:10:40.230 INFO:teuthology.orchestra.run.smithi073.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51608.log.gz 2024-03-29T04:10:40.230 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48354.log 2024-03-29T04:10:40.230 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.50541.log: /var/log/ceph/ceph-client.admin.49835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43212.log 2024-03-29T04:10:40.230 INFO:teuthology.orchestra.run.smithi073.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50541.log.gz 2024-03-29T04:10:40.231 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.48354.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53166.log 2024-03-29T04:10:40.231 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49835.log.gz 2024-03-29T04:10:40.231 INFO:teuthology.orchestra.run.smithi073.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48354.log.gz 2024-03-29T04:10:40.231 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45587.log 2024-03-29T04:10:40.231 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.53166.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43212.log.gz 2024-03-29T04:10:40.231 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48774.log 2024-03-29T04:10:40.231 INFO:teuthology.orchestra.run.smithi073.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53166.log.gz 2024-03-29T04:10:40.231 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45106.log 2024-03-29T04:10:40.232 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.0.45587.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45587.log.gz 2024-03-29T04:10:40.232 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.48774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47772.log 2024-03-29T04:10:40.232 INFO:teuthology.orchestra.run.smithi073.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48774.log.gz 2024-03-29T04:10:40.232 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.45106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49495.log 2024-03-29T04:10:40.232 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.47772.log: -- /var/log/ceph/ceph-client.admin.43384.log 2024-03-29T04:10:40.232 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.49495.log: gzip -5 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47772.log.gz 2024-03-29T04:10:40.232 INFO:teuthology.orchestra.run.smithi073.stderr: --verbose -- /var/log/ceph/ceph-client.admin.37862.log 91.1% -- replaced with /var/log/ceph/ceph-client.admin.45106.log.gz 2024-03-29T04:10:40.232 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-03-29T04:10:40.232 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43384.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49495.log.gz 2024-03-29T04:10:40.233 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53040.log 2024-03-29T04:10:40.233 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43384.log.gz 2024-03-29T04:10:40.233 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46372.log 2024-03-29T04:10:40.233 INFO:teuthology.orchestra.run.smithi073.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37862.log.gz 2024-03-29T04:10:40.233 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.53040.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-03-29T04:10:40.233 INFO:teuthology.orchestra.run.smithi073.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53040.log.gz 2024-03-29T04:10:40.233 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49625.log 2024-03-29T04:10:40.233 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.46372.log: /var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46329.log 2024-03-29T04:10:40.234 INFO:teuthology.orchestra.run.smithi073.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46372.log.gz 2024-03-29T04:10:40.234 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.49625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52316.log 2024-03-29T04:10:40.234 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.46329.log: gzip 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49625.log.gz 2024-03-29T04:10:40.234 INFO:teuthology.orchestra.run.smithi073.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46989.log 2024-03-29T04:10:40.234 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.52316.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46329.log.gz 2024-03-29T04:10:40.234 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48522.log 2024-03-29T04:10:40.234 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52316.log.gz 2024-03-29T04:10:40.234 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.46989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47556.log 2024-03-29T04:10:40.234 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.48522.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46989.log.gz 2024-03-29T04:10:40.235 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45244.log 2024-03-29T04:10:40.235 INFO:teuthology.orchestra.run.smithi073.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48522.log.gz 2024-03-29T04:10:40.235 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.47556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48732.log 2024-03-29T04:10:40.235 INFO:teuthology.orchestra.run.smithi073.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47556.log.gz 2024-03-29T04:10:40.235 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.45244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51835.log 2024-03-29T04:10:40.235 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.48732.log: 89.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53082.log 2024-03-29T04:10:40.235 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45244.log.gz 2024-03-29T04:10:40.235 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.51835.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.48732.log.gz -5 2024-03-29T04:10:40.235 INFO:teuthology.orchestra.run.smithi073.stderr: --verbose -- /var/log/ceph/ceph-client.admin.37969.log 2024-03-29T04:10:40.236 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51835.log.gz 2024-03-29T04:10:40.236 INFO:teuthology.orchestra.run.smithi073.stderr: --verbose --/var/log/ceph/ceph-client.admin.53082.log: /var/log/ceph/ceph-client.admin.47856.log 2024-03-29T04:10:40.236 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.37969.log: gzip -5 --verbose -- 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53082.log.gz 2024-03-29T04:10:40.236 INFO:teuthology.orchestra.run.smithi073.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37969.log.gz 2024-03-29T04:10:40.236 INFO:teuthology.orchestra.run.smithi073.stderr: /var/log/ceph/ceph-client.admin.49062.log 2024-03-29T04:10:40.236 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.47856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52776.log 2024-03-29T04:10:40.236 INFO:teuthology.orchestra.run.smithi073.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47856.log.gz 2024-03-29T04:10:40.236 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.49062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53644.log 2024-03-29T04:10:40.236 INFO:teuthology.orchestra.run.smithi073.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49062.log.gz 2024-03-29T04:10:40.237 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.52776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46845.log 2024-03-29T04:10:40.237 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.53644.log: gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52776.log.gz 2024-03-29T04:10:40.237 INFO:teuthology.orchestra.run.smithi073.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47898.log 2024-03-29T04:10:40.237 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53644.log.gz 2024-03-29T04:10:40.237 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.46845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48228.log 2024-03-29T04:10:40.237 INFO:teuthology.orchestra.run.smithi073.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46845.log.gz 2024-03-29T04:10:40.237 INFO:teuthology.orchestra.run.smithi073.stderr:gzip/var/log/ceph/ceph-client.admin.47898.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.47268.log 2024-03-29T04:10:40.237 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.48228.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47898.log.gz 2024-03-29T04:10:40.238 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48228.log.gz 2024-03-29T04:10:40.238 INFO:teuthology.orchestra.run.smithi073.stderr: --verbose -- /var/log/ceph/ceph-client.admin.46947.log 2024-03-29T04:10:40.238 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.47268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43256.log 2024-03-29T04:10:40.238 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47268.log.gz/var/log/ceph/ceph-client.admin.46947.log: 2024-03-29T04:10:40.238 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46719.log 2024-03-29T04:10:40.238 INFO:teuthology.orchestra.run.smithi073.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46947.log.gz 2024-03-29T04:10:40.238 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52998.log 2024-03-29T04:10:40.238 INFO:teuthology.orchestra.run.smithi073.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43256.log.gz 2024-03-29T04:10:40.239 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.46719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45022.log 2024-03-29T04:10:40.239 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46719.log.gz 2024-03-29T04:10:40.239 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.52998.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-03-29T04:10:40.239 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5/var/log/ceph/ceph-client.admin.45022.log: --verbose 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52998.log.gz 2024-03-29T04:10:40.239 INFO:teuthology.orchestra.run.smithi073.stderr: -- /var/log/ceph/ceph-client.admin.43942.log 2024-03-29T04:10:40.239 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.0.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45022.log.gz 2024-03-29T04:10:40.239 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43468.log 2024-03-29T04:10:40.239 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53544.log 2024-03-29T04:10:40.239 INFO:teuthology.orchestra.run.smithi073.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43942.log.gz 2024-03-29T04:10:40.240 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51919.log 2024-03-29T04:10:40.240 INFO:teuthology.orchestra.run.smithi073.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43468.log.gz 2024-03-29T04:10:40.240 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.53544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48438.log 2024-03-29T04:10:40.240 INFO:teuthology.orchestra.run.smithi073.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53544.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42983.log 2024-03-29T04:10:40.240 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-03-29T04:10:40.240 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.51919.log: /var/log/ceph/ceph-client.admin.48438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50483.log 2024-03-29T04:10:40.240 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.42983.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48438.log.gz 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51919.log.gz 2024-03-29T04:10:40.240 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-03-29T04:10:40.241 INFO:teuthology.orchestra.run.smithi073.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42983.log.gz 2024-03-29T04:10:40.241 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51320.log 2024-03-29T04:10:40.241 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46161.log 2024-03-29T04:10:40.241 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.50483.log: /var/log/ceph/ceph-client.admin.51320.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-29T04:10:40.241 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.46161.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50483.log.gz 2024-03-29T04:10:40.242 INFO:teuthology.orchestra.run.smithi073.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51320.log.gz 2024-03-29T04:10:40.242 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53208.log 2024-03-29T04:10:40.242 INFO:teuthology.orchestra.run.smithi073.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46161.log.gz 2024-03-29T04:10:40.242 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-03-29T04:10:40.242 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.53208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43594.log 2024-03-29T04:10:40.242 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.2.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53208.log.gz 2024-03-29T04:10:40.242 INFO:teuthology.orchestra.run.smithi073.stderr: 84.6% -- replaced with /var/log/ceph/ceph.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48018.log 2024-03-29T04:10:40.242 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-03-29T04:10:40.243 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.43594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42941.log 2024-03-29T04:10:40.243 INFO:teuthology.orchestra.run.smithi073.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43594.log.gz 2024-03-29T04:10:40.243 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.48018.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-03-29T04:10:40.243 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.42941.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48018.log.gz 2024-03-29T04:10:40.243 INFO:teuthology.orchestra.run.smithi073.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42941.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51404.log 2024-03-29T04:10:40.243 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-03-29T04:10:40.243 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47682.log 2024-03-29T04:10:40.243 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.51404.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51404.log.gz 2024-03-29T04:10:40.243 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46677.log 2024-03-29T04:10:40.244 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.47682.log: 92.1% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-03-29T04:10:40.244 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49272.log 2024-03-29T04:10:40.244 INFO:teuthology.orchestra.run.smithi073.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47682.log.gz 2024-03-29T04:10:40.244 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.46677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53250.log 2024-03-29T04:10:40.244 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.49272.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46677.log.gz 2024-03-29T04:10:40.244 INFO:teuthology.orchestra.run.smithi073.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49272.log.gz 2024-03-29T04:10:40.244 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49751.log 2024-03-29T04:10:40.244 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44560.log 2024-03-29T04:10:40.245 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.53250.log: /var/log/ceph/ceph-client.admin.49751.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53250.log.gz 2024-03-29T04:10:40.245 INFO:teuthology.orchestra.run.smithi073.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49751.log.gz 2024-03-29T04:10:40.245 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47115.log 2024-03-29T04:10:40.245 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44938.log 2024-03-29T04:10:40.245 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.47115.log: /var/log/ceph/ceph-client.admin.44560.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44560.log.gz 2024-03-29T04:10:40.245 INFO:teuthology.orchestra.run.smithi073.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47115.log.gz 2024-03-29T04:10:40.245 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48564.log 2024-03-29T04:10:40.245 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47073.log 2024-03-29T04:10:40.245 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44938.log: /var/log/ceph/ceph-client.admin.48564.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44938.log.gz 2024-03-29T04:10:40.246 INFO:teuthology.orchestra.run.smithi073.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48564.log.gzgzip 2024-03-29T04:10:40.246 INFO:teuthology.orchestra.run.smithi073.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48606.log 2024-03-29T04:10:40.246 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48854.log 2024-03-29T04:10:40.246 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.47073.log: /var/log/ceph/ceph-client.admin.48606.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47073.log.gz 2024-03-29T04:10:40.246 INFO:teuthology.orchestra.run.smithi073.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48606.log.gzgzip 2024-03-29T04:10:40.246 INFO:teuthology.orchestra.run.smithi073.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50441.log 2024-03-29T04:10:40.246 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53124.log 2024-03-29T04:10:40.246 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.50441.log: /var/log/ceph/ceph-client.admin.48854.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48854.log.gz 2024-03-29T04:10:40.246 INFO:teuthology.orchestra.run.smithi073.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50441.log.gz 2024-03-29T04:10:40.247 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47031.log 2024-03-29T04:10:40.247 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42660.log 2024-03-29T04:10:40.247 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.53124.log: /var/log/ceph/ceph-client.admin.47031.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53124.log.gz 2024-03-29T04:10:40.247 INFO:teuthology.orchestra.run.smithi073.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47031.log.gz 2024-03-29T04:10:40.247 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47598.log 2024-03-29T04:10:40.247 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46551.log 2024-03-29T04:10:40.247 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.47598.log: /var/log/ceph/ceph-client.admin.42660.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42660.log.gz 2024-03-29T04:10:40.247 INFO:teuthology.orchestra.run.smithi073.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47598.log.gz 2024-03-29T04:10:40.248 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46635.log 2024-03-29T04:10:40.248 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51877.log 2024-03-29T04:10:40.248 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.46551.log: /var/log/ceph/ceph-client.admin.46635.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46551.log.gz 2024-03-29T04:10:40.248 INFO:teuthology.orchestra.run.smithi073.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46635.log.gz 2024-03-29T04:10:40.248 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.46028.log 2024-03-29T04:10:40.248 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44276.log 2024-03-29T04:10:40.248 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.51877.log: /var/log/ceph/ceph-client.2.46028.log: 0.0% 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51877.log.gz 2024-03-29T04:10:40.248 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.2.46028.log.gz 2024-03-29T04:10:40.248 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52213.log 2024-03-29T04:10:40.249 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-03-29T04:10:40.249 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.44276.log: /var/log/ceph/ceph-client.admin.52213.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44276.log.gz 2024-03-29T04:10:40.249 INFO:teuthology.orchestra.run.smithi073.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52213.log.gz 2024-03-29T04:10:40.249 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49919.log 2024-03-29T04:10:40.249 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52460.log 2024-03-29T04:10:40.249 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.49919.log: /var/log/ceph/ceph-mds.a.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49919.log.gz 2024-03-29T04:10:40.249 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.52460.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52460.log.gz 2024-03-29T04:10:40.249 INFO:teuthology.orchestra.run.smithi073.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-03-29T04:10:40.250 INFO:teuthology.orchestra.run.smithi142.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-03-29T04:10:40.250 INFO:teuthology.orchestra.run.smithi142.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-03-29T04:10:40.260 INFO:teuthology.orchestra.run.smithi073.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-03-29T04:10:40.270 INFO:teuthology.orchestra.run.smithi142.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-03-29T04:10:40.289 INFO:teuthology.orchestra.run.smithi142.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-03-29T04:10:40.292 INFO:teuthology.orchestra.run.smithi073.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-03-29T04:10:40.298 INFO:teuthology.orchestra.run.smithi142.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-03-29T04:10:40.306 INFO:teuthology.orchestra.run.smithi073.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-03-29T04:10:40.341 INFO:teuthology.orchestra.run.smithi073.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-03-29T04:10:40.345 INFO:teuthology.orchestra.run.smithi142.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-03-29T04:10:40.347 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-03-29T04:10:40.347 INFO:teuthology.orchestra.run.smithi142.stderr:real 0m0.226s 2024-03-29T04:10:40.348 INFO:teuthology.orchestra.run.smithi142.stderr:user 0m0.870s 2024-03-29T04:10:40.348 INFO:teuthology.orchestra.run.smithi142.stderr:sys 0m0.062s 2024-03-29T04:10:40.367 INFO:teuthology.orchestra.run.smithi073.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-03-29T04:10:40.416 INFO:teuthology.orchestra.run.smithi073.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-03-29T04:10:40.418 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-03-29T04:10:40.418 INFO:teuthology.orchestra.run.smithi073.stderr:real 0m0.340s 2024-03-29T04:10:40.418 INFO:teuthology.orchestra.run.smithi073.stderr:user 0m1.293s 2024-03-29T04:10:40.418 INFO:teuthology.orchestra.run.smithi073.stderr:sys 0m0.176s 2024-03-29T04:10:40.419 INFO:tasks.ceph:Archiving logs... 2024-03-29T04:10:40.419 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-03-29_02:01:30-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629079/remote/smithi073/log 2024-03-29T04:10:40.420 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-29T04:10:40.830 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-03-29_02:01:30-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629079/remote/smithi142/log 2024-03-29T04:10:40.830 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-29T04:10:40.979 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-29T04:10:40.990 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-29T04:10:40.991 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-29T04:10:40.993 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-29T04:10:41.081 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-29T04:10:41.090 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-29T04:10:41.091 DEBUG:teuthology.orchestra.run.smithi073:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-29T04:10:41.093 DEBUG:teuthology.orchestra.run.smithi142:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-29T04:10:41.104 INFO:teuthology.orchestra.run.smithi073.stderr:bash: line 1: ntpq: command not found 2024-03-29T04:10:41.107 INFO:teuthology.orchestra.run.smithi142.stderr:bash: line 1: ntpq: command not found 2024-03-29T04:10:41.109 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-29T04:10:41.109 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2024-03-29T04:10:41.109 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 12 +80us[ +80us] +/- 78ms 2024-03-29T04:10:41.109 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 13 -1276us[-1276us] +/- 69ms 2024-03-29T04:10:41.110 INFO:teuthology.orchestra.run.smithi073.stdout:^* hv03.front.sepia.ceph.com 3 6 377 13 +1166us[+1162us] +/- 66ms 2024-03-29T04:10:41.110 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-03-29T04:10:41.111 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-29T04:10:41.112 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2024-03-29T04:10:41.112 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 14 +92us[ +93us] +/- 78ms 2024-03-29T04:10:41.112 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 13 -1269us[-1268us] +/- 69ms 2024-03-29T04:10:41.112 INFO:teuthology.orchestra.run.smithi142.stdout:^* hv03.front.sepia.ceph.com 3 6 377 13 +1186us[+1187us] +/- 66ms 2024-03-29T04:10:41.112 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-03-29T04:10:41.113 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-29T04:10:41.145 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-29T04:10:41.145 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-29T04:10:41.167 DEBUG:teuthology.orchestra.run.smithi073:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-29T04:10:41.238 DEBUG:teuthology.orchestra.run.smithi142:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-29T04:10:41.304 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-29T04:10:41.334 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-29T04:10:41.335 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-29T04:10:41.364 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-29T04:10:41.365 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-29T04:10:41.374 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-29T04:10:41.386 INFO:teuthology.task.internal:Duration was 597.153737 seconds 2024-03-29T04:10:41.387 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-29T04:10:41.401 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-29T04:10:41.401 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-29T04:10:41.404 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-29T04:10:41.444 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-29T04:10:41.447 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-29T04:10:41.733 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-29T04:10:41.733 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi073.front.sepia.ceph.com 2024-03-29T04:10:41.733 DEBUG:teuthology.orchestra.run.smithi073:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-29T04:10:41.752 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi142.front.sepia.ceph.com 2024-03-29T04:10:41.752 DEBUG:teuthology.orchestra.run.smithi142:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-29T04:10:41.793 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-29T04:10:41.793 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-29T04:10:41.795 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-29T04:10:41.861 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-29T04:10:41.862 DEBUG:teuthology.orchestra.run.smithi073:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-29T04:10:41.864 DEBUG:teuthology.orchestra.run.smithi142:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-29T04:10:41.999 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-29T04:10:42.010 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-29T04:10:42.010 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-29T04:10:42.037 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-29T04:10:42.064 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-29T04:10:42.076 DEBUG:teuthology.orchestra.run.smithi073:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-29T04:10:42.079 DEBUG:teuthology.orchestra.run.smithi142:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-29T04:10:42.102 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = core 2024-03-29T04:10:42.129 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = core 2024-03-29T04:10:42.145 DEBUG:teuthology.orchestra.run.smithi073:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-29T04:10:42.173 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-29T04:10:42.173 DEBUG:teuthology.orchestra.run.smithi142:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-29T04:10:42.198 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-29T04:10:42.199 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-29T04:10:42.212 INFO:teuthology.task.internal:Transferring archived files... 2024-03-29T04:10:42.212 DEBUG:teuthology.misc:Transferring archived files from smithi073:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-03-29_02:01:30-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629079/remote/smithi073 2024-03-29T04:10:42.213 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-29T04:10:42.249 DEBUG:teuthology.misc:Transferring archived files from smithi142:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-03-29_02:01:30-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629079/remote/smithi142 2024-03-29T04:10:42.250 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-29T04:10:42.285 INFO:teuthology.task.internal:Removing archive directory... 2024-03-29T04:10:42.286 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-29T04:10:42.288 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-29T04:10:42.335 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-29T04:10:42.345 INFO:teuthology.task.internal:Not uploading archives. 2024-03-29T04:10:42.346 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-29T04:10:42.380 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-29T04:10:42.380 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-29T04:10:42.382 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-29T04:10:42.394 INFO:teuthology.orchestra.run.smithi073.stdout: 265305 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 29 04:10 /home/ubuntu/cephtest 2024-03-29T04:10:42.396 INFO:teuthology.orchestra.run.smithi142.stdout: 265661 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 29 04:10 /home/ubuntu/cephtest 2024-03-29T04:10:42.397 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-29T04:10:42.415 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-29T04:10:42.510 INFO:teuthology.nuke:Checking targets against current locks 2024-03-29T04:10:42.536 DEBUG:teuthology.nuke:shortname: smithi073 2024-03-29T04:10:42.536 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-29T04:10:42.561 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-03-29_02:01:30-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629079', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-29 03:52:49.533430', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI4Ax4u1lAgFsWLs5ESi5tpuehTRg0FRB0+vfAHwr/KO29aNjk4W0DsWrZMAGFfrq5Snk2BJ03OryLC7ByC/ctQ='} 2024-03-29T04:10:42.564 DEBUG:teuthology.nuke:shortname: smithi142 2024-03-29T04:10:42.564 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-29T04:10:42.586 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-03-29_02:01:30-fs:functional-wip-mchangir-testing1-main-20240328-072412-distro-default-smithi/7629079', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-29 03:52:49.532101', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCpFhUf5tCEKq5adp87Qd5MYoDuMKAXwJCchRCoZgAO2mw2wDoCcH5s0QIau8OOLXBgc+O0rKIPTXdfT3blRVk0='} 2024-03-29T04:10:42.605 INFO:teuthology.orchestra.console.smithi073:Power off 2024-03-29T04:10:42.606 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-29T04:10:42.630 DEBUG:teuthology.orchestra.console.smithi073:power off output: Chassis Power Control: Down/Off 2024-03-29T04:10:42.630 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T04:10:42.648 INFO:teuthology.orchestra.console.smithi142:Power off 2024-03-29T04:10:42.648 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-29T04:10:42.658 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2024-03-29T04:10:42.672 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off 2024-03-29T04:10:42.672 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T04:10:42.698 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-03-29T04:10:42.775 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-03-29T04:10:42.776 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-03-29T04:10:42.776 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-03-29T04:10:42.776 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-03-29T04:10:42.776 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-03-29T04:10:42.776 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-03-29T04:10:42.776 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-03-29T04:10:46.659 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T04:10:46.699 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T04:10:46.771 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2024-03-29T04:10:46.810 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-03-29T04:10:50.773 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T04:10:50.811 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T04:10:50.884 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2024-03-29T04:10:50.922 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-03-29T04:10:50.986 INFO:teuthology.orchestra.console.smithi073:Power off completed 2024-03-29T04:10:54.925 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T04:10:55.037 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2024-03-29T04:10:55.137 INFO:teuthology.orchestra.console.smithi142:Power off completed 2024-03-29T04:10:55.243 INFO:teuthology.run:Summary data: description: fs:functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/uninlining} duration: 597.1537365913391 failure_reason: 'Test failure: test_data_uninlining (tasks.cephfs.test_uninlining.TestDataUninlining)' flavor: default owner: scheduled_mchangir@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=46644ef669984bdc8000f4aa32244409 status: fail success: false 2024-03-29T04:10:55.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T04:10:55.331 INFO:teuthology.run:FAIL